Big Data Developer
6 days ago
Experience: Years)
Job Requirements:
Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust Experience in designing application solutions in hadoop ecosystemDeep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and PysparkHDFS file formats and their use cases (eg Parquet, ORC, Sequence etc)Good knowledge in data warehousing systemExperienced in any scripting language (SHELL, PYTHON)HortonWorks distribution and understanding on SQL engines (Tez, MR) Java/RestServices/Maven experience is a value additionControl-M development. Monitoring Resource utilization using Grafana ToolGood skillset to create automation scripts in Jenkins & knowledge in working on automating builds, test frameworks, app configuration etcExperience in implementing scalable applications with fully automated deployment and control using Bitbucket, Jenkins, ADO etc
Skillset:
o Mandatory: Big Data - Hive, HDFS, Spark, Scala, Pyspark.
o Good to have : Schedulers (Control-M), ETL Tool - Dataiku , Unix/Shell scripting , Knowledge of Integration services of FileIT/MQ and others , CI/CD tools - Jenkins, Jira, ADO Devops - tools suite , Oracle .
When you apply, you voluntarily consent to the disclosure, collection and use of your personal data for employment/recruitment and related purposes in accordance with the Tech Aalto Privacy Policy, a copy of which is published at Tech Aalto's website )
Confidentiality is assured, and only shortlisted candidates will be notified for interviews.
-
Big Data Developer
1 week ago
Singapore SURPASS STAFFING PTE. LTD. Full time**Overview**: **Key Responsibilities**: - Design, develop, and optimize scalable data processing systems leveraging Hadoop, Flink, and other Big Data technologies. - Build and manage robust data pipelines for data ingestion, transformation, and analysis. - Create and implement efficient data models to support effective data storage and retrieval. -...
-
Big Data Developer
7 days ago
Singapore ALMR CONSULTING PTE. LTD. Full time**Responsibilities**: - Designing, building, and maintaining systems that handle large volumes of data, enabling businesses to extract valuable insights and make data-driven decisions - Creating scalable and efficient data pipelines, implementing data models, and integrating various data sources. - Write efficient and optimised code in programming languages...
-
Big Data Developer
7 days ago
Singapore ITCAN Pte. Ltd. Full time**Must Have**: - Strong foundational knowledge of data structures and algorithms - Experience in Java programming, Relational/NoSQL database, and SQL - Exposure to one or more Big Data technologies like Hadoop, Spark, Hive, Kafka **Good To Have**: - Experience in development in a CI/CD environment and familiarity with CI/CD tools is required **Job...
-
Senior Big Data Developer
2 weeks ago
Singapore Peoplebank Singapore Pte Ltd Full timeOverview We are seeking a skilled and experienced Senior Big Data Developer to join our technology team. The ideal candidate will be responsible for designing, developing, and maintaining high-performance big data solutions, while working collaboratively within a structured Agile development environment. Responsibilities Analyze functional specifications and...
-
Senior Big Data Developer
1 week ago
Singapore Information Tech Consultants Full timeDescription Location: Onsite (Relocation to UK) Experience: 14-18 years Education: Bachelors in Science (IT/Computer Science/Engineer) Employment Type: Full-Time About Us We are a dynamic team focused on building scalable, high-performance data platforms across the cloud ecosystem (Azure, AWS, GCP). As part of an exciting growth phase, we are looking for a...
-
Senior Big Data Developer
7 days ago
Singapore Information Tech Consultants Full timeDescription Location: Onsite (Relocation to UK)Experience: 14-18 years Education: Bachelors in Science (IT/Computer Science/Engineer)Employment Type: Full-Time About Us We are a dynamic team focused on building scalable, high-performance data platforms across the cloud ecosystem (Azure, AWS, GCP). As part of an exciting growth phase, we are looking for a...
-
Senior Big Data Developer
7 days ago
Singapore Information Tech Consultants Full timeLocation: Onsite (Relocation to UK)Experience: 14-18 years Education: Bachelors in Science (IT/Computer Science/Engineer)Employment Type: Full-Time About Us We are a dynamic team focused on building scalable, high-performance data platforms across the cloud ecosystem (Azure, AWS, GCP). As part of an exciting growth phase, we are looking for a Senior Big Data...
-
Application Development Lead
21 hours ago
Singapore Tangspac Full timeA large financial institution with large big data team is looking for Application Development Manager / Lead with the following responsibilities: - Leading an applicaiton development team - Utilizing big data tools to perform data ingestion, interface and data analytics - Building interfaces to big data (Hadoop) data store - Integration of various tools as...
-
Big Data
6 days ago
Singapore AccionLabs Full time $80,000 - $120,000 per yearCompany Description Accion Labs is a global technology services firm with offering a full range of product life-cycle services in the emerging technology segment. This includes Web 2.0, Open Source, SaaS/Cloud, Mobility, IT Operations Management/ITSM, Big Data and traditional BI/DW.Through nine global offices and a rapid-response delivery model, Accion...
-
Big Data
6 days ago
Singapore AccionLabs Full time $100,000 - $200,000 per yearCompany Description Accion Labs is a global technology services firm with offering a full range of product life-cycle services in the emerging technology segment. This includes Web 2.0, Open Source, SaaS/Cloud, Mobility, IT Operations Management/ITSM, Big Data and traditional BI/DW.Through nine global offices and a rapid-response delivery model, Accion...
