
Big Data Engineering Opportunity
5 days ago
About this role
We are looking for a Data Engineer to join our team and contribute to building scalable data solutions using Spark applications within a Hadoop ecosystem.
This is an exciting opportunity to gain experience working on large-scale enterprise data projects, while gaining exposure to banking data systems. The successful candidate will have access to ongoing training and development opportunities to help them grow in their career.
Responsibilities
- Develop and maintain Spark applications in PySpark/Scala for data ingestion, transformation, and processing on Hadoop clusters.
- Work with HDFS, Hive, Sqoop, and other Hadoop ecosystem tools.
- Optimize Spark jobs for performance and scalability (memory, executors, partitions).
- Support ETL pipelines, troubleshoot production issues, and ensure data quality.
- Collaborate with business and technology teams to deliver data solutions.
Requirements
- Bachelor's degree in Computer Science or related field.
- At least 1 year of experience as a Data Engineer or Big Data Developer.
- Familiarity with Linux/Unix environments.
Benefits
This role offers a chance to work on high-profile projects, develop new skills, and advance your career in the field of big data engineering.
Additional Information
Please note that this job description may be subject to change based on business needs.
-
Big Data Engineer
1 week ago
Singapore beBeeDataEngineering Full time $80,000 - $120,000Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...
-
Big Data Engineer
1 week ago
Singapore beBeeDataEngineer Full timeAbout the Data Management Suite Team The Data Management Suite team is focused on building scalable products that cover the entire lifecycle of data pipeline, including data ingestion and integration, data development, data catalog, data security, and data governance. These products support various businesses, allowing data engineers and scientists to...
-
Big Data Engineer
1 week ago
Singapore IITMATRIX Full timeWe are looking for a skilled **Big Data Engineer** to join our dynamic team. You will be responsible for designing, developing, and optimizing data solutions within the Big Data ecosystem. This role involves working with large datasets, ensuring high performance at scale, and collaborating with cross-functional teams to deliver data-driven insights and...
-
Lead Big Data Engineer
4 days ago
Singapore beBeeDataEngineering Full time $80,000 - $120,000Big Data EngineerWe are seeking an experienced Big Data Engineer to design and implement scalable data processing pipelines using Spark. The ideal candidate will have a strong understanding of Hadoop architecture, Hive data modeling, and query optimization.Responsibilities:Design and maintain ETL/ELT pipelines using Spark for batch and streaming data.Manage...
-
Big Data Engineering Specialist
2 weeks ago
Singapore beBeeData Full time $90,000 - $120,000Job Opportunity: Become a Big Data Engineer and Contribute to Large-Scale System DevelopmentThe data management team at our company is focused on creating solutions that handle the entire big data pipeline, from ingestion and integration to development, cataloging, security, and governance. Our mission is to design, build, optimize, and scale one of the...
-
Big Data Engineer Specialist
4 days ago
Singapore beBeeDataEngineering Full time $80,000 - $120,000Big Data Engineer SpecialistWe are seeking a skilled Big Data Engineer to join our team. The successful candidate will be responsible for designing, maintaining and optimizing large-scale distributed systems.Key Responsibilities:Design and implement ETL/ELT pipelines using Spark for batch and streaming data.Manage and optimize Hadoop clusters (HDFS, YARN)...
-
Big Data Engineer
6 days ago
Singapore AlgoriX Technology Pte. Ltd. Full time**Responsibilities** The Big Data Engineer is responsible for analyzing big data and optimizing the performance of our online advertising delivery system. They are also responsible for the research and development of the advertising system’s offline and real-time data streams. **Requirements**: - Bachelor’s degree or above, majoring in Computer...
-
Big Data Engineer
3 days ago
Singapore INCOME INSURANCE LIMITED Full timeResponsible for data pipeline setup and data transformation - Implementation including loading from disparate data sets, preprocessing data. - Scope and deliver various Big Data solutions - Ability to design solutions independently based on high-level architecture. - Maintain the production systems (Kafka, Hadoop, Elasticsearch, RDBMS and No-SQL) -...
-
Big Data Engineer
2 weeks ago
Singapore Baidu, Inc. Full timeDirect message the job poster from Baidu, Inc. Responsibilities Build the company's big data warehouse system, including batch and stream data flow construction; In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance Responsible...
-
Big Data Engineer
1 week ago
Singapore UNISON Group Full time $104,000 - $130,878 per yearWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...