Big Data Engineer

6 days ago

Central Singapore NICOLL CURTIN TECHNOLOGY PTE. LTD. Full time $90,000 - $120,000 per year

We're looking for a skilled and detail-oriented Big Data Engineer to join a growing data team. In this role, you'll be responsible for building and maintaining robust data pipelines, enabling the transformation of large datasets into actionable insights. You'll work closely with cross-functional teams to support the design, development, and optimization of scalable data workflows.

Key Responsibilities:

  • Develop and maintain ETL workflows using Talend, ensuring efficient data extraction, transformation, and loading from various sources.
  • Integrate data from systems such as Cloudera, PostgreSQL, and SQL Server into target environments.
  • Design and implement database schemas and structures, ensuring data accuracy and reliability.
  • Collaborate with business and technical stakeholders to understand source data systems and provide optimized solutions.
  • Write clean and efficient code in SQL, Python, and other scripting tools for data transformation.
  • Improve and maintain data quality by implementing robust validation and cleaning procedures.
  • Participate in performance tuning, troubleshooting, and ongoing support of big data processes.

What We're Looking For:

  • At least 3-5 years proven experience with Talend ETL, Python, and Apache Spark.
  • Solid understanding of big data tools and platforms, especially Hadoop ecosystem components like Hive, Impala, and HDFS.
  • Familiarity with data warehousing concepts and data modeling techniques.
  • Strong analytical skills and the ability to translate complex data requirements into scalable technical solutions.
  • Experience with visualization or analytics tools is a plus.
  • Excellent problem-solving abilities and a proactive, team-oriented mind

  • Big Data Engineer

    2 weeks ago

    Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time

    **Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...

  • Big Data Engineer

    3 days ago

    Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...

  • Data Engineer

    2 weeks ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...

  • Big Data Engineer

    3 days ago

    Singapore IITMATRIX Full time

    We are looking for a skilled **Big Data Engineer** to join our dynamic team. You will be responsible for designing, developing, and optimizing data solutions within the Big Data ecosystem. This role involves working with large datasets, ensuring high performance at scale, and collaborating with cross-functional teams to deliver data-driven insights and...

  • Data Engineer

    2 weeks ago

    Singapore TALENTSIS PTE. LTD. Full time

    We are looking for a skilled **Data Engineer**with a focus on **Big Data**to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. **Key Responsibilities**: - Build and maintain big data pipelines using technologies like...

  • Big Data Engineer

    2 weeks ago

    Singapore SAKSOFT PTE LIMITED Full time

    Experience: 9+ Years Role: Big Data Engineer Skills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting(Good to have). Design...

  • Big Data Engineer

    3 hours ago

    Singapore AlgoriX Technology Pte. Ltd. Full time

    **Responsibilities** The Big Data Engineer is responsible for analyzing big data and optimizing the performance of our online advertising delivery system. They are also responsible for the research and development of the advertising system’s offline and real-time data streams. **Requirements**: - Bachelor’s degree or above, majoring in Computer...

  • Big Data Engineer

    1 week ago

    Singapore Baidu, Inc. Full time

    Direct message the job poster from Baidu, Inc. Responsibilities Build the company's big data warehouse system, including batch and stream data flow construction; In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance Responsible...

  • Big Data Engineer

    2 weeks ago

    Singapore Unison Consulting Pte Ltd Full time $90,000 - $120,000 per year

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...

  • Big Data Engineer

    3 days ago

    Singapore UNISON Group Full time $104,000 - $130,878 per year

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...