Big Data Engineering Lead

4 days ago


Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full time

We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation.
Key Responsibilities:
Design and develop large-scale data pipelines using Scala, Python, and PySpark
Lead and mentor a team of data engineers to build and maintain data architectures
Collaborate with cross-functional teams to identify data requirements and implement data-driven solutions
Ensure data quality, integrity, and security across all data pipelines
Develop and maintain technical documentation for data pipelines and architectures
Stay up-to-date with industry trends and emerging technologies in big data, cloud computing, and data engineering
Drive technical innovation and recommend new tools and technologies to improve data engineering capabilities
Requirements:
5+ years of experience in big data engineering, with expertise in Scala, Python, and PySpark
Strong experience with big data technologies such as Apache Spark, Hadoop, and Kafka
Experience with cloud-based data platforms such as AWS, GCP, or Azure
Strong understanding of data architecture, data governance, and data security
Excellent leadership and mentoring skills, with experience leading high-performing teams
Strong communication and collaboration skills, with ability to work with cross-functional teams
Bachelor's or Master's degree in Computer Science, Engineering, or related field
#J-18808-Ljbffr



  • Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full time

    We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation. **Key Responsibilities**: - Design and...


  • Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full time

    Roles & Responsibilities We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation. Key...


  • Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Big Data EngineerWe are seeking an experienced Big Data Engineer to design and implement scalable data processing pipelines using Spark. The ideal candidate will have a strong understanding of Hadoop architecture, Hive data modeling, and query optimization.Responsibilities:Design and maintain ETL/ELT pipelines using Spark for batch and streaming data.Manage...


  • Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$10,000 - S$18,000 / Monthly **Job Type** **Seniority** Lead **Years of Experience** At least 8 years **Tech Stacks** ClickHouse Druid Storm HBase Spark Linux kafka Flink Hadoop **Job** **Description**: - Lead a Big Data SRE team and oversee the development and maintenance of the big data ops automation platform, and...


  • Singapore Shopee Full time

    DepartmentEngineering and Technology- LevelExperienced (Team Lead)- LocationSingaporeThe Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not merely solve...

  • Technical Lead

    2 weeks ago


    Singapore Global bank - Singapore Full time

    A large financial institution with large big data infrastructure is looking for Lead Big Data Engineer with the following responsibilities: - Utilizing big data tools to perform data ingestion, interface and data analytics - Building interfaces to big data (Hadoop) data store - Integration of various tools as part of Hadoop ecosystems - Troubleshoot and...


  • Singapore GREAT EASTERN Full time

    Job Number: Lead Big Data Engineer ( Job Number: WW ) About the Job We are seeking a skilled and detail-oriented Data Engineer to design, develop, and maintain robust data pipelines and ETL solutions. This role involves working closely with cross-functional teams to ensure data quality, scalability, and alignment with business and technical...

  • Big Data Engineer

    7 days ago


    Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...


  • Singapore GREAT EASTERN Full time

    Job Number: Lead Big Data Engineer (Job Number: WW ) About the JobWe are seeking a skilled and detail-oriented Data Engineer to design, develop, and maintain robust data pipelines and ETL solutions. This role involves working closely with cross-functional teams to ensure data quality, scalability, and alignment with business and technical requirements....

  • Big Data Engineer

    2 weeks ago


    Singapore AXPARA SOLUTIONS PTE. LTD. Full time

    Job Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...