
Big Data Engineering Lead
4 days ago
We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation.
Key Responsibilities:
Design and develop large-scale data pipelines using Scala, Python, and PySpark
Lead and mentor a team of data engineers to build and maintain data architectures
Collaborate with cross-functional teams to identify data requirements and implement data-driven solutions
Ensure data quality, integrity, and security across all data pipelines
Develop and maintain technical documentation for data pipelines and architectures
Stay up-to-date with industry trends and emerging technologies in big data, cloud computing, and data engineering
Drive technical innovation and recommend new tools and technologies to improve data engineering capabilities
Requirements:
5+ years of experience in big data engineering, with expertise in Scala, Python, and PySpark
Strong experience with big data technologies such as Apache Spark, Hadoop, and Kafka
Experience with cloud-based data platforms such as AWS, GCP, or Azure
Strong understanding of data architecture, data governance, and data security
Excellent leadership and mentoring skills, with experience leading high-performing teams
Strong communication and collaboration skills, with ability to work with cross-functional teams
Bachelor's or Master's degree in Computer Science, Engineering, or related field
#J-18808-Ljbffr
-
Big Data Engineering Lead
2 weeks ago
Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full timeWe're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation. **Key Responsibilities**: - Design and...
-
Big Data Engineering Lead
1 week ago
Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full timeRoles & Responsibilities We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation. Key...
-
Lead Big Data Engineer
2 days ago
Singapore beBeeDataEngineering Full time $80,000 - $120,000Big Data EngineerWe are seeking an experienced Big Data Engineer to design and implement scalable data processing pipelines using Spark. The ideal candidate will have a strong understanding of Hadoop architecture, Hive data modeling, and query optimization.Responsibilities:Design and maintain ETL/ELT pipelines using Spark for batch and streaming data.Manage...
-
Site Reliability Engineer Lead
7 days ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$10,000 - S$18,000 / Monthly **Job Type** **Seniority** Lead **Years of Experience** At least 8 years **Tech Stacks** ClickHouse Druid Storm HBase Spark Linux kafka Flink Hadoop **Job** **Description**: - Lead a Big Data SRE team and oversee the development and maintenance of the big data ops automation platform, and...
-
Site Reliability Engineer Lead
1 week ago
Singapore Shopee Full timeDepartmentEngineering and Technology- LevelExperienced (Team Lead)- LocationSingaporeThe Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not merely solve...
-
Technical Lead
2 weeks ago
Singapore Global bank - Singapore Full timeA large financial institution with large big data infrastructure is looking for Lead Big Data Engineer with the following responsibilities: - Utilizing big data tools to perform data ingestion, interface and data analytics - Building interfaces to big data (Hadoop) data store - Integration of various tools as part of Hadoop ecosystems - Troubleshoot and...
-
Lead Big Data Engineer
2 days ago
Singapore GREAT EASTERN Full timeJob Number: Lead Big Data Engineer ( Job Number: WW ) About the Job We are seeking a skilled and detail-oriented Data Engineer to design, develop, and maintain robust data pipelines and ETL solutions. This role involves working closely with cross-functional teams to ensure data quality, scalability, and alignment with business and technical...
-
Big Data Engineer
7 days ago
Singapore beBeeDataEngineering Full time $80,000 - $120,000Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...
-
Lead Big Data Engineer
2 weeks ago
Singapore GREAT EASTERN Full timeJob Number: Lead Big Data Engineer (Job Number: WW ) About the JobWe are seeking a skilled and detail-oriented Data Engineer to design, develop, and maintain robust data pipelines and ETL solutions. This role involves working closely with cross-functional teams to ensure data quality, scalability, and alignment with business and technical requirements....
-
Big Data Engineer
2 weeks ago
Singapore AXPARA SOLUTIONS PTE. LTD. Full timeJob Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...