
Big Data Engineering Lead
4 weeks ago
We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation.
Key Responsibilities:
- Design and develop large-scale data pipelines using Scala, Python, and PySpark
- Lead and mentor a team of data engineers to build and maintain data architectures
- Collaborate with cross-functional teams to identify data requirements and implement data-driven solutions
- Ensure data quality, integrity, and security across all data pipelines
- Develop and maintain technical documentation for data pipelines and architectures
- Stay up-to-date with industry trends and emerging technologies in big data, cloud computing, and data engineering
- Drive technical innovation and recommend new tools and technologies to improve data engineering capabilities
Requirements:
- 5+ years of experience in big data engineering, with expertise in Scala, Python, and PySpark
- Strong experience with big data technologies such as Apache Spark, Hadoop, and Kafka
- Experience with cloud-based data platforms such as AWS, GCP, or Azure
- Strong understanding of data architecture, data governance, and data security
- Excellent leadership and mentoring skills, with experience leading high-performing teams
- Strong communication and collaboration skills, with ability to work with cross-functional teams
- Bachelor's or Master's degree in Computer Science, Engineering, or related field
Mentoring
Technical Documentation
PySpark
Apache Spark
Scala
Azure
Big Data
Cloud Computing
Pipelines
Hadoop
Data Quality
Data Governance
Data Engineering
Python
Data Architecture
GCP
-
Big Data Engineer Lead
4 days ago
Singapore Maltem Asia-Pacific Full timeMaltem Singapore is seeking a Big Data Engineer Lead for our Media Communications Client. Summary: We are looking for a highly skilled Lead Big Data Engineer to join our data team. The candidate will design, develop, and maintain scalable big data solutions and provide technical leadership. This role will support Data Governance initiatives, ensuring...
-
Lead Big Data Engineer
3 days ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$8,000 - S$11,000 / Monthly **Job Type** **Seniority** Lead **Years of Experience** At least 8 years **Tech Stacks** ETL MariaDB Docker Data Extraction play Shell Script Analytics Sqoop Dataiku Cloudera HDFS Shell Java Hive Airflow Spark Bitbucket SQL Scala Hadoop Python **Job Purpose** At Great Eastern, we are building a...
-
Leading Edge Big Data Expert
3 days ago
Singapore beBeeBigDataEngineer Full timeLead Big Data EngineerMaltem Singapore is seeking a highly skilled Lead Big Data Engineer to join our data team.The candidate will design, develop and maintain scalable big data solutions and provide technical leadership.Support Data Governance initiatives to ensure data integrity, privacy and accessibility.Design, implement and optimize data pipelines and...
-
Application Development Lead
1 week ago
Singapore Tangspac Full timeA large financial institution with large big data team is looking for Application Development Manager / Lead with the following responsibilities: - Leading an applicaiton development team - Utilizing big data tools to perform data ingestion, interface and data analytics - Building interfaces to big data (Hadoop) data store - Integration of various tools as...
-
Big Data Engineer
14 hours ago
Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time**Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...
-
Lead Big Data Engineer
5 days ago
Singapore GREAT EASTERN Full timeJob Number: Lead Big Data Engineer ( Job Number: WW ) About the Job We are seeking a skilled and detail-oriented Data Engineer to design, develop, and maintain robust data pipelines and ETL solutions. This role involves working closely with cross-functional teams to ensure data quality, scalability, and alignment with business and technical...
-
Engineering Manager
25 minutes ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full timeAs an Engineering Manager of Big Data Platform, you lead engineering teams to deliver Big Data platforms for running mission-critical workflows. You set the technical direction, architect, lead and manage the development Big Data Platforms. You push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...
-
Data Engineer
2 days ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...
-
Big Data Leading Talent
7 days ago
Central Singapore Emprego SG Full time**Location** - Singapore, Central Singapore**Job Type** - Permanent**Salary** - $17,000 - $53,000 Per Month**Date Posted** - 4 hours agoAdditional Details **Job ID** - 112681**Job Views** - 1Roles & Responsibilities Position: Big Data Leading Talent Annual Salary: RMB 1,000,000 and above (Negotiable) Location: Beijing, China **Job Decription**: 1. Lead...
-
Big Data Lead
2 days ago
Singapore Sanderson-iKas Singapore Pte Ltd Full timeWe are looking to speak to Big Data Lead Key Responsibilities - Lead end-to-end software/product development and ad hoc projects. - Design scalable, well-structured technical solutions. - Oversee all development phases: analysis, design, coding, integration, and testing. - Ensure high-quality deliverables aligned with Bank standards and Agile methodology. -...