Big Data Engineer
17 hours ago
Job Summary:
We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.
Key Responsibilities:
- Design and develop data ingestion, processing, and integration pipelines using Python, PySpark, and Informatica.
- Analyse data requirements and build scalable data solutions.
- Support testing, deployment, and production operations.
- Collaborate with business and technical teams for smooth delivery.
- Drive automation, standardization, and performance optimization.
Requirements:
- Bachelor's degree in IT, Computer Science, or related field.
- Minimum 5 years' experience in Big Data Engineering.
- Hands-on skills in Python, PySpark, Linux, SQL, and ETL tools (Informatica preferred).
- Experience with Cloudera Data Platform is an advantage.
- Knowledge of data warehousing, Denodo, and reporting tools (SAP BO, Tableau) preferred.
- Strong analytical, problem-solving, and communication skills.
-
Big Data Engineer
1 day ago
Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time**Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...
-
Big Data Engineer
3 days ago
Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full timeJob Title: Big Data Engineer (Java, Spark, Hadoop)Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep...
-
Data Engineer
3 days ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...
-
Data Engineer
3 days ago
Singapore TALENTSIS PTE. LTD. Full timeWe are looking for a skilled **Data Engineer**with a focus on **Big Data**to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. **Key Responsibilities**: - Build and maintain big data pipelines using technologies like...
-
Big Data Engineer
15 hours ago
Singapore ALMR Consulting Pte Ltd Full time $150,000 - $200,000 per yearRoles & ResponsibilitiesJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting...
-
Big Data Engineer
6 days ago
Singapore UNISON Group Full time $80,000 - $120,000 per yearWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...
-
Big Data Platform Engineer
5 days ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time**SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...
-
Platform Engineer – Big Data
4 days ago
Singapore RISKDATA CONSULTING PTE. LTD. Full time $104,000 - $130,878 per yearWe are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN)...
-
Senior Engineer
1 day ago
Singapore Experis Full time**Senior Engineer (Big Data)**: - Location- Singapore- Job reference- BBBH130672_1691631585- Salary- Negotiable- Consultant name - Canete Christopher Miguel Consultant contact no. - EA License No. - 02C3423 - Consultant Registration No. - R23112144 **Job Description**: Experience in designing, creating, and managing large-scale data processing...
-
Principal Big Data Engineer
3 days ago
Singapore LUMINARY SERVICE PTE. LTD. Full timeDesign and implement scalable data pipelines to collect, process, and store large volumes of structured and unstructured data. Ensure data quality, integrity, and consistency across various data sources. Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business...