Big Data Engineer

3 weeks ago

Singapore AXPARA SOLUTIONS PTE. LTD. Full time

Job Description:

  • We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and accessibility across the organization.

Key Responsibilities:

  • Design, implement, and optimize robust data pipelines and ETL/ELT workflows using SQL and Python.
  • Collaborate closely with Data Engineers, Analysts, and cross-functional engineering teams to meet evolving data needs.
  • Build synchronous and asynchronous data APIs for downstream systems to consume the data.
  • Deploy and manage infrastructure using Terraform and other
  • Infrastructure-as-Code (IaC) tools.
  • Develop and maintain CI/CD pipelines for deploying data applications and services.
  • Leverage strong experience in AWS services (e.g., S3, Glue, Lambda, RDS, Lake
  • Formation) to support scalable and secure cloud-based data platforms.
  • Handle both batch and real-time data processing effectively.
  • Apply best practices in data modeling and support data privacy and data protection initiatives.
  • Implement and manage data encryption and hashing techniques to secure sensitive information.
  • Ensure adherence to software engineering best practices including version control, automated testing, and deployment standards.
  • Lead performance tuning and troubleshooting for data applications and platforms.

Required Skills & Experience:

  • Strong proficiency in SQL for data modeling, querying, and transformation.
  • Advanced Python development skills with an emphasis on data engineering use cases.
  • Hands-on experience with Terraform for cloud infrastructure provisioning.
  • Proficiency with CI/CD tools, particularly GitHub Actions.
  • Deep expertise in AWS cloud architecture and services.
  • Demonstrated ability to create and evaluate ERDs and contribute to architectural decisions.
  • Strong communication.

Preferred Qualifications:

  • Experience with big data technologies such as Apache Spark, Hive, or Kafka.
  • Familiarity with containerization tools (e.g., Docker) and orchestration platforms (e.g., Kubernetes) .
  • Solid understanding of data governance, data quality, and security frameworks.
#J-18808-Ljbffr

  • Data Engineer

    6 days ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...

  • Big Data Engineer

    1 day ago

    Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full time

    Job Title: Big Data Engineer (Java, Spark, Hadoop)Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep...

  • Data Engineer

    6 days ago

    Singapore TALENTSIS PTE. LTD. Full time

    We are looking for a skilled **Data Engineer**with a focus on **Big Data**to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. **Key Responsibilities**: - Build and maintain big data pipelines using technologies like...

  • Big Data Engineer

    1 week ago

    Singapore SAKSOFT PTE LIMITED Full time

    Experience: 9+ Years Role: Big Data Engineer Skills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting(Good to have). Design...

  • Big Data Engineer

    4 days ago

    Singapore UNISON Group Full time $80,000 - $120,000 per year

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...

  • Big Data Engineer

    3 weeks ago

    Singapore Unison Consulting Full time

    Get AI-powered advice on this job and more exclusive features. We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing,...

  • Big Data Platform Engineer

    1 week ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    **SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...

  • Big Data Engineering Lead

    3 weeks ago

    Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full time

    We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation.Key Responsibilities: Design and develop...

  • Principal Big Data Engineer

    1 week ago

    Singapore QUESSCORP HOLDINGS PTE. LTD. Full time

    **Job Description**: - Design and implement scalable data pipelines to collect, process, and store large volumes of structured and unstructured data. - Ensure data quality, integrity, and consistency across various data sources. - Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that...

  • Platform Engineer – Big Data

    3 weeks ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesWe are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive. Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets. Maintain and fine-tune...