Big Data Engineer

2 days ago

Singapore beBeeDataEngineer Full time

About the Data Management Suite Team

The Data Management Suite team is focused on building scalable products that cover the entire lifecycle of data pipeline, including data ingestion and integration, data development, data catalog, data security, and data governance. These products support various businesses, allowing data engineers and scientists to significantly boost their productivity.

As a software engineer in this team, you will have the opportunity to design, optimize, and grow one of the world's largest data platforms. You'll gain hands-on experience with core systems in the data platform ecosystem, directly impacting the company's core products and hundreds of millions of users.

We are seeking talented individuals who can help us achieve our goals.

  • Ensure production stability for big data development and governance systems.
  • Engage in and improve the whole lifecycle of services, from inception and design through deployment, operation, and refinement.
  • Maintain services once they are live by measuring and monitoring availability, latency, and overall system health. Practice sustainable incident response and blameless postmortems.
  • Establish best engineering practices for engineers and non-technical staff.
  • Design and implement reliable, scalable, robust, and extensible big data systems that support core products and business.

Key qualifications include:

Minimum Qualifications

  • Pursuing an Undergraduate or Master's degree in Computer Science or a related technical field.
  • Experience with site reliability engineering, monitoring, and alerting for big data-related systems.
  • Proficiency in writing code in Java, Go, Python, or similar languages.

Preferred Qualifications

  • Familiarity with data ingestion, modeling, processing, and persistence strategies, ETL design, job scheduling, and dimensional modeling.
  • Experience running production-grade services at scale and understanding cloud-native technologies and networking.
  • Ability to develop tools and APIs reducing human interaction with systems and applications using coding and scripting standards.
  • Expertise in designing, analyzing, and troubleshooting large-scale distributed systems (Hadoop, M/R, Hive, Spark, Presto, Flume, Kafka, ClickHouse, Flink).
  • Systematic problem-solving approach and effective communication skills.

  • Big Data Engineer

    1 week ago

    Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time

    **Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...

  • Big Data Engineer

    1 day ago

    Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...

  • Data Engineer

    2 weeks ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...

  • Big Data Engineer

    1 day ago

    Singapore IITMATRIX Full time

    We are looking for a skilled **Big Data Engineer** to join our dynamic team. You will be responsible for designing, developing, and optimizing data solutions within the Big Data ecosystem. This role involves working with large datasets, ensuring high performance at scale, and collaborating with cross-functional teams to deliver data-driven insights and...

  • Data Engineer

    2 weeks ago

    Singapore TALENTSIS PTE. LTD. Full time

    We are looking for a skilled **Data Engineer**with a focus on **Big Data**to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. **Key Responsibilities**: - Build and maintain big data pipelines using technologies like...

  • Big Data Engineer

    2 weeks ago

    Singapore SAKSOFT PTE LIMITED Full time

    Experience: 9+ Years Role: Big Data Engineer Skills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting(Good to have). Design...

  • Big Data Engineer

    1 week ago

    Singapore Baidu, Inc. Full time

    Direct message the job poster from Baidu, Inc. Responsibilities Build the company's big data warehouse system, including batch and stream data flow construction; In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance Responsible...

  • Big Data Engineer

    2 weeks ago

    Singapore Unison Consulting Pte Ltd Full time $90,000 - $120,000 per year

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...

  • Big Data Engineer

    2 days ago

    Singapore UNISON Group Full time $104,000 - $130,878 per year

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...

  • Big Data Engineer

    2 weeks ago

    Singapore beBeeData Full time

    Big Data Engineer PositionWe are seeking a skilled and experienced Big Data Engineer to join our team. The ideal candidate will have hands-on experience in building and maintaining data pipelines, working with cloud platforms (Alicloud, AWS, Microsoft Azure, or Google Cloud Platform), and ensuring efficient data integration, storage, and accessibility.Job...