Big Data Engineer

2 weeks ago

Singapore TIKTOK PTE. LTD. Full time

TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo.

**About the Ads Data team**

The Ads Data team provides tools and services to deliver ad data to millions of internal and external clients all around the globe. The team has end-to-end ownership of ad data's lifecycle including data ETL, data warehouse and data services. We leverage data technologies to advice local customer support teams and help global advertisers make wiser investment decisions on our Advertising Platform.

Ads Data is the cornerstone of every business decision that millions of advertisers make every day on our platform. Therefore, we are tasked with innovating on daily basis to create and maintain complex systems at large scale and continue expanding the capacity to better serve advertisers growing at exponential pace.

You will share in the ownership of the technical vision and direction for advanced Ads Data products. You will be a part of a team of top notch technical professionals developing scalable systems and with a focus on sustained operational excellence. Members of this team will be challenged to innovate using cutting edge technologies. We are looking for people who are highly motivated by aiming for the highest, moving fast, and changing the way customers use data to drive profitability.

**Responsibilities**
- Translate business requirements into technical implementations and responsible for building batch and real-time data warehouse;
- Design, build and launch real-time/batch data models/pipelines in production;
- Build up data marts and own data quality for business areas;
- Support existing real-time/batch systems in production, solve on-call issues;
- Define and manage SLA for all data sets in business areas;
- Support daily project management, assist junior engineers in business and technical problems.

**Qualifications**
- Final year or recent graduate with a background in Computer Science or other related fields;
- Experience working with big data technologies such as Hadoop, Hive, Spark, etc.;
- Experience with schema design and dimensional data modelling;
- Experience in custom ETL design, implementation and maintenance;
- Proficient in at least one programming language such as Python, Java or C++;
- Good communication skills, including the ability to identify and communicate data driven insights.

  • Big Data Engineer

    3 days ago

    Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time

    **Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...

  • Big Data Engineer

    1 week ago

    Singapore ALMR Consulting Pte Ltd Full time $150,000 - $200,000 per year

    Roles & ResponsibilitiesJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting...

  • Big Data Engineer

    1 week ago

    Singapore ALMR CONSULTING PTE. LTD. Full time $100,000 - $150,000 per year

    Job Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.Key...

  • Big Data Engineer

    5 days ago

    Singapore SAKSOFT PTE LIMITED Full time

    Experience: 9+ Years Role: Big Data Engineer Skills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting(Good to have). Design...

  • Big Data Platform Engineer

    6 days ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    **SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...

  • Big Data Engineering Lead

    1 day ago

    Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full time

    We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation. **Key Responsibilities**: - Design and...

  • Principal Big Data Engineer

    5 days ago

    Singapore QUESSCORP HOLDINGS PTE. LTD. Full time

    **Job Description**: - Design and implement scalable data pipelines to collect, process, and store large volumes of structured and unstructured data. - Ensure data quality, integrity, and consistency across various data sources. - Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that...

  • Senior Engineer

    3 days ago

    Singapore Experis Full time

    **Senior Engineer (Big Data)**: - Location- Singapore- Job reference- BBBH130672_1691631585- Salary- Negotiable- Consultant name - Canete Christopher Miguel Consultant contact no. - EA License No. - 02C3423 - Consultant Registration No. - R23112144 **Job Description**: Experience in designing, creating, and managing large-scale data processing...

  • Big Data Engineer

    1 week ago

    Singapore Baidu, Inc. Full time

    Build the company's big data warehouse system, including batch and stream data flow construction. In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance. Responsible for data integration and ETL architecture design and development....

  • Big Data Test Engineer

    7 days ago

    Singapore Patsnap Full time $80,000 - $120,000 per year

    About PatSnap Patsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable...