Big Data Engineer

6 hours ago

Singapore BYTEPLUS PTE. LTD. Full time

ByteDance will be prioritizing applicants who have a current right to work in Singapore, and do not require ByteDance's sponsorship of a visa.

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

**Why Join Us**

Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible.

Together, we inspire creativity and enrich life - a mission we aim towards achieving every day.

To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.

At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve.

Join us.

**About the Team**

BytePlus Recommend Platform helps our user to build a delightful discovery experience. BytePlus Recommend Platform aims to provide this service to our users as a flexible and efficient tool to incorporate into their business. Through our services, users will be able to build better user experiences and grow their business further. It enhances every step of the user journey with personalized recommendations. The team provides rich personalized experiences using the latest innovations in machine learning to achieve higher retention, engagement, and revenue, explore flexible recommendation models that cater to our users' specific scenarios and goals, and explore all the need to get users started in an easy-to-use platform.

**Responsibilities**
- Responsible for the continuous evolution of the BytePlus Recommendation Product's data architecture.
- Participate in developing a full life-cycle of ML sample preparation, including data ingestion, validation, transformation, and collaborate with MLEs to provide top-level recommendation solutions to To-B clients.
- Build cutting-edge indexing, feature engineering, and data storage solutions to support efficient machine learning algorithm iteration.
- Develop systematic processes and tools to optimize system costs and enhance overall stability and efficiency.
- Visualise, interpret, and report data findings and may create dynamic data reports as well.

**Qualifications**
- Proficient in programming languages such as Java, Scala, Python, with a solid foundation in computer science and strong coding, system design, and problem-solving skills.
- Familiar with modern big data ecosystem such as Yarn, Kubernetes (K8s), HDFS, Hive, Iceberg/Hudi, HBase, ClickHouse etc.
- Agile, quick self learner, highly self-motivated with a strong sense of product ownership.
- Experience in developing search, recommendation, advertising system or big data platform would be a plus.
- At least 3+ year of relevant experience.

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

  • Big Data Engineer

    2 weeks ago

    Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time

    **Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...

  • Big Data Engineer

    5 days ago

    Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...

  • Data Engineer

    2 weeks ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...

  • Big Data Engineer

    5 days ago

    Singapore IITMATRIX Full time

    We are looking for a skilled **Big Data Engineer** to join our dynamic team. You will be responsible for designing, developing, and optimizing data solutions within the Big Data ecosystem. This role involves working with large datasets, ensuring high performance at scale, and collaborating with cross-functional teams to deliver data-driven insights and...

  • Data Engineer

    2 weeks ago

    Singapore TALENTSIS PTE. LTD. Full time

    We are looking for a skilled **Data Engineer**with a focus on **Big Data**to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. **Key Responsibilities**: - Build and maintain big data pipelines using technologies like...

  • Big Data Engineer

    2 days ago

    Singapore AlgoriX Technology Pte. Ltd. Full time

    **Responsibilities** The Big Data Engineer is responsible for analyzing big data and optimizing the performance of our online advertising delivery system. They are also responsible for the research and development of the advertising system’s offline and real-time data streams. **Requirements**: - Bachelor’s degree or above, majoring in Computer...

  • Big Data Engineer

    6 hours ago

    Singapore INCOME INSURANCE LIMITED Full time

    Responsible for data pipeline setup and data transformation - Implementation including loading from disparate data sets, preprocessing data. - Scope and deliver various Big Data solutions - Ability to design solutions independently based on high-level architecture. - Maintain the production systems (Kafka, Hadoop, Elasticsearch, RDBMS and No-SQL) -...

  • Big Data Engineer

    2 weeks ago

    Singapore Baidu, Inc. Full time

    Direct message the job poster from Baidu, Inc. Responsibilities Build the company's big data warehouse system, including batch and stream data flow construction; In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance Responsible...

  • Big Data Engineer

    6 days ago

    Singapore UNISON Group Full time $104,000 - $130,878 per year

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...

  • Big Data Engineer

    4 days ago

    Singapore Unison Consulting Full time

    Get AI-powered advice on this job and more exclusive features. We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing,...