Large Scale Data Architect

24 hours ago

Singapore beBeeData Full time $120,000 - $180,000

We are seeking a skilled Big Data Engineer to join our E-commerce Recommendation Infrastructure team.

Job Description

This role involves designing and implementing large-scale recommendation systems, ensuring high-performance storage and computing systems, and troubleshooting production issues. You will work closely with applied machine learning engineers to build scalable systems that support innovative algorithms and techniques.

Responsibilities
  • Data Architecture Design: Design and implement a reasonable offline data architecture for large-scale recommendation systems
  • Storage and Computing Systems: Design and implement flexible, scalable, stable, and high-performance storage and computing systems
  • Troubleshooting and Stability: Trouble-shoot the production system, design, and implement necessary mechanisms and tools to ensure the stability of the overall operation of the production system
  • Distributed Systems Development: Build industry-leading distributed systems such as storage and computing to provide reliable infrastructure for massive data and large-scale business systems
  • Data Analysis and Visualization: Develop and implement techniques and analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualisation software
  • Data Mining and Machine Learning: Apply data mining, data modelling, natural language processing, and machine learning to extract and analyze information from large structured and unstructured datasets
  • Data Reporting: Visualise, interpret, and report data findings and may create dynamic data reports as well
Qualifications

To be successful in this role, you should have:

  • A Bachelor's degree or above in computer science, software engineering, or a related field
  • Familiarity with many open source frameworks in the field of big data, e.g. Hadoop, Hive, Flink, Spark, Kafka, HBase, Redis, RocksDB, ElasticSearch etc.
  • Familiarity with Java, C++ and other programming languages
  • Strong coding and trouble shooting ability
  • Willingness to challenge questions that have no obvious answers, and have a strong enthusiasm for learning new technologies
  • Experience of Peta Byte level data processing is a plus
  • At least 3 years of relevant experience

We are committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. We strive to celebrate our diverse voices and create an environment that reflects the many communities we reach.

  • Data Architect for Large-Scale Recommendation Systems

    1 day ago

    Singapore beBeeRecommendation Full time $80,000 - $120,000

    About the RoleWe are seeking a seasoned Data Architect to lead the development of our recommendation system. This is an exceptional opportunity to leverage your expertise and passion for building scalable, stable, and high-performance recommendation systems.Key ResponsibilitiesDesign and implement offline data architectures for large-scale recommendation...

  • Large Scale Data Engineering Professional

    2 days ago

    Singapore beBeeDataEngineering Full time $120,000 - $180,000

    Large Scale Data Engineering ExpertWe are seeking an experienced Large Scale Data Engineering Expert to join our team. As a key member of our team, you will play a vital role in designing and maintaining large-scale distributed systems.The ideal candidate will have hands-on experience with Spark (Core, SQL, Streaming), a good understanding of Hadoop (HDFS,...

  • Large Scale Data Engineering Professional

    12 hours ago

    Singapore beBeeDataEngineering Full time

    Large Scale Data Engineering Expert We are seeking an experienced Large Scale Data Engineering Expert to join our team. As a key member of our team, you will play a vital role in designing and maintaining large-scale distributed systems. The ideal candidate will have hands-on experience with Spark (Core, SQL, Streaming), a good understanding of Hadoop...

  • Senior Large Scale Data Architect

    4 days ago

    Singapore beBeeData Full time $80,000 - $120,000

    Job SummaryWe are seeking an experienced Data Modeler to develop sophisticated models and algorithms for our recommendation systems. The ideal candidate will have expertise in large-scale data mining, machine learning, and deep learning techniques. Strong programming skills in C++ and Python, along with familiarity with Big Data tools like Hive...

  • Large Scale Data Infrastructure Specialist

    2 weeks ago

    Singapore beBeeDataInfrastructure Full time $80,000 - $120,000

    **System Architect for Large-Scale Recommendation Systems** Craft a robust data infrastructure to power offline recommendation systems serving over a billion users. Design an efficient architecture for real-time and offline data processing.Implement scalable storage solutions and computation models. Key Responsibilities:Develop large-scale distributed...

  • Large-Scale Data Architecture Specialist

    2 weeks ago

    Singapore beBeeDataArchitect Full time $120,000 - $250,000

    Job TitleWe are seeking a highly skilled professional to join our E-commerce Recommendation team as a Data Architect.You will design and implement robust offline data architecture for large-scale recommendation systems, working closely with applied machine learning engineers.Your focus will be on ensuring stability and high availability of the production...

  • Large Scale Data Engineering Specialist

    4 days ago

    Singapore beBeeDataEngineer Full time $90,000 - $120,000

    Are you an accomplished data professional looking for a new challenge?Our ideal candidate will be responsible for architecting and developing large-scale data pipelines that meet our business needs.Design, develop, and maintain complex data systems using cutting-edge technologies.Collaborate with cross-functional teams to understand requirements and deliver...

  • Data Engineering Technologist

    2 days ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time

    We are hiring Data Engineering Technologist - Large-Scale Distributed Systems with below requirements; **Responsibilities** - Design and maintain ETL/ELT pipelines using Spark for batch and streaming data. - Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability. - Build and maintain Hive data models, partitions, and queries for...

  • Data Engineer

    4 days ago

    Singapore beBeeData Full time $90,000 - $120,000

    Job Title: Data Engineer with 8 Years Experience">Job Description:We are looking for a highly skilled Data Engineer to join our team. The successful candidate will design, develop, and deploy data tables, views, and marts in data warehouses, operational data stores, data lakes, and data virtualization.Responsibilities:Data Engineering: Design, build, launch,...

  • Data Engineering Technologist – Large-Scale Distributed Systems

    2 days ago

    Singapore RISKDATA CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesWe are hiring Data Engineering Technologist – Large-Scale Distributed Systems with below requirements;ResponsibilitiesDesign and maintain ETL/ELT pipelines using Spark for batch and streaming data. Manage and optimize Hadoop clusters (HDFS, YARN) for scalability and reliability. Build and maintain Hive data models, partitions, and...