Data Engineer Expertise

2 weeks ago

Singapore beBeeData Full time $90,000 - $120,000

Job Title:

Data Engineering Professional

Description:

We are seeking an experienced data engineer to join our organization. The ideal candidate will have a strong understanding of data processing frameworks, streaming technologies, and data lake architectures.

The successful candidate will be responsible for designing and implementing scalable data ingestion pipelines, developing real-time and near-real-time data workflows, and optimizing performance for high-volume and high-velocity datasets.

About the Role:

  • Design and implement data ingestion pipelines from diverse sources.
  • Develop real-time and near-real-time data workflows using Apache Flink and Kafka Streams.
  • Optimize performance for high-volume and high-velocity datasets.
  • Implement data quality checks and automatic monitoring systems to ensure accurate and available data.
  • Design and manage storage solutions such as Databricks and Delta Lake.
  • Apply best practices for schema design, partitioning, and data lifecycle management.
  • SUPPORT DATA DISCOVERY AND CATALOGUING IN COORDINATION WITH GOVERNANCE TOOLS.
  • COLLABORATE WITH DATA SCIENTISTS AND ANALYSTS TO UNDERSTAND DATA NEEDS.
  • PARTNER WITH DEVSECOPS AND PLATFORM ENGINEERS TO AUTOMATE DEPLOYMENT AND ORCHESTRATION OF DATA PIPELINES.

Requirements:

  • Bachelor or Master degree in Computer Science or a related field.
  • At least 5 years of experience in data engineering.
  • Deep expertise in Spark, Databricks, and data processing frameworks.
  • Strong knowledge of streaming technologies and data lake architectures.
  • Proficient in Python and SQL.
  • Analytical mindset with a focus on data quality and performance.
  • Strong communication and documentation skills.

  • Data Engineer

    1 week ago

    Singapore NTT Data Singapore Full time

    **The primary responsibilities**: - Lead architecture design, develop, document, and implement end-to-end data pipelines and data-driven solutions. - Define roadmap to transform data architecture focusing on scalability, performance, and stability for the entire data lifecycle; - Build data flow for data acquisition, aggregation, and modelling, using both...

  • Expertise in Data Engineering

    2 weeks ago

    Singapore beBeeDataEngineer Full time $60,000 - $120,000

    Key Role: Junior Data EngineerThis position offers a unique opportunity to work on large-scale data engineering projects. Key responsibilities will include designing, implementing, and maintaining complex data systems, as well as collaborating with cross-functional teams to ensure smooth data flow.Required Skills and Qualifications:Proficiency in Hadoop and...

  • Global Data Engineering Expertise Specialist

    1 week ago

    Singapore beBeeDataEngineer Full time $90,000 - $120,000

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team and contribute to the development of our Global Data Analytics Platform. This is an exceptional opportunity to enhance data culture and analytics competency across the organization.Collaborate with cross-functional teams to design, build, and maintain data warehouse models, data...

  • Systems Optimization Expert

    5 days ago

    Singapore beBee Engineer Full time $80,000 - $120,000

    Role Description:">">We are seeking an Engineer to join our team, responsible for monitoring and maintaining critical information-communication systems.">">About the Role:">As a key member of our team, you will work alongside fellow engineers to ensure the reliability and functionality of our communication systems. Your expertise in advanced technologies...

  • Data Engineering Expertise

    1 week ago

    Singapore beBeeEngineer Full time $80,000 - $120,000

    Big Data EngineerJoin us to drive innovation in data engineering and artificial intelligence. As a key member of our team, you will design and implement scalable distributed computing and training systems for large-scale recommendation systems.Key Responsibilities:Design and implement high-performance components for offline storage, computing, and...

  • Cloud Engineering Expertise

    1 week ago

    Singapore beBeeData Full time $90,000 - $120,000

    Senior Cloud Data EngineerWe are seeking a skilled Senior Cloud Data Engineer to join our team. As a key member of our engineering group, you will be responsible for designing and implementing scalable data pipelines on cloud-native services.We require expertise in AWS and GCP, with strong Python and SQL development skills.Experience with orchestration tools...

  • Azure Data engineer

    2 days ago

    Singapore NTT Data Singapore Full time $120,000 - $180,000 per year

    Job Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...

  • Data Expertise Professional

    1 week ago

    Singapore beBeeDataHistorian Full time $80,000 - $120,000

    About the Job">We are seeking a skilled Data Historian Engineer to join our team. As a key member of our organization, you will play a critical role in designing and maintaining interfaces for contextualized data acquisition. ">Your primary responsibilities will include:">">Designing and implementing interfaces for APRM, including alarms, events, and audit...

  • Big Data Engineering Expertise

    2 weeks ago

    Singapore beBeeDataEngineering Full time $90,000 - $120,000

    Big Data Engineering ProfessionalJob Description:As a seasoned Big Data Engineer, you will play a pivotal role in designing and implementing cutting-edge data pipelines that drive business growth. You will collaborate closely with cross-functional teams to understand business requirements, translate technical concepts into actionable solutions, and ensure...

  • Data Scientist with Quantitative Expertise

    1 week ago

    Singapore beBeeQuantitative Full time $80,000 - $120,000

    Job Description:We are seeking an exceptional Data Scientist with a strong background in quantitative analysis and expertise in machine learning. The successful candidate will be responsible for conducting research on proprietary and alternative datasets, developing advanced statistical models to extract fundamental insights for Portfolio Managers and...