Data Engineer

6 days ago

Singapore NE Digital Full time

COMPANY DESCRIPTION

NE Digital is the digital, data and technology organization that serve as a center of excellence to drive digital transformation for our group of NTUC Social Enterprises to meet the critical social needs of Singapore's community. Delivering innovative products and solutions, we empower our people to lead a better and meaningful life through digital services in the area of daily essentials, health and community care, childcare and education as well as financial services.

**The Team**

We believe that diversity is key to driving an innovative, cohesive, productive and fun workplace Hence, at NE Digital our people join us from all around the world. Be sure to be soaked in an environment with different ethnic groups driving innovation and injecting some creative juice as one

Contributing to a social purpose through technology, our team of passionate and dedicated folks are spread into different social enterprises such as NTUC Fairprice Group, NTUC First Campus, NTUC Health and among others

**Creating technologies that impacts**

DESIGNATION : Data Engineer

RESPONSIBILITIES

This role is part of the newly minted Central Data Platform & Infrastructure team, within the office of Chief Data Officer of NTUC Group. This team will be responsible for building and maintaining mission-critical data engineering platforms and associated infrastructure of the whole NTUC Group.

Other core responsibilities will involve, but not limited to:

- Designing Central Data Architecture
- Upholding data engineering standards for the entire group.
- Working closely with various Data Engineering teams across social enterprises
- Maintain cognizance of Data Technologies and Processes used in the organization.
- Data Security and Privacy

**Responsibilities**

The Data Engineer will be responsible for the design, develop, and maintain:

- Best Practices for Data Architecture and Design Patterns for Data Engineering Use-Cases.
- Real-time data feeds from database sources like MySQL, Oracle, and MS SQLServer using the “Change Data Capture Engine” aka “CDC”.
- Sub-Second Real-Time Data Pipelines using Google Dataflow (Apache Beam), Kinesis, Lambda & Google PubSub.
- Batch Pipeline Orchestration using on Google Cloud Composer (Apache Airflow) and Jenkins.
- Auto Scalable platform using Kubernetes on GKE and EKS.
- Org Wide Master Data Management, Data Catalog Engine, and Data Quality Engine.
- Code Repo Pipeline to automate Continuous Integration and Continuous Deployment (CI / CD).
- Structure Tables with Partitioning and Clustering to increase Cost & Performance Benefits.
- Guide Data Analysts and Data Scientists to write efficient queries and workloads.
- Data Sharing with On-Demand Encryption/Decryption which can operate at Scale.
- Running Containerized ETL workflow at scale.

QUALIFICATIONS
- Have strong fundamentals in Computer Science concepts like Cloud Computing Architecture, Distributed Computing, High-Velocity Data Processing, Lambda Architecture, etc
- Strong Data modeling and managing Distributed Computing Platforms for Data Processing.
- Advance knowledge of SQL and writing resource-efficient queries.
- Have at least 2+ years of professional programming experience in Python.
- Have at least 2+ years of experience in running a data processing pipelines on either of these: Google BigQuery, Redshift, Hadoop, Presto, Spark, or KSQL.
- Have at least 2+ years of experience in writing Sub-Second Real-Time pipelines using Google DataFlow(Apache Beam), PubSub, Kinesis Stream, Lamda, etc...
- Have a good understanding of how Kubernetes clusters work and scale on-demand.
- Have adequate experience using Containers for Data Engineering workload.
- Implemented manual or automated tools for Data Quality, Catalog, and Lineage.
- Uphold the sense of Frugality across Data Engineering teams.
- Have Good Interpersonal and Presentation Skills to explain and promote Best Practices across the organization with both technical as well as non-technical stakeholders.

  • Data Engineer(Cloud Migration)

    3 days ago

    Singapore NTT DATA Full time

    Requirements / Qualifications - Bachelor's or master's degree in computer science, data engineering, or a related field. - Minimum 7 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC. - Proficiency in programming languages such as Python, Java, or Scala for building data pipelines. - Evaluate...

  • Data Engineer

    3 days ago

    Singapore DOZER DATA PTE. LTD. Full time

    **About the job**: This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data. This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers. **Responsibilities**: In...

  • Data Engineer

    3 weeks ago

    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates may also send their resume via email to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Changi Business ParkRequirements:Min 3-4 years experience At least one year of...

  • Ms20220804 Data Engineer

    1 week ago

    Singapore NTT DATA Singapore PTE Ltd Full time

    Job Description - About Us - Roles and Responsibility **Job scopes**: - The Data Engineer will lead the enterprise-wide data transformations projects. The person will involve in developing and automating data processing pipelines for financial and Investment data modelling, analysis, and reporting from various data sources systems; The primary...

  • Chemical Process Optimization Engineer

    4 days ago

    Singapore The Chemical Engineer Full time

    The Chemical Engineer has an exciting opportunity for a Chemical Process Optimization Engineer to join their team in Singapore. This is a challenging role that requires a strong understanding of chemical processes and a passion for optimization.Key Responsibilities:• Develop and refine process formulations, methods, and controls to meet high-quality...

  • Data Engineer

    2 weeks ago

    Singapore TRIVI DATA CONSULTING PTE. LTD. Full time

    Key Responsibilities - Design, implement, and maintain ETL workflows for managing large-scale datasets. - Develop cloud-based data pipelines (AWS, Azure) for scalable and real-time analytics delivery. - Optimize data models to ensure high performance and reliable reporting. - Create advanced dashboards and visualizations using tools like Qlik Sense and...

  • Production Engineering Expert

    4 days ago

    Singapore The Chemical Engineer Full time

    Pfizer Singapore is recruiting a Production Engineering Expert to support the expansion of their manufacturing site. In this role, you will develop and refine process formulations, methods, and controls to meet high-quality standards.Key Responsibilities:• Develop and refine process formulations, methods, and controls to meet high-quality standards.•...

  • Process Engineer

    4 days ago

    Singapore The Chemical Engineer Full time

    Pfizer Singapore is recruiting permanent employees for manufacturing site expansion of Pfizer Asia Manufacturing Pte Ltd (PAMPL) in Singapore. Use Your Power for Purpose Whether you are involved in the design and development of manufacturing processes for products or supporting maintenance and reliability, engineering is crucial to ensuring that customers...

  • SME Support Engineer

    4 days ago

    Singapore Keppel (Data Centres and Networks Division) Full time

    About This Role:This SME Support Engineer position is focused on providing expert support for our data centre operations. The successful candidate will have a strong background in electrical and mechanical engineering, as well as experience working in data centre environments.Responsibilities:• Provide technical expertise to support the day-to-day...

  • Consultant / Data Engineer

    1 week ago

    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    **Job Highlights**: - Hybrid Mode & Work Life Balance - Attractive Benefits Package - Career Development Within a MNC Company **Company Overview**: **Job Description - Deliver end-to-end Business Intelligence, Analytics and Data Management solutions to customer - Work with the larger team in technical design sessions to define data definition, data and...

  • Manufacturing Process Specialist

    4 days ago

    Singapore The Chemical Engineer Full time

    The Chemical Engineer is seeking a highly skilled Manufacturing Process Specialist to join their team in Singapore. As a key member of the engineering team, you will play a critical role in accelerating the delivery of medicines to the world.Key Responsibilities:• Develop and refine process formulations, methods, and controls to meet high-quality...

  • Ts Implementation Engineer

    2 weeks ago

    Singapore NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...

  • Process Development Professional

    4 days ago

    Singapore The Chemical Engineer Full time

    The Chemical Engineer is looking for a Process Development Professional to join their team in Singapore. In this role, you will develop and refine process formulations, methods, and controls to meet high-quality standards.Key Responsibilities:• Develop and refine process formulations, methods, and controls to meet high-quality standards.• Recommend and...

  • Senior Process Development Scientist

    4 days ago

    Singapore The Chemical Engineer Full time

    POSITION SUMMARY Will serve as a laboratory based member of the Technical Services team providing chemistry and process related technical support to OSP, Technology Transfers, changeover cleaning and solvent recovery sections. POSITION RESPONSIBILITIES Design and conduct laboratory scale experiments and analysis with minimal supervision to support plant...

  • Data Business Analyst

    1 week ago

    Singapore NTT Data Singapore Full time

    Responsibilities: - Installation of SQL Server / Oracle - Creation of new database - Database Instance Hardening, Patching on identification of Vulnerabilities - Configuration and Testing of Backup-Restore scripts - Configuration of AOAG (SQL Server) / DataGuard (Oracle) - Testing of AOAGroup/Instance Switchover to D.R. and Switchback to PROD - Migration of...

  • Manager, Electrical Engineering, Apac

    1 week ago

    Singapore Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience. Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and...

  • Manager, Mechanical Engineering, Apac

    1 week ago

    Singapore Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience. Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and...

  • Full Stack Engineer

    1 week ago

    Central Singapore Singularity Data Full time

    **One-line description** Design and implement RisingWave Cloud. **What will you will be working on after joining our company?** - Implement cross-platform web-based features, user interfaces, and services for enterprise-grade cloud platforms; **What are the essential skills?** - BS/MS in Computer Science or a related technical field preferred; - Strong...

  • Senior Mechanical Engineer

    1 week ago

    Singapore Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience. Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and...

  • Cross Technology Service Delivery Field Support Engineer

    5 days ago

    Singapore NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...