Data Engineer

3 weeks ago

Singapore Thales Dis (singapore) Pte. Ltd. Full time

As a Data Engineer in AIR Lab, you should be someone who enjoys designing, discussing topics around processing patterns like data quality control, streaming SQL, data sources/sinks and data synchronization streaming-backfill, stream-to-stream joins etc. You should be someone who cares about the quality of the technical implementation and delivery as much as you care about the quality of delivery. You should be someone who enjoys working in a team of diverse people with multiple ethnic and cultural backgrounds. You should be someone who enjoys diving into the technical details of figuring out a problem and be able to communicate the solution back to the team so that the members can learn from it. You should be someone who loves learning new technologies and find innovative ways to apply newfound knowledge and be courageous to encourage fellow team members to be like YOU and enjoy participating in all aspects of engineering activities in the AIR Lab.

Responsibilities:

  • Improve and maintain the DataLake cybersecurity posture with regards to data governance and cybersecurity standards by working with other stakeholders (e.g., Data Architect, Data Assessment Office, Cybersecurity Office).
  • Improve and maintain the DataLake service levels for reliable data flow, health of infrastructure (i.e., compute and storage).
  • Improve and maintain the total-cost of ownership of the DataLake this activity includes raising efficiencies around FinOps, CloudOps.
  • Improve and maintain the architecture transforming data between the DataLake and a distributed search and analytics engine (e.g., ElasticSearch)
  • Lead the technical evolution of the DataLake by conducting the following activities (non-exhaustively) exploring new methods, techniques, algorithms (e.g., data meshes, AI/MLOps infrastructure).
  • Improve and maintain the data model, data catalogue (e.g., event data, batched data, persisted, ephemeral).
  • Work with the Data Architect to effect best practices to the engineering organization.
  • To implement features by defining test, develop feature and associated automated tests. If appropriate, implement security tests and load tests.
  • Write and review the necessary technical and functional documentation in documentation repositories (e.g., backstage.io, JIRA, READMEs).
  • Work in an agile, cross-functional multinational team, actively engaging to support the success of the team.

Requirements:

Education

  • Bachelors in Computer Science or Information Technology
  • Master's degree in Computer Science or Data Science, if applicable

Essential Skills/Experience

  • Proficiency in designing, implementing ETL data pipelines (with structured or unstructured data) using the frameworks like Apache Dataflow/Apache Beam, Apache Flink proficient in deploying ETL pipelines into Kubernetes cluster in Azure cloud either as virtual machines or containerized workloads.
  • Proficiency in designing, implementing data lifecycle management using scalable object-storage systems like MinIO (e.g., tiering, object expiration, multi-nodal approach)
  • Proficiency in programming languages in Java, Kotlin with a focus around design and development for scalable applications with microservices and monolith approaches.
  • Proficiency in developing performant abstract data structures (e.g., deterministic data lookups versus heuristic data lookups) able to conduct independent research of methods, techniques and algorithms.
  • Demonstrated application of working with Continuous Integration and/or Continuous Delivery models you are expected to be familiar with using Linux (e.g., shell commands)
  • Proficiency in distributed source code management tools like GitLab, Github and practice GitOps
  • With respects to ETL pipelines, you are expected to demonstrate proficiency in the following.
  1. pipeline configuration using Gitlab
  2. environment management using Gitlab it's a bonus if you have demonstrated experience in deployment management (e.g., canary, blue/green rollouts) using Gitlab
  • Familiar with cloud deployment strategies to public clouds (e.g., Azure Cloud, AWS, GCP) and Kubernetes using virtualized and containerized workloads (e.g., Kaniko, Docker, Virtual Machine)
  • Good communication skills in English

Desirable Skills/Experience

  • Working knowledge of designing application with a 'shift-left' cybersecurity approach.
  • Working knowledge of other languages (e.g., Python3, Scala2 or Scala3, Go, TypeScript, C, C++17, Java17)
  • Implement event-driven processing pipelines using frameworks like Apache Kafka, Apache Samza
  • Familiar with the cloud deployment models (e.g., public, private, community and hybrid)
  • Familiar with the main cloud service models: Software as a Service, Platform as a Service and Infrastructure as a Service.
  • Familiar with designing and/or implementing AI/MLOps pipelines in public cloud (e.g., Azure, AWS, GCP)

Essential / Desirable Traits

  • Possess learning agility, flexibility and pro-activity
  • Comfortable with agile teamwork and user engagement

  • Data Engineer

    3 weeks ago

    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates, please email your resume to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 2 years Renewable contractExperience: Minimum of 5 yearsLocation : Tanjong PagarBenefits: Renewable contract (Performance-based, with possibility of conversion to...

  • Data Engineer

    3 weeks ago

    Singapore Ntt Data Singapore Pte. Ltd. Full time

    ' EMAIL ID : Interested candidates, please email your resume to [HIDDEN TEXT]Only shortlisted candidates would be contacted for interview.Role: Data Engineer - 2 years Renewable contractExperience: Minimum of 5 yearsLocation : Tanjong PagarBenefits:Renewable contract (Performance-based, with possibility of conversion to perm)Medical Insurance CoverageLeave...

  • Data Centre Operations Technology

    4 weeks ago

    Singapore Bridge Data Centres (international) Pte. Ltd. Full time

    Key Responsibilities:. Conduct in-depth design reviews and oversee the commissioning/Integrated Systems Testing (IST) processes for new data centre projects, as well as modifications and expansions to existing data centres. Enhance and standardize data centre operation and maintenance policies and procedures to ensure efficiency and compliance. Perform...

  • Nlp And Text Classfication Ml Engineering

    1 month ago

    Singapore DATA DISTINCTION Full time

    b'This description is supported by a more extensive requirements document. Overview We are looking to establish a text classification model that will create a mapping between a dictionary (JSON) of trip types with locales or destinations which are individually described in "articles" in Wiki Voyage. There are three specific outcomes that can be achieved...

  • Nlp And Text Classfication Ml Engineering

    3 weeks ago

    Singapore DATA DISTINCTION Full time

    b'This description is supported by a more extensive requirements document. Overview We are looking to establish a text classification model that will create a mapping between a dictionary (JSON) of trip types with locales or destinations which are individually described in "articles" in Wiki Voyage. There are three specific outcomes that can be achieved...

  • Data Engineer

    5 days ago

    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...

  • Data Engineer

    3 weeks ago

    Singapore Ntt Data Business Solutions Singapore Pte. Ltd. Full time

    Your career at NTT DATA Business SolutionsEmpowering You - to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on their journey to becoming...

  • Data Engineer

    1 week ago

    Singapore ASE SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesAs a Data Engineer assigned to the Test/Product Department, you will be working with various internal teams to develop Smart Engineering solutions through Artificial Intelligence and Machine Learning.Responsibilities: Work with Test/Product Engineers, Process and Equipment Engineers, IT and other relevant departments collaboratively...

  • Data Engineer

    1 day ago

    Singapore AIRWALLEX (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesThe Role:In 2024, the global data team is actively scaling up, and we're eager to explore more talents to join our R&D centers in Singapore and Shanghai. Your contribution will play a pivotal role in steering the data team into the next step - the era of AI in Airwallex.As a data engineering expert, you'll delve into various facets of...

  • Data Engineer

    3 weeks ago

    Singapore Ase Singapore Pte. Ltd. Full time

    As a Data Engineer assigned to the Test/Product Department, you will be working with various internal teams to develop Smart Engineering solutions through Artificial Intelligence and Machine Learning.Responsibilities:Work with Test/Product Engineers, Process and Equipment Engineers, IT and other relevant departments collaboratively to develop data science...

  • Data Engineer

    2 weeks ago

    Singapore SUNRAY WOODCRAFT CONSTRUCTION PTE LTD Full time

    Roles & ResponsibilitiesResponsibilities:● Design, construct, install, test, and maintain highly scalable data management systems.● Ensure systems meet business requirements and industry practices.● Build high-performance algorithms, prototypes, predictive models, and proof of concepts.● Research opportunities for data acquisition and new uses for...

  • Data Engineer

    1 week ago

    Singapore INNOCELLENCE SYSTEMS PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description:We are looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data. As a Data Engineer, you will work closely with data...

  • Data Engineer

    3 weeks ago

    Singapore GRASSHOPPER PTE. LTD. Full time

    Roles & ResponsibilitiesWe seek a Data engineer to support our high frequency trading activities and quantitative research. At Grasshopper we recognise that effective research and trading strategies are built upon solid foundations in the collection, storage, and service of data. Grasshopper trades at a number of exchanges globally and we are looking for an...

  • Data Engineer

    3 weeks ago

    Singapore VANGUARD SOFTWARE PTE. LTD. Full time

    Roles & ResponsibilitiesJOB SUMMARYWe are looking for a skilled and experienced Data Engineerto join our growing team. The ideal candidate will be responsible for designing, building, and maintaining scalable and efficient data pipelines, databases, and data infrastructure. You will work closely with our data scientists, analysts, and software engineers to...

  • Data Engineer

    3 weeks ago

    Singapore Vanguard Software Pte. Ltd. Full time

    JOB SUMMARYWe are looking for a skilled and experienced Data Engineerto join our growing team. The ideal candidate will be responsible for designing, building, and maintaining scalable and efficient data pipelines, databases, and data infrastructure. You will work closely with our data scientists, analysts, and software engineers to support data-driven...

  • Data Engineer

    4 weeks ago

    Singapore Cognizant Full time

    Do you have software developer experience, and are you seeking a new job in Singapore? Cognizant is looking for a Data Engineer, and the full-time role comes with an attractive salary and benefits package.As a Data Engineer, you will design, develop and implement data-processing pipelines to process large volumes of structured and unstructured data....

  • Data Engineer

    7 days ago

    Singapore Innocellence Systems Pte. Ltd. Full time

    Job Description:We are looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data. As a Data Engineer, you will work closely with data scientists and software...

  • Data Engineer

    2 weeks ago

    Singapore Sunray Woodcraft Construction Pte Ltd Full time

    Responsibilities:. Design, construct, install, test, and maintain highly scalable data management systems.. Ensure systems meet business requirements and industry practices.. Build high-performance algorithms, prototypes, predictive models, and proof of concepts.. Research opportunities for data acquisition and new uses for existing data.. Develop data set...

  • Data Engineer

    2 days ago

    Singapore IKAS INTERNATIONAL (ASIA) PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking to speak with Data Engineers:Responsibilities:· Data Pipeline Development: Develop and maintain data pipelines that extract, transform, and load (ETL) data from various sources into a centralized data storage system, such as a data warehouse or data lake.· Data Integration: Integrate data from multiple sources and...

  • Data Engineer

    4 weeks ago

    Singapore AZENDIAN SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesJob Responsibilities: Responsible for data analysis and generate reports for estate sub-system performance. Develop data set processes. Develop analytics programs, machine learning algorithms, and use statistical methods to make raw data useful for smart estate application. Extracting data from existing Building Management Systems...