Data Engineer

1 day ago


Singapore ARISTON SERVICES PTE. LTD. Full time
Roles & Responsibilities

Responsibilities:

· Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives

· Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions

· Ensure data quality and integrity throughout the data processing lifecycle

· Design and deploy data engineering solutions on OpenShift Container Platform (OCP) using containerization and orchestration techniques

· Optimize data engineering workflows for containerized deployment and efficient resource utilization

· Collaborate with DevOps teams to streamline deployment processes, implement CI/CD pipelines, and ensure platform stability

· Implement data governance practices, data lineage, and metadata management to ensure data accuracy, traceability, and compliance

· Monitor and optimize data pipeline performance, troubleshoot issues, and implement necessary enhancements

· Implement monitoring and logging mechanisms to ensure the health, availability, and performance of the data infrastructure

· Document data engineering processes, workflows, and infrastructure configurations for knowledge sharing and reference

· Stay updated with emerging technologies, industry trends, and best practices in data engineering and DevOps

· Provide technical leadership, mentorship, and guidance to junior team members to foster a culture of continuous learning and innovation to the continuous improvement of the analytics capabilities within the bank


Requirements:

· Proven experience as a Data Engineer, working with Hadoop, Spark, and data processing technologies in large-scale environments

· Strong expertise in designing and developing data infrastructure using Hadoop, Spark, and related tools (HDFS, Hive, Pig, etc)

· Experience with containerization platforms such as OpenShift Container Platform (OCP) and container orchestration using Kubernetes

· Proficiency in programming languages commonly used in data engineering, such as Spark, Python, Scala, or Java

· Knowledge of DevOps practices, CI/CD pipelines, and infrastructure automation tools (e.g., Docker, Jenkins, Ansible, BitBucket)

· Experience with Graphana, Prometheus, Splunk will be an added benefit

· Strong problem-solving and troubleshooting skills with a proactive approach to resolving technical challenges

· Excellent collaboration and communication skills to work effectively with cross-functional teams

· Ability to manage multiple priorities, meet deadlines, and deliver high-quality results in a fast-paced environment

· Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services is a plus


Tell employers what skills you have

Machine Learning
Scala
Kubernetes
OpenShift
Azure
DevOps
Pipelines
Azure DevOps
Hadoop
Data Transformation
Data Quality
Data Governance
Data Engineering
Python
Docker
Metadata
Java
Orchestration
Data Analytics
  • Data Engineer

    4 weeks ago


    Singapore NTT Data Singapore Full time

    Job SummaryWe are seeking a highly skilled and experienced Big Data Engineer to join our team at NTT Data Singapore. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments, such as Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/Senior Consultant preferably.Key...

  • Data Engineer

    4 weeks ago


    Singapore NTT Data Singapore Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team at NTT Data Singapore.Key ResponsibilitiesAnalyze the Authority's data needs and document the requirements.Refine data collection/consumption by migrating data collection to more efficient channels.Plan, design and implement data engineering jobs and reporting solutions...


  • Singapore NTT Data Singapore Full time

    Requirements We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. The ideal candidate will have a Bachelor's degree in Computer Science or a related field and at least 7 years of IT experience, with a minimum of 5 years in a similar role. Proficiency in distributed computing principles and strong experience with Hadoop,...


  • Singapore NTT Data Singapore Full time

    Job Requirements We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. The ideal candidate will have a Bachelor's degree in Computer Science or a related field and at least 7 years of IT experience, with a minimum of 5 years in a similar role. Key Responsibilities • Proficient understanding of distributed computing...

  • Data Scientist

    4 weeks ago


    Singapore NTT Data Singapore Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore.Key Responsibilities:Design and develop large-scale data processing systems using Hadoop and Spark.Implement data pipelines using Spring Boot and integrate data from multiple sources.Develop and maintain data warehouses using NoSQL databases such as HBase and...


  • Singapore DATA CONNECT TECHNOLOGIES PTE. LTD. Full time

    Technical Consultant RoleAt DATA CONNECT TECHNOLOGIES PTE. LTD., we are seeking a skilled Technical Consultant to join our team. The ideal candidate will possess a strong understanding of systems administration, networking protocols, and cybersecurity principles.Pre-Sales Technical ServicesAssist potential clients in understanding our suite of products and...

  • Data Engineer

    1 month ago


    Singapore Cognizant Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Cognizant. As a Data Engineer, you will be responsible for designing, developing, and deploying large-scale data pipelines and architectures to support our business needs.Key Responsibilities:Data Pipeline Development: Design, build, and maintain efficient and reliable...

  • Data Engineer

    1 day ago


    Singapore NEURONES IT ASIA PTE. LTD. Full time

    Roles & ResponsibilitiesAs a Data Engineer, Your main responsibilities will include: Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data. Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data. Optimize and tune Spark...

  • Data Engineer

    1 day ago


    Singapore SYNECHRON TECHNOLOGIES SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities:· Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives· Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions· Ensure data quality and integrity...

  • Data Engineer

    1 day ago


    Singapore HTC SOFTWARE SINGAPORE PTE LTD Full time

    Roles & ResponsibilitiesWe are seeking a talented Data Engineer experience in Quantexa with expertise in Hadoop, Scala, Spark, Elastic, Open Shift Container Platform (OCP) and DevOps practices.As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.You will...

  • Data Engineer

    1 month ago


    Singapore SINGAPORE SHELL EMPLOYEES' UNION CO-OPERATIVE LTD Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at SINGAPORE SHELL EMPLOYEES' UNION CO-OPERATIVE LTD. As a Data Engineer, you will play a critical role in designing and implementing data solutions that drive business growth and innovation.Key Responsibilities:Design and develop data pipelines to extract, transform, and...

  • Data Engineer

    1 day ago


    Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesWe are seeking a skilled and motivated Intermediate Data Engineer to join our dynamic team. The successful candidate will play a crucial role in designing, developing, and maintaining our data infrastructure, ensuring efficient processing and analysis of large datasets. As an Intermediate Data Engineer, you will collaborate with...

  • Data Engineer

    1 day ago


    Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesJob DescriptionWe are seeking a skilled and motivated Intermediate Data Engineer to join our dynamic team. The successful candidate will play a crucial role in designing, developing, and maintaining our data infrastructure, ensuring efficient processing and analysis of large datasets. As an Intermediate Data Engineer, you will...

  • Data Engineer

    1 day ago


    Singapore JCO ANALYTICS PTE. LTD. Full time

    Roles & ResponsibilitiesJob Title: Data EngineerLocation: Tai Seng, SingaporeJob Type: Full-TimeOverview:We are looking for a fresh graduate (degree or diploma) Data Engineer to join our growing team. In this role, you will design, build, and maintain data pipelines and infrastructure to support the collection, storage, and analysis of large volumes of data....

  • Data Engineer

    1 month ago


    Singapore MAESTRO HUMAN RESOURCE PTE. LTD. Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our product development team at MAESTRO HUMAN RESOURCE PTE. LTD. As a key member of our team, you will be responsible for designing and implementing data integration pipelines and asynchronous data events using event-driven architecture approaches to consolidate data from various sources and...

  • Data Engineer

    1 day ago


    Singapore NICOLL CURTIN TECHNOLOGY PTE. LTD. Full time

    Roles & ResponsibilitiesKey Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and Python. Collaborate with data scientists, analysts, and other engineers to ensure efficient data flow and processing. Manage and optimize data workflows in AWS cloud environments. Ensure data quality through data...

  • Data Engineer

    21 hours ago


    Singapore ABS CONNECT PTE. LTD. Full time

    Data Engineer Job at ABS CONNECT PTE. LTD.Are you looking for a challenging role in data engineering? We are seeking a skilled Data Engineer to join our team at ABS CONNECT PTE. LTD. As a Data Engineer, you will be responsible for designing and building robust and scalable data ingestion and data management solutions for batch loading and streaming from data...

  • Data Engineer

    3 weeks ago


    Singapore Cognizant Full time

    Job Title: Data EngineerCognizant is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and deploying data tables, views, and marts in data warehouses, operational data stores, data lakes, and data virtualization.Key Responsibilities:Data Engineering: Design and develop efficient...

  • Data Engineer

    1 day ago


    Singapore PEOPLEBANK SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesData Engineer 6 months contract with a possibility of extension Work location: CBDOur Client MNC IT companyThe Opportunity Work across workstreams to support data requirements including reports and dashboards Analyze and perform data profiling to understand data patterns and discrepancies following Data Quality and Data...

  • Data Engineer

    1 day ago


    Singapore AZENDIAN SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesJob Responsibilities: Conduct data analysis and generate performance reports for estate sub-systems. Develop data processes workglows and analytics programs. Build Machine Learning algorithms and apply statistical methods to extract insights for Smart Estate applications. Extract data from existing Building Management Systems...