Data Engineer

3 weeks ago

Singapur, Singapore Krisvconsulting Services Pte Ltd Full time

Key Responsibilities:

  • Create Spark Scala/PySpark jobs for data transformation and aggregation.
  • Produce unit tests for Spark transformations and helper methods.
  • Use Spark and Spark-SQL to read parquet data and create tables in Hive using the Scala API.
  • Work closely with Business Analysts to review test results and obtain sign-off.
  • Prepare necessary design and operations documentation for future use.
  • Perform peer code quality reviews and ensure compliance with quality standards.
  • Engage in hands-on coding, often in a pair programming environment.
  • Collaborate with teams to build quality code and ensure smooth production deployments.

Requirements:

  • 4-10 years of experience as a Hadoop Data Engineer, with strong expertise in Hadoop, Spark, Scala, PySpark, Python, Hive, Impala, CI/CD, Git, Jenkins, Agile Methodologies, DevOps, and Cloudera Distribution.
  • Strong knowledge of data warehousing methodologies.
  • Minimum of 4 years of relevant experience in Hadoop and Spark/PySpark.
  • Strong understanding of enterprise data architectures and data models.
  • Experience in the core banking and finance domains.
  • Familiarity with Oracle, Spark streaming, Kafka, and machine learning.
  • Good to have cloud experience, particularly with AWS.
  • Ability to develop applications using the Hadoop tech stack efficiently and effectively, ensuring on-time, in-specification, and cost-effective delivery.

  • Transmission Network Engineer

    4 days ago

    Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Associate Infrastructure Engineering and Operations Engineer

    2 weeks ago

    Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Network and Security Engineer

    1 week ago

    Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Associate SRE Engineer

    7 days ago

    Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Associate DevOps Engineer

    7 days ago

    Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Senior DevOps Engineer

    3 days ago

    Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Network & Security Engineer (L2)

    2 weeks ago

    Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Network & Security Engineer (L3)

    4 days ago

    Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Associate Infrastructure Engineering and Operations Engineer

    2 weeks ago

    Singapur, Singapore NTT DATA Full time

    Job Description Want to be a part of our team?A Senior Associate Network Engineer is a developing technical professional responsible for leveraging their networking skills and experience to support, design, and optimise NTT's network infrastructure. This role works closely with network engineers, architects, and cross-functional teams to ensure the...

  • Senior Associate Infrastructure Engineering and Operations Engineer

    3 weeks ago

    Singapur, Singapore NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Networking Service Delivery Field Support Engineer

    2 weeks ago

    Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Security and Operations Engineers-L3

    2 weeks ago

    Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Associate DevOps Engineer

    4 weeks ago

    Singapur, Singapore NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Data Engineer

    2 weeks ago

    Singapur, Singapore Nityo Infotech Full time

    Responsibilities:•Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives•Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions•Ensure data quality and integrity throughout the data processing...

  • Cross Technology Managed Services Engineer

    4 days ago

    Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Transmission Network Engineer

    4 weeks ago

    Singapur, Singapore NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Transmission Network Engineer

    2 weeks ago

    Singapur, Singapore NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • TS Implementation Engineer L2

    2 weeks ago

    Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Machine Learning Engineer

    3 weeks ago

    Singapur, Singapore NTT Data Singapore Full time

    Job Description:Conduct reviews for compliance of the ML models in accordance with overall platform governance principles such as versioning, data / model lineage, code best practices and provide feedback to data scientists for potential improvementsDevelop pipelines for continuous operation, feedback and monitoring of ML models leveraging best practices...

  • Data Engineer

    1 hour ago

    Singapur, Singapore Amazon Asia-Pacific Holdings Private Limited - D43 Full time

    Do you want to contribute to a team working on cutting edge technology, solve new problems that didn’t exist before, and have the ability to see the impact of your successes?Amazon is shaping the future of digital video entertainment. We seek Data Engineers who can help us store, process and analyze vast amounts of data as we build products in the video...