Data Engineer

3 weeks ago


Singapore ARGYLL SCOTT CONSULTING PTE. LTD. Full time
Roles & Responsibilities

We are looking for Data Engineer to support our project in Singapore. This is a 2 year contract role.


The Data Engineer will support the development and maintenance of the global AI sandbox, development of cutting-edge AI solutions, R&D, and provide technical guidance and support in the data domain to the teams under incubation that develop AI Products.

The role requires a strong technical background in Data Engineering, AI, and modern Cloud infrastructure, excellent technical skills, and the ability to collaborate with both internal and external stakeholders across technology, AI, and business to deliver impactful AI products. The Data Engineer will work on the delivery of high-quality data infrastructure, continuous improvement, and experimentation, and development of the company’s data expertise.


Key Responsibilities:

In this role, you will be an active member of the AI Lab, playing the role of Data Engineer to support the implementation of solutions built in AI labs:

  • Build data pipelines to bring in wide variety of data from multiple sources within the organization as well as from relevant 3rd party sources.
  • Collaborate with cross functional teams to source data and make it available for downstream consumption.
  • Work with the team to provide an effective solution design to meet business needs.
  • Ensure regular communication with key stakeholders, understand any key concerns in how the initiative is being delivered or any risks/issues that have either not yet been identified or are not being progressed.
  • Ensure timelines (milestones, decisions, and delivery) are managed and value of initiative is achieved, without compromising quality and within budget.
  • Ensure an appropriate and coordinated communications plan is in place for initiative execution and delivery, both internal and external.

Qualifications:

  • Strong technical background in data, AI, and modern cloud infrastructure.
  • Excellent programming skills in languages such as Python, SQL.
  • Experience with Cloud Infra providers like Azure data bricks, Google cloud platform or AWS
  • Experience in building data pipelines using batch processing with Apache Spark (Spark SQL, Dataset / Dataframe API) or Hive query language (HQL)
  • Knowledge of Big data ETL processing tools
  • Experience with Hive and Hadoop file formats (Avro / Parquet / ORC)
  • Basic knowledge of scripting (shell / bash)
  • Experience of working with multiple data sources including relational databases (SQL Server / Oracle / DB2 / Netezza), NoSQL / document databases, flat files
  • Basic understanding of CI CD tools such as Jenkins, JIRA, Bitbucket, Artifactory, Bamboo and Azure Dev-ops.
  • Basic understanding of DevOps practices using Git version control
  • Ability to debug, fine tune and optimize large scale data processing jobs

Argyll Scott Consulting Pte Ltd


Tell employers what skills you have

Git
Apache Spark
Oracle
Azure
Big Data
Pipelines
Hadoop
Google Cloud Platform
Scripting
ETL
Data Engineering
SQL
SQL Server
Python
Netezza
Databases

  • Singapore NTT Data Singapore Full time

    NTT Data Singapore is seeking a highly skilled Data Engineer to join our team. This role will be responsible for designing, developing, and maintaining large-scale data systems.Job Description:Key Responsibilities: Design, develop, and maintain large-scale data systems using Scala programming and functional programming principles. Collaborate with...


  • Singapore NTT Data Singapore Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore.This is an excellent opportunity for someone with experience in big data technologies to take their career to the next level and work on challenging projects.ResponsibilitiesDesign, develop, and deploy large-scale data processing systems using Hadoop ecosystem...


  • Singapore ECF Data, LLC Full time

    Description: Location: Singapore Budget : 8000 -10000Responsibilities: 1. Drive analytic projects for all pillars of the bank’s treasury and markets department, such as bond analytics, news generation FX trading signals, product recommendation and customer hyper-personalization. 2. Conduct literature review and evaluate trade-offs between different...


  • Singapore Aboitiz Data Innovation Full time

    Aboitiz Data Innovation (ADI)is one of the leading up and coming start-ups in the field of Data Science and Artificial Intelligence. We believe data can drive change for a better world by advancing businesses across industries and communities. We are looking for 2 x Mid-Senior Data Scientists to develop and deploy multiple machine learning models leveraging...


  • Singapore Tech Data Full time

    Job Purpose: The Services Engagement Manager is responsible for achieving sales and profit targets for Professional Services offerings related to the products TechData distributes while ensuring exceptional service delivery. This role balances Professional Services sales with Service Delivery, focusing on relationships with TechData's extended sales...


  • Singapore TRIVI DATA CONSULTING PTE. LTD. Full time

    Unlock Business Potential with Data Engineering ExpertiseWe are seeking a seasoned Data Engineer to join our team at NITYO PROGRESSION CONSULTANCY PTE. LTD. The ideal candidate will have a proven ability to design scalable data pipelines, implement machine learning models, and deliver data-driven solutions that optimize decision-making processes.About the...

  • Data Scientist

    3 weeks ago


    Singapore Aboitiz Data Innovation (ADI) Remote Work Freelance Full time

    Aboitiz Data Innovation (ADI) is one of the leading up and coming start-ups in the field of Data Science and Artificial Intelligence. We believe data can drive change for a better world by advancing businesses across industries and communities.We are looking for 2 x Mid-Senior Data Scientists to develop and deploy multiple machine learning models leveraging...


  • Singapore NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Application Management...

  • Cloud Data Architect

    3 weeks ago


    Singapore NTT Data Business Solutions Singapore Pte Ltd Full time

    Your career at NTT DATA Business Solutions Empowering You – to feel our passion for SAP / Analytic Solutions As NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on their journey to becoming intelligent...

  • Data Engineer

    3 weeks ago


    Singapore SMRT Corporation Ltd Full time

    Job PurposeAs a Data Engineer, you will be a key player in building and maintaining the robust data infrastructure that underpins our railway operations. You will design, develop, and optimize data pipelines to ingest, process, and transform data from diverse sources, including laser measurement systems, photo imaging, and maintenance records. Your expertise...


  • Singapore BRIDGE DATA CENTRES (INTERNATIONAL) PTE. LTD. Full time

    OverviewBridge Data Centres (International) Pte. Ltd. is a leading provider of hyperscale and wholesale data centre solutions in the Asia-Pacific region.Job DescriptionWe are seeking an experienced Business Development Director to drive our expansion in Asia, focusing on new business development, strategic partnerships, and exceptional service delivery.The...

  • Cloud Data Architect

    3 weeks ago


    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic SolutionsAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on their journey to...

  • Cloud Data Architect

    4 weeks ago


    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic SolutionsAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on their journey to...


  • Singapore NTT Data Full time

    Qualifications and Responsibilities Duties include providing support to client perimeter security infrastructure, which includes firewall , proxy , and remote access systems . Investigation, documentation, and resolution of outages to critical business systems that may be caused by firewall, proxy, or remote access systems. Escalation of issues and tracking...


  • Singapore NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Network-Routing System Integration Specialist Company: NTT DATA Services NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking...

  • Data Engineer

    1 month ago


    Singapore TOTAL EBIZ SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesAs a Data Engineer, you will be required to:•Perform data extraction, cleaning, transformation, and flow.•Design, build, launch and maintain efficient and reliable large-scale batch and realtime data pipelines with data processing frameworks.•Integrate and collate data silos in a manner which is both scalable and compliant. ...

  • Data Engineer

    4 months ago


    Singapore ADOMITA TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJD:"Proficiency with SQLBuilding data pipelines and architectureShould have extensive experience with relational and NO-SQL databasesShould have proficiency in handling both structured and unstructured data sourcesStrong experience deploying applications to cloud platforms like Azure, AWSInterest in building efficient batch and...

  • Data Engineer

    4 weeks ago


    Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJD:o Good programming skills in Pythono Must possess experience or interest in training and deploying machine learning models end to end.o Good understanding of basic statistics and deep learning techniqueso Prior experience in data integration, profiling, validation and cleansingo Proficiency with SQL· Software deliveryo Strong...

  • Data Engineer

    3 weeks ago


    Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJD:o Good programming skills in Pythono Must possess experience or interest in training and deploying machine learning models end to end.o Good understanding of basic statistics and deep learning techniqueso Prior experience in data integration, profiling, validation and cleansingo Proficiency with SQL· Software deliveryo Strong...

  • Data Engineer

    2 months ago


    Singapore VUI SYSTEMS PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilites Design, develop, and maintain robust data pipelines and architectures.Collaborate with cross-functional teams to integrate data from various sources. Implement and manage CI/CD processes to ensure smooth deployments. Optimize Snowflake database performance and ensure efficient data storage. Utilize Azure Data...