Data Engineer

1 week ago

Singapore ONE NORTH AI PTE. LTD. Full time
Roles & Responsibilities

One North, a Singapore based firm specializing in providing AI based Technology Solutions is currently hiring Data Engineers with about 5+ years of experience as per details given below.

Skills & Responsibilities: -

As Data Engineer, you will focus on managing the Hadoop cluster, implementing data ingestion framework designing data models.

Your primary role will be to implement data lake & transform the data for business use.

  • Experience with at least one Cloud Infra provider (Azure/AWS)
  • Experience in building data pipelines using batch processing with Apache Spark (Spark SQL, DataSet / Dataframe API) or Hive query language (HQL)
  • Knowledge of Big data ETL processing tools
  • Write SQL scripts to test ETL results
  • Write scripts to regression test the ETL iterations already completed
  • Experience with Hive and Hadoop file formats (Avro / Parquet / ORC)
  • Basic knowledge of scripting (shell / bash)
  • Experience with CI CD tools such as Jenkins, JIRA, Bitbucket, Artifactory, Bamboo and Azure Dev-ops.
  • Understanding of DevOps practices using Git version control
  • Debug, fine tune and optimize large scale data processing jobs
  • Deliver big data solutions based on premise Hadoop or cloud-based systems like AWS.
  • Manage Hadoop cluster, participate in scale out planning & implementation.
  • Design ingestion layer for structured & unstructured data (text, voice, xml etc)
  • Implement specific data model for business & analytics use.
  • Deliver ELT solution including data extraction, transformation, cleansing, data integration and data management.
  • Augment with new sources of data including internal/external untapped data.
  • Contribute to the establishment and maintenance of cloud computing platform and big data services.
  • Provide support for analytics tools & environment like RServer etc & debug performance issues.

Competencies :-

  • Databases: RDBMS, SQL programming
  • ETL and Data Integration Tools: Azure Data Factory (ADF), Microsoft SQL Server Integration Service(SSIS), SAS Data Integration
  • Big Data: Hadoop (Hortonworks), Hive, Spark, Sqoop, etc
  • Programming and Scripting: Linux/Unix Shell Scripting, Java, Scala, Hive QL
  • BI/Dashboarding: SAS Visual Analytics, Qliksense

Working Experience :-

  • 5+ years (no upper limit) in data engineering and modelling.
  • Hands-on in MS SQL. Should be an expert in MS SQL queries and scripting.
  • Hands-on experience in testing ETL systems is mandatory
  • Hands-on in managing data mapping, data quality and integrity, performance in data processing.
  • Develop and implement techniques and analytics applications to transform raw data into meaningful information
  • Experience in Agile software development.
  • Candidate should be able to create executable scripts for regression testing purposes
  • Experience in testing SSIS ETL mappings is good to have
  • Visualise, interpret, and report data findings and may create dynamic data reports as well
Tell employers what skills you have

Apache Spark
Jenkins
Scala
Azure
Big Data
Bitbucket
Azure DevOps
AWS
Hadoop
Data Management
ETL
Data Engineering
SQL
JIRA
Artificial Intelligence Application
Hive
Unix Shell Scripting
Java
SSIS
Sqoop

  • Data Engineer

    7 days ago

    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates may also send their resume via email to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Changi Business ParkRequirements:Min 3-4 years experience At least one year of...

  • Data Engineer

    4 weeks ago

    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...

  • Data Engineer

    4 weeks ago

    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...

  • Data Engineer

    7 days ago

    Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities•Bachelor's Degree in Computer Science or equivalent;•Minimum 4+ years of experience in data engineering or software engineering.•Possess a solid foundation in Computer Science concepts such as Distributed Computing, High-Velocity Data Processing, and Lambda Architecture;•Proficient in Data modeling and...

  • Data Engineer

    4 weeks ago

    Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description:We are looking for a skilled Data Engineer to join our team and support our data-driven initiatives. The ideal candidate should have strong technical expertise in Informatica, SQL, and .NET, along with experience in data engineering, migration, and analysis.Key Responsibilities:Design, develop, and maintain data...

  • Data Engineer

    4 weeks ago

    Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesJob DescriptionBachelor's Degree in Computer Science or equivalent; Minimum 5 years of experience in data engineering or software engineering; Possess a solid foundation in Computer Science concepts such as Distributed Computing, High-velocity Data Processing, and Lambda Architecture; Proficient in Data modeling and managing...

  • Data Engineer

    2 weeks ago

    Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesSummaryYou will be developing banking applications and supporting production environments.Responsibilities:Bachelor's Degree in Computer Science or equivalent; Minimum 4+ years of experience in data engineering or software engineering. Possess a solid foundation in Computer Science concepts such as Distributed Computing,...

  • Data Engineer

    4 weeks ago

    Singapore GREEN LINK DIGITAL BANK PTE. LTD. Full time

    Roles & ResponsibilitiesAbout UsGreen Link Digital Bank is Singapore's inaugural wholesale digital bank focusing on supply chain finance, mainly serving MSMEs and aiming to help MSMEs grow and improve digitization.We are seeking a talented and driven Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and...

  • Data Engineer

    2 weeks ago

    Singapore INNOCELLENCE SYSTEMS PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data. As a Data Engineer, you will work closely with data scientists and...

  • Data Engineer

    3 weeks ago

    Singapore MAESTRO HUMAN RESOURCE PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description & RequirementsWe are looking for aspiring Data Engineer/Software Developer to join our product development team, you will be responsible for the design and implementation of data integration pipeline and asynchronous data event using event driven architecture approach to consolidate data from various sources and...

  • Data Engineer

    4 weeks ago

    Singapore TALENTSIS PTE. LTD. Full time

    Roles & ResponsibilitiesCompany's Profile:Our client is an international technology and engineering company that specialises in providing innovative digital and security solutions to their esteemed clients. They are well-known for their dedication of quality delivery standards with more than 15,000 engineers globally supporting projects. They have an...

  • Data Engineer

    3 weeks ago

    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full time

    Roles & ResponsibilitiesJob Title: Data Engineer - Mid-level/SeniorLocation: Singapore (CBD)Job Type: Full-Time PermanentKey Responsibilities:Design and maintain scalable ETL pipelines using Informatica. Optimize SQL queries and stored procedures for data manipulation. Lead data migration projects ensuring data integrity and quality. Collaborate with...

  • Data Engineer

    4 weeks ago

    Singapore YOUZU (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking for a skilled and motivated Data Engineer to join our team. You will play a key role in designing, maintaining, and expanding our data pipelines while actively shaping the future of our BI system. If you are passionate about data engineering, ETL processes, and driving business insights, we'd love to hear from...

  • Data Engineer

    4 weeks ago

    Singapore YOUZU (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking for a skilled and motivated Data Engineer to join our team. You will play a key role in designing, maintaining, and expanding our data pipelines while actively shaping the future of our BI system. If you are passionate about data engineering, ETL processes, and driving business insights, we’d love to hear from you! ...

  • Data Engineer

    3 weeks ago

    Singapore PERCEPT SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesDuties:Data Domain business workflow interpretation, data requirement study, data exploration, creation of entity relationship diagram, data model creation, data extraction, transformation, and loading ("ETL"), pipeline creation and servicing data requests. Data Platform Operations, setup, installation, access controls and pipeline...

  • Data Engineer

    4 weeks ago

    Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description:We are looking for a skilled and motivated Data Engineer with expertise in Scala, SQL, and Hadoop to join our dynamic team. In this role, you will design, develop, and optimize scalable data pipelines and systems, collaborating with cross-functional teams to drive high-quality data solutions.Key ResponsibilitiesData...

  • Data Engineer

    2 weeks ago

    Singapore DELTA SG CONSULTING Full time

    Roles & ResponsibilitiesLocation: SingaporeJob Type: Renewable Contract (Work onsite with a leading bank)Experience Level: Associate LevelWe are seeking a Data Engineer to design, develop, and implement data solutions leveraging Quantexa's cutting-edge technology. The ideal candidate will have strong expertise in data engineering, ETL pipelines, and big...

  • Data Engineer

    3 weeks ago

    Singapore CHARLES & KEITH (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesJob Responsibilities:1. Data Pipeline DevelopmentDesign, develop, and maintain scalable and reliable ETL (Extract, Transform, Load) pipelines to integrate structured and unstructured data from various sources Automate data workflows and ensure efficient data movement across platforms2. Collaboration and Team ManagementWork closely...

  • Data Engineer

    3 weeks ago

    Singapore DCI CONSULTANTS PRIVATE LIMITED Full time

    Roles & ResponsibilitiesThe RoleThe Data Engineer will be part of the data engineering team. He/she will design and develop high quality data products - data warehouse, data marts, data lake and data hubs; either on cloud or on-premises system environments.Job Responsibilities· Build and support data pipelines and all associated Software Engineering...

  • Data Engineer

    2 weeks ago

    Singapore INFOCEPTS PTE. LTD. Full time

    Roles & ResponsibilitiesInfoCepts is a global leader of end-to-end data & analytics solutions with nearly 20 years of experience, also named as Gartner's 2020, 2021 and 2022 customers' choice for Data & Analytics providers. We continue to grow rapidly year over year, now employing more than 1,200 people in offices across the globe. As we have grown, we have...