Data Engineer with Expertise in Large-Scale Data Pipelines

15 hours ago


Singapore NSEARCH GLOBAL PTE. LTD. Full time
Job Description

We are seeking a highly skilled Data Engineer to join our team at NSEARCH GLOBAL PTE. LTD. As a Junior Data Engineer, you will play a crucial role in designing, building, and maintaining efficient and reliable large-scale data pipelines with data processing frameworks.

About the Role

This is an excellent opportunity for individuals who are passionate about working with data and have a strong interest in being the bridge between engineering and analytics. You will collaborate with Project Manager, Visualisation Developer, Data Scientist, UX Designers, and Data Analyst to build scalable data-driven products.

Key Responsibilities:
  • Design, build, launch, and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworks.
  • Perform data extraction, cleaning, transformation, and flow; Web scraping may be also a part of the work scope in data extraction.
  • Collaborate with Project Manager, Visualisation Developer, Data Scientist, UX Designers, and Data Analyst to build scalable data-driven products.
  • Work in an Agile Environment that practices Continuous Integration and Delivery.
  • Support and advise best practices in data management standards, policies, and procedures; Work closely with fellow developers through pair programming and code review process.

Requirements:

To be successful in this role, you should have the following skills and qualifications:
  • Interest in being the bridge between engineering and analytics; Knowledge about system design, data structure, and algorithms.
  • Familiar with data modelling, data access, and data storage infrastructure like Data Mart, Data Lake, and Data Warehouse.
  • Good in general data cleaning and transformation (e.g., SQL, pandas, R, etc.), and AWS.
  • Good in processing data from open-standard file format or data interchange format (e.g., XML, JSON).
  • Good in building ETL pipeline (eg., Talend Data Integration, Informatica PowerCenter, IBM DataStage, SAS Data Integration).
  • Good in database design and various databases (e.g., MS SQL Server, Oracle RDBMS, IBM DB2, Postgres, etc.).
  • Comfortable in at least one scripting language (eg., Python).

Salary

The estimated salary for this position is SGD 50,000 - 60,000 per annum, depending on experience.

Benefits:

We offer a comprehensive benefits package including medical insurance, paid leave, and opportunities for career growth and development.

  • Singapore UMILIFE (SINGAPORE) PTE. LTD. Full time

    We are seeking a highly skilled Data Engineer to join our team at UMILIFE (SINGAPORE) PTE. LTD.About the Role:As a Data Engineer, you will be responsible for designing, developing, and optimizing large-scale data pipelines to efficiently collect, process, and store data. You will work closely with data teams to meet data requirements and communicate complex...


  • Singapore THEE BIRAPANJAA SYSTEMS (PTE. LTD.) Full time

    We are seeking a skilled Data Engineer to join our team at THEE BIRAPANJAA SYSTEMS (PTE. LTD.). The successful candidate will have experience designing, developing, and maintaining scalable data pipelines using Spark and Scala to process large datasets.As a Data Engineer, you will play a key role in implementing and managing Elasticsearch clusters for...


  • Singapore NSEARCH GLOBAL PTE. LTD. Full time

    Job Description:We are seeking a skilled Data Engineer to join our team at NSEARCH GLOBAL PTE. LTD. as part of Asia-Pacific's leading organizations.About the Role:This is an exciting opportunity for a Junior Data Engineer to work on designing, building, launching, and maintaining efficient and reliable large-scale batch and real-time data pipelines with data...


  • Singapore NSEARCH GLOBAL PTE. LTD. Full time

    We are seeking a skilled Data Engineer to join our team at NSEARCH GLOBAL PTE. LTD.About the RoleThis is a key position in our organization, requiring an individual with expertise in designing, building, and maintaining efficient data pipelines using various frameworks.Job DescriptionThe ideal candidate will have experience in data extraction, cleaning,...


  • Singapore ITCAN Full time

    Data Engineering ExpertiseWe are seeking a seasoned Senior Network Consultants to lead our data engineering efforts.As a key member of our team, you will leverage your expertise in architecting, designing, and implementing large-scale Cloudera/Hortonworks Data Platform solutions.Your strong business acumen and technical skills will enable you to translate...

  • Senior Data Engineer

    4 weeks ago


    Singapore Crypto Full time

    About the RoleWe are seeking a Senior Data Engineer with deep expertise in ClickHouse and AWS infrastructure to join our dynamic Trading Analytics team. This role will be crucial in supporting our data engineering needs across various trading, middle office, and trade capture systems.Key ResponsibilitiesDesign, implement, and manage scalable ClickHouse...


  • Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full time

    Job SummaryWe are seeking an experienced Data Solutions Architect to lead the design and implementation of large-scale data intelligence solutions leveraging Snowflake technology. The ideal candidate will possess a strong background in data warehousing, ETL processes, and modern data engineering practices.About the RoleDevelop and implement robust data...

  • Senior Data Engineer

    2 months ago


    Singapore Crypto Full time

    Job Description:The Quant Trading team at Crypto.com is responsible for trading and managing risks associated with different crypto products, including spots and derivatives. The team develops and implements trading strategies in fast-paced and complex trading environments.We are seeking a Senior Data Engineer with deep expertise in ClickHouse and AWS...

  • Data Engineer

    15 hours ago


    Singapore PERSOLKELLY SINGAPORE PTE. LTD. Full time

    Job Title:Data Engineer - Large Scale Data Processing SpecialistOverview:PERSOLKELLY SINGAPORE PTE. LTD. is seeking a highly skilled Data Engineer to join our team in Singapore.Salary:The estimated salary for this position is SGD $80,000 - $120,000 per annum, depending on experience.Job Description:We are looking for an experienced Data Engineer to design,...


  • Singapore MANPOWER STAFFING SERVICES (SINGAPORE) PTE LTD Full time

    Job Title: Data Engineer for Large Scale Azure Data Factory ProjectsLocation: SingaporeSalary Range: SGD 120,000 - SGD 180,000 per annum Job Description:MANPOWER STAFFING SERVICES (SINGAPORE) PTE LTD is seeking a highly skilled Data Engineer to lead the development and implementation of large-scale ETL pipelines in Azure Data Factory. The ideal candidate...


  • Singapore TRIVI DATA CONSULTING PTE. LTD. Full time

    Unlock Business Potential with Data Engineering ExpertiseWe are seeking a seasoned Data Engineer to join our team at NITYO PROGRESSION CONSULTANCY PTE. LTD. The ideal candidate will have a proven ability to design scalable data pipelines, implement machine learning models, and deliver data-driven solutions that optimize decision-making processes.About the...


  • Singapore NTT Data Singapore Full time

    NTT Data Singapore is seeking a highly skilled Data Engineer to join our team. This role will be responsible for designing, developing, and maintaining large-scale data systems.Job Description:Key Responsibilities: Design, develop, and maintain large-scale data systems using Scala programming and functional programming principles. Collaborate with...


  • Singapore SECRETLAB SG PTE. LTD. Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team at Secretlab SG PTE. LTD. in Singapore. As a key member of our Business Intelligence Team, you will be responsible for designing and implementing large-scale data platforms that drive business growth and inform strategic decision-making.Company OverviewSecretlab is an international...


  • Singapore Careers@Gov Full time

    Data Engineer At Careers@Gov, we are committed to empowering individuals and shaping the future of Singapore's workforce. As a statutory board under the Ministry of Education, we lead the charge in driving the SkillsFuture movement, a national initiative that promotes lifelong learning and skills development. With a strong focus on innovation and...


  • Singapore SAKSOFT PTE LIMITED Full time

    About the RoleSAKSOFT PTE LIMITED is seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, implementing, and maintaining large-scale enterprise systems.About YouTo be successful in this role, you will need to have at least 8 years of experience in Hadoop, Hive,...


  • Singapore Twelve Data Full time

    At Twelve Data, we're on a mission to make the world's financial data universally accessible. We aggregate and store vast volumes of data, leveraging custom terabytes-scale distributed time series databases to deliver high-speed performance.We're seeking an experienced Frontend Software Engineer to join our core development team. As a key member, you'll...


  • Singapore SAKSOFT PTE LIMITED Full time

    OverviewSaksoft PTE LIMITED is a leading technology firm seeking an experienced Senior Data Engineer to spearhead the implementation of large-scale systems. This is a critical role that demands technical expertise and leadership skills.About the JobWe are looking for a seasoned professional with a strong background in data engineering, software development,...


  • Singapore APAR TECHNOLOGIES PTE. LTD. Full time

    Job Title: Data Engineering SpecialistAbout the Role:We are seeking an experienced Data Engineer to join our team at Apar Technologies PTE. LTD. The ideal candidate will have a strong background in data engineering, with expertise in designing, building, and maintaining large-scale batch and real-time data pipelines.Main Responsibilities:Design, build,...


  • Singapore PAGE PERSONNEL RECRUITMENT PTE. LTD. Full time

    Compelling OpportunityThis is an exceptional chance to excel in a prestigious role as a Senior Data Architect for a leading global tech company. The ideal candidate will possess a strong background in big data frameworks, expertise in designing and optimizing scalable data architectures, and experience with large-scale recommendation systems.About Our...

  • Data Engineer

    2 months ago


    Singapore MARINE ONLINE (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesResponsibilities: Design, develop, and optimize large-scale data pipelines for efficient data collection, processing, and storage. Monitor and maintain data pipelines to ensure high availability and consistency. Develop algorithms for processing and analyzing large datasets. Utilize distributed computing frameworks like Hadoop and...