Data Engineer: Scalable Data Solutions

2 days ago


Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time

RAPSYS TECHNOLOGIES PTE. LTD. is seeking a skilled Senior Data Engineer to join our team. This role offers an estimated salary of SGD 120,000 - 180,000 per annum.

Job Description

We are looking for a highly experienced Senior Data Engineer with 5-10 years of hands-on experience in designing, implementing, and optimizing complex data workflows using Apache Airflow, Apache NiFi, Kafka, PySpark, Spark Scala, and other key technologies.

  • Data Pipeline Design & Management: The successful candidate will design, build, and maintain scalable and reliable data pipelines to support both real-time and batch processing requirements.
  • Workflow Optimization & Monitoring: He/She will manage, monitor, and optimize workflows in Apache Airflow to ensure data quality, integrity, and system performance.
  • Data Integration: The ideal candidate will develop and integrate data flows using Apache NiFi to ensure seamless data ingestion and transformation processes.
  • Real-Time Data Streaming: Extensive experience with Apache Kafka for data streaming and messaging across various data sources is required.
  • Data Processing Solutions: The chosen candidate will implement data processing solutions using PySpark and Spark Scala to handle large-scale datasets and complex transformations.
  • Automation & Scripting: Efficient coding skills in Python and Java are necessary to automate data workflows and support data engineering needs, utilizing shell scripting for operational tasks.
  • Cross-functional Collaboration: Strong analytical, problem-solving, and communication skills are essential to collaborate with cross-functional teams to understand data requirements and provide optimized engineering solutions.
  • Data Security & Compliance: Ensuring data security, compliance, and performance by following best practices in big data and distributed systems is crucial.


  • Singapore Synechron Inc. Full time

    Job OverviewSynechron Inc. is seeking an experienced Data Engineer to join our team in creating and implementing scalable data solutions using Hadoop, Spark, OpenShift Container Platform (OCP), and DevOps practices.

  • Data Engineer

    4 weeks ago


    Singapore WEBSPARKS PTE. LTD. Full time

    Join WebSpark as a highly skilled Data Engineer in our Government Productivity Engineering (GPE) Group, where you will play a pivotal role in designing and building scalable data pipelines and infrastructure.We are seeking an experienced professional with a strong background in data engineering to collaborate with various teams to deliver high-quality...

  • Data Engineer

    4 days ago


    Singapore WEBSPARKS PTE. LTD. Full time

    Job DescriptionAt WebSparks PTE. LTD., we are seeking an experienced Data Engineer to join our team as a Scalable Data Solutions Specialist.The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and infrastructure. This role requires collaboration with various teams to deliver data-driven solutions...


  • Singapore FACEBOOK SINGAPORE PTE. LTD. Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team in Singapore. This is a unique opportunity to work on scalable data solutions, collaborating with software engineering, data science, and product management teams.As a Data Engineer at Meta, you will have a direct impact on company growth and user satisfaction. You will work with some...


  • Singapore NTT DATA Full time

    Unleash Your Potential as a Data Solutions AnalystAs a Data Solutions Analyst at NTT DATA, you will play a pivotal role in helping organizations unlock the full potential of their data. With a focus on process improvement and business transformation, you will work closely with stakeholders to identify areas for optimization and develop innovative solutions...

  • Data Architect

    6 days ago


    Singapore HYPERSCAL SOLUTIONS PTE. LTD. Full time

    Job Summary:We are seeking an experienced Senior Frontend (Full Stack) Engineer to join our team at HYPERSCAL SOLUTIONS PTE. LTD. This role is responsible for designing, developing, and maintaining our data product suite.About the Role:You will work closely with cross-functional teams including data scientists, data engineers, and UX/UI developers to create...

  • Cloud Data Engineer

    3 hours ago


    Singapore SOURCEO PTE. LTD. Full time

    Job DescriptionWe are seeking a highly skilled Cloud Data Engineer to join our team at SOURCEO PTE. LTD. as we continue to drive business value across the organization with high-quality, scalable data solutions.About the RoleThis is a critical position that requires expertise in designing and implementing modern data platforms, leveraging cloud-based...


  • Singapore AVN DIGITAL PTE. LTD. Full time

    Job OverviewA high-level cloud data engineer is needed to lead the design, development, and deployment of scalable data storage solutions using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB, in conjunction with Databricks' Delta Lake. The ideal candidate will have extensive experience in cloud data engineering, proficiency...


  • Singapore TRIVI DATA CONSULTING PTE. LTD. Full time

    Unlock Business Potential with Data Engineering ExpertiseWe are seeking a seasoned Data Engineer to join our team at NITYO PROGRESSION CONSULTANCY PTE. LTD. The ideal candidate will have a proven ability to design scalable data pipelines, implement machine learning models, and deliver data-driven solutions that optimize decision-making processes.About the...


  • Singapore RISKINSIGHT CONSULTING PTE. LTD. Full time

    Job Title: Quantexa Data EngineerOverview: RISKINSIGHT CONSULTING PTE. LTD. is seeking an experienced Data Engineer to join our team in developing and maintaining scalable data pipelines using Spark and Scala.Key Responsibilities:Design, develop, and maintain large-scale data pipelines using Spark and Scala for efficient data processing.Implement and manage...


  • Singapore Data Privacy Full time

    Job Description We're seeking a talentedBioprocess Data Engineerto join our team and play a crucial role in establishing the framework and systems for bioprocess data in a greenfield facility. As a Bioprocess Data Engineer, you'll bridge the gap between digital infrastructure and process engineers, creating a user-friendly interface for data...


  • Singapore MINDEN INTERNATIONAL PTE. LTD. Full time

    Minden International Pte. Ltd., a technology venture, seeks a Senior Data Engineer to contribute to the design and implementation of a scalable data platform based on data mesh principles with a modern data stack.Key Responsibilities:Develop efficient data pipelines to ingest, transform, and store data from various sources.Collaborate with engineers across...


  • Singapore BIOQUEST ADVISORY PTE. LTD. Full time

    BioQuest Advisory PTE. LTD. is seeking a highly skilled Senior Data Engineer to join our team.About the RoleAs a Senior Data Engineer, you will play a crucial part in designing and building scalable data pipelines and applications. You will work closely with clients to understand their unique data needs and deliver tailored solutions that drive business...


  • Singapore SHELL INFOTECH PTE. LTD. Full time

    Job SummaryA challenging opportunity has emerged for a skilled Data Integration Engineer to join our team at Shell Infotech Pte. Ltd. As an integral part of our data integration team, you will play a crucial role in designing and developing robust data integration solutions using Talend Studio. Your primary focus will be on integrating data from various...


  • Singapore Twelve Data Full time

    At Twelve Data, we're on a mission to make the world's financial data universally accessible. We aggregate and store vast volumes of data, leveraging custom terabytes-scale distributed time series databases to deliver high-speed performance.We're seeking an experienced Frontend Software Engineer to join our core development team. As a key member, you'll...


  • Singapore D L RESOURCES PTE LTD Full time

    We are seeking a highly skilled Data Engineering Lead to join our team at D L RESOURCES PTE LTD. This role offers an exciting opportunity to design, build, and optimize large-scale data infrastructure for advanced analytics needs.About the RoleThe successful candidate will play a leading role in overseeing the development of scalable data engineering...


  • Singapore RISKINSIGHT CONSULTING PTE. LTD. Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at Riskinsight Consulting PTE. LTD.About the RoleThis is an exciting opportunity for a motivated and experienced Data Engineer to design, develop, and maintain scalable data pipelines using Spark and Scala to process large datasets.You will be responsible for implementing and...


  • Singapore CAPGEMINI SINGAPORE PTE. LTD. Full time

    About CAPGEMINI SINGAPORE PTE. LTD.CAPGEMINI SINGAPORE PTE. LTD. is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society.Salary: SGD 120,000 - SGD 180,000 per annumJob Description:We are seeking an...


  • Singapore AUTODESK ASIA PTE. LTD. Full time

    About the RoleAs a Senior Data Engineer at Autodesk Asia PTE. LTD., you will play a key part in designing and implementing data processing & analytics pipelines that drive business growth. With a focus on scalability, reliability, and resiliency, you will tackle complex problems to improve our platform's performance.We are seeking an experienced engineer who...


  • Singapore Housing and Development Board Full time

    Are you a skilled systems architect with a passion for data-driven solutions?We are seeking an experienced Data Architect to join our team and design robust, scalable, and secure Salesforce solutions. As a key member of our team, you will collaborate with stakeholders to validate and gather business requirements, ensuring alignment with the project's goals...