Data Engineer

4 weeks ago


Singapore WEBSPARKS PTE. LTD. Full time
Roles & Responsibilities

We are seeking a highly skilled Data Engineer to design, develop, and maintain our data infrastructure. As a Data Engineer, you will be pivotal in driving the creation of efficient data pipelines, integration of diverse data sources, and development of scalable products.

Key Responsibilities:
• Design, develop, and deploy data tables, views, and marts in data warehouses, operational data stores, data lakes, and data virtualization platforms.
• Perform data extraction, cleaning, transformation, and flow, including web scraping as needed.
• Design, build, launch, and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworks such as Apache Hadoop, Apache Spark, and Apache Kafka.
• Integrate and collate data silos in a manner that is both scalable and compliant.
• Collaborate with project managers, data architects, business analysts, frontend developers, UX designers, and data analysts to build scalable data-driven products.
• Develop backend APIs and work on databases to support applications.
• Work in an Agile environment that practices Continuous Integration and Delivery.
• Participate in pair programming and code review processes with fellow developers.

Qualifications:
• Proficient in general data cleaning and transformation techniques, including SQL, pandas, and R.
• Experienced in building ETL pipelines using SQL Server Integration Services (SSIS), AWS Database Migration Services (DMS), RedShift, Python, AWS Lambda, ECS Container tasks, Eventbridge, and AWS Glue.
• Familiar with database design and various databases, including SQL, PostgreSQL, AWS S3, Athena, MongoDB, Postgres/GIS, MySQL, SQLite, VoltDB, Cassandra, and more.
• Experience in cloud technologies such as AWS, Azure, and Google Cloud Platform (GPC/GCC).
• Experienced in building production-grade data pipelines, ETL/ELT data integration, and familiar with big data frameworks and tools, including Hadoop, Spark, Kafka, RabbitMQ, and more.
• Knowledgeable about system design, data structure, and algorithms.
• Familiar with data modeling, data access, and data storage infrastructure, including Data Mart, Data Lake, Data Virtualization, and Data Warehouse.
• Familiar with REST APIs and web requests/protocols.
• Comfortable in at least one scripting language, such as SQL or Python.
• Proficient in Windows and Linux development environments.

  • Singapore Data Privacy Full time

    Job Description We're seeking a talentedBioprocess Data Engineerto join our team and play a crucial role in establishing the framework and systems for bioprocess data in a greenfield facility. As a Bioprocess Data Engineer, you'll bridge the gap between digital infrastructure and process engineers, creating a user-friendly interface for data...


  • Singapore NTT Data Singapore Full time

    Requirements We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. The ideal candidate will have a Bachelor's degree in Computer Science or a related field and at least 7 years of IT experience, with a minimum of 5 years in a similar role. Proficiency in distributed computing principles and strong experience with Hadoop,...


  • Singapore NTT Data Singapore Full time

    Job Requirements We are seeking a highly skilled Data Engineer to join our team at NTT Data Singapore. The ideal candidate will have a Bachelor's degree in Computer Science or a related field and at least 7 years of IT experience, with a minimum of 5 years in a similar role. Key Responsibilities • Proficient understanding of distributed computing...


  • Singapore Twelve Data Full time

    At Twelve Data, we're on a mission to make the world's financial data universally accessible. We aggregate and store vast volumes of data, leveraging custom terabytes-scale distributed time series databases to deliver high-speed performance.We're seeking an experienced Frontend Software Engineer to join our core development team. As a key member, you'll...


  • Singapore NTT DATA Full time

    Transform Business with NTT DATAAbout the Role:We are seeking a seasoned Strategic Data Insights Lead to join our team at NTT DATA. As a key member of our analytics capacity, you will be responsible for driving business value using data analytics, data visualization, and data modelling techniques and technologies.Key Responsibilities:Gather relevant...


  • Singapore NTT DATA Full time

    About the RoleWe are seeking a seasoned Strategic Data Insights Specialist to join our team at NTT DATA. This is an exciting opportunity for a highly skilled professional to work with data collection tools and software, producing actionable insights that drive business value.Key ResponsibilitiesData Analysis: Gather relevant information from multiple...

  • Data scientist

    3 days ago


    Singapore ECF Data, LLC Full time

    Description:Location: SingaporeBudget : 8000 -10000Responsibilities:1. Drive analytic projects for all pillars of the bank’s treasury and markets department, such as bond analytics, news generation FX trading signals, product recommendation and customer hyper-personalization.2. Conduct literature review and evaluate trade-offs between different...

  • Business Analyst

    2 weeks ago


    Singapore NTT DATA Full time

    Transform Business with Data InsightsAbout the RoleThe Business Analyst - Data Insights Specialist is a seasoned subject matter expert responsible for driving business value using data analytics, data visualization, and data modeling techniques and technologies. This role transforms data into critical information and knowledge to inform sound business...


  • Singapore DATA CONNECT TECHNOLOGIES PTE. LTD. Full time

    Technical Consultant RoleAt DATA CONNECT TECHNOLOGIES PTE. LTD., we are seeking a skilled Technical Consultant to join our team. The ideal candidate will possess a strong understanding of systems administration, networking protocols, and cybersecurity principles.Pre-Sales Technical ServicesAssist potential clients in understanding our suite of products and...


  • Singapore NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Director, Design Management to lead our team of design professionals and oversee the development of high-quality data center designs for our clients in Japan and APAC regions.Job DescriptionThe ideal candidate will have a strong background in designing critical facilities and complex infrastructure, with at...


  • Singapore Vantage Data Centers Full time

    About Vantage Data CentersVantage Data Centers is a leading provider of data center services, committed to delivering innovative and sustainable solutions for hyperscalers, cloud providers, and large enterprises. With a presence in North America, EMEA, and Asia Pacific, we have evolved data center design to achieve dramatic gains in reliability, efficiency,...


  • Singapore NTT Data Singapore Full time

    We are seeking a highly skilled Red Hat OpenShift Engineer to join our team at NTT Data Singapore. As an OpenShift Engineer, you will play a critical role in ensuring the uptime, performance, and compliance of Red Hat OpenShift Container Platform (OCP) according to bank standards.You will work closely with architecture, development, operations, and security...


  • Singapore NTT DATA Services Full time

    About NTT DATANTT DATA is a trusted global innovator of business and technology services.We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. Job OverviewThe Software Development Senior Analyst role requires strong data engineering concepts and programming experience. This...


  • Singapore KEPPEL DATA CENTRES HOLDING PTE. LTD. Full time

    About the RoleWe are seeking an exceptional Senior Manager, Technical Solutions to lead our Data Centre Engineering projects from inception to completion. This is a key position that requires strong technical expertise and leadership skills.Key Responsibilities:Develop and manage technical solutions for Data Centre Engineering projects, ensuring timely...


  • Singapore NTT DATA Full time

    About the RoleWe are seeking a skilled Performance Test Engineer to join our team at NTT DATA. As a key member of our technical team, you will play a critical role in ensuring the performance and reliability of our software applications.As a Performance Test Engineer, you will be responsible for designing, developing, and executing performance tests to...


  • Singapore NTT DATA Full time

    About NTT DATA NTT DATA is a global technology services leader, dedicated to helping clients innovate and transform for long-term success. With over $30 billion in revenue and more than 50 years of experience, we serve 75% of the Fortune Global 100. Your Role: We are seeking a skilled Quality Assurance Engineer to join our team. As a Quality Assurance...


  • Singapore Vantage Data Centers Full time

    About Vantage Data CentersWe are a leading provider of data center infrastructure, committed to delivering reliable, efficient, and sustainable solutions to our customers.Job SummaryWe are seeking an experienced Customer Solutions Engineer to join our team. In this role, you will be responsible for supporting the development and execution of technical...


  • Singapore ST ENGINEERING CLOUD AND DATA CENTRE SOLUTIONS PTE. LTD. Full time

    Job Title: Cloud and Data Centre Solutions EngineerWe are seeking an experienced Cloud and Data Centre Solutions Engineer to join our team at ST Engineering Cloud and Data Centre Solutions Pte. Ltd.Estimated Salary: SGD 120,000 - 180,000 per annumAs a Cloud and Data Centre Solutions Engineer, you will play a key role in designing, implementing, and managing...


  • Singapore NTT DATA Full time

    About the RoleNTT DATA is seeking an experienced Field Support Engineer to join our team. In this role, you will provide second-line remote and onsite technical support to clients, ensuring their collaboration technologies are configured, installed, and operational.Key ResponsibilitiesConfigure, install, and test client infrastructure to ensure it meets...


  • Singapore NTT DATA Full time

    About the RoleWe are seeking a talented Global Collaboration Support Engineer to join our team. As a key member of our support team, you will be responsible for providing exceptional technical support and engineering services to clients worldwide.Key Responsibilities:Configure, install, test, and operate client infrastructure at site locations.Install and...