Senior Platform and Data Engineer

1 day ago


Central Singapore Emprego SG Full time

**Location**

Singapore, Central Singapore

**Job Type**

Full Time

**Salary**

$7,000 - $10,000 Per Month

**Date Posted**

1 hour ago

Additional Details

**Job ID**

2031

**Job Views**

1

**Job Description**:
Roles & Responsibilities

**Responsibilities**:

Lead the design, development, testing, deployment of efficient and reliable big data processing workflows that follow secure SDLC practices
- Design, develop, manage data warehouse architecture and relational databases
- Provide monitoring, maintenance and support for system operations as part of M&S as required in commercial projects
- Embrace the challenge of dealing with terabytes to petabytes of data on a daily basis
- Manage different experimentation, development, staging, production environments to provide overall system functionality, health, scalability, resiliency, and security
- Responsible for implementing and maintaining complex big data projects with a focus on collecting, parsing, managing, and analysing large sets of data to turn information into insights using multiple platforms
- Deliver detailed documentation and ensure quality throughout project lifecycle

**Requirements**:

- Bachelor’s degree in Computer Science/Information Systems/Computer Engineering or equivalent
- Minimum 5 years of experience developing data engineering pipelines or machine learning operations using big data platforms (e.g. Hadoop, Apache Spark, MPP DBs)
- Good in-depth knowledge of Hadoop ecosystem (e.g. HDFS, Impala, Kafka, Spark, NiFi, Elasticsearch), associated tools and cloud-based technologies (e.g. EMR, Redshift, S3)
- Extensive experience in programming (PySpark, Scala) for data engineering
- Understanding of modern software engineering tools such as Git, Bitbucket, Jenkins, Maven
- Highly proficient at reading, profiling, parsing, transforming, cleansing and integrating data from various sources (structured, semi-structured and unstructured)
Knowledge in Agile and CI/CD is desirable
- Comfort and experience working in Linux environment
- Aptitude for automation and software profiling
- Experience in Cyber Security / Telco industry will be an advantage
- Proven ability to handle multiple customer projects concurrently
- Detail-oriented, solution-focused and problem solver

Tags

senior

platform

and

data

engineer



  • Singapore Airwallex Full time $150,000 - $200,000 per year

    About AirwallexAirwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...


  • Central Singapore Ascenda Loyalty Pte Ltd Full time

    **Job description**: Ascenda solutions make loyalty simple for financial institutions globally. Previously, these companies had to endure complex patchworks of third-party systems, mediocre user experiences, and 18-month implementation projects to deploy a competitive rewards program. We turn things upside down with loyalty solutions rooted in beautiful...


  • Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$7,000 - S$14,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 2 years As an Entry Level to Mid Level Data Platform Engineer, you will be responsible for designing, implementing, and maintaining the Denodo Data Virtualization Platform. You will work closely with the project team to ensure...


  • Singapore Shopify Full time

    Company Description Shopify is the leading omni-channel commerce platform. Merchants use Shopify to design, set up, and manage their stores across multiple sales channels, including mobile, web, social media, marketplaces, brick-and-mortar locations, and pop-up shops. The platform also provides merchants with a powerful back-office and a single view of...


  • Singapore Shopify Full time

    Company Description Shopify is the leading omni-channel commerce platform. Merchants use Shopify to design, set up, and manage their stores across multiple sales channels, including mobile, web, social media, marketplaces, brick-and-mortar locations, and pop-up shops. The platform also provides merchants with a powerful back-office and a single view of...


  • Singapore Shopify Full time

    Company Description Shopify is a leading global commerce company, providing trusted tools to start, grow, market, and manage a retail business of any size. Shopify makes commerce better for everyone with a platform and services that are engineered for reliability, while delivering a better shopping experience for consumers everywhere. Shopify powers...


  • Singapore Airwallex Full time

    **About Airwallex** Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide - including Brex, Rippling, Navan, Qantas, SHEIN and many more - with fully integrated solutions to manage everything from business...


  • Singapore Capgemini Full time

    **Job Requirement** A senior leadership role that entails the oversight of multiple teams or a substantial team of data platform engineers, the management of intricate data infrastructure projects, and the making of strategic decisions that shape technological direction within the realm of data platform engineering. **Key responsibilities encompass**: -...


  • Singapore AIRWALLEX (SINGAPORE) PTE. LTD. Full time

    Hiring Location: Singapore (or Shanghai)Airwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world's most powerful payments and banking infrastructures, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their financial operations, all in one...

  • Data Engineer

    11 hours ago


    Singapore NTT DATA, Inc. Full time

    Join to apply for the Data Engineer role at NTT DATA, Inc. . Overview As part of our data-driven transformation initiatives, we are looking for a motivated Associate Data Engineer to join our team. This role is ideal for early-career professionals who are passionate about building scalable data pipelines, integrating diverse data sources, and enabling...