Senior Platform and Data Engineer

1 day ago

Central Singapore Emprego SG Full time

**Location**

Singapore, Central Singapore

**Job Type**

Full Time

**Salary**

$7,000 - $10,000 Per Month

**Date Posted**

1 hour ago

Additional Details

**Job ID**

2031

**Job Views**

1

**Job Description**:
Roles & Responsibilities

**Responsibilities**:

Lead the design, development, testing, deployment of efficient and reliable big data processing workflows that follow secure SDLC practices
- Design, develop, manage data warehouse architecture and relational databases
- Provide monitoring, maintenance and support for system operations as part of M&S as required in commercial projects
- Embrace the challenge of dealing with terabytes to petabytes of data on a daily basis
- Manage different experimentation, development, staging, production environments to provide overall system functionality, health, scalability, resiliency, and security
- Responsible for implementing and maintaining complex big data projects with a focus on collecting, parsing, managing, and analysing large sets of data to turn information into insights using multiple platforms
- Deliver detailed documentation and ensure quality throughout project lifecycle

**Requirements**:

- Bachelor’s degree in Computer Science/Information Systems/Computer Engineering or equivalent
- Minimum 5 years of experience developing data engineering pipelines or machine learning operations using big data platforms (e.g. Hadoop, Apache Spark, MPP DBs)
- Good in-depth knowledge of Hadoop ecosystem (e.g. HDFS, Impala, Kafka, Spark, NiFi, Elasticsearch), associated tools and cloud-based technologies (e.g. EMR, Redshift, S3)
- Extensive experience in programming (PySpark, Scala) for data engineering
- Understanding of modern software engineering tools such as Git, Bitbucket, Jenkins, Maven
- Highly proficient at reading, profiling, parsing, transforming, cleansing and integrating data from various sources (structured, semi-structured and unstructured)
Knowledge in Agile and CI/CD is desirable
- Comfort and experience working in Linux environment
- Aptitude for automation and software profiling
- Experience in Cyber Security / Telco industry will be an advantage
- Proven ability to handle multiple customer projects concurrently
- Detail-oriented, solution-focused and problem solver

Tags

senior

platform

and

data

engineer

  • Senior Data Platform Engineer, Growth Data Platform

    2 weeks ago

    Singapore Airwallex Full time

    About Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...

  • (Senior) Data Platform Engineer, Growth Data Platform

    2 days ago

    Singapore Airwallex Full time

    About Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...

  • Senior Data Platform Engineer

    5 days ago

    Singapore AIRWALLEX (SINGAPORE) PTE. LTD. Full time

    Senior Data Platform Engineer Hiring Location: Singapore (or Shanghai)Airwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world’s most powerful payments and banking infrastructures, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their...

  • Senior Site Reliability Engineer, Data Platform

    7 days ago

    Singapore Shopify Full time

    Company Description Shopify is the leading omni-channel commerce platform. Merchants use Shopify to design, set up, and manage their stores across multiple sales channels, including mobile, web, social media, marketplaces, brick-and-mortar locations, and pop-up shops. The platform also provides merchants with a powerful back-office and a single view of...

  • Senior Data Platform Engineer

    2 days ago

    Singapore Airwallex Full time

    Join to apply for the Senior Data Platform Engineer role at Airwallex Join to apply for the Senior Data Platform Engineer role at Airwallex About Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses...

  • Platform Engineer

    2 days ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Join to apply for the Platform Engineer - Data Exploration Platform Management role at Centre for Strategic Infocomm Technologies (CSIT)1 month ago Be among the first 25 applicants Join to apply for the Platform Engineer - Data Exploration Platform Management role at Centre for Strategic Infocomm Technologies (CSIT)Get AI-powered advice on this job and more...

  • Data Platform Engineer

    2 weeks ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$7,000 - S$14,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 2 years As an Entry Level to Mid Level Data Platform Engineer, you will be responsible for designing, implementing, and maintaining the Denodo Data Virtualization Platform. You will work closely with the project team to ensure...

  • Data Reliability Engineer, Data Platform

    3 days ago

    Singapore Shopify Full time

    Company Description Shopify is a leading global commerce company, providing trusted tools to start, grow, market, and manage a retail business of any size. Shopify makes commerce better for everyone with a platform and services that are engineered for reliability, while delivering a better shopping experience for consumers everywhere. Shopify powers...

  • Data Platform Engineer II

    5 days ago

    Singapore AIRWALLEX (SINGAPORE) PTE. LTD. Full time

    Airwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world’s most powerful payments and banking infrastructures, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their financial operations, all in one single platform. Established in 2015 in...

  • Senior Data Platform Engineer

    2 days ago

    Singapore Airwallex Pty Ltd. Full time

    About Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...