Senior Platform and Data Engineer

3 days ago

Central Singapore Emprego SG Full time

**Location**

Singapore, Central Singapore

**Job Type**

Full Time

**Salary**

$7,000 - $10,000 Per Month

**Date Posted**

1 hour ago

Additional Details

**Job ID**

2031

**Job Views**

1

**Job Description**:
Roles & Responsibilities

**Responsibilities**:

Lead the design, development, testing, deployment of efficient and reliable big data processing workflows that follow secure SDLC practices
- Design, develop, manage data warehouse architecture and relational databases
- Provide monitoring, maintenance and support for system operations as part of M&S as required in commercial projects
- Embrace the challenge of dealing with terabytes to petabytes of data on a daily basis
- Manage different experimentation, development, staging, production environments to provide overall system functionality, health, scalability, resiliency, and security
- Responsible for implementing and maintaining complex big data projects with a focus on collecting, parsing, managing, and analysing large sets of data to turn information into insights using multiple platforms
- Deliver detailed documentation and ensure quality throughout project lifecycle

**Requirements**:

- Bachelor’s degree in Computer Science/Information Systems/Computer Engineering or equivalent
- Minimum 5 years of experience developing data engineering pipelines or machine learning operations using big data platforms (e.g. Hadoop, Apache Spark, MPP DBs)
- Good in-depth knowledge of Hadoop ecosystem (e.g. HDFS, Impala, Kafka, Spark, NiFi, Elasticsearch), associated tools and cloud-based technologies (e.g. EMR, Redshift, S3)
- Extensive experience in programming (PySpark, Scala) for data engineering
- Understanding of modern software engineering tools such as Git, Bitbucket, Jenkins, Maven
- Highly proficient at reading, profiling, parsing, transforming, cleansing and integrating data from various sources (structured, semi-structured and unstructured)
Knowledge in Agile and CI/CD is desirable
- Comfort and experience working in Linux environment
- Aptitude for automation and software profiling
- Experience in Cyber Security / Telco industry will be an advantage
- Proven ability to handle multiple customer projects concurrently
- Detail-oriented, solution-focused and problem solver

Tags

senior

platform

and

data

engineer

  • Senior Data Platform Engineer

    5 days ago

    Singapore AIRWALLEX (SINGAPORE) PTE. LTD. Full time

    Senior Data Platform Engineer Hiring Location: Singapore (or Shanghai)Airwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world's most powerful payments and banking infrastructures, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their...

  • Senior Site Reliability Engineer, Data Platform

    1 week ago

    Singapore Shopify Full time

    Company Description Shopify is the leading omni-channel commerce platform. Merchants use Shopify to design, set up, and manage their stores across multiple sales channels, including mobile, web, social media, marketplaces, brick-and-mortar locations, and pop-up shops. The platform also provides merchants with a powerful back-office and a single view of...

  • Senior Data Platform Engineer

    1 week ago

    Singapore Airwallex Full time

    Join to apply for the Senior Data Platform Engineer role at Airwallex Join to apply for the Senior Data Platform Engineer role at Airwallex About Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses...

  • Senior Site Reliability Engineer, Data Platform

    5 days ago

    Singapore Shopify Full time

    Company Description Shopify is the leading omni-channel commerce platform. Merchants use Shopify to design, set up, and manage their stores across multiple sales channels, including mobile, web, social media, marketplaces, brick-and-mortar locations, and pop-up shops. The platform also provides merchants with a powerful back-office and a single view of...

  • Data Platform Engineer II

    5 days ago

    Singapore AIRWALLEX (SINGAPORE) PTE. LTD. Full time

    Airwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world's most powerful payments and banking infrastructures, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their financial operations, all in one single platform. Established in 2015 in...

  • Senior Backup Engineer SME

    1 week ago

    Singapore NTT DATA, Inc. Full time

    Join to apply for the Senior Backup Engineer SME role at NTT DATA, Inc. 2 days ago Be among the first 25 applicants Join to apply for the Senior Backup Engineer SME role at NTT DATA, Inc. Get AI-powered advice on this job and more exclusive features. Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are...

  • Platform and Data Engineer

    1 week ago

    Singapore Ensign InfoSecurity Full time

    Ensign is hiring ! Reporting to Head, Platforms and Data Engineering, the Platforms and Data Engineer will work closely with Data Scientists, Threat/Malware Researchers, Project Managers and Infrastructure Engineers to develop and manage high-performance analytics solutions. The incumbent will be accountable for the design, development, deployment and...

  • Staff Software Engineer, Data Platform

    5 days ago

    Singapore NodeFlair Full time

    **Job Summary**: **Job Type** Permanent **Seniority** **Years of Experience** Information not provided **Tech Stacks** Core Data AWS Analytics RedShift Airflow kafka Ruby SQL PostgreSQL Python - We're searching for a Staff Software Engineer to drive the engineering vision of our Data Platform. In this pivotal role, you'll design, build, and operate the...

  • Senior Data Engineer

    2 weeks ago

    Central Region, Singapore Shinka Labs Full time $120,000 - $180,000 per year

    OverviewWe are seeking a Senior Data Engineer to join our Forward-Deployed Engineering Team, working full-time with one of our key clients on a long-term Agile engagement.As a Senior Data Engineer, you will be responsible for designing, building, and maintaining data pipelines, transformations, and curated datasets that power analytics, BI, and machine...

  • Azure Data engineer

    7 days ago

    Singapore NTT Data Singapore Full time $80,000 - $120,000 per year

    Job Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations...