Senior Platform and Data Engineer

1 day ago


Singapore Ensign InfoSecurity Full time

Ensign is hiring

Reporting to the Director of Platforms and Data Engineering, the Senior Platform and Data Engineer will work closely with Data Scientists, Threat Researchers/Analysts and Infrastructure Engineers to develop and manage high-performance analytics solutions. The incumbent will be accountable for the design, development, deployment and maintenance of big data platforms as well as its data processing workflows.

Key Responsibilities:

- Lead the design, development, testing, deployment of efficient and reliable big data processing workflows that follow secure SDLC practices
- Design, develop, manage data warehouse architecture and relational databases
- Provide monitoring, maintenance and support for system operations as part of M&S as required in commercial projects
- Embrace the challenge of dealing with terabytes to petabytes of data on a daily basis
- Manage different experimentation, development, staging, production environments to provide overall system functionality, health, scalability, resiliency, and security.
- Responsible for implementing and maintaining complex big data projects with a focus on collecting, parsing, managing, and analysing large sets of data to turn information into insights using multiple platforms
- Deliver detailed documentation and ensure quality throughout project lifecycle

Qualifications/Requirements:

- Bachelor’s degree in Computer Science/Information Systems/Computer Engineering or equivalent
- Minimum 5 years of experience developing data engineering pipelines or machine learning operations using big data platforms (e.g. Hadoop, Apache Spark, MPP DBs)
- Good in-depth knowledge of Hadoop ecosystem (e.g. HDFS, Impala, Kafka, Spark, NiFi, Elasticsearch), associated tools and cloud-based technologies (e.g. EMR, Redshift, S3).
- Extensive experience in programming (PySpark, Scala) for data engineering
- Understanding of modern software engineering tools such as Git, Bitbucket, Jenkins, Maven.
- Highly proficient at reading, profiling, parsing, transforming, cleansing and integrating data from various sources (structured, semi-structured and unstructured)
- Knowledge in Agile and CI/CD is desirable
- Comfort and experience working in Linux environment
- Aptitude for automation and software profiling
- Experience in Cyber Security / Telco industry will be an advantage
- Proven ability to handle multiple customer projects concurrently
- Detail-oriented, solution-focused and problem solver



  • Singapore Airwallex Full time

    Join to apply for the Senior Data Platform Engineer, Growth Data Platform role at Airwallex Join to apply for the Senior Data Platform Engineer, Growth Data Platform role at Airwallex Get AI-powered advice on this job and more exclusive features. About Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by...


  • Singapore Airwallex Full time

    **About Airwallex** Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide - including Brex, Rippling, Navan, Qantas, SHEIN and many more - with fully integrated solutions to manage everything from business...


  • Singapore Airwallex Full time

    About Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...

  • Data Engineer

    1 week ago


    Singapore Housing and Development Board Full time

    **About Us!** The mission of Housing & Development Board (HDB) is to provide affordable, quality housing and a great living environment where communities thrive. To achieve its mission, HDB aims to be data-driven to the core and adopt evidence-based decision making in developing better housing policies service, improving service delivery and optimising...


  • Singapore beBeeDataEngineer Full time $90,000 - $120,000

    Job Opportunity for Data Platform EngineerYou have a chance to work as a senior data platform engineer on a contract basis for 6-7 months, working remotely in the UK. This is an excellent opportunity to showcase your skills and experience in designing and implementing large-scale data platforms.The ideal candidate will have at least 9 years of hands-on...


  • Singapore Airwallex Pty Ltd. Full time

    About Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...


  • Singapore Airwallex Full time

    Airwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world’s most powerful payments and banking infrastructure, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their financial operations, all in one single platform. Established in 2015 in...


  • Singapore NodeFlair Full time

    **Job Summary**: **Job Type** **Seniority** **Years of Experience** Information not provided As an Entry Level to Mid Level Data Platform Engineer, you will be responsible for designing, implementing, and maintaining the Denodo Data Virtualization Platform. You will work closely with the project team to ensure seamless integration with other IT...


  • Singapore Equinix Full time

    **Senior Platform Engineer - Data & AI**: - JR-151601 - Hybrid - Singapore - Information Technology - Full time Who are we? Equinix is the world’s digital infrastructure company®, operating over 260 data centers across the globe. Digital leaders harness Equinix's trusted platform to bring together and interconnect foundational infrastructure at...

  • Platform Engineer

    3 days ago


    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Join to apply for the Platform Engineer - Data Exploration Platform Management role at Centre for Strategic Infocomm Technologies (CSIT)1 month ago Be among the first 25 applicants Join to apply for the Platform Engineer - Data Exploration Platform Management role at Centre for Strategic Infocomm Technologies (CSIT)Get AI-powered advice on this job and more...