Senior Platform and Data Engineer
2 hours ago
Ensign is hiring
Reporting to the Director of Platforms and Data Engineering, the Senior Platform and Data Engineer will work closely with Data Scientists, Threat Researchers/Analysts and Infrastructure Engineers to develop and manage high-performance analytics solutions. The incumbent will be accountable for the design, development, deployment and maintenance of big data platforms as well as its data processing workflows.
Key Responsibilities:
- Lead the design, development, testing, deployment of efficient and reliable big data processing workflows that follow secure SDLC practices
- Design, develop, manage data warehouse architecture and relational databases
- Provide monitoring, maintenance and support for system operations as part of M&S as required in commercial projects
- Embrace the challenge of dealing with terabytes to petabytes of data on a daily basis
- Manage different experimentation, development, staging, production environments to provide overall system functionality, health, scalability, resiliency, and security.
- Responsible for implementing and maintaining complex big data projects with a focus on collecting, parsing, managing, and analysing large sets of data to turn information into insights using multiple platforms
- Deliver detailed documentation and ensure quality throughout project lifecycle
Qualifications/Requirements:
- Bachelor’s degree in Computer Science/Information Systems/Computer Engineering or equivalent
- Minimum 5 years of experience developing data engineering pipelines or machine learning operations using big data platforms (e.g. Hadoop, Apache Spark, MPP DBs)
- Good in-depth knowledge of Hadoop ecosystem (e.g. HDFS, Impala, Kafka, Spark, NiFi, Elasticsearch), associated tools and cloud-based technologies (e.g. EMR, Redshift, S3).
- Extensive experience in programming (PySpark, Scala) for data engineering
- Understanding of modern software engineering tools such as Git, Bitbucket, Jenkins, Maven.
- Highly proficient at reading, profiling, parsing, transforming, cleansing and integrating data from various sources (structured, semi-structured and unstructured)
- Knowledge in Agile and CI/CD is desirable
- Comfort and experience working in Linux environment
- Aptitude for automation and software profiling
- Experience in Cyber Security / Telco industry will be an advantage
- Proven ability to handle multiple customer projects concurrently
- Detail-oriented, solution-focused and problem solver
-
Singapore Airwallex Pty Ltd. Full timeAbout Airwallex Airwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...
-
Senior Data Platform Engineer
2 weeks ago
Singapore AIRWALLEX (SINGAPORE) PTE. LTD. Full timeSenior Data Platform Engineer Hiring Location: Singapore (or Shanghai)Airwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world's most powerful payments and banking infrastructures, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their...
-
Singapore Airwallex Full time $120,000 - $180,000 per yearAbout AirwallexAirwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...
-
Senior Data Platform Engineer
2 weeks ago
Singapore Airwallex Full timeAirwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the world’s most powerful payments and banking infrastructure, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their financial operations, all in one single platform. Established in 2015 in...
-
Senior Data Platform Engineer
1 day ago
Singapore Airwallex Full time $120,000 - $180,000 per yearAbout AirwallexAirwallex is the only unified payments and financial platform for global businesses. Powered by our unique combination of proprietary infrastructure and software, we empower over 150,000 businesses worldwide – including Brex, Rippling, Navan, Qantas, SHEIN and many more – with fully integrated solutions to manage everything from business...
-
Senior Platform Engineer
4 days ago
Singapore Equinix Full time**Senior Platform Engineer - Data & AI**: - JR-151601 - Hybrid - Singapore - Information Technology - Full time Who are we? Equinix is the world’s digital infrastructure company®, operating over 260 data centers across the globe. Digital leaders harness Equinix's trusted platform to bring together and interconnect foundational infrastructure at...
-
Data Platform Engineer
2 hours ago
Singapore NodeFlair Full time**Job Summary**: **Job Type** **Seniority** **Years of Experience** Information not provided As an Entry Level to Mid Level Data Platform Engineer, you will be responsible for designing, implementing, and maintaining the Denodo Data Virtualization Platform. You will work closely with the project team to ensure seamless integration with other IT...
-
Senior Big Data Platform Engineer
2 weeks ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full timeData processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...
-
Data Platform Engineer
2 days ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$7,000 - S$8,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake Oracle Shell Script Shell Java MSSQL Linux Python **COMPANY DESCRIPTION** Beyondsoft International (Singapore) Pte. Ltd. was set up in 2007 and established as the regional headquarters for the Southeast...
-
Senior Data Platform Engineer
1 day ago
Singapore Tech Aalto Full time $120,000 - $180,000 per yearJob Summary:We are seeking an experienced Senior Data Platform Engineer with over 15 years of expertise in managing and administering complex data and compute infrastructure across on-premises and cloud environments. The ideal candidate will have deep hands-on experience with Kubernetes (on-prem & Azure), Spark Clusters, and CI/CD pipelines using...
