Senior Data Engineer

4 days ago


Singapore PALO IT Full time

**WHO WE ARE**:
**Build. Scale. Sustain.**

PALO IT is a global technology consultancy that crafts tech as a force for good. We design, develop and scale digital and sustainable products and services to unlock value across the triple bottom line: people, planet, profit. **We do the right thing, and we do it right. **We're proud to be a World Economic Forum New Champion, and a B Corp-certified company.
- We are **small enough to care locally, big enough to deliver globally** (5 continents, 18 offices, +650 experts from +50 nationalities)
- We are **robust and resilient** (100% independent and 0 debt)
- We are **entrepreneurs and passionate experts**: We invest in what we believe genuinely and work as a collective intelligence
- We are **positive, courageous, caring, doers and committed to excellence**

**YOUR ROLE**:
The Senior Data Engineer will work on acquiring, storing, governing and processing huge sets of structured / unstructured data. You will bring a vision of the big data solutions landscape for choosing optimal architecture components to use for these purposes as well as a set of data engineering skills for implementing enterprise data foundations such as data lake. Finally, you will work closely with other PALO IT experts in Data Intelligence, Research, UX Design, Digital Technology and Agile teams to enable intelligence in the digital mesh of our clients and deliver big impact to them.

**YOUR RESPONSIBILITIES**:

- Design, implement, and maintain robust and scalable data pipelines to ingest, transform, and process structured and unstructured data from various sources.
- Build and manage data warehouses and data lakes, implementing efficient data storage and retrieval mechanisms. Design data models that support business requirements and analytics use cases.
- Leverage **cloud platforms** (e.g., AWS, Azure, GCP) to design and deploy scalable data infrastructure, optimizing for performance, cost-effectiveness, and reliability.
- Implement data quality checks, validation processes, and data governance frameworks to ensure data accuracy, integrity, and compliance with security standards.
- Continuously monitor and optimize data pipelines and infrastructure to improve processing speed, reduce latency, and enhance overall system performance.
- Work collaboratively with data scientists, analysts, and other stakeholders to understand their data needs, provide technical expertise, and deliver solutions that meet business objectives.
- Support business users by implementing data presentation layer including data visualisation using tools like Tableau, PowerBI etc.
- Stay up-to-date with emerging technologies and industry trends in the big data and data engineering space, evaluating and implementing innovative solutions to improve data processing capabilities.
- Support the definition and optimization of underlying data infrastructure

**WHO YOU ARE**:

- You hold a Bachelor's, Master's, or Ph.D. degree in IT, Information Management, and/or Computer Science with at least 6 years of experience.
- Good knowledge of the big data technology landscape and concepts related to distributed storage/computing
- Experience with big data frameworks (e.g. Hadoop, Spark) and distributions (Cloudera, Hortonworks, MapR)
- Experience with batch & ETL jobs to ingest and process data from multiple data sources
- Experience with **NoSQL** databases (e.g. Cassandra, MongoDB, Neo4J, ElasticSearch)
- Experience with querying tools (e.g **Hive,** Spark **SQL**, **Impala**)
- Experience with **PowerBI**:

- Experience or willingness to go in real-time stream processing, using solutions such as Kafka, AWS Kinesis, Flume, and/or Spark Streaming
- Experience or willingness to learn about DevOps and DataOps principles (e.g Infrastructure as Code, automating different parts of the data pipeline)
- High-level understanding of Data Science concepts and methodologies (how models are built, trained, and deployed)
- You are passionate about technology and continuous learning comes naturally to you

**_We will be prioritizing applicants who have a current right to work in Singapore, and do not require sponsorship of a visa._**

**MORE ABOUT PALO IT**:
We're eager to adapt to change, learn from our experiences and move to meet our planet's urgent needs. We are continuously taking action to:

- Become a climate net-zero company
- Attain 50% of revenue from projects with a positive impact
- Train 100% of our workforce on impact
- Achieve B Corp certification among all our offices across the globe
- Continuously measure & improve employee happiness

Our clients are amongst the world's most successful companies. We innovate with both established Fortune 1000s, SMEs and start-ups who aim to make an impact, become global leaders and address the world's most complex challenges.

**What We Offer**
- Stimulating working environments
- Unique career path
- International mobility
- Internal R&D projects
- Knowledge sharing
- Personalized training

For m



  • Singapore NTT DATA Full time

    Requirements / Qualifications - Bachelor's or master's degree in computer science, data engineering, or a related field. - Minimum 7 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC. - Proficiency in programming languages such as Python, Java, or Scala for building data pipelines. - Evaluate...

  • Data Engineer

    1 week ago


    Singapore DOZER DATA PTE. LTD. Full time

    **About the job**: This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data. This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers. **Responsibilities**: In...

  • Senior Data Engineer

    2 weeks ago


    Singapore DC FRONTIERS PTE. LTD. Full time

    Handshakes by DC Frontiers is an award-winning DataTech company that leverages data to empower safe, informed business decisions. We are located in 7 cities and are expanding our presence across the globe. We are hiring an experienced **Senior **Data Engineer **to be based in our Singapore office. The **Senior Data Engineer **will be part of our Data and AI...


  • Singapore Handshakes by DC Frontiers Pte Ltd Full time

    Handshakes is an award-winning DataTech company. We enable our clients to make safer, more informed decisions by delivering meaningful insights, harnessed from reliable data. We apply machine learning technology to analyze and provide corporate data from public and private domains. Our award-winning Handshakes App fuses these data to provide strategic...

  • Senior Data Engineer

    2 weeks ago


    Singapore Datasearch Consulting Full time

    **Senior Data Engineer** **Singapore** **SGD $90-120,000/year** We are working with a product focused software client of ours looking for a senior data engineer to join an existing software focused team here in Singapore. They have a data science team in the US who you will liase with but you will report into their VP of engineering here in...

  • Data Engineer

    4 weeks ago


    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates may also send their resume via email to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Changi Business ParkRequirements:Min 3-4 years experience At least one year of...


  • Singapore Optimas Capital Full time

    -Optimas Capital Singapore Posted 1 hour ago In-Office Permanent Competitive - C - POSTED BY - Christina Chiu - RecruiterFollow - We are looking for a talented senior data engineer to be part of our dynamic team based in Singapore. Reporting to the COO, the incumbent will define, implement and manage the overall data infrastructure and strategy for Optimas...


  • Singapore The Chemical Engineer Full time

    The Chemical Engineer has an exciting opportunity for a Chemical Process Optimization Engineer to join their team in Singapore. This is a challenging role that requires a strong understanding of chemical processes and a passion for optimization.Key Responsibilities:• Develop and refine process formulations, methods, and controls to meet high-quality...


  • Singapore NTT DATA Singapore PTE Ltd Full time

    Job Description - About Us - Roles and Responsibility **Job scopes**: - The Data Engineer will lead the enterprise-wide data transformations projects. The person will involve in developing and automating data processing pipelines for financial and Investment data modelling, analysis, and reporting from various data sources systems; The primary...

  • Senior Data Engineer

    2 weeks ago


    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$103,700 - S$135,000 / Monthly **Job Type** **Seniority** Senior **Years of Experience** At least 5 years **Tech Stacks** ClickHouse T SQL BigQuery JavaScript SQL Python **Key Responsibilities**: - Lead the development and optimization of our data pipelines, databases and systems for serving data to our customers, ensuring...


  • Singapore Trulyyy Full time

    *Experience in data infra will be big plusKey Responsibilities Design, develop, and maintain scalable data pipelines for processing and analyzing data from various advertising platforms. Implement data models and ETL processes to facilitate automated monitoring and performance optimization. Collaborate with the business team to drive actionable insights and...

  • Data Engineer

    2 weeks ago


    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$4,000 - S$6,000 / Monthly **Job Type** **Seniority** Senior **Years of Experience** At least 5 years **Tech Stacks** Snowflake AWS Microsoft SQL Server Google Cloud Synapse T SQL Microsoft BigQuery RedShift Azure Airflow Spark NoSQL kafka Flink SQL As a Data Engineer, you need to: - Create and maintain data architectures...


  • Singapore The Chemical Engineer Full time

    Pfizer Singapore is recruiting a Production Engineering Expert to support the expansion of their manufacturing site. In this role, you will develop and refine process formulations, methods, and controls to meet high-quality standards.Key Responsibilities:• Develop and refine process formulations, methods, and controls to meet high-quality standards.•...


  • Singapore Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience. Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and...


  • Singapore Randstad Singapore Full time

    Senior Data Engineer (min 8 years of exp)This range is provided by Randstad Singapore. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Salary budget open Base salary + AWS + variable bonus. About Company I am currently working with a leading and reputable game studio, headquartered in...


  • Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$14,000 - S$23,000 / Monthly EST **Job Type** Permanent **Seniority** Senior **Years of Experience** At least 4 years **Tech Stacks** Amazon S3 AWS Terraform Glue RedShift Less Airflow Kubernetes PostgreSQL - The Data Engineering team is part of the broader DevOps department, and sits at the core of the business, bridging...


  • Singapore Centre for Strategic Infocomm Technologies Full time

    CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of use-cases, including but not limited to Counter-terrorism and Computer Network Defence. We are looking for talented senior data engineers to lead and build mission-critical products that identify, analyse and investigate threats. Role As a...

  • Process Engineer

    1 week ago


    Singapore The Chemical Engineer Full time

    Pfizer Singapore is recruiting permanent employees for manufacturing site expansion of Pfizer Asia Manufacturing Pte Ltd (PAMPL) in Singapore. Use Your Power for Purpose Whether you are involved in the design and development of manufacturing processes for products or supporting maintenance and reliability, engineering is crucial to ensuring that customers...


  • Singapore The Chemical Engineer Full time

    POSITION SUMMARY Will serve as a laboratory based member of the Technical Services team providing chemistry and process related technical support to OSP, Technology Transfers, changeover cleaning and solvent recovery sections. POSITION RESPONSIBILITIES Design and conduct laboratory scale experiments and analysis with minimal supervision to support plant...


  • Singapore HR Tech Full time

    About the RoleThis is a challenging opportunity for a Senior Data Engineer to facilitate and provide technical and testing support before and after production deployment.You will liaise with other units across IT and business in the organization and require at least 5 years of experience/knowledge in Unix Shell Scripting, MariaDB or Oracle DB, SQL, and...