Senior Data Engineer

2 weeks ago


Singapur, Singapore PALO IT SINGAPORE PTE. LTD. Full time
Roles & Responsibilities

WHO WE ARE:

Build. Scale. Sustain.

PALO IT is a global technology consultancy that crafts tech as a force for good. We design, develop and scale digital and sustainable products and services to unlock value across the triple bottom line: people, planet, profit. We do the right thing, and we do it right. We're proud to be a World Economic Forum New Champion, and a B Corp-certified company.

  • We are small enough to care locally, big enough to deliver globally (5 continents, 18 offices, +650 experts from +50 nationalities)
  • We are robust and resilient (100% independent and 0 debt)
  • We are entrepreneurs and passionate experts: We invest in what we believe genuinely and work as a collective intelligence
  • We are positive, courageous, caring, doers and committed to excellence

YOUR ROLE:

The Senior Data Engineer will work on acquiring, storing, governing and processing huge sets of structured / unstructured data. You will bring a vision of the big data solutions landscape for choosing optimal architecture components to use for these purposes as well as a set of data engineering skills for implementing enterprise data foundations such as data lake. Finally, you will work closely with other PALO IT experts in Data Intelligence, Research, UX Design, Digital Technology and Agile teams to enable intelligence in the digital mesh of our clients and deliver big impact to them.

YOUR RESPONSIBILITIES:

  • Design, implement, and maintain robust and scalable data pipelines to ingest, transform, and process structured and unstructured data from various sources.
  • Build and manage data warehouses and data lakes, implementing efficient data storage and retrieval mechanisms. Design data models that support business requirements and analytics use cases.
  • Leverage cloud platforms (e.g., AWS, Azure, GCP) to design and deploy scalable data infrastructure, optimizing for performance, cost-effectiveness, and reliability.
  • Implement data quality checks, validation processes, and data governance frameworks to ensure data accuracy, integrity, and compliance with security standards.
  • Continuously monitor and optimize data pipelines and infrastructure to improve processing speed, reduce latency, and enhance overall system performance.
  • Work collaboratively with data scientists, analysts, and other stakeholders to understand their data needs, provide technical expertise, and deliver solutions that meet business objectives.
  • Support business users by implementing data presentation layer including data visualisation using tools like Tableau, PowerBI etc.
  • Stay up-to-date with emerging technologies and industry trends in the big data and data engineering space, evaluating and implementing innovative solutions to improve data processing capabilities.
  • Support the definition and optimization of underlying data infrastructure

WHO YOU ARE:

  • You hold a Bachelor's, Master's, or Ph.D. degree in IT, Information Management, and/or Computer Science with at least 6 years of experience.
  • Good knowledge of the big data technology landscape and concepts related to distributed storage/computing
  • Experience with big data frameworks (e.g. Hadoop, Spark) and distributions (Cloudera, Hortonworks, MapR)
  • Experience with batch & ETL jobs to ingest and process data from multiple data sources
  • Experience with NoSQL databases (e.g. Cassandra, MongoDB, Neo4J, ElasticSearch)
  • Experience with querying tools (e.g Hive, Spark SQL, Impala)
  • Experience or willingness to go in real-time stream processing, using solutions such as Kafka, AWS Kinesis, Flume, and/or Spark Streaming
  • Experience or willingness to learn about DevOps and DataOps principles (e.g Infrastructure as Code, automating different parts of the data pipeline)
  • High-level understanding of Data Science concepts and methodologies (how models are built, trained, and deployed)
  • You are passionate about technology and continuous learning comes naturally to you

We will be prioritizing applicants who have a current right to work in Singapore, and do not require sponsorship of a visa.

MORE ABOUT PALO IT:

We’re eager to adapt to change, learn from our experiences and move to meet our planet’s urgent needs. We are continuously taking action to:

  • Become a climate net-zero company
  • Attain 50% of revenue from projects with a positive impact
  • Train 100% of our workforce on impact
  • Achieve B Corp certification among all our offices across the globe
  • Continuously measure & improve employee happiness

Our clients are amongst the world's most successful companies. We innovate with both established Fortune 1000s, SMEs and start-ups who aim to make an impact, become global leaders and address the world's most complex challenges.

What We Offer

  • Stimulating working environments
  • Unique career path
  • International mobility
  • Internal R&D projects
  • Knowledge sharing
  • Personalized training

For more on our team culture and benefits, check out our careers page.

PALO IT Singapore is an equal opportunity employer. Employment decisions will be based on merit, qualifications and abilities. Palo IT SG does not discriminate in employment opportunities or practices on the basis of race, colour, religion, sex, sexuality, national origin, age, disability, marital status or any other characteristics protected by law.

Protecting your privacy and the security of your data are longstanding top priorities for Palo-IT.

Your personal data will be processed for the purposes of managing Palo-IT’s recruitment related activities, which include setting up and conducting interviews and tests for applicants, evaluating and assessing the results, and as is otherwise needed in the recruitment and hiring processes.

Please consult our Privacy Notice to know more about how we collect, use, and transfer the personal data of our candidates. Here you can find how you can request for access, correction and/or withdrawal of your Personal Data.


Tell employers what skills you have

MongoDB
Azure
Big Data
Pipelines
Hadoop
Data Management
UX Design
ETL
Data Quality
Cassandra
Data Engineering
Impala
SQL
Data Architecture
Hive
Data Science
Data Warehousing
Databases
  • Data Engineer

    3 weeks ago


    Singapur, Singapore NTT Data Singapore Full time

    Job SummaryWe are seeking a highly skilled and experienced Big Data Engineer to lead our data engineering efforts. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments, such as Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/Senior Consultant preferably.Key...


  • Singapur, Singapore NTT Data Singapore Full time

    Job SummaryWe are seeking a highly skilled and experienced Big Data Engineer to lead our data engineering team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments, such as Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/Senior Consultant preferably. The...

  • Data Engineer

    4 weeks ago


    Singapur, Singapore NTT Data Singapore Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team at NTT Data Singapore. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments, such as Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/Senior Consultant preferably.Key...


  • Singapur, Singapore NTT Data Singapore Full time

    Job Summary We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. Overall experience can be 4 to 10 years. Consultant/ Senior Consultant preferably. The successful candidate will...


  • Singapur, Singapore Careers@Gov Full time

    Job Title: Senior Data EngineerJoin our team at Careers@Gov as a Senior Data Engineer and play a key role in developing an integrated Asset Management System to gain a deeper understanding of railway assets, including their performance and condition.About the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to join our Asset...


  • Singapur, Singapore NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Data Analyst

    6 days ago


    Singapur, Singapore LNRS Data Services Pte Ltd Company Full time

    About the RoleThis is an exciting opportunity to join LNRS Data Services Pte Ltd Company as a Senior Analyst, playing a central role in delivering high-quality data and analysis on the plastics recycle value chain. You will be part of a global team of industry experts and analysts, contributing to the development of new products and services that drive our...


  • Singapur, Singapore NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Principal Enterprise Architect to join our team at NTT DATA. As a key member of our organization, you will play a critical role in driving business growth and innovation through the development and implementation of strategic enterprise architecture solutions.Key ResponsibilitiesSupport the client manager...

  • Senior Data Engineer

    2 weeks ago


    Singapur, Singapore HKT Full time

    HKT is seeking a highly technical Senior Data Engineer to join our dynamic team.We are passionate about harnessing the power of data to drive innovation and empower businesses. As a Senior Data Engineer, you will play a key role in designing, building, and optimizing our data infrastructure, ensuring seamless integration and efficient data processing.Key...


  • Singapur, Singapore NTT DATA Full time

    Job OverviewMake a meaningful impact with NTT DATANTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. Our workplace embraces diversity and inclusion – it's a place where you can grow,...


  • Singapur, Singapore Vantage Data Centers Full time

    About Vantage Data CentersWe're committed to creating a workplace of inclusion, equity, respect, and acceptance. Our diverse team celebrates individuality and strives to learn from each other's experiences.Job SummaryThe Customer Solutions Engineer plays a critical role in supporting the successful development and execution of technical solutions programs....


  • Singapur, Singapore Vantage Data Centers Full time

    About Vantage Data CentersWe are a workplace of inclusion, equity, respect, and acceptance, celebrating diversity and seeking opportunities to learn from each other's experiences.Job SummaryThe Customer Solutions Engineer will support the successful development and execution of a technical solutions program. This key sales solutions & engineering team member...

  • Senior Data Engineer

    2 weeks ago


    Singapur, Singapore Careers@Gov Full time

    Job Title: Senior / Engineer (AMDA - Data Strategy & System)About the Role:We are seeking a highly skilled Senior / Engineer to join our Asset Management team. As a key member of the team, you will be responsible for developing an integrated Asset Management System to gain understanding of railway assets, including its performance and condition. This system...

  • Senior Data Engineer

    4 weeks ago


    Singapur, Singapore Careers@Gov Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Asset Management team. As a key member of our team, you will play a critical role in developing an integrated Asset Management System to gain a deeper understanding of railway assets, including their performance and condition.Key ResponsibilitiesDevelop and implement data...

  • Data Engineer

    1 month ago


    Singapur, Singapore NTT Data Singapore Full time

    Work Location: SingaporeContract Duration - 12 months renewable  Responsibilities: Work closely with data stewards, data analysts and business end-users to implement and support data solutions. Design and build robust and scalable data ingestion and data management solutions for batch loading and streaming from data sources using Python. Familiar with SDLC...

  • Senior Data Engineer

    2 weeks ago


    Singapur, Singapore Careers@Gov Full time

    Job Title: Senior / Engineer (AMDA - Data Strategy & System)About the Role:We are seeking a highly skilled Senior / Engineer to join our Asset Management team. As a key member of our team, you will be responsible for developing an integrated Asset Management System to gain a deeper understanding of railway assets, including their performance and...

  • Senior Data Engineer

    3 weeks ago


    Singapur, Singapore Helius Full time

    Job Title: Senior Data Engineer - Big DataHelius is seeking a highly skilled Senior Data Engineer - Big Data to join our team. As a Senior Data Engineer - Big Data, you will be responsible for designing, developing, and deploying large-scale data processing systems using Talend Big Data version 7+ and Hadoop.Key Responsibilities:Design and develop...

  • Senior Data Engineer

    3 weeks ago


    Singapur, Singapore Careers@Gov Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Asset Management team. As a key member of our team, you will play a critical role in developing an integrated Asset Management System to gain a deeper understanding of railway assets, including their performance and condition.Working closely with teams from various disciplines...


  • Singapur, Singapore Careers@Gov Full time

    Job Title: Senior Data Applications EngineerAs a Senior Data Applications Engineer at Careers@Gov, you will play a critical role in advancing technological innovation, particularly in managing and analyzing data collected through distributed sensors and other channels.Key Responsibilities:Leading industry and internal projects focused on innovative data...

  • Senior Data Engineer

    2 weeks ago


    Singapur, Singapore PALO IT SINGAPORE PTE. LTD. Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at PALO IT SINGAPORE PTE. LTD. The successful candidate will be responsible for designing, implementing, and maintaining robust and scalable data pipelines to ingest, transform, and process structured and unstructured data from various sources.Key...