Data Engineer

**About Us**

PALO IT is an innovation & agile development company. From Design Research to DevOps, we are in the business of end-to-end development of breakthrough digital experiences. As a community of innovators and developers, we also aim at renewing the way organizations operate, promoting sustainable business agility, user-centricity, and open collaboration while having fun doing it.

Started in France in 2009 and with offices in Singapore, Australia, Hong Kong, Thailand, and Mexico, we are looking for our next superstar to join our talents in Singapore.

At PALO IT, our employees are in the center of all our projects and successes. We offer an exciting and creative working environment, with endless opportunities to develop your skills, travel and take your career to the next level. Get in touch to find out more

**Our Vision and Values**

We aspire to positively impact the world by empowering organizations to harness the power of transformative technology for the greater good.
- We Care about our World
- We Act with Courage
- We Share, it’s in our DNA
- We Choose Positivity & Self Improvement
- We Deliver Awesomeness

**Your profile & role on the project**

**You**:

- Thrive on challenges. _When was the last time you failed? _
- Are curious & always learning. _What are you up to right now? _
- Can deal with constant change. _When were you last surprised? _
- Have mastered at least one skill of your trade but you’re not defined by it. _What can you teach us? Can you wear many hats? _

**You Again**:
The Data Engineer will work on acquiring, storing, governing, and processing huge sets of structured/unstructured data. You will bring a vision of the big data solutions landscape for choosing optimal architecture components to use for these purposes as well as a set of data engineering skills for implementing enterprise data foundation such as data lake. Finally, you will work closely with other PALO IT experts in Data Intelligence, Research, UX Design, Digital Technology and Agile teams to enable intelligence in the digital mesh of our clients and deliver big impact to them.

➔ Identify and implement big data frameworks/components that best fit to required capabilities

➔ Gather and process data at scale, tackling challenges coming from unstructured data,

real-time processing, data quality etc.

➔ Enable data management capabilities to govern enterprise data/metadata and provide an easy and secured access to them

➔ Support the definition and optimization of underlying infrastructure

**Still You**:
✔ You hold a Bachelor, Master or PhD degree in IT, Information Management and/or Computer Science

✔ Good knowledge of big data technology landscape and concepts related to distributed storage / computing

✔ Experience with big data frameworks (e.g. Hadoop, Spark) and distributions (Cloudera, Hortonworks, MapR)

✔ Experience with batch & ETL jobs to ingest and process data from multiple data sources

✔ Experience with NoSQL databases (e.g. Cassandra, MongoDB, Neo4J, ElasticSearch)

✔ Experience with querying tools (e.g Hive, Spark SQL, Impala)

✔ Experience or willingness to go in real-time stream processing, using solutions such as Kafka, AWS Kinesis, Flume and/or Spark Streaming

✔ Experience or willingness to learn about DevOps and DataOps principles (e.g Infrastructure as code, automating differents parts of the data pipeline)

✔ High-level understanding of Data Science (how models are built, trained and deployed)

✔ You are passionate about technology and continuous learning comes naturally to you

**_If you like what you just read, we’d love to have a chat with you _**
- PALO IT Singapore is an equal opportunity employer. Employment decisions will be based on merit, qualifications and abilities. Palo IT SG does not discriminate in employment opportunities or practices on the basis of race, colour, religion, sex, sexuality, national origin, age, disability, marital status or any other characteristics protected by law. _
- Protecting your privacy and the security of your data are longstanding top priorities for Palo-IT. _
- Your personal data will be processed for the purposes of managing Palo-IT’s recruitment related activities, which include setting up and conducting interviews and tests for applicants, evaluating and assessing the results, and as is otherwise needed in the recruitment and hiring processes. _
- Here you can find how you can request for access, correction and/or withdrawal of your Personal Data_