Developer (Big Data-framework Engineer)

2 weeks ago


Singapore Encora Full time

Encora is a global Software and Digital Engineering company that helps business overcome the Software Engineering Talent shortage and provides next-gen services and such as Predictive Analysis, Artificial Intelligence & Machine Learning, IoT, Cloud, and Test Automation.

We count with 16 global offices and 25 innovation labs.

Our Software Engineering experts work with leading-edge technology companies to improve their speed to impact.


You will also be responsible for quality assurance of the team's delivery in conformance with the Bank-defined software delivery methodology and tools.

You will partner with other technology functions to help deliver required technology solutions.

Other responsibilities include:

  • Create frameworks, technical features which helps in faster operationalisation of Data models, Analytical models(including AI/ML) and user generated contents (dashboards, reports etc)
  • Effectively partner with data scientists in enabling faster adoption of AL/ML model based systems
  • Independently install, customise and integrate software packages and programs
  • Carry out POCs involving new data technologies
  • Create technical documents such as solution design, program specifications for target solutions
  • Performance tuning
  • Work with production support team members to conduct root cause analysis of issues, review new and existing code and/or perform unit testing
  • Perform tasks as part of a cross functional development team using agile or other methodologies and utilising project management software

TEAM
Architecture (Big Data)

  • Experience in large scale implementations and performance optimizations in the Big Data Ecosystem using Spark, Hive, Impala, Apache Kudu, Ozone, Presto, Tez, Iceberg etc
-
Knowledge of frameworks such as Spring, Struts, Hibernate etc

  • Knowledge of Object Oriented Programming, Multithreading, Containerization, etc
  • Knowledge of related technologies such as HTML, Javascript, CSS, Jquery, , docker
  • Knowledge of Elastic, Kibana, Logstash, Hive, Sqoop, MongoDB, Oozie, Flume, Kafka
At least, 2 to 3 technical certifications in any of the below technologies:

  • Language - SQL, Java, Python, Scala, Javascript,
  • Automation / scripting - CtrlM, Shell Scripting, Groovy
  • Cloudera Hadoop distribution - Hive, Impala, Spark, Kudo, Kafka, Flume

Additional Experience required for all teams to create an added advantage:

  • CI/CD software, Testing Tools - Jenkins, SonarQube
  • Version Control Tool - Aldon+LMe, CA Endeavor
  • Deployment Tool kit -Jenkins
  • Service or Incident Management (IcM) Tools - Remedy
  • Source Code Repository Tool - Bitbucket
  • Scheduling Tool - Control-M
  • Defect Management Tool - JIRA
  • Application Testing tool - QuerySurge
  • Cloud certification
  • Platforms provided by FICO, Experian, SAS for credit and portfolio management

EDUCATION

  • Bachelor's degree/University degree in Computer Science, Engineering, or equivalent experience


  • Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesA large financial institution with large data team is looking for Application Development Manager / Lead with the following responsibilities : Managing an applicaiton development team of around 20+ members Managing the solutioning of Big Data and enterprise BI applications Building frameworks, best practices for the engineering...


  • Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesA large financial institution with large data team is looking for Application Development Manager / Lead with the following responsibilities : Managing an applicaiton development team of around 20+ members Managing the solutioning of Big Data and enterprise BI applications Building frameworks, best practices for the engineering...


  • Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesA well-established financial organization with a robust data team is in search of an Application Development Manager/Lead to take on the following key responsibilities:Overseeing an application development team consisting of over 20 membersSupervising the design of Big Data and enterprise BI applicationsEstablishing frameworks and top...


  • Singapore Grab Full time

    Job Description:Life at Grab:At Grab, every Grabber is guided by The Grab Way, which spells out our mission, how we believe we can achieve it, and our operating principles - the 4Hs: Heart, Hunger, Honour and Humility. These principles guide and help us make decisions as we work to create economic empowerment for the people of Southeast Asia.Get to know our...


  • Singapore INOVAS TECH PTE. LTD. Full time

    Employer briefing:Our client is a leading interactive entertainment company revolutionizing the gaming industry. With a strong focus on innovation and exceptional game development, our client creates immersive experiences that captivate players worldwide. As the mastermind behind popular titles like "Genshin Impact," our client pushes the boundaries of...

  • Big Data Engineer

    2 weeks ago


    Singapore NodeFlair Full time

    Job Summary:SalaryS$6,500 - S$13,000 / MonthlyJob TypeSeniorityJuniorYears of ExperienceAt least 1 yearTech StacksETL ClickHouse Presto Java Hive Spark Flink SQL Scala Hadoop Python**ResponsibilitiesAbout TikTokTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices...

  • Big Data Engineer

    2 weeks ago


    Singapore HELIUS TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesPosition Type: Contract deputed to ClientRequired skillsMinimum 4 years of experience in Data Engineering Experience in Cloudera Data Platform Experience in computing, distributed, big data systems: Hadoop, HDFS, Nginx, Kubernetes, Docker, OpenStack, Spark, Flink Understands Linux operating system, storage, network IO and other...


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$13,160 - S$22,080 / Monthly ESTJob TypePermanentSeniorityDirectorYears of ExperienceAt least 7 yearsTech StacksETL SparkML Spring Pig HBase RabbitMQ Hive Impala Spark NoSQL kafka Springboot Cassandra Hadoop MongoDB We are looking for a Big Data Engineer that will work on developing frameworks using Spark and Spring Boot microservices to...


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$6,500 - S$11,700 / MonthlyJob TypeSenioritySeniorYears of ExperienceAt least 7 yearsTech StacksETL SparkML Spring Pig HBase RabbitMQ Hive Impala Spark NoSQL kafka Springboot Cassandra Hadoop MongoDBBusiness FunctionGroup Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure...

  • Big Data Engineer

    2 weeks ago


    Singapore D L RESOURCES PTE LTD Full time

    BIG DATA ENGINEER / DATA SCIENTIST, FCC ANALYTICSJob Description:Big Data EngineeringCreate, build and maintain the data infrastructure required for Extraction, Transformation and Loading of data from a wide variety of sources.Ensure high-quality data is delivered to support Compliance / FCC model development.Support the implementation of Data Analytics /...

  • Big Data Developer

    1 month ago


    Singapore Robert Walters Full time

    A global financial services company is seeking a Big Data Developer (12-month renewable contract). About the Big Data Developer (12-month renewable contract) Role: In this job, you will build data capabilities for multiple financial systems.Key Responsibilities: Study, evaluate and provide feedback on functional specifications. Provide detailed estimation...

  • Big Data Developer

    2 weeks ago


    Singapore Robert Walters Full time

    A global financial services company is seeking a Big Data Developer (12-month renewable contract). About the Big Data Developer (12-month renewable contract) Role: In this job, you will build data capabilities for multiple financial systems.Key Responsibilities: Study, evaluate and provide feedback on functional specifications. Provide detailed estimation...

  • Big Data Developer

    4 weeks ago


    Singapore Robert Walters Full time

    A global financial services company is seeking a Big Data Developer (12-month renewable contract). About the Big Data Developer (12-month renewable contract) Role: In this job, you will build data capabilities for multiple financial systems.Key Responsibilities: Study, evaluate and provide feedback on functional specifications. Provide detailed estimation...

  • Big Data Developer

    2 weeks ago


    Singapore Pan Asia Group Resources Full time

    JD: Minimum 5 years of total IT experience; at least 4 years of experience in development with PySpark & Python; Good knowledge and experience on Big Data platform, Big Data Eco system tools, SPARK, Python, Etc. Experience with Banking domain is preferable. Strong understanding of SDLC processes including all the project documentations. Ability to work under...

  • Big Data Engineer

    3 weeks ago


    Singapore TIKTOK PTE. LTD. Full time

    ResponsibilitiesAbout TikTokTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul, and Tokyo. Why Join UsCreation is the core of TikTok's purpose. Our platform is built to help...

  • Big Data Engineer

    2 weeks ago


    Singapore TIKTOK PTE. LTD. Full time

    Roles & ResponsibilitiesTikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa.TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin,...

  • Big Data Engineer

    4 weeks ago


    Singapore HELIUS TECHNOLOGIES PTE. LTD. Full time

    Roles & ResponsibilitiesPosition Type: Contract deputed to ClientRequired skills Minimum 4 years of experience in Data Engineering Experience in Cloudera Data Platform Experience in computing, distributed, big data systems: Hadoop, HDFS, Nginx, Kubernetes, Docker, OpenStack, Spark, Flink Understands Linux operating system, storage, network IO and other...

  • Big Data Engineer

    2 weeks ago


    Singapore TikTok Full time

    ResponsibilitiesTikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok's sponsorship of a visa.TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai,...

  • Senior Data Engineer

    4 weeks ago


    Singapore TANGSPAC CONSULTING PTE LTD Full time

    Roles & ResponsibilitiesWorking in a large Big data and datawarehouse team of a bank, you will be responsible for carrying out the following Understand functional requirements translate user specs to FSD Carrying out solution design Carrying out data analysis and mapping carrying out development of DW and Big data solutionsRequirements MIn 7 years of...

  • Big Data Developer

    2 weeks ago


    Singapore Cognizant Full time

    Responsibility: Develop and maintain data pipelines implementing ETL processes in Bigdata environment Take responsibility for Hadoop development and implementation Experience in Python, Spark, PySpark, and Hive Understanding of data warehousing and data modeling techniques Knowledge on Data lake architectureRequirements: Bachelor's degree in Computer Science...