Big Data Integration Specialist

4 weeks ago


Singapore Helius Full time
Job Description

About the Role

We are seeking a highly skilled Big Data Integration Specialist to join our team at Helius. As a key member of our data integration team, you will be responsible for designing and implementing production-grade Talend Big Data jobs that meet our IT organization's architecture standards.

Key Responsibilities

  • Develop and maintain Talend Big Data jobs with consideration for meeting the IT organization's architecture standards
  • Work closely with data modelers and system analysts on required data interface/requirement specifications
  • Conduct technical sessions/clarifications with data modelers and sub-system teams prior to solution design, coding, and unit testing
  • Document and review design of Talend Big Data jobs and interface specifications
  • Implement error and exception handling
  • Import jobs to Talend Data Catalogue
  • Integrate Talend jobs with Autosys and restart failed jobs from Autosys
  • Perform technical impact assessment, source code release, and deployment checklist
  • Validate built conformance to required specifications
  • Able to self-learn/pick up application setup and support from vendor
  • Work effectively with peers and vendors to develop, set up, and support IFRS17 application and data integration
  • Support SIT and UAT activities (e.g., perform defect analysis, troubleshooting, and fixing)
  • Coordinate and support Performance and Security Testing activities (e.g., environment setup and test scope)
  • Coordinate with infrastructure team on deployment and related activities
  • Provide enhancement and production support after project go live

Requirements

To be successful in this role, you will need:

  • Data Warehousing experience: 4 years minimum
  • 3+ years working experience of Hadoop (Hortonworks) developer experience in Spark and Hive; especially Spark version 2
  • Talend Big Data version 7+ Developer experience: having 3-5 years working experience deploying code to production
  • 2+ years working experience in Talend Big Data version 7 on Hadoop
  • Experience designing Talend job orchestration through enterprise workload automation tool like Control-M; preferably Autosys
  • Working knowledge of Hortonworks data platform for data ingestions frameworks from multiple source systems (e.g., AS400, Oracle Finance, MS SQL, etc.)
  • Have development experience using Java, PL/SQL, SQL, Python, Scala with good knowledge of data models and data flows with strong understanding of dimensional and relational databases, including: stored procedures, constraints, normalization, indexes, and security
  • Insurance and financial reporting domain knowledge will be an advantage

Salary Information

The estimated salary for this role is around $120,000 per year, depending on location and experience.



  • Singapore Unison Consulting Pte Ltd Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. This is a challenging role that requires expertise in designing, developing, and implementing scalable data processing pipelines using Spark Scala.Key Responsibilities:Data Processing: Design and develop efficient Spark Scala applications to process...


  • Singapore NTT DATA Services Full time

    About NTT DATANTT DATA is a trusted global innovator of business and technology services.We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. Job OverviewThe Software Development Senior Analyst role requires strong data engineering concepts and programming experience. This...


  • Singapore KERRY CONSULTING GROUP PTE. LTD. Full time

    About Kerry Consulting Group PTE. LTD.We are Kerry Consulting Group PTE. LTD., a leading consulting firm in the field of data analytics and cloud computing.Job OverviewWe are seeking an experienced Big Data Analytics Specialist to join our team. This role will involve designing, developing, and implementing big data solutions using Cloudera Distributed...


  • Singapore SAKSOFT PTE LIMITED Full time

    Job Title: Senior Data Integration SpecialistSAKSOFT PTE LIMITED invites applications for a skilled Data Engineer - Big Data ExpertAbout UsWe are a leading software company specializing in data integration and analytics solutions. Our team is passionate about delivering innovative technologies that drive business growth.Salary Range:$120,000 - $180,000 per...


  • Singapore KERRY CONSULTING GROUP PTE. LTD. Full time

    We are seeking a skilled Data Integration Specialist to join our team at Kerry Consulting Group PTE. LTD.The ideal candidate will have 5 years of relevant working experience and 2 years of experience in Big Data implementation projects.Key responsibilities include:Designing and implementing data integration solutions using Informatica, Data Stage, and...


  • Singapore ADVANCED E-SOLUTIONS PTE. LTD. Full time

    We are seeking a highly skilled Big Data Support Specialist to join our team at ADVANCED E-SOLUTIONS PTE. LTD. This role offers an exciting opportunity to work on complex data pipelines and support big data systems in a fast-paced banking/financial services industry environment.The estimated salary for this position is SGD $80,000 - SGD $110,000 per annum,...


  • Singapore Unison Consulting Pte Ltd Full time

    About UsUnison Consulting Pte Ltd is a leading consulting firm that specializes in data engineering solutions.We are seeking a highly skilled Big Data Engineering Specialist to join our team.Job DescriptionJob Title: Big Data Engineering SpecialistEstimated Salary: $120,000 - $180,000 per annumAs a Big Data Engineering Specialist at Unison Consulting Pte...


  • Singapore ONE NORTH CONSULTING PTE. LTD. Full time

    At One North Consulting PTE. LTD., we are seeking an experienced Senior Data Engineering Specialist to lead our big data solutions team. With a strong background in data engineering and modelling, you will design and implement scalable data pipelines, ensuring seamless data integration across multiple platforms.The ideal candidate will have at least 8+ years...


  • Singapore SOFTENGER (SINGAPORE) PTE. LTD. Full time

    We are Softenger (Singapore) PTE. LTD., a cutting-edge technology company, and we are seeking a highly skilled Senior Big Data Engineering Specialist to join our team.About the RoleThis is a contract position lasting 1 year, with a possibility of renewal. As a Senior Big Data Engineering Specialist, you will play a crucial role in building and optimizing big...


  • Singapore D L RESOURCES PTE LTD Full time

    About the RoleWe are seeking a highly skilled Big Data Engineering and Architecture Specialist to join our team at D L RESOURCES PTE LTD. As a key member of our data engineering group, you will be responsible for designing and implementing scalable, efficient, and secure big data solutions.


  • Singapore D L RESOURCES PTE LTD Full time

    About the RoleWe are seeking a skilled Big Data Architectural Specialist to join our team at D L RESOURCES PTE LTD. As a key member of our technology group, you will play a crucial role in designing and implementing end-to-end software solutions for our projects.

  • Big Data Developer

    2 weeks ago


    Singapore KERRY CONSULTING GROUP PTE. LTD. Full time

    Roles & ResponsibilitiesKerry is currently hiring a Big Data Developer / Data Modeller that is proficient with Cloudera Distributed Hadoop (CDH), Big Data, Spark, and Informatica. This role will involve strong experience in testing life cycles as well as excellent verbal and written communications skills to add value to the client-facing experiences.If you...


  • Singapore TikTok Full time

    About the TeamWe are the global engineering team for Tea, a cutting-edge in-house analytics platform that is heavily used by over 10,000 employees worldwide. Our mission is to build the best data analytics platform in the world.Job SummaryWe are seeking an experienced Data Analytics Platform Engineer - Big Data Specialist to join our talented team. The ideal...

  • Big Data Expert

    1 week ago


    Singapore KERRY CONSULTING GROUP PTE. LTD. Full time

    KERRY CONSULTING GROUP PTE. LTD. is seeking a highly skilled Big Data Expert to join our team in Singapore.We offer an attractive annual salary of SGD 120,000.Job Description:The ideal candidate will have strong experience in implementing big data solutions using Cloudera Distributed Hadoop (CDH), Hive, Pig, Sqoop, Flume, Oozie, MapReduce, YARN, Spark,...


  • Singapore D L RESOURCES PTE LTD Full time

    Job Title: Data Integration SpecialistAbout the Role:We are seeking a highly skilled Data Integration Specialist to join our team at D L RESOURCES PTE LTD. As a Data Integration Specialist, you will be responsible for designing, building, and implementing data integration solutions using Informatica Power Center 10.x or higher. You will work closely with our...


  • Singapore BRIGHTOIL PETROLEUM (S'PORE) PTE. LTD. Full time

    Are you a skilled data expert looking to take your career to the next level? We are seeking an experienced Big Data Infrastructure Specialist to join our team at Brightoil Petroleum (S'Pore) PTE. LTD.About the Role:We offer a highly competitive salary package of SGD $120,000 - $180,000 per annum, commensurate with experience.This is a full-time position...


  • Singapore ZENITH INFOTECH (S) PTE LTD. Full time

    At Zenith Infotech (S) Pte Ltd, we are seeking an experienced Big Data Migration Specialist to join our team. The ideal candidate will have a strong background in data engineering and migration, with expertise in AWS services, Databricks, and Informatica IDMC.About the RoleThis is a key role within our organization, responsible for migrating data from...


  • Singapore NTT Data Singapore Full time

    We are looking for a skilled Enterprise Workday Integration Specialist to join our team at NTT Data Singapore.About the RoleThis is an exciting opportunity to work on complex business problems and integrations with Workday cloud applications. As an Enterprise Workday Integration Specialist, you will be responsible for comprehending Workday integrations from...


  • Singapore ITCAN Full time

    About ITCAN">ITCAN is a leading technology company that specializes in data integration and big data solutions.


  • Singapore ITCAN Full time

    Job DescriptionAs a highly skilled ETL developer at ITCAN, you will be responsible for designing and implementing medium to large scale data integration projects using Big Data technologies such as Hadoop Spark, Hive, Sqoop, and YARN. Your extensive experience with SQL in relational databases like Oracle, DB2, and MySQL will be essential in developing...