Big Data Developer

2 months ago


Singapur, Singapore Helius Full time
Job Title: Big Data Developer

Helius is seeking a highly skilled Big Data Developer to join our team. As a key member of our data integration team, you will be responsible for designing, developing, and deploying production-grade Talend Big Data jobs that meet our organization's architecture standards.

Key Responsibilities:
  • Design and develop Talend Big Data jobs that integrate with various data sources, including AS400, Oracle Finance, and MS SQL.
  • Work closely with data modelers and system analysts to ensure data interface and requirement specifications are met.
  • Conduct technical sessions and clarifications with data modelers and sub-system teams to ensure solution design, coding, and unit testing meet requirements.
  • Document and review design of Talend Big Data jobs and interface specifications.
  • Implement error and exception handling, and integrate Talend jobs with Autosys.
  • Perform technical impact assessments, source code releases, and deployment checklists.
  • Validate built conformance to required specifications.
  • Self-learn and pick up application setup and support from vendors.
  • Work effectively with peers and vendors to develop, set up, and support IFRS17 application and data integration.
  • Support SIT and UAT activities, including defect analysis, troubleshooting, and fixing.
  • Coordinate and support Performance and Security Testing activities, including environment setup and test scope.
  • Coordinate with infrastructure teams on deployment and related activities.
  • Provide enhancement and production support after project go-live.
Requirements:
  • 4+ years of data warehousing experience.
  • 3+ years of experience working with Hadoop (Hortonworks) as a developer, with expertise in Spark and Hive, especially Spark version 2.
  • Talend Big Data version 7+ developer experience, with 3-5 years of working experience deploying code to production.
  • 2+ years of experience working with Talend Big Data version 7 on Hadoop.
  • Experience designing Talend job orchestration through enterprise workload automation tools like Control-M, preferably Autosys.
  • Working knowledge of Hortonworks data platform for data ingestions frameworks from multiple source systems.
  • Development experience using Java, PL/SQL, SQL, Python, Scala, with good knowledge of data models and data flows, and strong understanding of dimensional and relational databases.
  • Insurance and financial reporting domain knowledge is an advantage.


  • Singapur, Singapore TikTok Full time

    About the TeamTikTok's Tea platform is a cutting-edge analytics platform used by over 10,000 employees globally. As a key member of our global engineering team, you will be responsible for deploying, configuring, and maintaining big data platforms, as well as implementing and optimizing infrastructure for big data storage, processing, and computation.**Key...

  • Big Data Engineer

    2 months ago


    Singapur, Singapore Virtusa Full time

    Big Data EngineerVirtusa is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop data pipelines using ETL tools...

  • Big Data Engineer

    1 month ago


    Singapur, Singapore Virtusa Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop big data...

  • Big Data Engineer

    1 month ago


    Singapur, Singapore DBS Bank Full time

    Job SummaryDBS Bank is seeking an experienced Big Data Engineer to join our Group Technology and Operations team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining enterprise-class Big Data applications.Key ResponsibilitiesDesign and develop scalable Big Data architectures using Hadoop, Spark, and other related...

  • Senior Data Engineer

    2 months ago


    Singapur, Singapore Helius Full time

    Job Title: Senior Data Engineer - Big DataHelius is seeking a highly skilled Senior Data Engineer - Big Data to join our team. As a Senior Data Engineer - Big Data, you will be responsible for designing, developing, and deploying large-scale data processing systems using Talend Big Data version 7+ and Hadoop.Key Responsibilities:Design and develop...


  • Singapur, Singapore DBS Bank Full time

    Job Title: Big Data Delivery LeadDBS Bank is seeking a highly skilled Big Data Delivery Lead to join our Consumer Banking Group Technology team. As a key member of our team, you will be responsible for driving the delivery of big data solutions that meet the strategic goals of the bank.Responsibilities:Collaborate with cross-functional teams to design and...

  • Big Data Engineer

    3 weeks ago


    Singapur, Singapore TikTok Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our Data Platform Business Partnering team at TikTok. As a key member of our team, you will be responsible for designing and implementing data tools and applications that drive business growth.Key ResponsibilitiesTranslate business requirements into technical implementation for building...

  • Data Engineer

    3 weeks ago


    Singapur, Singapore IITMatrix Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at IITMatrix. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable data processing systems using Big Data technologies such as Hadoop, Spark, and NoSQL...


  • Singapur, Singapore TikTok Full time

    About the team :Tea(Toutiao Event Analyze) is an in-house analytics platform that is heavily used by more than 10,000 employees globally. This is a data middle platform product built on user behavior data, providing data analysis services for various domestic and international businesses within ByteDance/TikTok, including Douyin, Toutiao, Xigua, TikTok,...

  • Big Data Engineer

    3 weeks ago


    Singapur, Singapore Virtusa Full time

    Job Title: Big Data EngineerAt Virtusa, we are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop big data...


  • Singapur, Singapore Nityo Infotech Full time

    Job Title: Big Data Solutions EngineerWe are seeking a highly skilled Big Data Solutions Engineer to join our team at Nityo Infotech. As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:Design and develop scalable...

  • Big Data Specialist

    2 months ago


    Singapur, Singapore Epam Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data ingestion and processing jobs in big data environments.Key ResponsibilitiesAnalyze and document business data requirements to ensure seamless data access to...


  • Singapur, Singapore PatSnap Full time

    About PatSnap Patsnap empowers IP and R&D teams by providing better answers, so they can makefaster decisions with more confidence. Founded in 2007, Patsnap is the global leaderin AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on ourextensive proprietary innovation data, coupled with Hiro, our AI assistant, deliversactionable insights...

  • Data Engineer

    2 months ago


    Singapur, Singapore Nityo Infotech Full time

    Job Title: Data Engineer - Big Data SolutionsWe are seeking a highly skilled Data Engineer to join our team at Nityo Infotech. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:Design and develop scalable and efficient data processing...

  • Java Developer with

    4 months ago


    Singapur, Singapore Unison Consulting Pte Ltd Full time

    We are seeking an experienced Java Developer with expertise in Google Cloud Platform (GCP) and Big Data technologies. The ideal candidate will have a strong background in Java development, cloud computing, and data engineering to help us build and maintain scalable, high-performance systems.Key Responsibilities: Design, develop, and maintain Java-based...

  • Big Data Engineer

    5 months ago


    Singapur, Singapore Virtusa Full time

    Big Data Engineer - 123101 Description Responsibilities Good understanding and completion of projects using waterfall/Agile methodology. • Good understanding of analytics and data warehouse implementations. • Ability to troubleshoot complex issues ranging from system resource to application stack traces. • Strong SQL, data modelling and data...

  • Data Engineer

    3 weeks ago


    Singapur, Singapore Nityo Infotech Full time

    Job Title: Data Engineer - Big Data SolutionsWe are seeking a highly skilled Data Engineer to join our team at Nityo Infotech. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:* Design and develop scalable and efficient data...

  • Big Data Engineer

    2 months ago


    Singapur, Singapore DBS Bank Full time

    About the RoleDBS Bank is seeking a highly skilled Big Data Engineer to join our Group Technology and Operations team. As a key member of our team, you will be responsible for designing, developing, and maintaining enterprise-class Big Data applications.Key ResponsibilitiesDesign and implement scalable Big Data architectures using Hadoop, Spark, and other...


  • Singapur, Singapore U3 Full time

    Job Title: Big Data Platform Engineer/ArchitectAt U3, we are seeking a highly skilled Big Data Platform Engineer/Architect to join our team. As a key member of our engineering team, you will be responsible for designing and developing scalable, secure, and efficient big data platforms on hybrid cloud environments.Key Responsibilities:Design and develop batch...

  • Big Data Engineer

    4 weeks ago


    Singapur, Singapore TikTok Full time

    About the TeamWe are the Recommendation Architecture Team at TikTok, responsible for building and optimizing the architecture for our recommendation system to provide the best experience for our users.ResponsibilitiesDesign and implement a scalable offline data architecture for large-scale recommendation systemsDevelop flexible and high-performance storage...