Senior Data Engineer(with As400)

6 days ago

Singapore NodeFlair Full time

**Job Summary**:
**Salary**
S$8,500 - S$11,000 / Monthly

**Job Type**

**Seniority**

Senior

**Years of Experience**
At least 10 years

**Tech Stacks**
AWK ETL Informatica Shell Script HDFS Shell Control-M UNIX Git Hive Impala Spark SQL Hadoop Elasticsearch

**Role**:Senior Data Engineer

**Job level**:More than 10 years of relevant experience (L4)

**Key skills**:
AS400, Hadoop, Data Lake, SQL, Informatica

**Key Responsibilities**:

- Design, develop, and implement data processing pipelines to process large volumes of structured and unstructured data
- Should have good knowledge and working experience in Database and Hadoop (Hive, Impala, Kudu).
- Should have good knowledge and working experience in scripting using (Shell script, awk programming, quick automation to integrating any third-party tools), BMC monitoring tools
- Good understanding and knowledge in Data Modelling area using industry standard data model like (FSLDM)
- Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and translate them into technical specifications and solutions
- It will be good to have experience in working with No SQL as well as virtualized Database Environment
- Implement data transformations, aggregations, and computations using Spark RDDs, Data Frames, and Datasets, and integrate them with Elasticsearch
- Troubleshoot and resolve issues related to data processing, performance, and data quality in the Spark-Elasticsearch integration
- Monitor and analyze job performance metrics, identify bottlenecks, and propose optimizations in both Spark and Elasticsearch components
- Flexibility to stretch and take challenges
- Communication & Interpersonal skills
- Attitude to learn and execute

**Key Requirements**:

- 7+ years of AS400, RPG, CLP & SQL
- Knowledge of Aldon Change Management System(ACMS) is a must
- Experience in developing Hadoop
- Experience in data lake (integration of different data sources into the data lake)
- SQL Stored Procedures/Queries/Functions
- Unix Scripting
- Experience with distributed computing, parallel processing, and working with large datasets
- Familiarity with big data technologies such as Hadoop, Hive, and HDFS
- Job Scheduling in Control-M
- Strong problem-solving and analytical skills with the ability to debug and resolve complex issues
- Familiarity with version control systems (e.g., Git) and collaborative development workflows
- Excellent communication and teamwork skills with the ability to work effectively in cross-functional teams.

  • As400 Developer

    2 weeks ago

    Singapore SAKSOFT PTE LIMITED Full time

    **Role**:AS400 Developer **Job level**:6+ years **Key skills**: AS400, Hadoop, Data Lake, SQL, Informatica **Key Responsibilities**: - Design, develop, and implement data processing pipelines to process large volumes of structured and unstructured data - Should have good knowledge and working experience in Database and Hadoop (Hive, Impala, Kudu). -...

  • AS400 Application Infra

    3 weeks ago

    Singapore D L RESOURCES PTE LTD Full time

    Roles & ResponsibilitiesKey responsibilities:Responsible for reviewing/understanding requirements and develop CL/RPG programs with DB2 in AS400 Responsible for AS400 system environment setup for new server/apps/country Responsible for build of interface file layout in AS400 with the Connect Direct setup to file sending/receiving with source system in...

  • Rpgile As400 Deposits Igswk001

    3 days ago

    Singapore INTELLIMATICZ PTE. LTD. Full time

    **Intellimaticz Pte Ltd** **Role**:RPGILE AS400 Deposits **Job Requisition Number**:IGSWK001 **Job Level**:More than 10 years of experience (L4) **Location**:Singapore **Key Requirements**: - More than 10 years working experience with AS400 system development and projects/changes implementation experience in the financial industry. - Strong technical...

  • As400 Developer

    4 days ago

    Singapore HYPERSCAL SOLUTIONS PTE. LTD. Full time

    **COMPANY DESCRIPTION** Beyondsoft International (Singapore) Pte. Ltd. was set up in 2007 and established as the regional headquarters for the Southeast Asia (SEA) and European markets in September 2015. Based on our vision of "Using technology to promote social progress, economic development and become a global customer preferred partner" and our concept...

  • IT Infrastructure Engineer

    18 hours ago

    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full time

    Astek is looking for **Infrastructure Engineer (IBM AS400) **who will be responsible for supporting projects services based in Singapore. **Responsibilities** - Ensure the quality of ITP services remains consistently high, that operating policies are developed or are strictly followed, and adhere to all IT security policies to maintain system integrity and...

  • AS400 Application Infra

    2 weeks ago

    Singapore D L Resources Pte Ltd Full time

    Key responsibilities: Responsible for reviewing/understanding requirements and develop CL/RPG programs with DB2 in AS400 Responsible for AS400 system environment setup for new server/apps/country Responsible for build of interface file layout in AS400 with the Connect Direct setup to file sending/receiving with source system in various platforms. ...

  • AS400 Application Infra

    3 days ago

    Singapore D L Resources Pte Ltd Full time $90,000 - $120,000 per year

    Key responsibilities:Responsible for reviewing/understanding requirements and develop CL/RPG programs with DB2 in AS400Responsible for AS400 system environment setup for new server/apps/countryResponsible for build of interface file layout in AS400 with the Connect Direct setup to file sending/receiving with source system in various platforms.Responsible for...

  • Sr. Software Engineer

    2 weeks ago

    Singapore Thakral One Full time

    **Responsibilities**: - Maps functional requirements to components to enable common solution design across the platform. - Engages Product Owner to ensure that requirements are sufficiently communicated to enable technical design, estimation and build. - Hands-on coding using AS400, RPGLE, SQLRPGLE, RPG, SQLRPG, CLP, CLLE, Query/400, DB2/400 and ALDON. -...

  • AS400 Infrastructure Manager

    2 weeks ago

    Singapore ESPIRE INFOLABS (SINGAPORE) PTE. LTD. Full time

    Job Summary: The AS400 IT Infrastructure Manager is responsible for overseeing the end-to-end technical infrastructure and system resources of the IBM iSeries (AS400) platform. This role ensures the reliable, secure, and optimized operation of all iSeries hardware, software, and network components. The manager leads stratelifegic planning, system...

  • AS400 Manager

    2 weeks ago

    Singapore Espire Infolabs Full time

    Interested Candidates can share their CV at Position: IBMi (AS400) Manager Location- Singapore (Onsite) - Sponsorship available Job Summary: The AS400 IT Infrastructure Manager is responsible for overseeing the end-to-end technical infrastructure and system resources of the IBM iSeries (AS400) platform. This role ensures the reliable, secure, and...