Hadoop Developer

  Plan, install, configure, and deploy Hadoop clusters based on business requirements and workload demands. Monitor and manage the health of Hadoop clusters, addressing performance issues and ensuring optimal resource utilization. Implement and maintain security protocols within the Hadoop ecosystem, including authentication, authorization, and encryption....

We are seeking a skilled and experienced Hadoop Administrator to join our team. As a Hadoop Administrator, you will be responsible for the design, implementation, and maintenance of our Hadoop infrastructure. You will work closely with data engineers, data scientists, and other stakeholders to ensure the smooth functioning of our big data...

Key Responsibilities •Strong experience in Customization of ADF UI and SOA workflows.•Experience on XML, XSD, SOAP, WSDL, SOA BPEL process, Oracle Business Rule and Human Workflows for request approvals in Approval policy.•Strong experience in integrating OIM with AD, Exchange, RACF, AS400 connectors•Must have Core Java/J2EE knowledge for...

DCRP Core Build SG Red Hat Linux,Shell Script,SQL,Python,NOSQL development,MLS,enterprise design,application security testing,Unix Shell Scripting,MariaDB,Oracle DB,Hadoop,Hive,BitBucket,Git,JIRA,System Interfaces,FTP,API Experience Required 10 - 20 Years Industry Type IT Employment Type Permanent Location Singapore Roles &...

Job Description 5+ years of experience as ETL Developer.Minimum 3 year experience with Big Data Hadoop Spark ,Hive , Sqoop ,YARN.Experience in Programming Languages : Scala , Python, JavaExperience in developing medium to large scale Data Integration projectsExtensive experience with SQL with relational databases. Such as Oracle, DB2, MySQLGood knowledge in...

Key Responsibilities •Participate in end-to-end projects for system implementation of MLS system•Engage and collaborate with Architects, Security and Development Lead to ensure solution design complies with enterprise design principles, security, and control standards•Coordinate with Technical Delivery Manager to plan technical deliverables and...

We are looking for a highly experienced and skilled Data Architect to join our team. The ideal candidate will have 12-15 years of experience in architecting solutions of data engineering, focusing on ELT and PySpark/Hadoop workloads. In addition to strong solution and delivery skills, the ideal candidate will also have a view on business growth and managing...

[What the role is] NYP-Microsoft Centre for Applied AI is a specialist technology and training centre, jointly established by NYP and Microsoft with funding support from SkillsFuture Singapore. The centre aims to drive and accelerate the adoption of Artificial Intelligence (AI) technologies and solutions by Singapore’s industry, especially the SMEs in the...

Key Responsibilities Participate in end-to-end projects for system implementation of MLS system Engage and collaborate with Architects, Security and Development Lead to ensure solution design complies with enterprise design principles, security, and control standards Coordinate with Technical Delivery Manager to plan technical deliverables and...

Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our...

Key Responsibilities•Work with different technology teams across infrastructure, and other divisions to deliver system solutions for the business.•Involve in development and system integration relevant systems with CDP / CDSW.•Hands-on experiences on Big Data solution and development based on Python technologies stack to design and implement secure,...

Description du poste Position In a challenging and multicultural environment, we seek a Java Developer to join our Core Banking IT department which is in charge of developing and maintaining the International Back Office Cash Management System of CACIB. This information system is deployed in 25 business units all around the world. The system has...

[What the role is]NYP-Microsoft Centre for Applied AI is a specialist technology and training centre, jointly established by NYP and Microsoft with funding support from SkillsFuture Singapore. The centre aims to drive and accelerate the adoption of Artificial Intelligence (AI) technologies and solutions by Singapore’s industry, especially the SMEs in the...

As an Assistant Development Engineer specializing in data analytics, you will play a key role in supporting the design, development, and deployment of data analytics solutions to drive business insights and decision-making processes. Working closely with our team of engineers and data scientists, you will contribute to the development of algorithms, models,...

We are an established, globally active management consulting company with offices in Switzerland, Germany, Austria, UK, USA, Singapore, Hong Kong, the Philippines, Australia, Indonesia and India. We are a valued partner to many of the world‘s largest international financial services and insurance firms. We support our clients at all project management...

Informatica Data Engineer Informatica Data Engineer will work on and supportHadoop to Snowflake Migration project Job Description / Responsibilities: Build data pipelines that migrate data from Hadoop to Snowflake. Work closely with data analysts and business end-users to implement and support data platforms using best-of-breed technology and...

Roles and Responsibilities: Develop Spark Scala and PySpark jobs for data transformation and aggregation.  Create unit tests for Spark transformations and helper methods.  Utilize Spark and Spark SQL to read parquet data and create tables in Hive using the Scala API.  Collaborate closely with the Business Analysts team to review...

Lead Environment Developer Experience: 10 years Job Mode: Full-time  Work Mode: On-site To lead KYC infra team and provide support to AML KYC projects/upgrade for Singapore and Regional entities Responsibilities •  Lead KYC infra team together with Tech Lead • Participate in end-to-end projects for system implementation of AML KYC system ...

The Opportunity: Within our team, we are dedicated to developing and maintaining the engines that power machine-learning-driven systems for content deduplication. This involves a fusion of machine learning models, Spark jobs executed on Hadoop clusters, and a user-friendly back-office UI component accessible to our internal business users. Our systems...

Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize data pipelines...