BigData Platform Engineer/Architect

5 months ago

Singapur, Singapore U3 Full time
Summary :

The Platform Engineer /Architect is responsible to define architecture and strategy for Batch workloads in Hybrid cloud environment. This includes POC design, enabling multitenancy and capacity planning at enterprise scale, component stress and load testing, deployment automation, monitoring and governance.

Responsibilities :

The main and routine tasks of this position are to:
Design and develop the Batch data processing on onprem or public cloud Develop and maintain an advanced platform to manage Kubernetes clusters lifecycle for batch processing. Understand the On prem VM based Bigdata ecosystem, designing and developing migration plan to on prem cloud native deployment. Determine security and segregation of Lab and Factory/BAU workloads. Develop tools for automated build, test, deployment and management of the platform. Determine approach for multitenancy and capacity planning at enterprise scale. Improve continuous integration and delivery systems. Monitor system events to ensure health, maximum system availability and service quality Maintain documentation regarding configurations, operations and troubleshooting procedures Participate in the definition of standards, guidelines and best practices. Assist in evaluating new requirements, technical design and standards. Participate in R&D effort bringing new ideas and new technologies
Qualifications

A University Degree or equivalent experience in Computer Information Systems, Computer Science, Mathematics or a related field.

Relevant experience :
Architect: Have worked on Big Data for more than 8+ years and have hands on with Spark, Hive & Presto. Developer: 2+ years of experience in Kubernetes/OpenShift.
Skills :
Good with Architecture and has good understanding and in depth knowledge on distributed systems Professional experience building enterprise Big Data Applications using Spark, Hadoop, Hive etc. Hands on Knowledge on Containerisation and deploying Opensource products on K8s/ OpenShift. Maintaining and building inhouse based Opensource platforms like Hadoop, Spark, Hive, Presto Skill in developing techniques and methodologies to resolve unprecedented problems or situations Ability to communicate effectively with all levels of management Ability to communicate with remote teams Ability to make complex information accessible Must be a self-starter that requires only limited supervision/guidance Candidate must present with honesty, integrity and maintains confidentiality at all times Be a team player Have good interpersonal communication skills Ability to work effectively in a fast paced changing environment Ability to multi-task and prioritize Thorough experience in defining and applying design standards, patterns, quality matrix depending on the solutions Deep knowledge of OOPs, data structure, and algorithm Ability & willingness to learn technologies at pace

Knowledge:
Expertise with Java or any coding languages. Linux Scripting (Bash, Python, etc.) Expertise with Source Control Management (Git, Bitbucket, etc.) Expertise with CI/CD (Jenkins/ArgoCD) Expertise with Configuration Management (Ansible, Terraform etc.) Expertise with Monitoring (Prometheus, etc.) In-depth knowledge with Linux environments (RHEL) Knowledge on Protegrity. Knowledge of Cloud infrastructures (AWS EKS, Google GKS, Azure AKS, etc.) Knowledge of Web Servers (Nginx, Apache, etc.) Knowledge in RESTful API design and implementation Knowledge in the development of high-performance and fault-tolerant systems Knowledge in distributed systems programming Experience with Java or Go programming language an asset Experience with Docker an asset Experience running Kubernetes in production an asset Experience in large-scale production deployments an asset

  • Platform Architect

    2 weeks ago

    Singapur, Singapore ATLAS IMMIGRATION SERVICES PTE. LTD. Full time

    Job SummaryATLAS IMMIGRATION SERVICES PTE. LTD. is seeking a highly skilled Platform Architect to join our team. As a key member of our engineering team, you will be responsible for designing and developing our game development platform. This is a challenging and rewarding role that requires a strong technical background and excellent leadership skills.Key...

  • Big Data Platform Architect

    3 weeks ago

    Singapur, Singapore U3 Full time

    Job Title: Big Data Platform Engineer/ArchitectAt U3, we are seeking a highly skilled Big Data Platform Engineer/Architect to join our team. As a key member of our engineering team, you will be responsible for designing and developing scalable, secure, and efficient big data platforms on hybrid cloud environments.Key Responsibilities:Design and develop batch...

  • Cloud Engineer Associate

    1 week ago

    Singapur, Singapore DBS Bank Full time

    Job SummaryDBS Bank is seeking a skilled Cloud Engineer Associate to join our Data Technology team. As a Cloud Engineer Associate, you will play a key role in helping us realise Cloud at scale solutions in multi-hybrid cloud scenarios and heavily regulated workloads.Key ResponsibilitiesCollaborate with internal applications teams to understand platform usage...

  • Cloud Engineer Associate

    2 months ago

    Singapur, Singapore DBS Bank Full time

    Job SummaryWe are seeking a highly skilled Cloud Engineer Associate to join our Technology and Operations Data (T&O Data) team at DBS Bank. As a key member of our Cloud team, you will play a critical role in helping us realise Cloud at scale solutions in multi-hybrid cloud scenarios and heavily regulated workloads.Key ResponsibilitiesCollaborate with...

  • VP Analytics Platform Architect

    1 month ago

    Singapur, Singapore United Overseas Bank Full time

    About the RoleThe United Overseas Bank is seeking a highly skilled VP Analytics Platform Architect to join our Technology and Operations function. As a key member of our team, you will be responsible for designing, building, and overseeing the overall AI and ML solution in the organization.Key ResponsibilitiesArchitecting, designing, directing, and leading...

  • VP Analytics Platform Architect

    2 months ago

    Singapur, Singapore United Overseas Bank Full time

    About the RoleWe are seeking a highly skilled VP Analytics Platform Architect to join our Technology and Operations team at United Overseas Bank. As a key member of our organization, you will be responsible for designing, building, and overseeing the overall AI and ML solution in our organization.Key ResponsibilitiesArchitecting, designing, directing, and...

  • Big Data Platform Architect

    1 month ago

    Singapur, Singapore U3 Full time

    Job Title: Big Data Platform Engineer/ArchitectJob Summary:The Big Data Platform Engineer/Architect will be responsible for designing and implementing a scalable and secure big data platform on hybrid cloud environments. This includes defining architecture and strategy for batch workloads, enabling multitenancy and capacity planning at enterprise scale,...

  • Platform Architect

    4 weeks ago

    Singapur, Singapore Unison Consulting Pte Ltd Full time

    Job Title: Platform EngineerUnison Consulting Pte Ltd is seeking a skilled Platform Engineer to join our team. As a Platform Engineer, you will be responsible for designing and developing distributed applications using the Oracle Tuxedo middleware platform.Key Responsibilities:Design and Development: Design and develop distributed applications using Oracle...

  • Platform Architect

    4 weeks ago

    Singapur, Singapore Unison Consulting Pte Ltd Full time

    Job Title: Platform EngineerUnison Consulting Pte Ltd is seeking a skilled Platform Engineer to join our team. As a Platform Engineer, you will be responsible for designing and developing distributed applications using the Oracle Tuxedo middleware platform.Key Responsibilities:Design and Development: Design and develop distributed applications using Oracle...

  • VP Analytic Models Platform Architect

    2 weeks ago

    Singapur, Singapore United Overseas Bank Full time

    About the RoleThe United Overseas Bank is seeking a highly skilled Data Science Platform Architect to join its Technology and Operations function. As a key member of the team, you will be responsible for designing, building, and overseeing the overall AI and ML solution in the organization.Key ResponsibilitiesArchitecting, designing, directing, and leading...

  • VP Analytic Models Platform Architect

    5 months ago

    Singapur, Singapore United Overseas Bank Full time

    VP Analytic Models Platform Architect Posting Date: 08-May-2023 Location: Raffles Place, Singapore, Singapore Company: 3677 About UOB United Overseas Bank Limited (UOB) is a leading bank in Asia with a global network of more than 500 branches and offices in 19 countries and territories in Asia Pacific, Europe and North America. In Asia,...

  • AVP, Data Engineer

    5 months ago

    Singapur, Singapore DBS Bank Full time

    Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we managethe majority ofthe Bank's operational processes and inspire to delight our...

  • Associate, Cloud Engineer, Data Technology, Technology

    5 months ago

    Singapur, Singapore DBS Bank Full time

    Business Function Technology and Operations Data (T&O Data) enables and empowers the bank with an efficient, nimble, and resilient infrastructure through a strategic focus on big data, artificial intelligence and machine learning, empowering people capability and innovation. As part of the T&O Data, Automation and Innovation - Cloud team, you will help...

  • Cloud Engineer Associate

    2 weeks ago

    Singapur, Singapore DBS Bank Full time

    Job Title: Cloud Engineer AssociateJob Summary: We are seeking a highly skilled Cloud Engineer Associate to join our team at DBS Bank. As a key member of our Cloud team, you will be responsible for designing, building, and deploying cloud-based solutions that meet the needs of our business.Key Responsibilities:Collaborate with internal applications teams to...

  • Cloud Engineer Associate

    1 month ago

    Singapur, Singapore DBS Bank Full time

    Job SummaryDBS Bank is seeking a skilled Cloud Engineer to join our Technology team. As a Cloud Engineer, you will play a key role in designing and implementing cloud-based solutions that enable our business to operate efficiently and effectively.Key ResponsibilitiesCollaborate with internal applications teams to understand platform requirements and assist...

  • Digital Experience Platform Architect

    4 weeks ago

    Singapur, Singapore Sitecore Full time

    About Us:Sitecore is a leading company that empowers brands to build lifelong relationships with their customers through unforgettable digital connections. Our mission is to elevate leading brands by delivering a composable digital experience platform that meets the needs of the world's smartest and largest brands.We are a diverse group of passionate, smart,...

  • Senior Cloud Architect

    2 weeks ago

    Singapur, Singapore DBS Bank Full time

    Job Title: SVP/VP, Senior Principal Architect/Customer Success Manager, Data Technology, TechnologyDBS Bank is seeking a highly skilled and experienced Senior Principal Architect/Customer Success Manager to lead our Data Technology team. As a key member of our Technology organization, you will be responsible for designing, building, and managing our...

  • Big Data Platform Architect

    2 weeks ago

    Singapur, Singapore U3 Full time

    Job SummaryThe Enterprise Data Solutions Architect is responsible for designing and implementing scalable data processing architectures in hybrid cloud environments. This includes defining architecture and strategy for batch workloads, enabling multitenancy, and capacity planning at enterprise scale.Key ResponsibilitiesDesign and develop batch data...

  • Senior Engineering Manager, E-Commerce Platform

    2 weeks ago

    Singapur, Singapore TikTok Full time

    **Job Summary**We are seeking a highly experienced Senior Engineering Manager to lead our E-Commerce Platform team. The successful candidate will be responsible for designing and architecting solutions, providing technical support to engineers, and aligning with product and organizational objectives.**Key Responsibilities:**Design and architect solutions for...

  • Cloud Architect(AWS)

    1 month ago

    Singapur, Singapore VISEO ASIA PTE. LTD. Full time

    Roles & ResponsibilitiesThe ideal candidate will have a strong background in DevOps, MLOps, and DataOps, with expertise in cloud infrastructure, container platforms, and machine learning model deployment.Responsibilities: Design, implement, and maintain cloud infrastructure and container platforms Develop and manage DevOps, MLOps, and DataOpspipelines and...