BigData Platform Engineer/Architect

6 months ago

Singapur, Singapore U3 Full time
Summary :

The Platform Engineer /Architect is responsible to define architecture and strategy for Batch workloads in Hybrid cloud environment. This includes POC design, enabling multitenancy and capacity planning at enterprise scale, component stress and load testing, deployment automation, monitoring and governance.

Responsibilities :

The main and routine tasks of this position are to:
Design and develop the Batch data processing on onprem or public cloud Develop and maintain an advanced platform to manage Kubernetes clusters lifecycle for batch processing. Understand the On prem VM based Bigdata ecosystem, designing and developing migration plan to on prem cloud native deployment. Determine security and segregation of Lab and Factory/BAU workloads. Develop tools for automated build, test, deployment and management of the platform. Determine approach for multitenancy and capacity planning at enterprise scale. Improve continuous integration and delivery systems. Monitor system events to ensure health, maximum system availability and service quality Maintain documentation regarding configurations, operations and troubleshooting procedures Participate in the definition of standards, guidelines and best practices. Assist in evaluating new requirements, technical design and standards. Participate in R&D effort bringing new ideas and new technologies
Qualifications

A University Degree or equivalent experience in Computer Information Systems, Computer Science, Mathematics or a related field.

Relevant experience :
Architect: Have worked on Big Data for more than 8+ years and have hands on with Spark, Hive & Presto. Developer: 2+ years of experience in Kubernetes/OpenShift.
Skills :
Good with Architecture and has good understanding and in depth knowledge on distributed systems Professional experience building enterprise Big Data Applications using Spark, Hadoop, Hive etc. Hands on Knowledge on Containerisation and deploying Opensource products on K8s/ OpenShift. Maintaining and building inhouse based Opensource platforms like Hadoop, Spark, Hive, Presto Skill in developing techniques and methodologies to resolve unprecedented problems or situations Ability to communicate effectively with all levels of management Ability to communicate with remote teams Ability to make complex information accessible Must be a self-starter that requires only limited supervision/guidance Candidate must present with honesty, integrity and maintains confidentiality at all times Be a team player Have good interpersonal communication skills Ability to work effectively in a fast paced changing environment Ability to multi-task and prioritize Thorough experience in defining and applying design standards, patterns, quality matrix depending on the solutions Deep knowledge of OOPs, data structure, and algorithm Ability & willingness to learn technologies at pace

Knowledge:
Expertise with Java or any coding languages. Linux Scripting (Bash, Python, etc.) Expertise with Source Control Management (Git, Bitbucket, etc.) Expertise with CI/CD (Jenkins/ArgoCD) Expertise with Configuration Management (Ansible, Terraform etc.) Expertise with Monitoring (Prometheus, etc.) In-depth knowledge with Linux environments (RHEL) Knowledge on Protegrity. Knowledge of Cloud infrastructures (AWS EKS, Google GKS, Azure AKS, etc.) Knowledge of Web Servers (Nginx, Apache, etc.) Knowledge in RESTful API design and implementation Knowledge in the development of high-performance and fault-tolerant systems Knowledge in distributed systems programming Experience with Java or Go programming language an asset Experience with Docker an asset Experience running Kubernetes in production an asset Experience in large-scale production deployments an asset

  • Cloud Engineer Associate

    4 weeks ago

    Singapur, Singapore DBS Bank Full time

    Job SummaryDBS Bank is seeking a skilled Cloud Engineer Associate to join our Data Technology team. As a Cloud Engineer Associate, you will play a key role in helping us realise Cloud at scale solutions in multi-hybrid cloud scenarios and heavily regulated workloads.Key ResponsibilitiesCollaborate with internal applications teams to understand platform usage...

  • VP Analytic Models Platform Architect

    1 month ago

    Singapur, Singapore United Overseas Bank Full time

    About the RoleThe United Overseas Bank is seeking a highly skilled Data Science Platform Architect to join its Technology and Operations function. As a key member of the team, you will be responsible for designing, building, and overseeing the overall AI and ML solution in the organization.Key ResponsibilitiesArchitecting, designing, directing, and leading...

  • VP Analytic Models Platform Architect

    6 months ago

    Singapur, Singapore United Overseas Bank Full time

    VP Analytic Models Platform Architect Posting Date: 08-May-2023 Location: Raffles Place, Singapore, Singapore Company: 3677 About UOB United Overseas Bank Limited (UOB) is a leading bank in Asia with a global network of more than 500 branches and offices in 19 countries and territories in Asia Pacific, Europe and North America. In Asia,...

  • AVP, Data Engineer

    6 months ago

    Singapur, Singapore DBS Bank Full time

    Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we managethe majority ofthe Bank's operational processes and inspire to delight our...

  • Associate, Cloud Engineer, Data Technology, Technology

    6 months ago

    Singapur, Singapore DBS Bank Full time

    Business Function Technology and Operations Data (T&O Data) enables and empowers the bank with an efficient, nimble, and resilient infrastructure through a strategic focus on big data, artificial intelligence and machine learning, empowering people capability and innovation. As part of the T&O Data, Automation and Innovation - Cloud team, you will help...

  • Senior Cloud Architect

    1 month ago

    Singapur, Singapore DBS Bank Full time

    Job Title: SVP/VP, Senior Principal Architect/Customer Success Manager, Data Technology, TechnologyDBS Bank is seeking a highly skilled and experienced Senior Principal Architect/Customer Success Manager to lead our Data Technology team. As a key member of our Technology organization, you will be responsible for designing, building, and managing our...

  • Big Data Platform Architect

    1 month ago

    Singapur, Singapore U3 Full time

    Job SummaryThe Enterprise Data Solutions Architect is responsible for designing and implementing scalable data processing architectures in hybrid cloud environments. This includes defining architecture and strategy for batch workloads, enabling multitenancy, and capacity planning at enterprise scale.Key ResponsibilitiesDesign and develop batch data...

  • Principal Architect

    6 months ago

    Singapur, Singapore Airwallex Full time

    Airwallex is the leading financial technology platform for modern businesses growing beyond borders. With one of the worlds most powerful payments and banking infrastructure, our technology empowers businesses of all sizes to accept payments, move money globally, and simplify their financial operations, all in one single platform. Established in 2015,...

  • MicroStrategy Architect

    1 month ago

    Singapur, Singapore Rackspace Full time

    MicroStrategy Architect Job DescriptionWe are seeking an experienced MicroStrategy Architect to lead the design, development, and implementation of advanced business intelligence solutions using the MicroStrategy platform.Key Responsibilities:Architect and design BI solutions using MicroStrategy tools.Develop, optimize, and maintain MicroStrategy reports,...

  • Platform Engineer

    1 month ago

    Singapur, Singapore Centre for Strategic Infocomm Technologies Full time

    Key ResponsibilitiesWe are seeking a highly skilled Platform Engineer to join our team at the Centre for Strategic Infocomm Technologies. As a key member of our engineering team, you will be responsible for designing, building, and implementing platforms and tools for messaging and collaboration to enable seamless communication and knowledge sharing across...

  • Solutions Architect

    1 month ago

    Singapur, Singapore Databricks Full time

    Job Title: Solutions ArchitectAs a Pre-sales Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will...

  • Senior Vice President, Lead Data Analytics Platform Engineer

    1 month ago

    Singapur, Singapore United Overseas Bank Full time

    About the RoleAs a Senior Vice President, Lead Data Analytics Platform Engineer at United Overseas Bank, you will be responsible for leading the platform engineering aspects of Data Analytics domain, supporting BIG Data engineering, Data Integration, Data Quality, Analytics, ML model development, and operationalisation.Key ResponsibilitiesCollaborate with...

  • Senior Engineer

    3 months ago

    Singapur, Singapore Careers@Gov Full time

    [What the role is about] CAAS Next Generation Programme Office is looking for a strong, driven, and dynamic engineer candidate to be part of the Open Platform For Air Navigation Services System Integration (OPANS-SI) Section. You will be part of a multi-disciplinary team managing the integration of systems into the Open Platform for Air Navigation Services...

  • Cloud Architect

    1 month ago

    Singapur, Singapore Amaris Consulting Full time

    Job SummaryAmaris Consulting is seeking a skilled Cloud Architect to lead cloud transformation initiatives and design scalable, secure, and resilient cloud architectures.Lead cloud transformation initiatives to modernize and optimize infrastructure.Design and implement cloud architectures that meet business requirements.Collaborate with cross-functional...

  • Backend Software Engineer, E-commerce Platform

    2 months ago

    Singapur, Singapore TikTok Full time

    About the TeamThe Governance Platform team is a global team responsible for ensuring a safe and trustworthy marketplace for our buyers, sellers, and creators.We focus on risk detection, fairness, and sustainability of the E-commerce ecosystem, content and commodity quality, and friction-free experiences to drive improvement.ResponsibilitiesCollaborate with...

  • AWS Cloud Architect

    4 weeks ago

    Singapur, Singapore Amazon Web Services Singapore Private Limited Full time

    About the RoleWe are seeking a highly skilled AWS Cloud Architect to join our team in Singapore. As a Cloud Architect, you will be responsible for crafting architectures, proof of concepts, and demonstrations of our platform that work back from customer business needs and accelerate the adoption of appropriate AWS technology.Key ResponsibilitiesCollaborate...

  • MicroStrategy Architect

    3 months ago

    Singapur, Singapore Rackspace Full time

    MicroStrategy Architect We are looking for an experienced MicroStrategy Architect to lead the design, development, and implementation of advanced business intelligence solutions using the MicroStrategy platform. The ideal candidate will have in-depth expertise in MicroStrategy architecture, data modeling, report development, and dashboard design. They will...

  • Strategic Engineering Architect

    1 month ago

    Singapur, Singapore Crédit Agricole CIB Full time

    Job SummaryThe Principal Engineering Architect will lead the development of the IT strategy and architecture for Capital Markets, working closely with the Head of IT Division and the Head of division. The role will involve coordinating the elaboration of the IS Strategy, ensuring its consistency with the global CMI and GMD IS Strategy, and executing it...

  • Downstream Architect

    6 days ago

    Singapur, Singapore WGT EHR Pte Ltd Full time

    Job Descriptions: Owns the technology relationships & supports technology thought leadershipContinuously improve the architecture of Data Analytics PlatformDrives research, case studies, and prototypes on leading-edge technologies and how they can be leveraged.Develops proof of concepts (POCs) to evaluate new technologies and makes recommendations.Develops,...

  • Senior Technical Architect

    4 weeks ago

    Singapur, Singapore Idemia Full time

    At IDEMIA, we're committed to making the world a safer place through our cutting-edge identity technologies. As a key player in developing and implementing advanced border control systems, we're seeking a skilled Solution Architect to join our team.The Automated Border Control System (ABCS) uses state-of-the-art biometric technologies to facilitate faster...