This is an IT support group | Senior Data Engineer

18 hours ago


Singapore This is an IT support group Full time

As a
Senior Data Engineer , you will play a leading role in designing, building, and optimizing our data infrastructure, ensuring that it supports the advanced analytics needs of the bank. You will oversee a team of data engineers, working closely with data analysts, DevOps team, infrastructure engineers, and other stakeholders to deliver high-quality data solutions.
RESPONSIBILITIES
Lead the design, development, and implementation of data pipelines, transformations, and aggregations to support analytics and machine learning initiatives.
Optimize Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch.
Design and deploy data engineering solutions on OpenShift using containerization and orchestration techniques.
Implement and maintain CI/CD pipelines for data engineering workflows, ensuring platform stability and efficient resource utilization.
Stay abreast of emerging technologies and best practices in data engineering and DevOps.
Collaborate with cross-functional teams to define data requirements and translate them into robust and scalable solutions.
Mentor and guide junior team members, fostering a culture of continuous learning and innovation.
REQUIREMENTS
Bachelor's degree in Computer Science, Data Engineering, Information Technology, or a related field.
7+ years of experience as a Data Engineer with expertise in Hadoop, Spark, and related technologies (HDFS, Hive, Ranger).
Strong proficiency in Spark, Python, Scala, or Java for data engineering tasks.
Experience with containerization (Docker, Kubernetes) and orchestration platforms like OpenShift.
Knowledge of DevOps practices, CI/CD pipelines, and automation tools (Jenkins, Ansible, BitBucket).
Strong problem-solving, troubleshooting, and communication skills.
Ability to work effectively in a fast-paced, collaborative environment.
NICE TO HAVE
Experience with monitoring and logging tools (Grafana, Prometheus, Splunk) is a plus.
Experience with cloud platforms (AWS, Azure, GCP) is a plus.
WE OFFER
By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021, 2022, & 2023.
Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters.
You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices.
We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey.
At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us.
#J-18808-Ljbffr



  • Singapore This is an IT support group Full time

    Job Purpose As a Data Engineer, you will be a key player in building and maintaining the robust data infrastructure that underpins our railway operations. You will design, develop, and optimize data pipelines to ingest, process, and transform data from diverse sources, including laser measurement systems, photo imaging, and maintenance records. Your...


  • Singapore This is an IT support group Full time

    COMPANY DESCRIPTION As the world's leading owner and operator of LPG carriers with five decades of operating experience, BW LPG promotes competitive, sustainable solutions to secure value for society and our stakeholders. Our global footprint spans seven countries with 17 nationalities represented across our workforce. Our fleet of 39 Very Large Gas...


  • Singapore This is an IT support group Full time

    About iNova iNova is a different kind of health company. We are leading the way to better health by delivering innovative, patient-centric products that improve the lives of people around the world. Our diverse portfolio of iconic, market-leading consumer health brands and prescription medicines are backed by science and distributed in over 75 markets...


  • Singapore This is an IT support group Full time

    About our group: The Test Process and Engineering Analysis (TPEA) team is responsible for the design and development of HDD test processes and supporting new product launches for best-in-class Enterprise and Client classes of HDD with the latest cutting-edge technologies such as Heat Assisted Media Recording (HAMR) and Hybrid Shingled Media Recording. The...


  • Singapore This is an IT support group Full time

    As a Lecturer, your contributions go beyond teaching and facilitating learning. You will play a critical role in recognising and nurturing your students’ potential and their lifelong learning needs. In addition to your teaching duties, you will carry out industry or consultancy projects to help you remain relevant in your profession and to evolving...


  • Singapore This is an IT support group Full time

    As a Lead Data Engineer , you will play a leading role in designing, building, and optimizing our data infrastructure, ensuring that it supports the advanced analytics need of the bank. You will oversee a team of data engineers, working closely with data analysts, DevOps team, infrastructure engineers, and other stakeholders to deliver high-quality data...


  • Singapore This is an IT support group Full time

    Job title: Senior Engineer I (Manufacturing Support)Location: Singapore Hiring Manager: Senior Manager, Manufacturing Support About The Job We deliver 4.3 billion healthcare solutions to people every year, thanks to the flawless planning and meticulous eye for detail of our Manufacturing & Supply teams. With your talent and ambition, we can do even more to...


  • Singapore This is an IT support group Full time

    Phillips 66 & YOU - Together we can fuel the future Phillips 66 has more than 140 years of experience in providing the energy that enables people to dream bigger and go farther, faster. We are committed to improving lives, and that is our promise to our employees and our communities. We are sustained by the backgrounds and experiences of our diverse teams,...


  • Singapore This is an IT support group Full time

    Job description: Overall Function Reporting to the Head of Data Centre, the incumbent will primarily be involved in the day-to-day operations of the NETS Data Centre. Key Responsibilities Perform day-to-day data centre/ computer operations (batch processing, printing reports, systems backup, tape management, server reboots, facilities and infrastructure...


  • Singapore This is an IT support group Full time

    As a Senior DevOps Engineer , you will play a leading role in designing, building, and optimizing our data infrastructure, ensuring that it supports the advanced analytics needs of the bank. You will oversee a team of data engineers, working closely with data analysts, the DevOps team, infrastructure engineers, and other stakeholders to deliver high-quality...


  • Singapore This is an IT support group Full time

    At Barings, we are as invested in our associates as we are in our clients. We recognize those who work diligently for us and reward them for personal and professional integrity, communication skills, distinct competencies and expertise in specific strategies, ability to collaborate as a team member and true dedication to the interests of our clients. We...


  • Singapore This is an IT support group Full time

    Desired Candidate Profile Technology Engineering Expertise 5 years of experience in implementing data solutions using GCP SQL programming Proficient in dealing with data access layer RDBMS and NoSQL Experience in implementing and deploying Big Data applications with AWS and GCP Big Data Services Must have excellent SQL skills Experience with different...


  • Singapore This is an IT support group Full time

    IT INFRASTRUCTURE ENGINEER RESPONSIBILITY The IT Infrastructure Engineer is responsible for the implementation, operation and maintenance of application infrastructure services that meet application requirements and business needs, and is aligned to Government’s policies, standards and procedures. The IT Infrastructure Engineer Will Get To Engage...


  • Singapore This is an IT support group Full time

    Description The Data Center Infrastructure Operations Team forms the backbone of AWS, supporting the rapidly growing business and its customers 24/7. We are dedicated to maintaining AWS’s physical infrastructure while upholding the highest operational standards in safety, security, availability, productivity, capacity, efficiency, and cost-effectiveness....


  • Singapore This is an IT support group Full time

    PURPOSE Being a vital member of the GO Data monetization team to support and contribute to the overall Smart Insurance and Data Monetization Strategy Champion and drive customer acquisition, retention, cross-sell and upsell campaign across markets. Drive customer engagement initiatives to achieve the collective Data Monetization target set for all markets....


  • Singapore This is an IT support group Full time

    Job Purpose Master Data Management is the core process to manage, centralize, organize, categorize, localize, synchronize, and enrich master data according to the operational strategies of the company. It manages and oversees the data source of information for SMRT’s inventories. Policy Management is the process of creating, implementing and maintaining...


  • Singapore This is an IT support group Full time

    1-Net manages carrier-neutral Internet Data Centers, along with providing a comprehensive range of integrated services including network connectivity, managed services, work area recovery suite, cloud and media delivery services. 1-Net's Data Center Corridor initiative currently interconnects key data centers in Singapore to facilities quick deployment...


  • Singapore This is an IT support group Full time

    Information Salary range: $4,500 - $6,500Allowance: $250 transport allowance Responsibilities Source new business by contacting potential customers, decision makers and target accounts. Analyzing market strategies, deal requirements and evaluate options. Works with internal to close deals and establish long term working relationships with stakeholders....


  • Singapore This is an IT support group Full time

    Award-winning medical device startup (GyroGear.co) has a single opening for a skilled Senior Electronics Engineer at our Singapore office. We are developing intelligent wearable devices to stabilise hand tremors for 200 million people globally. The candidate must be able to effectively understand and address the needs and problems, and to do so with a small...


  • Singapore This is an IT support group Full time

    Established since 1987, ECON Healthcare Group celebrates more than 35 years of commitment to quality healthcare and eldercare services this year. As a regional provider for integrated healthcare services in Singapore, Malaysia, and China, the Group incorporates a chain of medicare centres and nursing homes, hospital services, a careskill training centre, a...