Senior/Lead Data Engineer

2 weeks ago

Singapore CHARLES & KEITH GROUP Full time

Get AI-powered advice on this job and more exclusive features.
Job Overview:
The Senior/Lead Data Engineer is responsible for designing, developing, and optimizing scalable data solutions on Alibaba Cloud's big data platforms, including MaxCompute and Hologres. This role will take a hands-on approach in building robust data pipelines, ensuring data quality and integrity, and supporting the organization's data-driven initiatives. The ideal candidate has deep experience with Alibaba Cloud's big data ecosystem and is proficient in leading technical efforts in complex data warehousing and processing environments.
Responsibilities:
Data Pipeline Development and Optimization
Design and implement efficient ETL/ELT pipelines on Alibaba Cloud to support ingestion, transformation, and loading of large-scale data
Integrate data from multiple systems into a centralized data warehouse, ensuring consistency, accuracy, and accessibility for analytics and reporting
Continuously optimize and monitor data pipelines to ensure high performance, scalability, and efficient resource usage within Alibaba Cloud environments
Data Warehouse Management
Develop, manage, and optimize big data warehouses on Alibaba Cloud, using tools like Hologres, MaxCompute, and DataWorks
Implement data modeling best practices to structure and organize data for optimal accessibility, flexibility, and query performance
Establish data validation, monitoring, and quality assurance practices to maintain high data quality standards across the data warehouse
Collaboration and Team Management
Work closely with data analysts, data scientists, and business stakeholders to understand data needs and provide tailored data solutions
Translate business requirements into technical specifications for data pipelines, storage, and processing solutions
Provide guidance on data engineering best practices and data warehouse solutions to team members and support their technical growth
Data Governance and Compliance
Maintain clear and comprehensive documentation for data pipelines, data warehouse structures, and data governance practices
Ensure compliance with data governance policies and standards for data security and privacy, working closely with security and governance teams
Requirements:
Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or related field
5+ years in data engineering, with strong hands-on experience in Alibaba Cloud, particularly Hologres, MaxCompute, and related big data tools
Proficiency in big data technologies (e.g., Hologres, MaxCompute, DataWorks, Flink), Strong SQL, Python, or Spark skills for data manipulation and processing
Ability to work independently and take initiative on complex data engineering tasks
Capacity to lead technical efforts, mentor junior engineers, and set standards for data engineering best practices
Team player with strong collaboration skills, able to work effectively with both internal and external teams
Seniority level
Executive
Employment type
Full-time
Job function
Information Technology
Industries
Retail and Retail Apparel and Fashion
#J-18808-Ljbffr

  • Senior Data Scientist

    2 weeks ago

    Singapore Data Science Full time

    Data Science RoleJoin our team of passionate Data Scientists dedicated to enhancing Grab Food and Mart Search and Ranking experiences.We're looking for a Senior Data Scientist to create scalable machine learning algorithms, spanning areas like Search, Ranking, Natural Language Processing, and Large Language Models (LLMs).The role is based onsite at Grab...

  • Senior Data Scientist

    2 weeks ago

    Singapore Data Science Full time

    Get to know the team You'll be part of the SNP Data Science Search and Ranking team, an established group dedicated to enhancing Grab Food and Mart Search and Ranking experiences. We focus on developing cutting-edge Deep Learning models to deliver user experiences. Our team comprises passionate Data Scientists with various expertise. If searching for Search...

  • Data Engineering Lead

    2 days ago

    Singapore R Systems (Singapore) Pte Ltd Full time

    At least 3 full end to end project delivery experience in last 5+ years as Senior Data engineer as mentioned in the Qualifications and Job descriptions section above. - Have lead, at least 2 full projects as senior or lead data engineer - Familiarity with agile and DevOps principles, test-driven development, continuous integration, and other Software...

  • Senior Data Centre Engineer

    3 weeks ago

    Singapore E-ENGINEER SERVICE PTE. LTD. Full time

    Job DescriptionWe are seeking an experienced Data Center Engineer to join our team. The successful candidate will be responsible for setting up and installing network and server hardware according to business requirements.The role involves maintaining, diagnosing, and troubleshooting infrastructure system health, as well as fixing any issues that arise.Key...

  • Senior Data Centre Engineer

    4 weeks ago

    Singapore E-ENGINEER SERVICE PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description● Setup and install network and server hardware according to business requirements● Maintain, diagnose and troubleshoot infrastructure system health and fix any issues that arise● Deploy and configure Linux server operating system● Manage data center assets and inventories● Maintain proper documentation and...

  • Senior Data Centre Engineer

    3 weeks ago

    Singapore E-ENGINEER SERVICE PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description● Setup and install network and server hardware according to business requirements● Maintain, diagnose and troubleshoot infrastructure system health and fix any issues that arise● Deploy and configure Linux server operating system● Manage data center assets and inventories● Maintain proper documentation and...

  • Data Engineer

    2 weeks ago

    Singapore NTT Data Singapore Full time

    **The primary responsibilities**: - Lead architecture design, develop, document, and implement end-to-end data pipelines and data-driven solutions. - Define roadmap to transform data architecture focusing on scalability, performance, and stability for the entire data lifecycle; - Build data flow for data acquisition, aggregation, and modelling, using both...

  • Data Centre Engineer

    3 weeks ago

    Singapore E-ENGINEER SERVICE PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description Summary:We are seeking a skilled Data Center Engineer to join our team at E-Engineer Service Pte Ltd. The ideal candidate will have hands-on experience in data center operations, familiarity with facility management, server hardware, and network equipment.Job Description:

  • Lead Data Engineer

    3 days ago

    Singapore Temus Full time

    Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Temus Temus was established by Temasek in partnership with UST, to provide digital transformation solutions for the private and public sectors as we aspire to be a strategic partner in realising the Singapore Government's Smart Nation vision. We are...

  • Lead Data Engineer

    3 weeks ago

    Singapore VANGUARD SOFTWARE PTE. LTD. Full time

    Lead Data EngineerWe are seeking a highly experienced and talented Lead Data Engineer to lead the design, development, and maintenance of our data infrastructure, pipelines, and analytical tools.The ideal candidate will have a strong technical background in data engineering, expertise in analytical tools, and proven leadership skills to mentor and guide a...