Senior Data Engineer

2 weeks ago


Central Singapore BBGC Full time

Job Description:
Senior Data Engineer

Key Responsibilities:

  • Design, develop, and maintain data pipelines and ETL processes to ingest, process, and transform large volumes of structured and unstructured data from multiple sources.
  • Collaborate with crossfunctional teams including data scientists, analysts, and software engineers to understand data requirements and implement solutions that meet business needs.
  • Optimize and tune data pipelines and workflows for performance, scalability, and reliability.
  • Implement data governance processes and ensure data quality and integrity throughout the data lifecycle.
  • Design and maintain data warehouse and data lake architectures to store and organize data for analytics and reporting purposes.
  • Research and evaluate new technologies and tools to enhance our data infrastructure and capabilities.
  • Provide technical leadership and mentorship to junior members of the data engineering team.
  • Collaborate with infrastructure and DevOps teams to deploy and manage data solutions in cloudbased environments.
  • Develop and maintain documentation for data pipelines, systems, and processes.

Qualifications:

  • Bachelor's degree or higher in Computer Science, Engineering, or a related field.
  • X+ years of experience in data engineering, with a proven track record of designing and implementing complex data solutions.
  • Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks like Apache Spark or Apache Flink.
  • Strong experience with distributed data storage and processing technologies such as Hadoop, Apache Kafka, Apache HBase, or similar.
  • Handson experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and familiarity with related services such as AWS EMR, S3, Glue, or Azure Data Factory.
  • Experience with SQL and relational databases (e.g., PostgreSQL, MySQL) as well as NoSQL databases (e.g., MongoDB, Cassandra).
  • Solid understanding of data modeling concepts and proficiency in designing efficient data schemas.
  • Excellent problemsolving skills and the ability to troubleshoot complex data issues.
  • Strong communication and collaboration skills, with the ability to work effectively in a team environment.
  • Experience with Agile development methodologies and tools like JIRA is a plus.

  • Data Engineer

    2 weeks ago


    Singapore DOZER DATA PTE. LTD. Full time

    About the job:This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data.This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers.Responsibilities:In this role,...

  • Senior Data Engineer

    2 weeks ago


    Singapore NodeFlair Full time

    Job Summary:SalaryS$103,700 - S$135,000 / MonthlyJob TypeSenioritySeniorYears of ExperienceAt least 5 yearsTech StacksClickHouse T SQL BigQuery JavaScript SQL PythonKey Responsibilities: Lead the development and optimization of our data pipelines, databases and systems for serving data to our customers, ensuring scalability, efficiency, and reliability. Work...

  • Senior Data Engineer

    2 weeks ago


    Central Singapore PERSOLKELLY Full time

    Duration: 12 months contractWorking hours: Monday - Friday (8.30AM to 6.00PM / 9.00AM to 6.30PM)Working locations: Central.Salary up to $12750 SGDResponsibilities Perform complex daytoday development for GCP cloud environment. Develop, maintain, and tune highly complex scripts using Python and Big Query. Managing and designing solutions related to Data...


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$6,000 - S$10,000 / MonthlyJob TypeSenioritySeniorYears of ExperienceAt least 2 yearsTech StacksDruid Java Hive Spark Linux kafka Flink Scala Hadoop PythonResponsible for the collection, analysis and mining of massive data in the game business and building an intelligent game system. Collaborate with the business team for game data...

  • Data Engineer

    4 weeks ago


    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates, please email your resume to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Marina Bay Financial CentreBenefits: Renewable contract (Performance-based, with possibility of...

  • Senior Data Engineer

    2 weeks ago


    Singapore Claremont Consulting Full time

    Work type: Location:Singapore Discipline: Contact name: Posted date:25-Jul-2023Senior Data Engineer-Essential Skills:Strong experience in Data Engineering building strong, robust pipelines to ingest data from a variety of sources with a focus on real-time streaming Strong Spark / Spark Streaming experience Experience in Java, Kafka and Streaming...


  • Singapore Land Transport Authority Full time

    What the role is SENIOR / EXECUTIVE DATA ENGINEER / DATA ENGINEERWhat you will be working on You will be part of a team of data engineers deriving business insights from large and realtime datasets for strategic planning and operational efficiency. You will also be responsible for the team's projects to identify and explore suitable technologies, strategies...


  • Singapore NodeFlair Full time

    Job Summary:SalaryS$8,33- S$16,666 / Monthly ESTJob TypePermanentSenioritySeniorYears of ExperienceAt least 5 yearsTech StacksSnowflake Spring BigQuery Java Spark kafka Flink Springboot Kotlin SQL Scala Hadoop Python In this data engineering role, we are seeking engineers with a background in data engineering to join us in various aspects of data...

  • Senior Data Engineer

    2 weeks ago


    Singapore REGASK PTE. LTD. Full time

    **OUR COMPANYRegASK is an international, diverse and rewarding place to work. If you are a builder, highly autonomous in your working style, and eager to problem solve, we would love to hear from you.**THE POSITION_Title: _Senior Data EngineerRegASK is a digital platform, using artificial intelligence for augmenting regulatory research. Our technology...

  • Senior Data Engineer

    2 weeks ago


    Singapore NodeFlair Full time

    Job Summary:SalaryS$7,000 - S$10,000 / MonthlyJob TypeSenioritySeniorYears of ExperienceAt least 7 yearsTech StacksHANA ETL Snowflake AWS Data Extraction Analytics Teradata CI R RedShift Java Scala PythonThe Data and AI teams at TE are part of the TE Information Solutions (TEIS) Organization and Corporate Technology and are responsible for driving organic...

  • Senior Data Engineer

    2 weeks ago


    Singapore NodeFlair Full time

    Job Summary:SalaryS$9,000 - S$10,000 / MonthlyJob TypeSenioritySeniorYears of ExperienceAt least 10 yearsTech StacksAWK ETL Informatica Shell Script HDFS Shell Control-M UNIX Git Hive Impala Spark SQL Hadoop ElasticsearchRole:Senior Data EngineerJob level:More than 10 years of relevant experience (L4)Key skills:AS400, Hadoop, Data Lake, SQL, InformaticaKey...

  • Senior Data Engineer

    2 weeks ago


    Singapore NodeFlair Full time

    Job Summary:SalaryS$6,000 - S$7,700 / MonthlyJob TypeSenioritySeniorYears of ExperienceAt least 2 yearsTech StacksStrategy HANA ETL AWS Oracle Analytics Google Cloud SAP MSSQL Hive SQL PythonDuties and Responsibilities Set up data infrastructure, data pipelines, integrate source system data with data lakes and data mining models into data pipelines. Design,...

  • Senior Data Engineer

    4 weeks ago


    Singapore MINDEN INTERNATIONAL PTE. LTD. Full time

    Roles & ResponsibilitiesWho we are:minden.ai is a technology venture founded by Temasek in strategic partnership with DFI Retail Group and coalition partners BreadTalk Group, DBS Bank, PAssion Card, Mandai Wildlife Group, Singtel, FoodPanda, GoJek and Great Eastern. We are on a mission to redefine the engagement between brands and consumers in Southeast...

  • Senior Data Engineer

    2 months ago


    Singapore MINDEN INTERNATIONAL PTE. LTD. Full time

    Roles & ResponsibilitiesWho we are:minden.ai is a technology venture founded by Temasek in strategic partnership with DFI Retail Group and coalition partners BreadTalk Group, DBS Bank, PAssion Card, Mandai Wildlife Group, Singtel, FoodPanda, GoJek and Great Eastern. We are on a mission to redefine the engagement between brands and consumers in Southeast...

  • Senior Data Engineer

    2 weeks ago


    Singapore Singtel Full time

    Senior Data Engineer:Date:30-Mar-2023Location: Singapore, SingaporeCompany:Singtel GroupResponsibilities: Design, develop and automate large scale, highperformance distributed data pipelines (batch and/or realtime streaming) that meet both functional and nonfunctional requirements Deliver high level & detailed design to ensure that the solution meet business...

  • Data Engineer

    2 weeks ago


    Central Singapore Abbott Laboratories Full time

    Primary Function/Primary Goals/Objectives: Identify business needs, collect, data analysis & interpretation and visualization of manufacturing and business data. Report insights and help users to make decisions and find improvement opportunities.Major Responsibilities: Engaging crossfunctional stakeholders to understand business requirements (voice of...

  • Senior Data Engineer

    2 weeks ago


    Singapore AZENDIAN Full time

    Senior Data EngineerFull TimeMalaysia, SingaporeWhat We Do Matters:Azendian Solutions is an artificial Intelligence, data science solutions and operations technology start-up, contributing to smart city solutions with a current focus on Education and the Built Environment. We also have a thriving data science consulting and system integration practice. We...


  • Singapore NTT DATA Full time

    Req ID:227497We are currently seeking a Field Tech Senior Associate to join our team in Singapore, Central Singapore (SG-01), Singapore (SG).We are looking to hire a skilled Desktop Support Engineer to assist our clients with computer hardware and software issues. You will be required to work on-site or via remote connection and assist with hardware...

  • Senior Data Engineer

    2 weeks ago


    Singapore Munich Re Full time

    Senior Data Engineer:CompanyMunich ReLocationSingapore, SingaporeYOUR OPPORTUNITYBig data, artificial intelligence and advanced analytics are transforming the insurance industry across the value chain. Munich Re is at the forefront of this trend, having made a significant investment in start-of-the-art analytics infrastructure and software, central and...

  • Senior Data Engineer

    2 weeks ago


    Singapore Avanade Full time

    Come join usAs a member of the Data Engineering team, you'll have access to the research, knowledge, and tools to create leading-edge solutions across Avanade's Intelligent Data Platform practice. The role of Senior Data Engineer is perfect for ambitious technologists passionate about working with the latest Microsoft cloud technology and Microsoft experts....