Senior Data Engineer

1 week ago

Singapore Neurones IT Asia Full time $90,000 - $120,000 per year

We are looking for a passionate and skilled Python Data Engineer to join our Singapore Team.

The role will cover below areas:

  • Collaborate with BAs to clarify requirements in a fast-paced environment.
  • Develop scalable Python and PySpark scrapers integrated with existing Databricks frameworks.
  • Ingest structured and unstructured data from websites (HTML, PDF, Excel, APIs, CSV, etc.).
  • Build and test scrapers in Databricks (DBX), following GM design patterns and using shared libraries.
  • Use ADF for orchestration and integrate with GM frameworks for logging, error handling, and translation.
  • Write clean, reusable Python code for data processing, automation, and transformation.
  • Monitor, debug, and maintain data pipelines to ensure reliability and fast issue resolution.
  • Review technical specifications and work closely with FO Analysts for validation and clarification.
  • Ensure scrapers support Japanese websites with power market data and adhere to HTML/API nuances.
  • Follow IaC and AZD standards as per GM setup for deployment and infrastructure.
  • Document pipelines and approaches based on existing standards; explain solutions clearly to users.
  • Present work regularly to the Data Engineering Manager, wider team, and Head of Data when needed.
  • Validate solutions against functional and non-functional requirements.
  • Demonstrate a proactive, problem-solving, and delivery-focused mindset.

Technologies:

  • Strong expertise in Python programming and SQL.
  • Hands-on experience with web scraping and industry best practices.
  • Familiarity with Python libraries for language translation (nice to have).

Knowledge of modern cloud-based data architectures, including Data Lakehouse on Databricks

  • Experience with Databricks and Azure is highly desirable.
  • Good understanding of Big Data frameworks like Spark and file formats like Parquet.

Software engineering and delivery

  • Source code management e.g. Azure DevOps, Git
  • Agile delivery methodologies such as SCRUM or Kanban
  • Knowledge and work management tools (e.g., JIRA, Confluence)
  • Certified in Data Engineering, Azure or Python

  • Data Engineer

    2 weeks ago

    Singapore NTT DATA, Inc. Full time

    Join to apply for the Data Engineer role at NTT DATA, Inc. . Overview As part of our data-driven transformation initiatives, we are looking for a motivated Associate Data Engineer to join our team. This role is ideal for early-career professionals who are passionate about building scalable data pipelines, integrating diverse data sources, and enabling...

  • Senior Engineer/Engineer, Facility Management

    4 days ago

    Singapore Keppel Data Centres Full time

    Senior Engineer/Engineer, Facility Management Join to apply for the Senior Engineer/Engineer, Facility Management role at Keppel Data Centres Senior Engineer/Engineer, Facility Management Join to apply for the Senior Engineer/Engineer, Facility Management role at Keppel Data Centres Maintain a positive and professional working relationship with internal...

  • Senior Engineer/Engineer, Facility Management

    6 days ago

    Singapore Keppel Data Centres Full time

    Senior Engineer/Engineer, Facility Management Join to apply for the Senior Engineer/Engineer, Facility Management role at Keppel Data Centres Senior Engineer/Engineer, Facility Management Join to apply for the Senior Engineer/Engineer, Facility Management role at Keppel Data Centres Maintain a positive and professional working relationship with internal and...

  • Senior Engineer/Engineer, Facility Management

    3 weeks ago

    Singapore Keppel Data Centres Full time

    Senior Engineer/Engineer, Facility ManagementJoin to apply for the Senior Engineer/Engineer, Facility Management role at Keppel Data CentresSenior Engineer/Engineer, Facility ManagementJoin to apply for the Senior Engineer/Engineer, Facility Management role at Keppel Data CentresMaintain a positive and professional working relationship with internal and...

  • Data Engineer

    5 days ago

    Singapore NTT Data Singapore Full time

    **The primary responsibilities**: - Lead architecture design, develop, document, and implement end-to-end data pipelines and data-driven solutions. - Define roadmap to transform data architecture focusing on scalability, performance, and stability for the entire data lifecycle; - Build data flow for data acquisition, aggregation, and modelling, using both...

  • Senior Backup Engineer SME

    7 hours ago

    Singapore NTT DATA, Inc. Full time

    Join to apply for the Senior Backup Engineer SME role at NTT DATA, Inc. 2 days ago Be among the first 25 applicants Join to apply for the Senior Backup Engineer SME role at NTT DATA, Inc. Get AI-powered advice on this job and more exclusive features. Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are...

  • Senior CNC Machinist Specialist

    2 weeks ago

    Singapore beBeeMechanical Engineer Full time $4,500 - $5,500

    Job Title: Senior CNC Machinist Specialist">Overview:">We are seeking a skilled and experienced CNC Machinist to lead our machining operations. The ideal candidate will have a strong background in mechanical engineering, manufacturing, or a related field.">About the Role:">This is a leadership position that requires expertise in CNC turning and milling. You...

  • Senior Process Systems Specialist

    2 weeks ago

    Singapore beBeeProcess Engineer Full time $120,000 - $180,000

    Job Description">Hanwha Ocean Offshore Business is transitioning from a traditional shipbuilder to an Engineering, Procurement, Construction, Installation, and Operation (EPCI(O)) solution provider. We offer products such as FPSO, FLNG, Offshore Renewables, and other Floating Production Units.We are expanding our global footprint by establishing new Global...

  • Data Scientist

    1 week ago

    Singapore Data Analytics Full time $90,000 - $120,000 per year

    Get to Know the TeamGFin Analytics team supports the GFin product and business organisations, across Payments Core, Payments Experience, Lending, Insurance, and Kios. As a Data Scientist (Analytics), you'll be part of the Lending tech family where we strive to be the best FinTech company in the region. Our team is focused on understanding user experiences...

  • Senior Data Scientist

    2 days ago

    Singapore Data Analytics Full time $104,000 - $130,878 per year

    Get to Know the TeamOur Search and Personalisation Team focuses on advancing scalable machine learning and experimentation frameworks that power search relevance, ranking, and recommendations across Grab. By leveraging cutting-edge analytics and statistical methods, we continuously optimize how users connect with merchants, services, and content.Get to Know...