Python Data Engineer

6 days ago


Singapore NEURONES IT ASIA PTE. LTD. Full time

As a Python Data engineer, you will be a part of a highly qualified team, leading the delivery of modern data platforms using Azure Services and Databricks.

**Your role is**:

- Designing and delivering software using an agile and iterative approach based on Scrum or Kanban
- Following and contributing to improvement of client's software engineering practices e.g., source code management, test-driven development, automated testing, CI/CD
- Supporting the Lead Data Engineer in technical architecture and design
- Building an understanding of how data is used within client's commercial activity, and using this knowledge when working with Business Analysts or users to identify system requirements
- Analyzing and estimating IT changes giving input on technical opportunities, constraints, and trade-offs
- Creating documentation and presenting to technical and non-technical audiences - Providing handover to Support teams and providing third-line support for short periods after releases

**Technical Skills**
- Having solid experience of at least 7 plus years in data modeling, data warehousing, SQL Server database design and development (SQL, relational and dimensional modelling) Analytical querying using technologies such as SSAS cubes or columnar data stores, Python. - ETL tools such as SSIS, Alteryx, Azure Data Factory - Building data pipelines using code e.g. Pyspark - Modern cloud-based data architectures and technologies such as Data Lake, Delta Lake, Data Lakehouse e.g. Azure Data Lake Gen 2, Azure Delta Lake Lakehouse architecture using Databricks, Hudi or Iceberg
- NoSQL using CosmosDB, MongoDB, DynamoDB etc.
- Python scripting, including data engineering and machine learning libraries - Scripting languages such as Powershell, bash, DAX, M-language etc. (Note - We primarily use SQL, Pyspark and Python in our day-to-day work along with some coding around DAX, Bash, Powershell and other scripting languages. )
- Distributed computing mainly around Spark - Big data files formats e.g. Parquet, Avro, ORC etc.
- Big data technologies such as Hadoop, Hive, Map-Reduce, Partition design, performance tuning in Spark etc.
- Reporting and visualisation tools such as SSRS, Tableau, Power BI or Excel


  • Python Developer

    4 days ago


    Singapore NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT...


  • Singapore TECH AALTO PTE. LTD. Full time $80,000 - $120,000 per year

    Job Title: Python / Data Engineer – Quantitative Investment SupportLocation: Onsite – SingaporeEmployment Type: ContractExperience Required: 4–8 yearsAbout the RoleWe are looking for a highly skilled Python/Data Engineer with strong experience in data manipulation, statistics, and machine learning models to support our Quantitative Investment team ....

  • Data Engineer

    1 week ago


    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,500 - S$10,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 3 years **Tech Stacks** Snowflake CI Python Astek is proposing an opportunity for **Data Engineer (Snowflake/Python) **to support our project based in **Singapore**. **Responsibilities** - Develop data set processes for data...


  • Singapore DYNAMIC HUMAN CAPITAL PTE. LTD. Full time

    **Senior Data Engineer (Team lead, python, PostgreSQL, MongoDB)** Working location: Singapore West/ Hybrid (HW464- J) **Responsibilities** - **Perform research and development (R&D) and processes to meet the needs of our AI strategy**: - **Work with operation teams to identify and prioritize key areas of the business where AI solutions can drive...

  • Data Engineer

    6 days ago


    Singapore Unison Consulting Pte Ltd Full time

    Design, implement, and maintain scalable and efficient data pipelines using Spark, Python, and PySpark. Ensure the smooth flow of data from various sources to destination systems. Utilize SAS, Spark, Python, and PySpark for efficient data processing. Design and implement data models to support business requirements. Work closely with data architects to...

  • Data Engineer

    1 week ago


    Singapore foodpanda Full time

    **Company Description** foodpanda is part of the Delivery Hero Group, the world’s pioneering local delivery platform, our mission is to deliver an amazing experience—fast, easy, and to your door. We operate in over 70+ countries worldwide. Headquartered in Berlin, Germany. Delivery Hero has been listed on the Frankfurt Stock Exchange since 2017 and is...

  • Data Engineer

    2 weeks ago


    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 3 years **Tech Stacks** Analytics Java SQL Python Astek is proposing an opportunity for **Data Engineer (Python/Java/SQL) **to support our project based in** Singapore.** **Responsibilities** - Work closely with business analyst and...

  • Data Engineer

    2 weeks ago


    Singapore Capgemini Full time

    **Responsibilities**: - Develop enterprise grade Data Products using Spark and other Big Data frameworks - Benchmark existing solutions, identify gaps, and propose solutions to eliminate them - Be able to work within a team of data engineers, data scientists, Devops engineers, business analysts, project managers around the proposed solution and contribute...

  • Data Engineer

    3 days ago


    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full time

    Evaluate new data visualization products and tools for enterprise use. - Create data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems. - Design and develop PowerBI dashboards and reports. - Troubleshoot and debug issues in production environments. - Stay up-to-date with emerging trends and technologies in...


  • Singapore Nucleus Health Full time

    **Responsibilities**: - Write effective, high-quality Python code to solve problems - Clearly explain the reasoning behind the code in Jupyter notebooks - Debug code and produce thorough documentation - Using free datasets (such as Kaggle, the UN, the US government, etc.), use your data analytic skills to formulate and respond to important business issues -...