Python Data Engineer

1 week ago

Singapore NEURONES IT ASIA PTE. LTD. Full time
Roles & Responsibilities

As a Python Data engineer, you will be a part of a highly qualified team, leading the delivery of modern data platforms using Azure Services and Databricks.

Your role is :

· Designing and delivering software using an agile and iterative approach based on Scrum or Kanban

· Following and contributing to improvement of client's software engineering practices e.g., source code management, test-driven development, automated testing, CI/CD

· Supporting the Lead Data Engineer in technical architecture and design

· Building an understanding of how data is used within client's commercial activity, and using this knowledge when working with Business Analysts or users to identify system requirements

· Analyzing and estimating IT changes giving input on technical opportunities, constraints, and trade-offs

· Creating documentation and presenting to technical and non-technical audiences · Providing handover to Support teams and providing third-line support for short periods after releases

· Owning their own learning so that they remain a technical subject matter expert.

Technical Skills

· Having solid experience of at least 7 plus years in data modeling, data warehousing, SQL Server database design and development (SQL, relational and dimensional modelling) Analytical querying using technologies such as SSAS cubes or columnar data stores, Python. · ETL tools such as SSIS, Alteryx, Azure Data Factory · Building data pipelines using code e.g. Pyspark · Modern cloud-based data architectures and technologies such as Data Lake, Delta Lake, Data Lakehouse e.g. Azure Data Lake Gen 2, Azure Delta Lake Lakehouse architecture using Databricks, Hudi or Iceberg

· NoSQL using CosmosDB, MongoDB, DynamoDB etc.

· Python scripting, including data engineering and machine learning libraries · Scripting languages such as Powershell, bash, DAX, M-language etc. (Note - We primarily use SQL, Pyspark and Python in our day-to-day work along with some coding around DAX, Bash, Powershell and other scripting languages. )

· Distributed computing mainly around Spark § Big data files formats e.g. Parquet, Avro, ORC etc.

· Big data technologies such as Hadoop, Hive, Map-Reduce, Partition design, performance tuning in Spark etc.

· Reporting and visualisation tools such as SSRS, Tableau, Power BI or Excel

Tell employers what skills you have

Tableau
Machine Learning
MongoDB
Azure
Big Data
Data Modeling
Pipelines
Hadoop
Software Engineering
Scripting
ETL
Data Engineering
SQL
Python
Power BI
Data Warehousing

  • Python Data Engineer

    16 hours ago

    Singapore NEURONES IT ASIA PTE. LTD. Full time

    As a Python Data engineer, you will be a part of a highly qualified team, leading the delivery of modern data platforms using Azure Services and Databricks. **Your role is**: - Designing and delivering software using an agile and iterative approach based on Scrum or Kanban - Following and contributing to improvement of client's software engineering...

  • Python Data Engineer

    4 weeks ago

    Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full time

    Roles & ResponsibilitiesWe're looking for an experienced Python Data Engineer to join our growing team and help design scalable data pipelines that handle massive datasets. What You'll Do:Build robust ETL/ELT pipelines using Python and cloud technologiesDesign data warehouses and lakes for analytics workloadsImplement real-time data processing...

  • Python Developer

    6 days ago

    Singapore NTT Data Singapore Full time

    **Python Development**: - Develop efficient, reusable Python code while adhering to Object-Oriented Programming (OOP), Don't Repeat Yourself (DRY), and Test-Driven Development (TDD) principles. **Cloud Infrastructure**: - Ensure the scalability, performance, and security of cloud-based systems. **Collaboration and Agile Development**: - Collaborate with...

  • Data Engineer

    1 week ago

    Central Singapore Emprego SG Full time

    **Location** Singapore, Central Singapore **Job Type** Contract **Salary** $5,000 - $8,000 Per Month **Date Posted** 5 hours ago Additional Details **Job ID** 91530 **Job Views** 1 **Job Description**: Roles & Responsibilities **Key Responsibilities**: - Based in the Group Customer Analytics & Decisioning team, you will be responsible for...

  • Python Data Engineer

    6 days ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,000 - S$11,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 3 years **Tech Stacks** Strategy API Pandas Flask SQL Django Python In Zenika, we are looking for a** Python Data Engineer **with at least 5 years of experience **You may be a fit if**: - You have experience in Python pandas and...

  • Data Engineer

    5 days ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,500 - S$10,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 3 years **Tech Stacks** Snowflake CI Python Astek is proposing an opportunity for **Data Engineer (Snowflake/Python) **to support our project based in **Singapore**. **Responsibilities** - Develop data set processes for data...

  • Senior Data Engineer

    2 weeks ago

    Singapore Tangspac Full time

    S - Posted by Subagio Kusuma- Managing Partner Working as data engineer for a large international bank, you will be part of the global data engineering team involved in development and implementing data solutions You will be working as data engineer with a large global bank, you will be playing key role in building complex data solution Job...

  • Data Engineer(Cloud Migration)

    6 days ago

    Singapore NTT DATA Full time

    Requirements / Qualifications - Bachelor's or master's degree in computer science, data engineering, or a related field. - Minimum 7 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC. - Proficiency in programming languages such as Python, Java, or Scala for building data pipelines. - Evaluate...

  • Data Engineer

    6 days ago

    Singapore ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Full time

    Astek is proposing an opportunity for **Data Engineer (Snowflake/Python) **to support our project based in **Singapore **. **Responsibilities** - Develop data set processes for data modeling, mining, and production. - Provide BAU support for production job monitoring, issue resolution, bug fixes. - Collaborate with data architects, modelers, and IT team...

  • Senior Data Engineer

    5 days ago

    Singapore DYNAMIC HUMAN CAPITAL PTE. LTD. Full time

    **Senior Data Engineer (Team lead, python, PostgreSQL, MongoDB)** Working location: Singapore West/ Hybrid (HW464- J) **Responsibilities** - **Perform research and development (R&D) and processes to meet the needs of our AI strategy**: - **Work with operation teams to identify and prioritize key areas of the business where AI solutions can drive...