Python Data Engineer

2 weeks ago

Singapore NEURONES IT ASIA PTE. LTD. Full time

As a Python Data engineer, you will be a part of a highly qualified team, leading the delivery of modern data platforms using Azure Services and Databricks.

**Your role is**:

- Designing and delivering software using an agile and iterative approach based on Scrum or Kanban
- Following and contributing to improvement of client's software engineering practices e.g., source code management, test-driven development, automated testing, CI/CD
- Supporting the Lead Data Engineer in technical architecture and design
- Building an understanding of how data is used within client's commercial activity, and using this knowledge when working with Business Analysts or users to identify system requirements
- Analyzing and estimating IT changes giving input on technical opportunities, constraints, and trade-offs
- Creating documentation and presenting to technical and non-technical audiences - Providing handover to Support teams and providing third-line support for short periods after releases

**Technical Skills**
- Having solid experience of at least 7 plus years in data modeling, data warehousing, SQL Server database design and development (SQL, relational and dimensional modelling) Analytical querying using technologies such as SSAS cubes or columnar data stores, Python. - ETL tools such as SSIS, Alteryx, Azure Data Factory - Building data pipelines using code e.g. Pyspark - Modern cloud-based data architectures and technologies such as Data Lake, Delta Lake, Data Lakehouse e.g. Azure Data Lake Gen 2, Azure Delta Lake Lakehouse architecture using Databricks, Hudi or Iceberg
- NoSQL using CosmosDB, MongoDB, DynamoDB etc.
- Python scripting, including data engineering and machine learning libraries - Scripting languages such as Powershell, bash, DAX, M-language etc. (Note - We primarily use SQL, Pyspark and Python in our day-to-day work along with some coding around DAX, Bash, Powershell and other scripting languages. )
- Distributed computing mainly around Spark - Big data files formats e.g. Parquet, Avro, ORC etc.
- Big data technologies such as Hadoop, Hive, Map-Reduce, Partition design, performance tuning in Spark etc.
- Reporting and visualisation tools such as SSRS, Tableau, Power BI or Excel

  • Python Developer

    2 weeks ago

    Singapore NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT...

  • Python & Data Engineer

    1 week ago

    Singapore TECH AALTO PTE. LTD. Full time $80,000 - $120,000 per year

    Job Title: Python / Data Engineer – Quantitative Investment SupportLocation: Onsite – SingaporeEmployment Type: ContractExperience Required: 4–8 yearsAbout the RoleWe are looking for a highly skilled Python/Data Engineer with strong experience in data manipulation, statistics, and machine learning models to support our Quantitative Investment team ....

  • Senior Data Engineer

    1 week ago

    Singapore Selby Jennings Full time

    Get AI-powered advice on this job and more exclusive features. Our client is a global investment firm that is hiring a Senior Python Developer (Market Data) to help build and maintain a next-gen market data platform. This full-stack role spans system engineering and data infrastructure with a focus on performance, scalability and reliability. Overview...

  • Data Engineer

    2 weeks ago

    Singapore Unison Consulting Pte Ltd Full time

    Design, implement, and maintain scalable and efficient data pipelines using Spark, Python, and PySpark. Ensure the smooth flow of data from various sources to destination systems. Utilize SAS, Spark, Python, and PySpark for efficient data processing. Design and implement data models to support business requirements. Work closely with data architects to...

  • Data Engineer(Python + Airflow + Snowflake)

    1 week ago

    Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time

    Role Data Engineer (Python + Airflow + Snowflake)Responsibilities Design, develop, and maintain complex data pipelines using Python for efficient data processing and orchestration. Collaborate with cross-functional teams to understand data requirements and architect robust solutions within the AWS environment. Implement data integration and transformation...

  • Senior/Lead Python

    2 days ago

    Singapore Zühlke Group Full time

    Join to apply for the Senior/Lead Python & Data Engineer role at Zühlke Group Join to apply for the Senior/Lead Python & Data Engineer role at Zühlke Group Founded in Switzerland in 1968, Zühlke is owned by its partners and located across Europe and Asia. We are a global transformation partner, with engineering and innovation in our DNA. We're trusted to...

  • Senior Data Engineer

    1 week ago

    Singapore Selby Jennings Full time

    Responsibilities of Senior Data Engineer (Market Data, Python) * Design and implement systems using Python with a focus on performance and scalability * Maintain high development standards including testing, CI/CD, and clean architecture * Enhance and support legacy systems (e.g., microservices, ETL pipelines, Excel add-ins)* Improve infrastructure via IaC,...

  • Senior Data Engineer

    1 week ago

    Singapore Selby Jennings Full time

    Responsibilities of Senior Data Engineer (Market Data, Python)* Design and implement systems using Python with a focus on performance and scalability* Maintain high development standards including testing, CI/CD, and clean architecture* Enhance and support legacy systems (e.g., microservices, ETL pipelines, Excel add-ins)* Improve infrastructure via IaC,...

  • Etl -data Engineer (Python Developer)

    1 week ago

    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$6,000 - S$8,500 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 4 years **Tech Stacks** ETL Amazon S3 AWS Glue Athena SQL PostgreSQL Python **Role**: ETL -Data Engineer (Python Developer) **Contract** : 12 months contract **Work Location** : East Coast Road **Must have Skills **:Python, AWS...

  • Azure Data engineer

    23 hours ago

    Singapore NTT Data Singapore Full time $80,000 - $120,000 per year

    Job Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...