Data engineer

3 days ago

Singapore FLINTEX CONSULTING PTE. LTD. Full time

Benefits: 13th Month Salary

Data Engineer (Azure) – Synapse and Pyspark, Python, Datawarehouse and Power BI, Azure Devops

Skills & Experience

  • Bachelor’s Degree in Computer Science or Engineering with 3-5 years of experience in Azure Data engineering, Python, Pyspark or Big Data development.

  • Sound Knowledge of Azure Synapse analytics for pipelines, orchestration, and setup.

  • 1-2 years experience in Visualization design and development with Power BI. Knowledge on row-level security and access control.

  • Sound experience in SQL, Datawarehouse, data marts, data ingestion with Pyspark and Python.

  • Expertise in developing and maintaining ETL processing pipelines in cloud-based platforms such as AWS, Azure, etc. (Azure Synapse or Data Factory preferred).

  • Team player with good interpersonal, communication, and problem-solving skills.

Job Scope

  • Design, review, and development of Pyspark scripts. Testing and troubleshooting of data pipelines and orchestration.

  • Designing and developing reports and dashboards in Power BI, setting up access control with row-level security, and DAX query experience.

  • Establishing connections to source data systems, including internal systems (e.g., SAP, Historians, Data Lake) as well as external systems (e.g., Web APIs).

  • Managing the collected data in appropriate storage/database solutions (e.g., file systems, SQL servers, Big Data platforms such as Hadoop, HANA) as required by the specific project requirements.

  • Design and development of data marts and relevant data pipelines using Pyspark, including data copy activities for batch ingestion.

  • Deployment of pipeline artifacts from one environment to another using Azure Devops.

  • Performing data integration using database table joins or other mechanisms as required by the analysis requirements of the project.

Good to Have

  • Data catalog with Purview enabling effective metadata management, lineage tracking, and data discovery.

  • Candidates should demonstrate the ability to leverage Purview to ensure data governance, compliance, and efficient data exploration within Azure environments.

Others

  • Able to work independently on assignments according to agreed schedules without much supervision.

  • Own assignments and take initiative to resolve issues hindering completion. Proactively reach out for help/guidance whenever required.

#J-18808-Ljbffr

  • Data Engineer

    1 week ago

    Singapore NTT Data Singapore Full time

    **The primary responsibilities**: - Lead architecture design, develop, document, and implement end-to-end data pipelines and data-driven solutions. - Define roadmap to transform data architecture focusing on scalability, performance, and stability for the entire data lifecycle; - Build data flow for data acquisition, aggregation, and modelling, using both...

  • Azure Data engineer

    2 days ago

    Singapore NTT Data Singapore Full time $120,000 - $180,000 per year

    Job Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...

  • Data Engineer

    2 weeks ago

    Singapore NTT Data Singapore Full time

    **Competency Required**: - Possess a degree in Computer Science/Information Technology or related fields. - At least 3 years of experience in a role focusing on development and support of data ingestion pipelines. - **Experience with building on data platforms, e.g. Snowflake.**: - **Proficient in SQL and Python.**: - Experience in continuous integration...

  • Electrical Systems Technical Specialist

    2 weeks ago

    Singapore beBeeelectrical engineer Full time $80,000 - $120,000

    Job Title: Electrical Systems SpecialistAn Electrical Engineer plays a vital role in the conceptualization, design, and development of electrical engineering projects.This position involves performing prototype testing, troubleshooting, and compiling detailed analysis reports. The successful candidate will be responsible for generating electrical schematics...

  • Data Scientist

    2 weeks ago

    Singapore Data Analytics Full time $90,000 - $120,000 per year

    Get to Know the TeamGFin Analytics team supports the GFin product and business organisations, across Payments Core, Payments Experience, Lending, Insurance, and Kios. As a Data Scientist (Analytics), you'll be part of the Lending tech family where we strive to be the best FinTech company in the region. Our team is focused on understanding user experiences...

  • Systems Optimization Expert

    5 days ago

    Singapore beBee Engineer Full time $80,000 - $120,000

    Role Description:">">We are seeking an Engineer to join our team, responsible for monitoring and maintaining critical information-communication systems.">">About the Role:">As a key member of our team, you will work alongside fellow engineers to ensure the reliability and functionality of our communication systems. Your expertise in advanced technologies...

  • Senior Data Scientist

    5 days ago

    Singapore Data Analytics Full time $104,000 - $130,878 per year

    Get to Know the TeamOur Search and Personalisation Team focuses on advancing scalable machine learning and experimentation frameworks that power search relevance, ranking, and recommendations across Grab. By leveraging cutting-edge analytics and statistical methods, we continuously optimize how users connect with merchants, services, and content.Get to Know...

  • Senior Data Scientist

    1 day ago

    Singapore Data Analytics Full time

    Get to Know the Team Our Search and Personalisation Team focuses on advancing scalable machine learning and experimentation frameworks that power search relevance, ranking, and recommendations across Grab. By leveraging cutting-edge analytics and statistical methods, we continuously optimize how users connect with merchants, services, and content. Get to...

  • Lead Data Scientist

    2 weeks ago

    Singapore Data Analytics Full time $150,000 - $200,000 per year

    Get to Know the TeamAt Grab, the Market Insights team drives impactful data-driven decisions by uncovering insights about the region's users, merchants, and driver partners. By analysing vast datasets across transactional and behavioural activities, we bridge the gap between raw data science capabilities and actionable business strategies. Our work is...

  • Lead Data Scientist

    1 day ago

    Singapore Data Analytics Full time

    Get to Know the Team At Grab, the Market Insights team drives impactful data-driven decisions by uncovering insights about the region's users, merchants, and driver partners. By analysing vast datasets across transactional and behavioural activities, we bridge the gap between raw data science capabilities and actionable business strategies. Our work is...