Data Engineer

3 weeks ago


Singapore Avensys Consulting Pte. Ltd. Full time

Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation, and managed services. Given our decade of success, we have evolved to become one of the top trusted providers in Singapore and service a client base across banking and financial services, insurance, information technology, healthcare, retail, and supply chain.

We are currently looking to hire a Data Engineer. This is an exciting opportunity to expand your skill set, and achieve job satisfaction and work-life balance. More details as below.

We are seeking a highly skilled Data Engineer with a strong background to join our dynamic team.

Responsibilities:

Data Pipeline Development: Develop and maintain data pipelines that extract, transform, and load (ETL) data from various sources into a centralized data storage system, such as a data warehouse or data lake.
Data Integration: Integrate data from multiple sources and systems, including databases, APIs, log files, streaming platforms, and external data providers.
Data Transformation and Processing: Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare the data for analysis, reporting, or machine learning tasks.
Contribute to common frameworks and best practices in code development, deployment, and automation/orchestration of data pipelines.
Implement data governance in line with company standards.
Partner with Data Analytics and Product leaders to design best practices and standards for developing and productionalising analytic pipelines.
Partner with Infrastructure leaders on architecture approaches to advance the data and analytics platform, including exploring new tools and techniques that leverage the cloud environment (Azure, Databricks, others).
Monitoring and Support: Monitor data pipelines and data systems to detect and resolve issues promptly. Develop monitoring tools, alerts, and automated error handling mechanisms to ensure data integrity and system reliability.

Requirements:

Must haves

Proven experience as a Data Engineering role (3 years +), with a strong track record of delivering scalable data pipelines.
Extensive experience designing data solutions including data modelling is required.
Extensive hands-on experience developing data processing jobs (PySpark / SQL) that demonstrate a strong understanding of software engineering principles is needed.
Experience orchestrating data pipelines using technology like ADF, Airflow etc is necessary.
Experience working with both real-time and batch data is important.
Experience building data pipelines on Azure is crucial. AWS data pipelines will be beneficial.
Fluency in SQL (any flavour), with experience using Window functions and more advanced features is required.
Understanding of DevOps tools, Git workflow and building CI/CD pipelines is essential.

Nice to Have

Domain knowledge of commodities, covering Sales, Trading, Risk, Supply Chain, Customer Interaction, etc. is highly desirable.
Familiarity with Scrum methodology and experience working in a Scrum team can be advantageous. This includes understanding of Scrum roles, events, artifacts, and rules, and the ability to apply them in a practical context.
Experience with streaming data processing technologies such as Apache Kafka, Apache Flink, or AWS Kinesis can be beneficial. This includes the ability to design and implement real-time data processing pipelines.

WHAT'S ON OFFER

You will be remunerated with an excellent base salary and entitled to attractive company benefits. Additionally, you will get the opportunity to enjoy a fun and collaborative work environment, alongside a strong career progression.

To submit your application, please apply online or email your UPDATED CV in Microsoft Word format to . Your interest will be treated with strict confidentiality.

CONSULTANT DETAILS

Consultant Name: Meenakshi

Avensys Consulting Pte Ltd

EA License 12C5759

Privacy Statement: Data collected will be used for recruitment purposes only. Personal data provided will be used strictly in accordance with the relevant data protection law and Avensys' personal information and privacy policy.


  • Data Engineer

    3 weeks ago


    Singapore NTT DATA SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities EMAIL ID : Interested candidates, please email your resume to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 2 years Renewable contractExperience: Minimum of 5 yearsLocation : Tanjong PagarBenefits: Renewable contract (Performance-based, with possibility of conversion to...

  • Data Engineer

    3 weeks ago


    Singapore Ntt Data Singapore Pte. Ltd. Full time

    ' EMAIL ID : Interested candidates, please email your resume to [HIDDEN TEXT]Only shortlisted candidates would be contacted for interview.Role: Data Engineer - 2 years Renewable contractExperience: Minimum of 5 yearsLocation : Tanjong PagarBenefits:Renewable contract (Performance-based, with possibility of conversion to perm)Medical Insurance CoverageLeave...


  • Singapore Bridge Data Centres (international) Pte. Ltd. Full time

    Key Responsibilities:. Conduct in-depth design reviews and oversee the commissioning/Integrated Systems Testing (IST) processes for new data centre projects, as well as modifications and expansions to existing data centres. Enhance and standardize data centre operation and maintenance policies and procedures to ensure efficiency and compliance. Perform...


  • Singapore DATA DISTINCTION Full time

    b'This description is supported by a more extensive requirements document. Overview We are looking to establish a text classification model that will create a mapping between a dictionary (JSON) of trip types with locales or destinations which are individually described in "articles" in Wiki Voyage. There are three specific outcomes that can be achieved...


  • Singapore DATA DISTINCTION Full time

    b'This description is supported by a more extensive requirements document. Overview We are looking to establish a text classification model that will create a mapping between a dictionary (JSON) of trip types with locales or destinations which are individually described in "articles" in Wiki Voyage. There are three specific outcomes that can be achieved...

  • Data Engineer

    5 days ago


    Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesYour career at NTT DATA Business SolutionsEmpowering You – to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on...

  • Data Engineer

    3 weeks ago


    Singapore Ntt Data Business Solutions Singapore Pte. Ltd. Full time

    Your career at NTT DATA Business SolutionsEmpowering You - to feel our passion for SAP / Analytic Solutions / ServiceNowAs NTT DATA Business Solutions, we are more than just a company. We are a team of innovative and passionate people who specialize in creating value-added SAP and Analytic solutions and guiding our customers on their journey to becoming...

  • Data Engineer

    1 week ago


    Singapore ASE SINGAPORE PTE. LTD. Full time

    Roles & ResponsibilitiesAs a Data Engineer assigned to the Test/Product Department, you will be working with various internal teams to develop Smart Engineering solutions through Artificial Intelligence and Machine Learning.Responsibilities: Work with Test/Product Engineers, Process and Equipment Engineers, IT and other relevant departments collaboratively...

  • Data Engineer

    1 day ago


    Singapore AIRWALLEX (SINGAPORE) PTE. LTD. Full time

    Roles & ResponsibilitiesThe Role:In 2024, the global data team is actively scaling up, and we're eager to explore more talents to join our R&D centers in Singapore and Shanghai. Your contribution will play a pivotal role in steering the data team into the next step - the era of AI in Airwallex.As a data engineering expert, you'll delve into various facets of...

  • Data Engineer

    3 weeks ago


    Singapore Ase Singapore Pte. Ltd. Full time

    As a Data Engineer assigned to the Test/Product Department, you will be working with various internal teams to develop Smart Engineering solutions through Artificial Intelligence and Machine Learning.Responsibilities:Work with Test/Product Engineers, Process and Equipment Engineers, IT and other relevant departments collaboratively to develop data science...

  • Data Engineer

    2 weeks ago


    Singapore SUNRAY WOODCRAFT CONSTRUCTION PTE LTD Full time

    Roles & ResponsibilitiesResponsibilities:● Design, construct, install, test, and maintain highly scalable data management systems.● Ensure systems meet business requirements and industry practices.● Build high-performance algorithms, prototypes, predictive models, and proof of concepts.● Research opportunities for data acquisition and new uses for...

  • Data Engineer

    1 week ago


    Singapore INNOCELLENCE SYSTEMS PTE. LTD. Full time

    Roles & ResponsibilitiesJob Description:We are looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data. As a Data Engineer, you will work closely with data...

  • Data Engineer

    3 weeks ago


    Singapore GRASSHOPPER PTE. LTD. Full time

    Roles & ResponsibilitiesWe seek a Data engineer to support our high frequency trading activities and quantitative research. At Grasshopper we recognise that effective research and trading strategies are built upon solid foundations in the collection, storage, and service of data. Grasshopper trades at a number of exchanges globally and we are looking for an...

  • Data Engineer

    3 weeks ago


    Singapore VANGUARD SOFTWARE PTE. LTD. Full time

    Roles & ResponsibilitiesJOB SUMMARYWe are looking for a skilled and experienced Data Engineerto join our growing team. The ideal candidate will be responsible for designing, building, and maintaining scalable and efficient data pipelines, databases, and data infrastructure. You will work closely with our data scientists, analysts, and software engineers to...

  • Data Engineer

    3 weeks ago


    Singapore Vanguard Software Pte. Ltd. Full time

    JOB SUMMARYWe are looking for a skilled and experienced Data Engineerto join our growing team. The ideal candidate will be responsible for designing, building, and maintaining scalable and efficient data pipelines, databases, and data infrastructure. You will work closely with our data scientists, analysts, and software engineers to support data-driven...

  • Data Engineer

    4 weeks ago


    Singapore Cognizant Full time

    Do you have software developer experience, and are you seeking a new job in Singapore? Cognizant is looking for a Data Engineer, and the full-time role comes with an attractive salary and benefits package.As a Data Engineer, you will design, develop and implement data-processing pipelines to process large volumes of structured and unstructured data....

  • Data Engineer

    7 days ago


    Singapore Innocellence Systems Pte. Ltd. Full time

    Job Description:We are looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data. As a Data Engineer, you will work closely with data scientists and software...

  • Data Engineer

    2 weeks ago


    Singapore Sunray Woodcraft Construction Pte Ltd Full time

    Responsibilities:. Design, construct, install, test, and maintain highly scalable data management systems.. Ensure systems meet business requirements and industry practices.. Build high-performance algorithms, prototypes, predictive models, and proof of concepts.. Research opportunities for data acquisition and new uses for existing data.. Develop data set...

  • Data Engineer

    2 days ago


    Singapore IKAS INTERNATIONAL (ASIA) PTE. LTD. Full time

    Roles & ResponsibilitiesWe are looking to speak with Data Engineers:Responsibilities:· Data Pipeline Development: Develop and maintain data pipelines that extract, transform, and load (ETL) data from various sources into a centralized data storage system, such as a data warehouse or data lake.· Data Integration: Integrate data from multiple sources and...

  • Data Engineer

    4 weeks ago


    Singapore AZENDIAN SOLUTIONS PTE. LTD. Full time

    Roles & ResponsibilitiesJob Responsibilities: Responsible for data analysis and generate reports for estate sub-system performance. Develop data set processes. Develop analytics programs, machine learning algorithms, and use statistical methods to make raw data useful for smart estate application. Extracting data from existing Building Management Systems...