Data Engineer/Data Testing

4 weeks ago

Paya Lebar East, 00, Singapore Private Advertiser Full-time SGD 84,000 - SGD 108,000 Contract
Data Engineering Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources Develop and optimize data models, warehouses, and data lakes Collaborate with data analysts, scientists, and business stakeholders to understand data requirements Ensure efficient data storage, retrieval, and processing performance Monitor pipeline performance and troubleshoot production issues Implement data governance, security, and compliance best practices Data Testing & QA Design and execute test plans and test cases for data pipelines, transformations, and reports Perform data validation, reconciliation, and integrity checks across source and target systems Develop automated data quality checks and testing frameworks Identify, document, and track data defects, working with engineering teams on resolution Conduct regression testing for data pipeline changes and migrations Validate business logic and transformation rules against requirements Create and maintain test documentation, including test strategies and QA sign-off criteria Required Skills & Qualifications Bachelor's degree in Computer Science, Information Technology, or related field 3+ years of experience in data engineering, data testing, or QA (adjust based on seniority) Strong proficiency in SQL and at least one programming language (Python preferred) Experience with ETL/ELT tools (e.g., Informatica, Talend, dbt, Apache Airflow) Hands-on experience with cloud data platforms (AWS, Azure, or GCP) Familiarity with data warehousing concepts (Snowflake, Redshift, BigQuery, etc.) Experience with data testing/automation frameworks (e.g., Great Expectations, PyTest, DBT tests) Understanding of data modeling, data governance, and data quality principles Strong analytical and problem-solving skills with attention to detail Preferred Qualifications Experience with CI/CD pipelines for data workflows Knowledge of version control tools (Git) Exposure to Agile/Scrum methodologies Experience with BI tools (Power BI, Tableau) for data validation purposes Soft Skills Strong communication skills to liaise between technical and business teams Ability to work independently and manage multiple priorities Detail-oriented mindset with a quality-first approach