Big Data Engineer

Position Details:

Company : U3 Infotech (Payroll)

Role : Big Data Engineer

Position : Contract

Duration : 12+ Months

Location : Singapore

Job Description:

We are seeking a highly skilled and motivated Lead Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and accessibility across the organization.

Key Responsibilities:

● Design, implement, and optimize robust data pipelines and ETL/ELT workflows using SQL and Python.

● Lead architecture discussions, including the creation and review of Entity Relationship Diagrams (ERDs) and overall system design.

● Collaborate closely with Data Engineers, Analysts, and cross-functional engineering teams to meet evolving data needs.

● Deploy and manage infrastructure using Terraform and other Infrastructure-as-Code (IaC) tools.

● Develop and maintain CI/CD pipelines for deploying data applications and services.

● Leverage strong experience in AWS services (e.g., S3, Glue, Lambda, RDS, Lake Formation) to support scalable and secure cloud-based data platforms.

● Handle both batch and real-time data processing effectively.

● Apply best practices in data modeling and support data privacy and data protection initiatives.

● Implement and manage data encryption and hashing techniques to secure sensitive information.

● Ensure adherence to software engineering best practices including version control, automated testing, and deployment standards.

● Lead performance tuning and troubleshooting for data applications and platforms.

Required Skills & Experience:

● Strong proficiency in SQL for data modeling, querying, and transformation.

● Advanced Python development skills with an emphasis on data engineering use cases.

● Hands-on experience with Terraform for cloud infrastructure provisioning.

● Proficiency with CI/CD tools, particularly GitHub Actions.

● Deep expertise in AWS cloud architecture and services.

● Demonstrated ability to create and evaluate ERDs and contribute to architectural decisions.

● Strong communication and leadership skills with experience mentoring engineering teams.

Preferred Qualifications:

● Experience with big data technologies such as Apache Spark, Hive, or Kafka.

● Familiarity with containerization tools (e.g., Docker) and orchestration platforms (e.g., Kubernetes).

● Solid understanding of data governance, data quality, and security frameworks.

About the Company

U3 Infotech is a Technology Solutions, Managed Services, and Talent Management Solutions company with over 2 decades of experience in the APAC region since 2002. Our clients include Fortune 100, MNCs, Leading Regional Organisations, Government organizations, and Startups. We work with clients across Banking, Insurance, Bio-Science, Pharmaceutical, Healthcare, Engineering, Product, and Supply Chain domains.

We have been growing rapidly through value creation, solving complex problems, and addressing the opportunities of our clients' businesses. We differentiate ourselves through our deep commitment at all levels, entrepreneurial mindset, outcome-driven approach, and financial resources.

Please refer to U3's Privacy Notice for Job Applicants/Seekers at When you apply, you voluntarily consent to the collection, use and disclosure of your personal data for recruitment/employment and related purposes.

Cheers Stay Safe & Healthy.

Thanks and Regards,

Raghunath

Senior Recruitment Consultant

Talent Acquisition Team

Mobile:

Email:

133 Cecil Street, Keck Seng Tower, #14-3,

Singapore 069535

Singapore | Australia | Malaysia | Thailand

Vietnam | India | Philippines| Hong Kong

Job Types: Full-time, Contract

Contract length: 12 months

Pay: $10, $11,000.00 per month

Benefits:

• Health insurance

Work Location: In person