Lead Big Data Engineer

1 day ago

Downtown Core, Singapore U3 InfoTech Pte Ltd Full time

**Key Responsibilities**:

- Design, implement, and optimize robust data pipelines and ETL/ELT workflows using SQL and Python.
- Lead architecture discussions, including the creation and review of Entity Relationship Diagrams (ERDs) and overall system design.
- Collaborate closely with Data Engineers, Analysts, and cross-functional engineering teams to meet evolving data needs.
- Deploy and manage infrastructure using Terraform and other Infrastructure-as-Code (IaC) tools.
- Leverage strong experience in AWS services (e.g., S3, Glue, Lambda, RDS, Lake Formation) to support scalable and secure cloud-based data platforms.
- Handle both batch and real-time data processing effectively.
- Implement and manage data encryption and hashing techniques to secure sensitive information.
- Ensure adherence to software engineering best practices including version control, automated testing, and deployment standards.

**Required Skills & Experience**:

- Strong proficiency in SQL for data modeling, querying, and transformation.
- Advanced Python development skills with an emphasis on data engineering use cases.
- Hands-on experience with Terraform for cloud infrastructure provisioning.
- Proficiency with CI/CD tools, particularly GitHub Actions.
- Deep expertise in AWS cloud architecture and services.
- Demonstrated ability to create and evaluate ERDs and contribute to architectural decisions.
- Strong communication and leadership skills with experience mentoring engineering teams.

**Preferred Qualifications**:

- Experience with big data technologies such as Apache Spark, Hive, or Kafka.
- Familiarity with containerization tools (e.g., Docker) and orchestration platforms (e.g., Kubernetes).
- Solid understanding of data governance, data quality, and security frameworks.

**About the Company**
U3 Infotech is a Technology Solutions, Managed Services, and Talent Management Solutions company with over 2 decades of experience in the APAC region since 2002. Our clients include Fortune 100, MNCs, Leading Regional Organisations, Government organizations, and Startups. We work with clients across Banking, Insurance, Bio-Science, Pharmaceutical, Healthcare, Engineering, Product, and Supply Chain domains.
We have been growing rapidly through value creation, solving complex problems, and addressing the opportunities of our clients’ businesses. We differentiate ourselves through our deep commitment at all levels, entrepreneurial mindset, outcome-driven approach, and financial resources.
----------------------------------------------------------------------------------------

Pay: $9,000.00 - $10,000.00 per month

**Benefits**:

- Health insurance

Schedule:

- Day shift
- Monday to Friday

Supplemental Pay:

- Performance bonus

**Experience**:

- Python: 2 years (required)
- AWS: 2 years (required)

Work Location: In person

  • Senior Software Architect, Big Data

    1 day ago

    Downtown Core, Singapore Rakuten Asia Pte Ltd Full time

    Situated in the heart of Singapore's Central Business District, Rakuten Asia Pte. Ltd. is Rakuten's Asia Regional headquarters. Established in August 2012 as part of Rakuten's global expansion strategy, Rakuten Asia comprises various businesses that provide essential value-added services to Rakuten's global ecosystem. Through advertisement product...

  • Lead Software Engineer

    2 weeks ago

    Downtown Core, Singapore ASPIRE NXT PTE. LTD. Full time

    Designation : Lead Software Engineer (Data) Location : Singapore - Onsite Experience : 10+ yrs **Qualifications and Profile** **Work Experience** **Technical** - Java/J2EE 9, Spring, Spring MVC/Struts/JSF, Java script, JQuery - Hands on experience on Apache Spark - Batch processing : Big Data, Fast Data, Micro-services ElasticSearch, Kafka -...

  • Data Engineer

    2 weeks ago

    Downtown Core, Singapore Intellect Minds Pte Ltd Full time

    **We are a fast growing company that aims to help you with all in job finding matching to your skills.**: **Responsibilities**: - **Implementing Data Architecture/ Data modelling for data platform and Analytics.**: - **Responsible for the technical design and development of Analytics and big data systems including ETL, data transformations.**: - **Define...

  • Data Engineer

    1 day ago

    Downtown Core, Singapore Aon Corporation Full time

    Posting Description: **Data Engineer** **Aon is in the business of better decisions** At Aon, we shape decisions for the better to protect and enrich the lives of people around the world. As an organization, we are united through trust as one inclusive team and we are passionate about helping our colleagues and clients succeed. **What the day will look...

  • Director (Data Governance Lead)

    2 weeks ago

    Downtown Core, Singapore Cushman & Wakefield Full time

    **Job Title** Director (Data Governance Lead) **Job Description Summary** The On-Account Data Governance Lead plays a key role in leading and implementing the data governance program of one of Cushman and Wakefield’s accounts. They are responsible for establishing and maintaining an effective data governance framework, ensuring data quality, integrity,...

  • Talent Analytics Lead

    2 weeks ago

    Downtown Core, Singapore Aon Corporation Full time

    Posting Description: **Talent Analytics Lead** **Aon is in the business of better decisions** At Aon, we shape decisions for the better to protect and enrich the lives of people around the world. As an organization, we are united through trust as one inclusive team and we are passionate about helping our colleagues and clients succeed. **What the day...

  • Senior Data Engineer

    4 days ago

    Downtown Core, Singapore Aon Full time $120,000 - $200,000 per year

    Posting Description:Senior Data EngineerWe are seeking a data engineer who is a team player and extremely keen in pushing themselves to learn new skills on the job or off the job. The right individual for this role will need to have a meticulous eye for data and appreciates the process of wrangling, storing and understanding data. This person will work with...

  • Associate Data Engineer

    2 weeks ago

    Downtown Core, Singapore Aon Corporation Full time

    Posting Description: **Associate Data Engineer** **Aon is in the business of better decisions** At Aon, we shape decisions for the better to protect and enrich the lives of people around the world. As an organization, we are united through trust as one inclusive, diverse team, and we are passionate about helping our colleagues and clients...

  • System Engineer

    1 day ago

    Downtown Core, Singapore Intellect Minds Pte Ltd Full time

    **We are a fast growing company that aims to help you with all in job finding matching to your skills.**: **_Duties and responsibilities_**: - **Project planning and implementation which includes creation of project documentation such as SOW (Statement of Work), build document, UAT Test, etc.**: - **Work directly with customers to manage their project...

  • Data Centre Engineer

    1 day ago

    Downtown Core, Singapore EIRE Systems Singapore Pte Ltd Full time

    **Roles and Responsibilities**: - Hardware installation and basic configuration in production and staging environments (HP servers, network and storage equipment). - Break-Fix activities such as diagnosis of servers and replacement of faulty parts (swapping PSU, Memory, Hard disks, mother boards etc.) - Must have solid understanding of Power/Cooling in the...