Lead Big Data Engineer

2 days ago

Downtown Core, Singapore U3 InfoTech Pte Ltd Full time

**Key Responsibilities**:

- Design, implement, and optimize robust data pipelines and ETL/ELT workflows using SQL and Python.
- Lead architecture discussions, including the creation and review of Entity Relationship Diagrams (ERDs) and overall system design.
- Collaborate closely with Data Engineers, Analysts, and cross-functional engineering teams to meet evolving data needs.
- Deploy and manage infrastructure using Terraform and other Infrastructure-as-Code (IaC) tools.
- Leverage strong experience in AWS services (e.g., S3, Glue, Lambda, RDS, Lake Formation) to support scalable and secure cloud-based data platforms.
- Handle both batch and real-time data processing effectively.
- Implement and manage data encryption and hashing techniques to secure sensitive information.
- Ensure adherence to software engineering best practices including version control, automated testing, and deployment standards.

**Required Skills & Experience**:

- Strong proficiency in SQL for data modeling, querying, and transformation.
- Advanced Python development skills with an emphasis on data engineering use cases.
- Hands-on experience with Terraform for cloud infrastructure provisioning.
- Proficiency with CI/CD tools, particularly GitHub Actions.
- Deep expertise in AWS cloud architecture and services.
- Demonstrated ability to create and evaluate ERDs and contribute to architectural decisions.
- Strong communication and leadership skills with experience mentoring engineering teams.

**Preferred Qualifications**:

- Experience with big data technologies such as Apache Spark, Hive, or Kafka.
- Familiarity with containerization tools (e.g., Docker) and orchestration platforms (e.g., Kubernetes).
- Solid understanding of data governance, data quality, and security frameworks.

**About the Company**
U3 Infotech is a Technology Solutions, Managed Services, and Talent Management Solutions company with over 2 decades of experience in the APAC region since 2002. Our clients include Fortune 100, MNCs, Leading Regional Organisations, Government organizations, and Startups. We work with clients across Banking, Insurance, Bio-Science, Pharmaceutical, Healthcare, Engineering, Product, and Supply Chain domains.
We have been growing rapidly through value creation, solving complex problems, and addressing the opportunities of our clients’ businesses. We differentiate ourselves through our deep commitment at all levels, entrepreneurial mindset, outcome-driven approach, and financial resources.
----------------------------------------------------------------------------------------

Pay: $9,000.00 - $10,000.00 per month

**Benefits**:

- Health insurance

Schedule:

- Day shift
- Monday to Friday

Supplemental Pay:

- Performance bonus

**Experience**:

- Python: 2 years (required)
- AWS: 2 years (required)

Work Location: In person

  • Lead Big Data Engineer

    2 weeks ago

    Downtown Core, Singapore U3 InfoTech Pte Ltd Full time

    **Key Responsibilities**: - Design, implement, and optimize robust data pipelines and ETL/ELT workflows using SQL and Python. - Lead architecture discussions, including the creation and review of Entity Relationship Diagrams (ERDs) and overall system design. - Collaborate closely with Data Engineers, Analysts, and cross-functional engineering teams to meet...

  • Big Data Engineer

    1 week ago

    Downtown Core, Singapore U3 InfoTech Pte Ltd Full time $10,000 - $11,000 per year

    Position Details:Company : U3 Infotech (Payroll)Role : Big Data EngineerPosition : ContractDuration : 12+ MonthsLocation : SingaporeJob Description:We are seeking a highly skilled and motivated Lead Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while...

  • Big Data Developer

    2 weeks ago

    Downtown Core, Singapore Intellect Minds Pte Ltd Full time

    **We are a fast growing company that aims to help you with all in job finding matching to your skills.**: - **Minimum 5 years of total IT experience; at least 4 years of experience in development with PySpark & Python;**: - **Good knowledge and experience on Big Data platform, Big Data Eco system tools, SPARK, Python, Etc.**: - **Experience with Banking...

  • Data Engineer

    1 week ago

    Downtown Core, Singapore U3 InfoTech Pte Ltd Full time $90,000 - $100,000 per year

    Job Description:We are seeking a highly skilled and motivated Lead Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy,...

  • Senior Software Architect, Big Data

    2 days ago

    Downtown Core, Singapore Rakuten Asia Pte Ltd Full time

    Situated in the heart of Singapore's Central Business District, Rakuten Asia Pte. Ltd. is Rakuten's Asia Regional headquarters. Established in August 2012 as part of Rakuten's global expansion strategy, Rakuten Asia comprises various businesses that provide essential value-added services to Rakuten's global ecosystem. Through advertisement product...

  • Lead Data Architect

    1 week ago

    Downtown Core, Singapore Doctor World Pte Ltd Full time

    **Key Responsibilities** - Design and implement data management solutions, data models, and database architectures - Develop and maintain a comprehensive data strategy aligned with business goals - Collaborate with stakeholders to understand data requirements and translate them into technical specifications - Evaluate and adopt technologies and tools to...

  • Solution Architect

    1 day ago

    Downtown Core, Singapore W-Consulting Full time

    Our client is one of the Top Cloud solution vendors. They are looking for a Solution Architect (Big data& AI) to join their team in Singapore. **Customer Engagement and Implementation Support**: - Guide enterprise clients in sectors like retail, telecommunications, fintech, and online services through data-driven digital transformation...

  • Data Analytics Lead

    2 weeks ago

    Downtown Core, Singapore Genius Brio Full time

    If you are a data professional passionate about growing and empowering a team of analysts to enhance data-driven decision-making across the business, we’d like to meet you! In this role, you will have the opportunity to make an impact solving business problemsand influencing decisions on products used by millions of customers every day. Through hiring,...

  • Data Engineer

    2 weeks ago

    Downtown Core, Singapore Aon Corporation Full time

    Posting Description: **Data Engineer** **Aon is in the business of better decisions** At Aon, we shape decisions for the better to protect and enrich the lives of people around the world. As an organization, we are united through trust as one inclusive, diverse team, and we are passionate about helping our colleagues and clients succeed. **About...

  • Senior Data Engineer

    2 weeks ago

    Downtown Core, Singapore PALO IT SINGAPORE PTE. LTD. Full time

    **YOUR ROLE**: The Senior Data Engineer will work on acquiring, storing, governing and processing huge sets of structured / unstructured data. You will bring a vision of the big data solutions landscape for choosing optimal architecture components to use for these purposes as well as a set of data engineering skills for implementing enterprise data...