Lead Big Data Engineer

15 hours ago

Downtown Core, Singapore U3 InfoTech Pte Ltd Full time

**Key Responsibilities**:

- Design, implement, and optimize robust data pipelines and ETL/ELT workflows using SQL and Python.
- Lead architecture discussions, including the creation and review of Entity Relationship Diagrams (ERDs) and overall system design.
- Collaborate closely with Data Engineers, Analysts, and cross-functional engineering teams to meet evolving data needs.
- Deploy and manage infrastructure using Terraform and other Infrastructure-as-Code (IaC) tools.
- Leverage strong experience in AWS services (e.g., S3, Glue, Lambda, RDS, Lake Formation) to support scalable and secure cloud-based data platforms.
- Handle both batch and real-time data processing effectively.
- Implement and manage data encryption and hashing techniques to secure sensitive information.
- Ensure adherence to software engineering best practices including version control, automated testing, and deployment standards.

**Required Skills & Experience**:

- Strong proficiency in SQL for data modeling, querying, and transformation.
- Advanced Python development skills with an emphasis on data engineering use cases.
- Hands-on experience with Terraform for cloud infrastructure provisioning.
- Proficiency with CI/CD tools, particularly GitHub Actions.
- Deep expertise in AWS cloud architecture and services.
- Demonstrated ability to create and evaluate ERDs and contribute to architectural decisions.
- Strong communication and leadership skills with experience mentoring engineering teams.

**Preferred Qualifications**:

- Experience with big data technologies such as Apache Spark, Hive, or Kafka.
- Familiarity with containerization tools (e.g., Docker) and orchestration platforms (e.g., Kubernetes).
- Solid understanding of data governance, data quality, and security frameworks.

**About the Company**
U3 Infotech is a Technology Solutions, Managed Services, and Talent Management Solutions company with over 2 decades of experience in the APAC region since 2002. Our clients include Fortune 100, MNCs, Leading Regional Organisations, Government organizations, and Startups. We work with clients across Banking, Insurance, Bio-Science, Pharmaceutical, Healthcare, Engineering, Product, and Supply Chain domains.
We have been growing rapidly through value creation, solving complex problems, and addressing the opportunities of our clients’ businesses. We differentiate ourselves through our deep commitment at all levels, entrepreneurial mindset, outcome-driven approach, and financial resources.
----------------------------------------------------------------------------------------

Pay: $9,000.00 - $10,000.00 per month

**Benefits**:

- Health insurance

Schedule:

- Day shift
- Monday to Friday

Supplemental Pay:

- Performance bonus

**Experience**:

- Python: 2 years (required)
- AWS: 2 years (required)

Work Location: In person

  • Lead Big Data Engineer

    2 weeks ago

    Downtown Core, Singapore U3 InfoTech Pte Ltd Full time

    **Key Responsibilities**: - Design, implement, and optimize robust data pipelines and ETL/ELT workflows using SQL and Python. - Lead architecture discussions, including the creation and review of Entity Relationship Diagrams (ERDs) and overall system design. - Collaborate closely with Data Engineers, Analysts, and cross-functional engineering teams to meet...

  • Big Data Developer

    1 week ago

    Downtown Core, Singapore Intellect Minds Pte Ltd Full time

    **We are a fast growing company that aims to help you with all in job finding matching to your skills.**: - **Minimum 5 years of total IT experience; at least 4 years of experience in development with PySpark & Python;**: - **Good knowledge and experience on Big Data platform, Big Data Eco system tools, SPARK, Python, Etc.**: - **Experience with Banking...

  • Senior Software Architect, Big Data

    15 hours ago

    Downtown Core, Singapore Rakuten Asia Pte Ltd Full time

    Situated in the heart of Singapore's Central Business District, Rakuten Asia Pte. Ltd. is Rakuten's Asia Regional headquarters. Established in August 2012 as part of Rakuten's global expansion strategy, Rakuten Asia comprises various businesses that provide essential value-added services to Rakuten's global ecosystem. Through advertisement product...

  • Lead Data Architect

    7 days ago

    Downtown Core, Singapore Doctor World Pte Ltd Full time

    **Key Responsibilities** - Design and implement data management solutions, data models, and database architectures - Develop and maintain a comprehensive data strategy aligned with business goals - Collaborate with stakeholders to understand data requirements and translate them into technical specifications - Evaluate and adopt technologies and tools to...

  • Lead Software Engineer

    2 weeks ago

    Downtown Core, Singapore ASPIRE NXT PTE. LTD. Full time

    Designation : Lead Software Engineer (Data) Location : Singapore - Onsite Experience : 10+ yrs **Qualifications and Profile** **Work Experience** **Technical** - Java/J2EE 9, Spring, Spring MVC/Struts/JSF, Java script, JQuery - Hands on experience on Apache Spark - Batch processing : Big Data, Fast Data, Micro-services ElasticSearch, Kafka -...

  • Data Engineer

    2 weeks ago

    Downtown Core, Singapore Intellect Minds Pte Ltd Full time

    **We are a fast growing company that aims to help you with all in job finding matching to your skills.**: **Responsibilities**: - **Implementing Data Architecture/ Data modelling for data platform and Analytics.**: - **Responsible for the technical design and development of Analytics and big data systems including ETL, data transformations.**: - **Define...

  • Data Engineer

    15 hours ago

    Downtown Core, Singapore Aon Corporation Full time

    Posting Description: **Data Engineer** **Aon is in the business of better decisions** At Aon, we shape decisions for the better to protect and enrich the lives of people around the world. As an organization, we are united through trust as one inclusive team and we are passionate about helping our colleagues and clients succeed. **What the day will look...

  • Data Engineer

    1 week ago

    Downtown Core, Singapore Infocepts Pte Ltd Full time

    We are hiring aspiring / proven data engineers to join us. **Roles and Responsibilities**: - Design, build, and maintain scalable ETL pipelines using Python. - Extract data from various sources and transform it into clean, usable formats. - Optimize data pipelines for performance and scalability. - Design logical and physical data models that support...

  • Data Engineer

    2 weeks ago

    Downtown Core, Singapore Intellect Minds Pte Ltd Full time

    **We are a fast growing company that aims to help you with all in job finding matching to your skills.**: - **Degree in Computer Science, Data Science, or a related field**: - **Proficient in languages such as Python, JAVA, SQL, and experience with data science and engineering frameworks such as Scikit-learn, Pandas, Tensorflow, Spark, Hadoop, etc.**: -...

  • Talent Analytics Lead

    2 weeks ago

    Downtown Core, Singapore Aon Corporation Full time

    Posting Description: **Talent Analytics Lead** **Aon is in the business of better decisions** At Aon, we shape decisions for the better to protect and enrich the lives of people around the world. As an organization, we are united through trust as one inclusive team and we are passionate about helping our colleagues and clients succeed. **What the day...