Lead Big Data Engineer
3 days ago
**Key Responsibilities**:
- Design, implement, and optimize robust data pipelines and ETL/ELT workflows using SQL and Python.
- Lead architecture discussions, including the creation and review of Entity Relationship Diagrams (ERDs) and overall system design.
- Collaborate closely with Data Engineers, Analysts, and cross-functional engineering teams to meet evolving data needs.
- Deploy and manage infrastructure using Terraform and other Infrastructure-as-Code (IaC) tools.
- Leverage strong experience in AWS services (e.g., S3, Glue, Lambda, RDS, Lake Formation) to support scalable and secure cloud-based data platforms.
- Handle both batch and real-time data processing effectively.
- Implement and manage data encryption and hashing techniques to secure sensitive information.
- Ensure adherence to software engineering best practices including version control, automated testing, and deployment standards.
**Required Skills & Experience**:
- Strong proficiency in SQL for data modeling, querying, and transformation.
- Advanced Python development skills with an emphasis on data engineering use cases.
- Hands-on experience with Terraform for cloud infrastructure provisioning.
- Proficiency with CI/CD tools, particularly GitHub Actions.
- Deep expertise in AWS cloud architecture and services.
- Demonstrated ability to create and evaluate ERDs and contribute to architectural decisions.
- Strong communication and leadership skills with experience mentoring engineering teams.
**Preferred Qualifications**:
- Experience with big data technologies such as Apache Spark, Hive, or Kafka.
- Familiarity with containerization tools (e.g., Docker) and orchestration platforms (e.g., Kubernetes).
- Solid understanding of data governance, data quality, and security frameworks.
**About the Company**
U3 Infotech is a Technology Solutions, Managed Services, and Talent Management Solutions company with over 2 decades of experience in the APAC region since 2002. Our clients include Fortune 100, MNCs, Leading Regional Organisations, Government organizations, and Startups. We work with clients across Banking, Insurance, Bio-Science, Pharmaceutical, Healthcare, Engineering, Product, and Supply Chain domains.
We have been growing rapidly through value creation, solving complex problems, and addressing the opportunities of our clients’ businesses. We differentiate ourselves through our deep commitment at all levels, entrepreneurial mindset, outcome-driven approach, and financial resources.
**Job Type**: Contract
Contract length: 12 months
Pay: $10,000.00 - $11,000.00 per month
-
Sr Big Data Engineer
1 week ago
Downtown Core, Singapore Intellect Minds Pte Ltd Full time**We are a fast growing company that aims to help you with all in job finding matching to your skills.**: **_Qualification & Experience:_**: - **CS fundamentals**: At least a B.S. / MS in Computer Science, or related degree AND you have a strong ethos of continuous learning.**: - **Commercial software engineering**: You have 6 to 10 years of professional...
-
Big Data Developer
1 day ago
Downtown Core, Singapore Intellect Minds Pte Ltd Full time**We are a fast growing company that aims to help you with all in job finding matching to your skills.**: - **Minimum 5 years of total IT experience; at least 4 years of experience in development with PySpark & Python;**: - **Good knowledge and experience on Big Data platform, Big Data Eco system tools, SPARK, Python, Etc.**: - **Experience with Banking...
-
Data Engineer
2 weeks ago
Downtown Core, Singapore U3 InfoTech Pte Ltd Full time $120,000 - $180,000 per yearJob Description:We are seeking a highly skilled and motivated Lead Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy,...
-
Lead Software Engineer
5 days ago
Downtown Core, Singapore ASPIRE NXT PTE. LTD. Full timeDesignation : Lead Software Engineer (Data) Location : Singapore - Onsite Experience : 10+ yrs **Qualifications and Profile** **Work Experience** **Technical** - Java/J2EE 9, Spring, Spring MVC/Struts/JSF, Java script, JQuery - Hands on experience on Apache Spark - Batch processing : Big Data, Fast Data, Micro-services ElasticSearch, Kafka -...
-
Data Engineer
2 weeks ago
Downtown Core, Singapore U3 InfoTech Pte Ltd Full time**Key Responsibilities**: - Design, implement, and optimize robust data pipelines and ETL/ELT workflows using SQL and Python. - Lead architecture discussions, including the creation and review of Entity Relationship Diagrams (ERDs) and overall system design. - Collaborate closely with Data Engineers, Analysts, and cross-functional engineering teams to meet...
-
Data Engineer
5 days ago
Downtown Core, Singapore Intellect Minds Pte Ltd Full time**We are a fast growing company that aims to help you with all in job finding matching to your skills.**: **Responsibilities**: - **Implementing Data Architecture/ Data modelling for data platform and Analytics.**: - **Responsible for the technical design and development of Analytics and big data systems including ETL, data transformations.**: - **Define...
-
Data Engineer
2 weeks ago
Downtown Core, Singapore EDHEC Business School Full time**About us**: EDHEC Infrastructure Institute (EDHEC_infra_) is looking for a Data Engineer to join its Singapore team and contribute to the development and implementation of new data collection projects. EDHEC_infra_ is a team of 20 people based in Singapore and London, that creates and delivers exciting new data to the private infrastructure investment...
-
Data Engineer
2 weeks ago
Downtown Core, Singapore InfoCepts Full time $50,000 - $70,000 per yearInfoCepts is a global leader of end-to-end data & analytics solutions with nearly 20 years of experience, also named as Gartner's 2020, 2021 and 2022 customers' choice for Data & Analytics providers. We continue to grow rapidly year over year, now employing more than 1,200 people in offices across the globe. As we have grown, we have stayed true to our...
-
Talent Analytics Lead
5 days ago
Downtown Core, Singapore Aon Corporation Full timePosting Description: **Talent Analytics Lead** **Aon is in the business of better decisions** At Aon, we shape decisions for the better to protect and enrich the lives of people around the world. As an organization, we are united through trust as one inclusive team and we are passionate about helping our colleagues and clients succeed. **What the day...
-
Data Engineer
3 days ago
Downtown Core, Singapore Intellect Minds Pte Ltd Full time**We are a fast growing company that aims to help you with all in job finding matching to your skills.**: - **Degree in Computer Science, Data Science, or a related field**: - **Proficient in languages such as Python, JAVA, SQL, and experience with data science and engineering frameworks such as Scikit-learn, Pandas, Tensorflow, Spark, Hadoop, etc.**: -...