Data Engineer
4 days ago
As a Lead Data Engineer, you will play a leading role in designing, building, and optimizing the client's data infrastructure, ensuring that it supports the bank's advanced analytics needs.
Your main responsibilities will include:
- Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data.
- Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch.
- Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and translate them into technical specifications and solutions.
- Design and deploy data engineering solutions on OpenShift Container Platform (OCP) using containerization and orchestration techniques.
- Optimize data engineering workflows for containerized deployment and efficient resource utilization.
**Requirements**:
- Bachelor's degree in Computer Science, Data Engineering, Information Technology, or a related field.
- At least 10 years of experience as a Data Engineer, working with Hadoop, Spark, and data processing technologies in large-scale environments.
- Strong expertise in designing and developing data infrastructure using Hadoop, Spark, and related tools (HDFS, Hive, Ranger, etc)
- Experience with containerization platforms such as OpenShift Container Platform (OCP) and container orchestration using Kubernetes.
- Proficiency in programming languages commonly used in data engineering, such as Spark, Python, Scala, or Java.
- Knowledge of DevOps practices, CI/CD pipelines, and infrastructure automation tools (e.g., Docker, Jenkins, Ansible, BitBucket)
- Experience with Grafana, Prometheus, Splunk will be an added benefit
- Strong problem-solving and troubleshooting skills with a proactive approach to resolving technical challenges.
**Job Types**: Full-time, Contract
Contract length: 24 months
Pay: $6,000.00 - $8,000.00 per month
**Benefits**:
- Health insurance
- Professional development
Schedule:
- Day shift
Work Location: In person
-
Data Engineer
2 weeks ago
Singapore NTT DATA SINGAPORE PTE. LTD. Full timeRoles & Responsibilities EMAIL ID : Interested candidates may also send their resume via email to mike.ramos@nttdata.comOnly shortlisted candidates would be contacted for interview.Role: Data Engineer - 12 months Renewable contractExperience: Minimum of 3 yearsLocation : Changi Business ParkRequirements:Min 3-4 years experience At least one year of...
-
Ms20220804 Data Engineer
3 days ago
Singapore NTT DATA Singapore PTE Ltd Full timeJob Description - About Us - Roles and Responsibility **Job scopes**: - The Data Engineer will lead the enterprise-wide data transformations projects. The person will involve in developing and automating data processing pipelines for financial and Investment data modelling, analysis, and reporting from various data sources systems; The primary...
-
Data Engineer
4 days ago
Singapore TRIVI DATA CONSULTING PTE. LTD. Full timeKey Responsibilities - Design, implement, and maintain ETL workflows for managing large-scale datasets. - Develop cloud-based data pipelines (AWS, Azure) for scalable and real-time analytics delivery. - Optimize data models to ensure high performance and reliable reporting. - Create advanced dashboards and visualizations using tools like Qlik Sense and...
-
Consultant / Data Engineer
4 days ago
Singapore NTT DATA BUSINESS SOLUTIONS SINGAPORE PTE. LTD. Full time**Job Highlights**: - Hybrid Mode & Work Life Balance - Attractive Benefits Package - Career Development Within a MNC Company **Company Overview**: **Job Description - Deliver end-to-end Business Intelligence, Analytics and Data Management solutions to customer - Work with the larger team in technical design sessions to define data definition, data and...
-
Ts Implementation Engineer
4 days ago
Singapore NTT DATA Full time**Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...
-
Data Business Analyst
3 days ago
Singapore NTT Data Singapore Full timeResponsibilities: - Installation of SQL Server / Oracle - Creation of new database - Database Instance Hardening, Patching on identification of Vulnerabilities - Configuration and Testing of Backup-Restore scripts - Configuration of AOAG (SQL Server) / DataGuard (Oracle) - Testing of AOAGroup/Instance Switchover to D.R. and Switchback to PROD - Migration of...
-
Manager, Electrical Engineering, Apac
4 days ago
Singapore Vantage Data Centers Full timeAbout Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience. Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and...
-
Manager, Mechanical Engineering, Apac
4 days ago
Singapore Vantage Data Centers Full timeAbout Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience. Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and...
-
Full Stack Engineer
2 days ago
Central Singapore Singularity Data Full time**One-line description** Design and implement RisingWave Cloud. **What will you will be working on after joining our company?** - Implement cross-platform web-based features, user interfaces, and services for enterprise-grade cloud platforms; **What are the essential skills?** - BS/MS in Computer Science or a related technical field preferred; - Strong...
-
Senior Mechanical Engineer
4 days ago
Singapore Vantage Data Centers Full timeAbout Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience. Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and...
-
Technical Services Implementation Engineer
2 days ago
Singapore NTT DATA Full time**Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** This...
-
Senior Director
3 days ago
Singapore Vantage Data Centers Full timeAbout Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience. Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and...
-
Data Engineer
3 days ago
Singapore SANDBOX CONSULTING PTE. LTD Full time**Position** : Data Engineer **Location** : Singapore **Qualification** : Any Degree/Diploma **Experience** : 5+ Years **Skill's required** : Data Engineer, Bigdata, AWS, Azure **Job code** : SIN123 Experience and passion for data engineering in a big data environment using Cloud platforms - AWS, GCP or Azure Experience with building production-grade...
-
Data Engineer
3 days ago
Singapore Unison Consulting Pte Ltd Full timeWe are seeking a skilled and motivated Data Engineer with expertise in Hadoop, Spark, OpenShift Container Platform (OCP), and DevOps practices. As a Data Engineer, you will be responsible for designing, developing, and maintaining efficient data pipelines, processing large-scale datasets. Your expertise in Hadoop, Spark, OCP, and DevOps will be crucial in...
-
Data Engineer
3 days ago
Singapore ANTAS PTE. LTD. Full timeRole and Responsibilities - Architect and/or review technical solutions for the deployment of AI models, along with the data pipelines and visualization interfaces - Utilize DevOps tools and automate model deployment / tuning via orchestration - Provide guidance for maintenance, support and enhancements to model deployment platforms - Manage MLOps Engineer...
-
Data Engineer
4 days ago
Singapore Handshakes by DC Frontiers Full timeHandshakes is an award-winning DataTech company. We enable our clients to make safer, more informed decisions by delivering meaningful insights, harnessed from reliable data. We are looking for a **Data Engineer **to join our Data team. This is a full-time permanent position. We are open to fresh graduates or aspiring **Data Engineers** with little to 3...
-
Data Engineer
4 days ago
Singapore INFINEUM SINGAPORE LLP Full time**Position Summary** The Digital & Analytics Centre of Excellence (D&A CoE) is an independent team that helps fast track and spearhead our digital & analytics capabilities across the organisation. The D&A CoE is designed around key pillars, with Delivery and Execution being the one responsible for Infineum’s effective use of data to provide high value...
-
Data Engineer
3 days ago
Singapore CDG ZIG PTE. LTD. Full time**Responsibilities**: - Expanding data collection as well as optimizing data pipelines for cross-functional teams - Work closely with data analysts and business end-users to implement and support data platforms - Tuning, troubleshooting and scaling identified big data technologies. - Analyse, tackle and resolve day-to-day operational incidents related to...
-
Data Engineer
2 days ago
Singapore TIANCHENG ELECTRICAL MARINE EQUIPMENT PTE. LTD. Full timeJob Description & Requirements **Responsibilities**: Analyze and organize raw data Build data systems and pipelines Evaluate business needs and objectives Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modeling Build algorithms and prototypes Combine raw information from...
-
Data Engineer
3 days ago
Singapore FD Technologies Full time**Responsibilities**: - Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives - Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions - Ensure data quality and integrity throughout the data...