Senior Big Data Engineer
2 weeks ago
**Your Profile**
We are seeking a skilled and motivated Data Engineer with expertise in Hadoop, Spark, OpenShift Container Platform (OCP), and DevOps practices. As a Data Engineer, you will be responsible for designing, developing, and maintaining efficient data pipelines, processing large-scale datasets. Your expertise in Hadoop, Spark, OCP, and DevOps will be crucial in ensuring the availability, scalability, and reliability of our ML Solutions.
**Responsibilities**:
- Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives
- Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions
- Ensure data quality and integrity throughout the data processing lifecycle
- Design and deploy data engineering solutions on OpenShift Container Platform (OCP) using containerization and orchestration techniques
- Optimize data engineering workflows for containerized deployment and efficient resource utilization
- Collaborate with DevOps teams to streamline deployment processes, implement CI/CD pipelines, and ensure platform stability
- Implement data governance practices, data lineage, and metadata management to ensure data accuracy, traceability, and compliance
- Monitor and optimize data pipeline performance, troubleshoot issues, and implement necessary enhancements
- Implement monitoring and logging mechanisms to ensure the health, availability, and performance of the data infrastructure
- Document data engineering processes, workflows, and infrastructure configurations for knowledge sharing and reference
- Stay updated with emerging technologies, industry trends, and best practices in data engineering and DevOps
- Provide technical leadership, mentorship, and guidance to junior team members to foster a culture of continuous learning and innovation to the continuous improvement of the analytics capabilities within the bank
**Requirements**:
- Bachelor's degree in Computer Science, Information Technology, or a related field
- Proven experience as a Data Engineer, working with Hadoop, Spark, and data processing technologies in large-scale environments
- Strong expertise in designing and developing data infrastructure using Hadoop, Spark, and related tools (HDFS, Hive, Pig, etc)
- Experience with containerization platforms such as OpenShift Container Platform (OCP) and container orchestration using Kubernetes
- Proficiency in programming languages commonly used in data engineering, such as Spark, Python, Scala, or Java
- Knowledge of DevOps practices, CI/CD pipelines, and infrastructure automation tools (e.g., Docker, Jenkins, Ansible, BitBucket)
- Experience with Graphana, Prometheus, Splunk will be an added benefit
- Strong problem-solving and troubleshooting skills with a proactive approach to resolving technical challenges
- Excellent collaboration and communication skills to work effectively with cross-functional teams
- Ability to manage multiple priorities, meet deadlines, and deliver high-quality results in a fast-paced environment
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services is a plus
Pay: $3,916.98 - $10,000.00 per month
Schedule:
- Monday to Friday
**Experience**:
- Big data: 3 years (preferred)
Application Deadline: 30/12/2024
-
Senior Software Engineer
5 days ago
Rochor, Singapore Truegenics Pte Ltd Full time $80,000 - $120,000 per yearMission of the Role:As a Senior Software Engineer (Developer) - AI-Driven, you'll take the lead in shaping our internal infrastructure and DevOps processes. You'll work across the product lifecycle to deliver scalable, high-quality systems and tools that power our teams with a sharp eye for detail and long-term maintainability.What AI Means Here (And Why It...
-
Senior Business Development Associate
4 hours ago
Rochor, Singapore Handshakes by DC Frontiers Full timeHandshakes is an award-winning DataTech company. We enable our clients to make safer, more informed decisions by delivering meaningful insights, harnessed from reliable data. We are looking for a self-driven and enterprising **Senior Business Development Associate** to join our Business Development team in our Singapore office. The **Senior Business...
-
Senior Software Engineer
6 days ago
Rochor, Singapore Truegenics Pte Ltd Full time**Mission of the Role**: As a **Senior Software Engineer (Developer) - AI-Driven**, you’ll take the lead in shaping our internal infrastructure and DevOps processes. You'll work across the product lifecycle to deliver scalable, high-quality systems and tools that power our teams with a sharp eye for detail and long-term maintainability. **What AI Means...
-
Senior DevOps Engineer
2 weeks ago
Rochor, Singapore Accolite Digital Full time**Your Profile** We seek individuals with highly developed conceptual, strategic, and analytical skills, capable of striking a balance between visionary thinking and practical solutions. The ability to comprehend, inspire, and mobilize others is crucial. A business-oriented mindset coupled with effective storytelling will drive your success. We are looking...
-
Assistant Manager/Senior Executive, IT
5 days ago
Rochor, Singapore Singapore Children's Society Full time $80,000 - $120,000 per yearThe Senior Executive/Assistant Manager plays a key role in supporting and driving the organisation's digital transformation agenda to enhance productivity, service excellence, data protection, cybersecurity, and knowledge sharing across the organisation. Reporting to the Head of Corporate Services Department (CSD), the role requires close collaboration with...
-
Rochor, Singapore KidStart Singapore Limited (KSL) Full time**Description of Division/Branch**: The KidSTART Home Visitation Programme delivers a range of child development strategies by supporting parents through home visits and support groups, and to assess and monitor the progress of children’s health and development. The programme promotes parent-child bonding and promotes child development by actively engaging...
-
Full Stack Software Engineer
5 days ago
Rochor, Singapore Building System & Diagnostics Pte. Ltd. Full time $80,000 - $120,000 per yearWe're seeking a skilled Full-Stack Software Engineer with expertise in , React, and DynamoDB to build high-performance, scalable web applications. You'll work on our modern server architecture, creating seamless user experiences while leveraging AWS's powerfulKey ResponsibilitiesFrontend DevelopmentBuild dynamic, server-side rendered applications using and...
-
Digital Marketing Manager
2 weeks ago
Rochor, Singapore Mintable Pte Ltd Full time**Company Description** Mintable is one of the world’s leading NFT marketplace’s; founded in 2018 with its global headquarters in Singapore. Mintable is profitable, has multiple revenue streams, is well-funded and is going through a period of rapid growth. We are made up of a team of experienced professionals who are committed to building a meaningful...
-
Senior Planning Analyst
2 weeks ago
Rochor, Singapore Pizza Hut Digital & Technology Full time**PURPOSE OF THE JOB** Provide support to the Finance Manager and China Growth Leaders including accounting, financial analysis as well as management and financial reporting for the China License Fees and associated G&A. **JOB SIZE** - License Fees of >$300M and significant development pipeline. - This position will be based in Singapore **JOB FUNCTIONS** -...
-
Corporate Development
6 days ago
Rochor, Singapore KidStart Singapore Limited (KSL) Full timeKidSTART was introduced as a three-year pilot programme in 2016 to provide upstream support to children (aged 0-6) from low-income families in the areas of childhood development, health and social service. As we prepare to expand into new regions over the next few years, the Ministry of Social and Family Development is setting up a dedicated agency to...