Big Data Engineer
2 weeks ago
We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 9 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, building, maintaining and supporting big data platforms.
1 Responsibilities
•Oversee day-to-day operations of big data platform to ensure high availability, reliability and performance.
•Proactively monitor big data platform services, components and clusters to identify potential issues. Take corrective actions as needed to maintain platform health
•Manage configuration, upgrades, and patching of big data platform, ensuring all services are up to date
•Work with the Authority's technical teams to ensure smooth deployment and adoption of new solution to support data ingestions, process and workflows
•Maintain clear and detailed documentation of platform configuration, troubleshooting steps and incident resolution.
•Continuously monitor for and address platform security vulnerabilities. Implement patching strategies to resolve identified vulnerabilities and maintain a secure environment.
•Develop automation script to streamline administrative tasks, platform health and ensure operational consistency.
•Ensure the smooth operations and service level of IT solutions.
•Support production issues
2.What we are looking for
•Hands-on experience, knowledge and troubleshooting of Cloudera Data Platform such as HDFS, YARN, HIVE, Spark, Impala, Ranger, operating systems, security and network.
•Hands on experience with monitoring tools like Cloudera Manager, Zabbix, Grafana, Splunk, SyslogNG
•Familiarity with middleware applications i.e. Informatica, Denodo and scripting languages like bash, python, or shell scripting for automation
•Experience with cloud technology i.e. AWS, Azure is a plus
•Ability to troubleshoot complex issues ranging from system resource to application stack traces.
•Track record in implementing systems with high availability, high performance, high security hosted at various data centres or hybrid cloud environments will be an added advantage.
•Cloudera Certified Administrator or similar certification are a plus.
•Excellent communication skill to work with cross-functional teams
•Ability to handle high-pressure situations and manage critical incidents.
EA License # 14C6941
Tell employers what skills you haveTroubleshooting
Azure
Big Data
Pipelines
High Availability
Hadoop
Informatica
Scripting
Service Level
Reliability
Data Engineering
SQL
Python
Operating Systems
Zabbix
Java
-
Big Data Engineer
2 weeks ago
Singapore APAR TECHNOLOGIES PTE. LTD. Full timeRoles & ResponsibilitiesAre you passionate about big data and love working with cutting-edge technologies? Join our team as a Big Data Engineer and help us build scalable data solutions What You'll Do: Design, develop, and optimize big data pipelines Work with Apache Spark, Scala, Hadoop, Hive, Kafka, and more Manage and process large datasets efficiently...
-
Big Data Engineer
2 weeks ago
Singapore APAR TECHNOLOGIES PTE. LTD. Full timeRoles & ResponsibilitiesAre you passionate about big data and love working with cutting-edge technologies? Join our team as a Big Data Engineer and help us build scalable data solutions! What You’ll Do:✔ Design, develop, and optimize big data pipelines✔ Work with Apache Spark, Scala, Hadoop, Hive, Kafka, and more✔ Manage and process large datasets...
-
Big Data Engineer
3 weeks ago
Singapore ITCAN PTE. LIMITED Full timeRoles & Responsibilities· Bachelor's or master's degree in computer science, Engineering, or a related field.· Proven experience as a Big Data Engineer or similar role.· Strong proficiency in Apache Spark and Scala programming.· Experience with big data technologies such as Hadoop, Hive, Kafka, etc.· Familiarity with data warehousing concepts and...
-
Big Data Engineer
1 week ago
Singapore ITCAN PTE. LIMITED Full timeRoles & Responsibilities· Bachelor's or master's degree in computer science, Engineering, or a related field.· Proven experience as a Big Data Engineer or similar role.· Strong proficiency in Apache Spark and Scala programming.· Experience with big data technologies such as Hadoop, Hive, Kafka, etc.· Familiarity with data warehousing concepts and...
-
Big Data Engineer
2 weeks ago
Singapore INFINITE COMPUTER SOLUTIONS PTE LTD Full timeRoles & ResponsibilitiesWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 9 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, building, maintaining and supporting big...
-
Big Data Engineer
2 weeks ago
Singapore DADACONSULTANTS PTE. LTD. Full timeRoles & ResponsibilitiesMy ClientIt is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services. The platform offers a wide range of services, including spot trading, derivatives trading, and wealth management. They are looking for experienced and motivated Mobile app developer to join the...
-
Big Data Engineer
2 weeks ago
Singapore DADACONSULTANTS PTE. LTD. Full timeRoles & ResponsibilitiesMy ClientIt is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services. The platform offers a wide range of services, including spot trading, derivatives trading, and wealth management. They are looking for experienced and motivated Mobile app developer to join the...
-
Big Data Engineer
4 weeks ago
Singapore ITCAN PTE. LIMITED Full timeRoles & Responsibilities· Bachelor’s or master’s degree in computer science, Engineering, or a related field.· Proven experience as a Big Data Engineer or similar role.· Strong proficiency in Apache Spark and Scala programming.· Experience with big data technologies such as Hadoop, Hive, Kafka, etc.· Familiarity with data warehousing concepts and...
-
Big Data Engineer
4 weeks ago
Singapore ITCAN PTE. LIMITED Full timeRoles & Responsibilities· Bachelor’s or master’s degree in computer science, Engineering, or a related field.· Proven experience as a Big Data Engineer or similar role.· Strong proficiency in Apache Spark and Scala programming.· Experience with big data technologies such as Hadoop, Hive, Kafka, etc.· Familiarity with data warehousing concepts and...
-
Big Data Engineer
4 weeks ago
Singapore MICHAEL PAGE INTERNATIONAL PTE LTD Full timeRoles & Responsibilities Organisation is a global leader in the technology and telecoms industry. Fast-paced environment, rapidly growing organisation.About Our ClientThe organisation is a global leader in the technology and telecoms industry. They are well-known for their innovative approach to tackling complex technical challenges and their commitment to...
-
Big Data Engineer
2 weeks ago
Singapore MICHAEL PAGE INTERNATIONAL PTE LTD Full timeRoles & ResponsibilitiesOrganisation is a global leader in the technology and telecoms industry. Fast-paced environment, rapidly growing organisation.About Our ClientThe organisation is a global leader in the technology and telecoms industry. They are well-known for their innovative approach to tackling complex technical challenges and their commitment to...
-
Big Data
1 week ago
Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilities:Collaborate with cross-functional teams to understand business requirements and translate them into scalable and efficient big data platform solutions. Design and architect robust big data platforms, ensuring high performance, reliability, and scalability. Implement end-to-end data processing workflows, from data...
-
Senior Big Data Engineer
1 day ago
Singapore TANGSPAC CONSULTING PTE LTD Full timeRoles & ResponsibilitiesJob Description & RequirementsWorking in a large Big data and datawarehouse team of a bank, you will be responsible for carrying out the followingUnderstand functional requirements Carrying out data analysis, data mapping development of data pipeline, back end services performing data management and data transformation Ensuring...
-
Big Data Engineer
4 weeks ago
Singapore MINDMAP TECHNOLOGIES PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilities· Perform the role of a Data engineer on the Enterprise Data Architecture and Governance (EDAG) Programs, to ensure the business requirements and deliverables are aligned to business priorities· Design develop data pipelines on EDAG platform to support Wholesale bank data model.· Perform assessments and analysis on...
-
Big Data Engineer
2 weeks ago
Singapore MINDMAP TECHNOLOGIES PTE. LTD. Full timeRoles & ResponsibilitiesResponsibilities· Perform the role of a Data engineer on the Enterprise Data Architecture and Governance (EDAG) Programs, to ensure the business requirements and deliverables are aligned to business priorities· Design develop data pipelines on EDAG platform to support Wholesale bank data model.· Perform assessments and analysis on...
-
Cloudera & Big Data Engineer
1 week ago
Singapore MANPOWER STAFFING SERVICES (SINGAPORE) PTE LTD Full timeRoles & ResponsibilitiesJob scopes· Design, build, deployment, of ETL/ELT data pipelines within big data ecosystems ( Impala, Hue, Spark, Talend and Cloudera)· Develop technical design, and ETL specification documents· Manage, monitor and fine tune Hadoop cluster architecture (HDFS) jobs for performance, security and resource management.· Create detailed...
-
Big Data Engineer
1 week ago
Singapore DADACONSULTANTS PTE. LTD. Full timeRoles & ResponsibilitiesKey Responsibilities: Ensure seamless deployment, configuration, and operation of applications on cloud servers and container platforms. Collaborate with development teams to design scalable and highly available system architectures. Contribute to the development and maintenance of internal platforms and tools. Perform daily...
-
Singapore Tangspac Full timeCompany Overview:Tangspac is a leading provider of innovative solutions for the financial industry.We are seeking an experienced Big Data Engineer to join our team and contribute to the development of our cutting-edge big data applications.
-
Big Data Engineer
2 weeks ago
Singapore BYTEDANCE PTE. LTD. Full timeRoles & ResponsibilitiesAbout ByteDanceFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create...
-
Senior Big Data Engineer
2 weeks ago
Singapore PALO IT SINGAPORE PTE. LTD. Full timeRoles & ResponsibilitiesWHO WE ARE:Build. Scale. Sustain.PALO IT is a global technology consultancy that crafts tech as a force for good. We design, develop and scale digital and sustainable products and services to unlock value across the triple bottom line: people, planet, profit. We do the right thing, and we do it right. We're proud to be a World...