Big Data Engineer
1 week ago
**SKILLS SET AND TRACK RECORD**
- Good understanding and completion of projects using waterfall/Agile methodology.
- Analytical, conceptualisation and problem-solving skills.
- Good understanding of analytics and data warehouse implementations
- Hands-on experience in big data engineering jobs using Python, Pyspark, Linux, and ETL tools like Informatica
- Strong SQL and data analysis skills. Hands-on experience in data virtualisation tools like Denodo will be an added advantage
- Hands-on experience in a reporting or visualization tool like SAP BO and Tableau is preferred
- Track record in implementing systems using Cloudera Data Platform will be an added advantage.
- Motivated and self-driven, with ability to learn new concepts and tools in a short period of time
- Passion for automation, standardization, and best practices
- Good presentation skills are preferred
**The developer is responsible to**:
- Analyse the Client data needs and document the requirements.
- Refine data collection/consumption by migrating data collection to more efficient channels
- Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs.
- Develop test plan and scripts for system testing, support user acceptance testing.
- Work with the Client technical teams to ensure smooth deployment and adoption of new solution.
- Ensure the smooth operations and service level of IT solutions.
- Support production issues
-
Big Data Engineer
2 weeks ago
Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full timeJob Title: Big Data Engineer (Java, Spark, Hadoop)Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep...
-
Big Data Engineer
7 days ago
Singapore ALMR CONSULTING PTE. LTD. Full timeJob Summary We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. Key Responsibilities...
-
Big Data Engineer
2 weeks ago
Singapore ALMR CONSULTING PTE. LTD. Full time $100,000 - $150,000 per yearJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.Key...
-
Big Data Engineer
2 weeks ago
Singapore ALMR Consulting Pte Ltd Full time $150,000 - $200,000 per yearRoles & ResponsibilitiesJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting...
-
Big Data Engineer
1 day ago
Singapore INCOME INSURANCE LIMITED Full timeResponsible for data pipeline setup and data transformation - Implementation including loading from disparate data sets, preprocessing data. - Scope and deliver various Big Data solutions - Ability to design solutions independently based on high-level architecture. - Maintain the production systems (Kafka, Hadoop, Elasticsearch, RDBMS and No-SQL) -...
-
Big Data Engineer
1 week ago
Singapore Tata Consultancy Services Limited Full timeRequirements Proven experience as a Big Data Engineer or similar role. Strong proficiency in Apache Spark and Scala programming. Experience with big data technologies such as Hadoop, Hive, Kafka, etc. Familiarity with data warehousing concepts and tools. Knowledge of SQL and NoSQL databases. Excellent problem-solving skills and attention to detail. Strong...
-
Big Data Engineering Lead
2 weeks ago
Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full timeWe're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation. **Key Responsibilities**: - Design and...
-
Big Data Platform Engineer
2 weeks ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full timeData processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...
-
Senior Engineer
3 days ago
Singapore Reeracoen Singapore Pte Ltd Full timeOur client is a dynamic technology consulting company specializing in digital transformation and innovative solutions. They are currently looking for a Senior Engineer (Big Data) to join their tech engineering team. - 【 What you will be doing 】- Responsible for designing, creating, and managing large-scale data processing systems. - Ensure that systems...
-
Big Data Test Engineer
2 weeks ago
Singapore Patsnap Full time $90,000 - $120,000 per yearAbout PatSnapPatsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, deliversactionable insights...