
Big Data Engineer
18 hours ago
Develop data processing pipelines for ingestion, modelling, analysis, mining and reporting with Enterprise Big Data Lake
- Responsible for the code writing of the core module of the system
- Develop POC and build data pipeline architecture using of the overall technical framework of the software
- Work closely with teams ensure timely delivery of assignments
**What do you need to succeed?**:
- Possess good communications skills to understand our customers' core business objectives and build end-to-end data centric solutions to address them
- Good critical thinking and problem-solving abilities
**Must-have**:
- Experience building large scale enterprise data pipelines using commercial and/or open source Big Data platforms from vendors such as Hortonworks/Cloudera, MapR, for Hadoop based platforms or NoSQL platforms such as Cassandra, HBase, DataStax, Couchbase, Elastic Search, Neo4j etc
- Hands on experience in Spark, Scala, Impala, Hive SQL, Apache Nifi necessary to build and maintain complex queries, streaming and real-time data pipelines
- Data modelling and architecting skills including strong foundation in data warehousing concepts, data normalisation, and dimensional data modelling such as OLAP
- Graduate degree in Computer science or equivalent
-
Big Data Engineer
1 week ago
Singapore ALMR CONSULTING PTE. LTD. Full timeJob Summary We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. Key Responsibilities...
-
Big Data Engineer
2 weeks ago
Singapore ALMR CONSULTING PTE. LTD. Full time $100,000 - $150,000 per yearJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.Key...
-
Big Data Engineer
2 weeks ago
Singapore ALMR Consulting Pte Ltd Full time $150,000 - $200,000 per yearRoles & ResponsibilitiesJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting...
-
Big Data Engineer
6 days ago
Singapore Unison Group Full time $120,000 - $180,000 per yearWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...
-
Big Data Test Engineer
1 week ago
Singapore Patsnap Full timeAbout PatSnap PatSnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable...
-
Senior Engineer
1 week ago
Singapore Reeracoen Singapore Pte Ltd Full timeOur client is a dynamic technology consulting company specializing in digital transformation and innovative solutions. They are currently looking for a Senior Engineer (Big Data) to join their tech engineering team. - 【 What you will be doing 】- Responsible for designing, creating, and managing large-scale data processing systems. - Ensure that systems...
-
Big Data Engineer
2 weeks ago
Singapore Baidu, Inc. Full timeBuild the company's big data warehouse system, including batch and stream data flow construction. In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance. Responsible for data integration and ETL architecture design and development....
-
Big Data Test Engineer
2 weeks ago
Singapore Patsnap Full time $90,000 - $120,000 per yearAbout PatSnapPatsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, deliversactionable insights...
-
Big Data Test Engineer
2 weeks ago
Singapore Patsnap Full time $80,000 - $120,000 per yearAbout PatSnap Patsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable...
-
Big Data Engineer
1 week ago
Singapore DADACONSULTANTS PTE. LTD. Full timeBuilt end-to-end data pipelines and automation of data quality reporting process to ensure data integrity; - Participate in the construction of a unified data warehouse in hierarchical architecture and support ETL requirements of various features; - Participate in building metrics and provide data solutions based on the business; **Job Requirement**: -...