Big Data Engineer

5 days ago

Singapore Unison Consulting Full time

Get AI-powered advice on this job and more exclusive features.

We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs. Candidate will also be integrating data sets to provide seamless data access to users.
Skills Set And Track Record

  • Good understanding and completion of projects using waterfall/Agile methodology
  • Analytical, conceptualisation and problem-solving skills
  • Good understanding of analytics and data warehouse implementations
  • Hands-on experience in big data engineering jobs using Python, Pyspark, Linux, and ETL tools like Informatica
  • Strong SQL and data analysis skills. Hands-on experience in data virtualisation tools like Denodo will be an added advantage
  • Hands-on experience in a reporting or visualization tool like SAP BO and Tableau is preferred
  • Track record in implementing systems using Cloudera Data Platform will be an added advantage
  • Motivated and self-driven, with ability to learn new concepts and tools in a short period of time
  • Passion for automation, standardization, and best practices
  • Good presentation skills are preferred
The developer is responsible to:
  • Analyse the Client data needs and document the requirements
  • Refine data collection/consumption by migrating data collection to more efficient channels
  • Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs
  • Develop test plan and scripts for system testing, support user acceptance testing
  • Work with the Client technical teams to ensure smooth deployment and adoption of new solution
  • Ensure the smooth operations and service level of IT solutions
  • Support production issues
Seniority level
  • Seniority level Mid-Senior level
Employment type
  • Employment type Contract
Job function
  • Job function Information Technology
  • Industries IT Services and IT Consulting

Referrals increase your chances of interviewing at Unison Consulting by 2x

Get notified about new Big Data Developer jobs in Singapore, Singapore .

Data Engineer (Snowflake/Microsoft Fabric), AI & Data, Technology Consulting

South East Community Development Council, Singapore 1 week ago

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Big Data Engineer

    2 weeks ago

    Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time

    **Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...

  • Big Data Engineer

    6 days ago

    Singapore beBeeDataEngineering Full time $80,000 - $120,000

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...

  • Big Data Engineer

    6 days ago

    Singapore IITMATRIX Full time

    We are looking for a skilled **Big Data Engineer** to join our dynamic team. You will be responsible for designing, developing, and optimizing data solutions within the Big Data ecosystem. This role involves working with large datasets, ensuring high performance at scale, and collaborating with cross-functional teams to deliver data-driven insights and...

  • Big Data Engineer

    3 days ago

    Singapore AlgoriX Technology Pte. Ltd. Full time

    **Responsibilities** The Big Data Engineer is responsible for analyzing big data and optimizing the performance of our online advertising delivery system. They are also responsible for the research and development of the advertising system’s offline and real-time data streams. **Requirements**: - Bachelor’s degree or above, majoring in Computer...

  • Big Data Engineer

    1 day ago

    Singapore INCOME INSURANCE LIMITED Full time

    Responsible for data pipeline setup and data transformation - Implementation including loading from disparate data sets, preprocessing data. - Scope and deliver various Big Data solutions - Ability to design solutions independently based on high-level architecture. - Maintain the production systems (Kafka, Hadoop, Elasticsearch, RDBMS and No-SQL) -...

  • Big Data Engineer

    2 weeks ago

    Singapore Baidu, Inc. Full time

    Direct message the job poster from Baidu, Inc. Responsibilities Build the company's big data warehouse system, including batch and stream data flow construction; In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance Responsible...

  • Big Data Engineer

    7 days ago

    Singapore UNISON Group Full time $104,000 - $130,878 per year

    We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...

  • Big Data Engineer

    2 weeks ago

    Singapore AXPARA SOLUTIONS PTE. LTD. Full time

    Job Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...

  • Big Data Engineer

    5 days ago

    Singapore AXPARA SOLUTIONS PTE. LTD. Full time

    Job Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...

  • Big Data Engineer

    6 days ago

    Singapore AXPARA SOLUTIONS PTE. LTD. Full time

    Job Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...