Cloud Data Engineer- Aws-big Data

1 day ago


Singapore InfoCepts Full time

**Position**: Cloud Data Engineer

**Location**: Singapore

**Type of Employment**: Fulltime

**Key Result Areas and Activities**:

- Share and Build Expertise - Develop and share expertise in Cloud solutioning domain and actively mine the experience and expertise in the organization for sharing across teams and clients in the firm. Support the Cloud COE initiatives
- Nurture and Grow Talent - Provide support for recruitment, coaching and mentoring, and building practice capacity in the firm in Cloud
- Develop and maintain scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity
- Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization
- Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it
- Works closely with a team of frontend and backend engineers, product/project managers, and analysts

**Work and Technical Expertise**:

- Strong understanding of cloud and data engineering concepts in AWS/Azure/GCP
- Develop and maintain scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity
- Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization
- Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it
- In depth knowledge of key cloud services for data integration, BI and data processing services
- In depth knowledge of cloud storage services & compute services
- Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
- Works closely with a team of frontend and backend engineers, product/project managers, and analysts
- Knowledge of containerization services such as Dockers and its orchestration through Kubernetes
- Good expertise on big data services such as Spark, PIG, Hive, Airflow, etc.
- Strong Experience with event stream processing technologies such as Kafka
- Experience with at least one programming language (Java, Scala, Python)
- Experience with at least one major Hadoop platform (Cloudera, Hortonworks, MapR) will be a plus
- Knowledge of Operating System (Must have) - Any flavor of Linux, ETL Tools (Good to have), Informatica, Talend
- Deep understanding of cloud computing infrastructure and platforms
- Experience of enabling DevOps automation for AWS or Azure with appropriate security and privacy considerations
- Expertise in developing ETL workflows comprising complex transformations like SCD, deduplications, aggregations, etc.
- Good expertise on databases including NoSQL. Experience on cloud DWH such as Snowflake, Redshift, Bigquery, etc. will be a plus

**Qualifications**:

- Overall work experience of 7+ years with minimum of 3 to 6 years experience on AWS or Azure or GCP related projects
- BS Degree in IT, MIS or business-related functional discipline
- Experience with or knowledge of Agile Software Development methodologies

**Qualities**:

- Ability to work individually on complex projects
- Able to guide and mentor junior developers, provide technical expertise, and contribute to team coordination and planning
- Adaptable, quick to learn new tools and frameworks, and resilient in the face of challenges and setbacks
- Outside the box thinking
- Possess strong verbal and written communication skills to convey technical concepts and collaborate effectively with team members, clients and other stakeholders

**Location**

Singapore

**Years Of Exp**

7 to 9 years



  • Singapore NTT DATA Full time

    Requirements / Qualifications - Bachelor's or master's degree in computer science, data engineering, or a related field. - Minimum 7 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC. - Proficiency in programming languages such as Python, Java, or Scala for building data pipelines. - Evaluate...

  • ETL Data Engineer

    3 days ago


    Singapore beBee Careers Full time

    Job Details: We are looking for an AWS ETL Data Engineer to join our team and contribute to the development of a Hybrid Datalake as part of a key IFRS project.Responsibilities:• Design and build production ETL data pipelines from ingestion to consumption within a big data architecture.• Analyze, re-architect, and re-platform on-premise data warehouses to...

  • Data Engineer

    1 day ago


    Singapore TALENTSIS PTE. LTD. Full time

    We are looking for a skilled **Data Engineer**with a focus on **Big Data**to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. **Key Responsibilities**: - Build and maintain big data pipelines using technologies like...

  • Big Data Engineer

    9 hours ago


    Singapore Triton AI PTE Ltd Full time

    Job Title Big Data Engineer Location Singapore Experience 8 12 years Skills Big Data Engineer Requirements: Bachelor's or Master's degree in Computer Science, Engineering, or a related field. Proven experience as a Big Data Engineer or similar role. Strong proficiency in Apache Spark and Scala programming. Experience with big data technologies such as...


  • Singapore EPS COMPUTER SYSTEMS PTE LTD Full time

    Roles & ResponsibilitiesJob Description –AWS ETL Cloud Data Engineer Role: We are looking to hire a AWS ETL Data Engineer. This is an exciting opportunity to use and further expand your AWS cloud skill set, and join Income Data Team to build Hybrid Datalake as part of key IFRS project. Responsibilities: • Design, build and operationalize large scale...


  • Singapore beBee Careers Full time

    We are seeking a highly skilled AWS ETL Cloud Data Engineer to join our team.As a key member of our data engineering team, you will be responsible for designing, building, and operationalizing large-scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Spark/Python on Glue,...

  • Big Data Engineer

    3 days ago


    Singapore beBee Careers Full time

    Data Engineering ExpertiseWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in big data technologies, including Hadoop, Spark, and NoSQL databases. Experience with cloud-based data platforms such as AWS or Azure is also a plus.


  • Singapore EPS COMPUTER SYSTEMS PTE LTD Full time

    Roles & ResponsibilitiesJob Description –AWS ETL Cloud Data Engineer Role: We are looking to hire an AWS ETL Data Engineer to join the Income Data Team and contribute to building a Hybrid Datalake as part of a key IFRS project. The ideal candidate will have experience designing, building, and operationalizing large-scale enterprise data solutions using AWS...


  • Singapore EPS COMPUTER SYSTEMS PTE LTD Full time

    Roles and ResponsibilitiesAWS ETL Cloud Data Engineer Role:We are looking for a skilled AWS ETL Data Engineer to join our Income Data Team. This role involves using and expanding your AWS cloud skills to build Hybrid Datalake as part of a key IFRS project.Key Responsibilities:Design, build, and operationalize large-scale enterprise data solutions and...


  • Singapore beBee Careers Full time

    Salary: Competitive compensation package based on experience.Job Description –AWS ETL Data Engineer Role: This is an exciting opportunity to utilize and expand AWS cloud skills, and contribute to building a Hybrid Datalake as part of a key IFRS project. The ideal candidate will have experience designing, building, and operationalizing large-scale...