Cloud-Based Big Data Engineer

4 days ago

Singapore beBeeDataArchitect Full time $80,000 - $120,000
Big Data Architect

We are seeking a skilled Big Data Architect to design and implement large-scale data pipelines using cloud-based services.

  • Bulk load structured and unstructured data into data warehouses, lakes, and marts for business intelligence and analytics.
  • Develop VQL queries and work with data virtualization tools to optimize data access and reduce latency.
  • Handle data ingestion from internal/external sources; manage data cleaning, transformation, and loading.
  • Automate data collection processes, including API integration where applicable.
  • Design conceptual, logical, and physical data models using ER Studio to ensure data integrity and consistency.
  • Maintain large datasets in data warehouses, data lakes, operational data stores, and data blueprints.
  • Create analytical views (Denodo, RDS) to support business decisions.
  • Implement data governance and master data management practices.
  • Ensure seamless integration of data systems and applications.
  • Implement data security, compliance, and scalable integration solutions.
  • Develop data processing scripts in Python for AWS Glue.
  • Write efficient VQL/SQL queries and stored procedures.
  • Build RESTful APIs following best practices.
  • Use AWS SageMaker for deploying machine learning models.
Key Responsibilities:

The ideal candidate will have 3+ years of experience in big data engineering or related fields. They should possess strong analytical skills, excellent communication abilities, and the capacity to work effectively in a fast-paced environment.

Qualifications:
  • Strong background in data architecture and engineering.
  • Proficiency in AWS services, including Glue, Athena, S3, and RDS.
  • Experience with data virtualization tools like Denodo.
  • Familiarity with SQL and VQL query languages.
  • Ability to handle large datasets and scale accordingly.

  • Big Data Engineering Lead

    2 days ago

    Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full time

    We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation. **Key Responsibilities**: - Design and...

  • Big Data Engineer

    2 days ago

    Singapore AXPARA SOLUTIONS PTE. LTD. Full time

    Job Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...

  • Big Data Engineering Lead

    4 weeks ago

    Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full time

    Roles & ResponsibilitiesWe're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation.Key...

  • Data Engineer

    4 days ago

    Singapore TALENTSIS PTE. LTD. Full time

    We are looking for a skilled **Data Engineer**with a focus on **Big Data**to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. **Key Responsibilities**: - Build and maintain big data pipelines using technologies like...

  • Cloud-Based Data Engineer

    2 days ago

    Singapore beBeeData Full time $150,000 - $200,000

    Job OpportunityThis role involves leading the development and implementation of data engineering solutions to support analytics and AI initiatives. Key responsibilities include designing, developing, and deploying cloud-based products that integrate telco data with other verticals (retail, healthcare). Key Responsibilities:Developing ETL/ELT workflows...

  • Cloud Consultant, Big Data and Analytics, Google

    2 days ago

    Singapore Google Full time

    Google will be prioritizing applicants who have a current right to work in Singapore, and do not require Google's sponsorship of a visa. Minimum qualifications: - Bachelor’s degree in Computer Science, Engineering, a related technical field, or equivalent practical experience. - 5 years of experience in agile program management with a focus on consulting...

  • Big Data Engineer

    3 days ago

    Singapore beBeeData Full time $120,000 - $180,000

    Job Title:Big Data Engineer - Cloud Infrastructure Overview:We are seeking an experienced Big Data Engineer with a background in cloud infrastructure to join our team. The ideal candidate will have a strong understanding of data processing frameworks, streaming technologies, and data lake architectures. The successful candidate will be responsible for...

  • Big Data Engineer

    2 weeks ago

    Singapore NOBILITY SERVICES SINGAPORE PTE. LTD. Full time

    Roles & Responsibilities Job Requirements:· Degree in Information Technology or equivalent.· Must have 6- 8 years of experience in Data Warehousing· Extensive experience in ERD Design/ETL/Querying· Must have at least 5 years of Python Development in Data Engineering· Minimum 6 years of SQL experience· Must have experience in Big Data Technologies-...

  • Big Data Engineer

    1 week ago

    Singapore NOBILITY PLACEMENT SERVICES PTE. LTD. Full time

    **Job Requirements**: - Degree in Information Technology or equivalent. - Must have 6- 8 years of experience in Data Warehousing. - Extensive experience in ERD Design/ETL/Querying. - Must have at least 5 years of Python Development in Data Engineering. - Minimum 6 years of SQL experience. - Must have experience in Big Data Technologies - Apache, Spark, Hive...

  • Big Data Engineer

    6 days ago

    Singapore NETEASE INTERACTIVE ENTERTAINMENT PTE. LTD. Full time

    NetEase Games is one of the largest game developers worldwide by size and revenue. Over the years, NetEase Games has been focusing on developing high quality content and providing the best experience for gamers all around the world. So far, the company has more than 100 games in operation. Its recent games include Naraka: Bladepoint, Knives Out, Onmyoji,...