Data Pipeline Consultant

1 week ago


Singapore Ashnik Full time

**Location**: Singapore

The Position

Ashnik is looking for someone to be part of consulting team who is passionate about Data and Analytics. If you like to solve customers’ problem by aggregating and enhancing different size and shape of data, if you have experience working with real time data pipeline and data engineering, if you like to impact customer business by providing real time data pipeline and analytics and if you like to lead data pipeline practice, here is opportunity for you.

Experience required
Graduate from Engineering or equivalent
Overall, 8 + years of experience with at least 4+ years’ experience in relevant building data pipeline/ETL/Data engineer
Solid experience required in SQL and NoSQL languages
Good experience is required in building data schemas with SQL, Json, Key-values etc data
Experience of building Data pipeline using automation tools like ansible, python, pearl etc
Must have experience working with Kafka preferred Confluent Kafka
Experience working with ETL tools such as SPARK, Pentaho etc
Experience working with Data lake, Data warehouse, Hadoop systems
Experience working with Public cloud such as AWS, Azure, GCP added advantages
Experience working in a pre-sales / customer-facing role will add advantages
Desire skills required
SQL query languages with Oracle, Postgres, SQL Server, etc
Database like MongoDB, Elasticsearch, Redis, etc
Apache/Confluent Kafka
Python, PHP, Pearl, Ansible, CloudFormation, etc
SPARK, Pentaho, Logstash
Database, Data warehouse
Consulting and Pre-Sales experience added advantages

This role requires a high degree of self-initiative, working with diversified teams and working with customers spread across Southeast Asia and Indian region. This role requires you to be proactive in communicating with customers and internal teams about industry trends, technology development and creating thought leadership.

**Responsibilities**:
Analyze and organize raw data with various data sources such as api’s, RDBMS, NoSQL, text, etc. These data may be structured or unstructured
Build data ecosystem and real-time data pipeline using various tools and technologies. This includes data cleans, transformation, and storing the data effectively
Understand customer technical and business requirements around building a data pipeline and how is it affecting the customer business
Build POV, POC, and prototype for business and technical use cases for customer data
Understand the right deployment method on the cloud as well as on-premises
Build the data pipeline with automation tools to ensure that the right data models get built constantly
Collaborate with architectures, Developers, Business Users, and Data Scientists to ensure that we deliver right-fit solutions
Guide the delivery team to deploy the solution effectively and ensure that the business objective meets
What is in it for You?
Be a part of the thought leadership team in the open-source world
Provide multi-technology solutions instead of delivering just a product
Work and learn from the pioneers in the open-source industry
Be a proud contributor and part of our customers’ fast-growing, digital transformation goals

**Benefits**:
Comprehensive medical insurance
Flexible working options with WFH being default
Continuous Training & Development
Professional courses and certification support 24×7 team assistance program
Generous parental and family leave
Paid medical and annual leaves
Reward and Recognition Program
About Us

Ashnik is a leading enterprise open-source solutions company in Southeast Asia and India, enabling organizations to adopt open source for their digital transformation goals. Founded in 2009, it offers a full-fledged Open-Source Marketplace, Solutions, and Services - Consulting, Managed, Technical, Training. Over 200 leading enterprises so far have leveraged Ashnik’s offerings in the space of Database platforms, DevOps & Microservices, Kubernetes, Cloud, and Analytics.

As a team culture, Ashnik is a family for its team members. Each member brings in a different perspective, new ideas and diverse background. Yet we all together strive for one goal - to deliver the best solutions to our customers using open-source software. We passionately believe in the power of collaboration. Through an open platform of idea exchange, we create a vibrant environment for growth and excellence.



  • Singapore beBee Careers Full time

    Job Description:As a Software Consultant, you will be responsible for developing and maintaining data pipelines using Python, Spark, and PySpark. This includes extracting, transforming, and loading (ETL) data from various sources into a centralized data storage system, such as a data warehouse or data lake.You will integrate data from multiple sources and...


  • Singapore beBee Careers Full time

    This role requires a skilled professional with expertise in data integration, distributed systems, and Elasticsearch. The ideal candidate will have a deep understanding of data ingestion pipelines, data processing, and data retention. Key responsibilities include designing and implementing data ingestion pipelines, developing and maintaining robust data...


  • Singapore beBee Careers Full time

    Data Pipelines SpecialistWe are seeking a highly skilled data pipelines specialist to design, develop, and maintain data pipelines that support business intelligence and decision-making.


  • Singapore beBee Careers Full time

    Data Engineer PositionWe are seeking a highly skilled Data Engineer to design, develop, and maintain robust data pipelines for clinical study and digital device sensor data processing and analysis.Key Responsibilities:Design scalable data pipelines to ingest, transform, and load clinical study data from various sources, including digital device...


  • Singapore beBee Careers Full time

    Developing Data PipelinesWe are seeking a skilled Data Engineer to develop and enhance data pipelines and system architecture. This role involves creating and maintaining optimal data pipelines to enable ingestion from various structured and unstructured data sources via Talend.The ideal candidate will have a strong background in traditional structured...


  • Singapore beBee Careers Full time

    Data Pipeline SpecialistWe are looking for a skilled Data Pipeline Specialist to join our team. The successful candidate will be responsible for designing, building, and maintaining scalable data pipelines that meet the needs of our organization.Key Responsibilities:Design and implement efficient data pipelines using Airbyte and Airflow.Collaborate with...


  • Singapore beBee Careers Full time

    Data Engineering OpportunityWe are seeking a highly skilled Data Engineer to contribute to the design, development, and maintenance of robust data pipelines. As a key member of our team, you will work closely with data scientists and software engineers to ensure the efficient flow of data from source systems to analytical tools and platforms.Key...


  • Singapore beBee Careers Full time

    Job Title:Data EngineerDescriptionWe are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for ensuring that data pipelines are deployed successfully into production environment. This includes deploying applications to AWS cloud leveraging on the full spectrum of the AWS cloud services, automating data pipelines...


  • Singapore beBee Careers Full time

    We are seeking an experienced Elastic Engineer to drive the development and implementation of data-driven solutions. The successful candidate will possess a deep understanding of Elasticsearch and related technologies, with expertise in designing, deploying, and managing large-scale data pipelines.Key ResponsibilitiesData Pipeline Design and Implementation:...


  • Singapore beBee Careers Full time

    Job Description As a data pipeline and data lake engineer, you will play a critical role in supporting our data platform development. Your responsibilities will include designing, building, and maintaining data pipelines to ensure seamless integration and flow of data from multiple systems across various frequencies and fidelities. Main Responsibilities •...