Data Pipeline Specialist

4 days ago

Singapore beBeeDataEngineer Full time $100,000 - $150,000

Job Title: Data Engineer

We are seeking a skilled professional to assume the role of Data Engineer in our organization. The successful candidate will be responsible for identifying relevant data to be gathered and implementing solutions to extract, transform, and load (ETL) the data into databases or data sources.

The ideal candidate will have experience in designing and coding skills, with proficiency in Python, PySpark, SQL, and Git. They will also possess strong business analysis skills to obtain requirements from users and document them.

Responsibilities include building and maintaining data pipelines, ensuring data flows smoothly from source to destination, and supporting software developers, database architects, data analysts, and data scientists on data initiatives.

The Data Engineer will also define and build data pipelines that enable faster, better, data-informed decision-making within the business, assist in developing enterprise data management strategies, and design and develop data products to drive business outcomes.

  • Design next-generation data platforms to support analytics in trading.
  • Identify, design, and implement internal process improvements, automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability.
  • Assemble large, complex data sets that meet functional/non-functional business requirements.
  • Build and maintain data pipelines required for extracting, cleaning, and transforming data from various sources.
  • Establish best practices around data governance, security, and privacy (GDPR).
  • Create data tools for analytics and data scientist team members.
  • Drive and apply Agile Framework within your operating environment.
Requirements:
  • A minimum of 1 year of experience in a Data Engineer role with preferred skills and experience.
  • 3-5 years of advanced experience in design and coding skills and programming experience in Python, PySpark, SQL.
  • Experience with data pipelining/data wrangling, strong business analysis skills, and interpretation of data.
  • Technical skills: Source Code Control (Git), reporting/visualization tools (Power BI), SQL-based technologies (MSSQL, MySQL, PostgreSQL), restful API developments, data blending technology (Databricks), Microsoft data stack (Microsoft Azure Data Lake, Azure Table/Blob stores).
  • Agile Project Delivery techniques (e.g., SCRUM) & experience creating and using scrum and agile artefacts and techniques, automated testing, personas, user stories, agile games, etc.
  • Interpersonal, communication, facilitation, and presentation skills, comfortable working with global stakeholders, internally and externally.
  • Able to work under pressure with tight deadlines and balancing multiple priorities.

  • Data Pipeline Specialist

    7 days ago

    Singapore beBeeDataPipeline Full time

    Job Title: Data Pipeline SpecialistWe are seeking a skilled professional to lead the development and maintenance of robust data pipelines.Design, build, and maintain scalable data pipelines to ingest, process, and store structured and unstructured data from internal and external sources.Optimize ETL/ELT processes for real-time and batch data...

  • Pipeline Data Engineer

    2 days ago

    Singapore beBeeData Full time $80,000 - $120,000

    Job Title:ETL Specialist">A strong ETL pipeline support engineer is required to ensure the smooth operation of our DevOps team's production pipelines. Key responsibilities will include monitoring and troubleshooting existing pipelines to maintain optimal performance and data reliability.">This role involves working with various technologies such as SQL,...

  • Data Pipeline Specialist

    2 days ago

    Singapore beBeeEngineering Full time $140,000 - $170,000

    Job Title: Lead Data EngineerWe are seeking an accomplished data engineer to spearhead the design, development and maintenance of scalable data pipelines and ETL solutions.Collaborate with cross-functional teams to ensure data quality, scalability and alignment with business and technical requirements.Design, develop, test and maintain robust ETL pipelines...

  • Data Pipeline Specialist

    4 days ago

    Singapore beBeeDataEngineer Full time $80,000 - $100,000

    Job Title: Data EngineerWe are seeking a skilled and experienced data engineer to join our team.The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data.

  • Data Pipeline Architect

    1 day ago

    Singapore beBeeData Full time $80,000 - $120,000

    Job Title: Data Analyst SpecialistThe primary function of this role is to design, build, maintain and optimize data pipeline architecture.Collaborate with our team of analysts and scientists to optimise extraction, transformation and loading of data from various sources using SQL and Big Data technologies.Evaluate data analytics technologies to recommend...

  • Data Pipeline Specialist

    6 days ago

    Singapore beBeeCybersecurity Full time $5,500

    Job OpportunityIn this role, you will be responsible for developing and optimizing data pipelines to support cybersecurity analytics.

  • Pipeline Specialist

    6 days ago

    Singapore beBeePipeFitter Full time $50,000 - $90,000

    Job Title: Pipeline SpecialistPipeline specialists play a vital role in ensuring the efficient operation of piping systems. We are seeking an experienced and skilled professional to join our team as a pipeline specialist.Job Overview:We are looking for a highly skilled pipeline specialist to work on various projects, including installation, assembly,...

  • Data Pipeline Specialist

    6 days ago

    Singapore beBeeData Full time $150,000 - $180,000

    Key to our organization's success is having skilled professionals like you on board. As a Data Engineer, you will play a crucial role in shaping the data landscape.Data Engineers design, build, and maintain the complex systems that handle massive amounts of data. This involves developing ETL processes to cleanse, transform, and enrich data using Databricks'...

  • Data Pipeline Specialist

    2 days ago

    Singapore beBeeDataEngineer Full time $90,000 - $120,000

    Job Title: Data EngineerThe ideal candidate will design, build and maintain robust data pipelines to meet both immediate and long-term business needs. They will drive data engineering projects by leveraging internal and cross-functional resources, setting meaningful targets and achieving them with innovative approaches.Key Responsibilities:Design, build, and...

  • Chief Data Pipeline Specialist

    4 days ago

    Singapore beBeeDataEngineer Full time $80,000 - $120,000

    Key Data Engineer Responsibilities">Develop and maintain data pipelines to transfer information between systems.Write and optimize SQL queries for data extraction and reporting.Organize and manage data in databases, warehouses, and cloud platforms.Monitor data pipelines and troubleshoot issues to ensure reliable data flow.Prepare data for dashboards and...