Senior Data Engineer
6 days ago
Company Description
Shopify is the leading omni-channel commerce platform. Merchants use Shopify to design, set up, and manage their stores across multiple sales channels, including mobile, web, social media, marketplaces, brick-and-mortar locations, and pop-up shops. The platform also provides merchants with a powerful back-office and a single view of their business, from payments to shipping. The Shopify platform was engineered for reliability and scale, making enterprise-level technology available to businesses of all sizes.
**Job Description**:
Our Data Engineering group builds and maintains the platform that delivers accessible data to power decision-making at Shopify for millions of merchants. We’re hiring high-impact developers across teams:
- The Engine group organizes all merchant and Shopify data into our data lake in highly-optimized formats for fast query processing, and maintaining the security and quality of our datasets.
- The Analytics group leverages the Engine primitives to build and deliver simple and useful products that power scalable transformation of data at Shopify in batch, streaming, or for machine learning. This group is focused on making it really simple for our users to answer three questions: What happened in the past? What is happening now? And, what will happen in the future?
- The Data Experiences group builds end-user experiences for experimentation, data discovery, and business intelligence reporting.
- The Reliability group operates the data platform in a consistent and reliable manner. They build tools for other teams on Data Platform to leverage and encourage consistency as they champion reliability across the platform.
**Qualifications**:
- An experienced technical leader with a proven track record of delivering impactful results.
- Technical engineering background in one or more areas in the next section.
- Experience with technical mentoring, coaching, and improving the technical output of the people around you.
- Exceptional communication skills and ability to translate technical concepts into easy to understand language for our stakeholders.
- Excitement for working with a remote team; you value collaborating on problems, asking questions, delivering feedback, and supporting others in their goals whether they are in your vicinity or entire cities apart.
A Senior Data Developer at Shopify typically has 4-6 years of experience in **one or more** of the following areas:
- Working with the internals of a distributed compute engine (Spark, Presto, DBT, or Flink/Beam)
- Query optimization, resource allocation and management, and data lake performance (Presto, SQL)
- Cloud infrastructure (Google Cloud, Kubernetes, Terraform)
- Security products and methods (Apache Ranger, Apache Knox, OAuth, IAM, Kerberos)
- Deploying and scaling ML solutions using open-source frameworks (MLFlow, TFX, H2O, etc.)
- Background and practical experience in statistics and/or computational mathematics (Bayesian and Frequentist approaches, NumPy, PyMC3, etc.)
- Modern Big-Data storage technologies (Iceberg, Hudi, Delta)
Additional Information
LI-REMOTE
- At Shopify, we understand that experience comes in many forms. We’re dedicated to adding new perspectives to the team - so if your experience is this close to what we’re looking for, please consider applying._
-
Senior Data Scientist
2 weeks ago
Singapore Data Science Full timeGet to Know the Team You'll be part of the SNP Data Science Personalization team, an established group dedicated to enhancing personalization experiences for Grab Food/Mart/Transport. We aim to develop cutting‐edge Deep Learning models to deliver best user experiences. Our team comprises passionate Data Scientists with various expertise. If personalization...
-
Data Engineer
2 weeks ago
Singapore NTT Data Singapore Full timeOpen roles: Lead Data EngineerSenior Data EngineerJunior Data EngineerJunior Data Engineer 1 year renewable contract Primary Skills Informatica/IDMC, Databricks/Python (Hands on strong knowledge in any combination of two) Team Lead experience Secondary SkillsTableau/OAS, AWS Cloud PreferenceAWS Architect / Databricks / IDMC certification Key...
-
Senior Arista/Data Center Network Engineer
2 weeks ago
Singapore NTT DATA Asia Pacific Full timeA global technology services company is seeking a Senior Network Engineer in Singapore. The ideal candidate will possess a strong background in Data Networking, with a focus on design and implementation of cloud technologies. This full-time role requires excellent automation skills and familiarity with various equipment manufacturers. Competitive...
-
Data Engineer
2 weeks ago
Singapore NTT Data Singapore Full timeOpen roles: Lead Data EngineerSenior Data EngineerJunior Data EngineerJunior Data Engineer 1 year renewable contract Primary Skills Informatica/IDMC, Databricks/Python (Hands on strong knowledge in any combination of two) Team Lead experience Secondary Skills Tableau/OAS, AWS Cloud Preference AWS Architect / Databricks / IDMC certification Key...
-
Data Engineer
2 weeks ago
Singapore NTT Data Singapore Full time**The primary responsibilities**: - Lead architecture design, develop, document, and implement end-to-end data pipelines and data-driven solutions. - Define roadmap to transform data architecture focusing on scalability, performance, and stability for the entire data lifecycle; - Build data flow for data acquisition, aggregation, and modelling, using both...
-
Data Engineer
7 days ago
Singapore NTT DATA Asia Pacific Full timeData Engineer (Junior to Lead roles available)Join to apply for the Data Engineer (Junior to Lead roles available)role at NTT DATA Asia Pacific Open roles Lead Data Engineer Senior Data Engineer Junior Data Engineer Junior Data Engineer 1 year renewable contract Primary Skills Informatica/IDMC, Databricks/Python (Hands on strong knowledge in any combination...
-
M-2025-1636/37/38/39 - Data Engineer
1 week ago
Singapore NTT Data Singapore Full timeOpen roles: M- - Lead Data Engineer M- - Senior Data Engineer M- - Junior Data Engineer M- - Junior Data Engineer 1 year renewable contract Primary Skills Informatica/IDMC, Databricks/Python (Hands on strong knowledge in any combination of two)Team Lead experience Secondary Skills Tableau/OAS, AWS Cloud Preference AWS Architect / Databricks / IDMC...
-
Azure Data engineer
5 days ago
Singapore NTT Data Singapore Full timeJob Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations...
-
Senior Data Scientist, Personalization
2 weeks ago
Singapore Data Science Full timeA leading tech company in Singapore is looking for a Senior Data Scientist to lead the solution and implementation of context-based Transport user understanding. You will process large-scale datasets and deploy models to enhance user personalization in the Mobility vertical. This role involves designing scalable algorithms and improving relevance through...
-
Data Engineer/Senior Engineer
7 days ago
Singapore Sea Full timeJoin to apply for the Data Engineer/Senior Engineer role at Sea Join to apply for the Data Engineer/Senior Engineer role at Sea About Us Sea is the leading consumer internet company in Southeast Asia and Taiwan. Our mission is to better the lives of the consumers and small businesses of our region with technology. About the Team: About Us Sea is the leading...