
Data Engineering Lead
4 days ago
At Teksalt Solutions, we specialize in connecting top-tier talent with leading companies to create dynamic, productive workforces. We are committed to delivering technology solutions that not only meet but exceed the demands of the modern business landscape.We are currently seeking a Data Engineering Lead - AWS Glue & PySpark Specialist for a permanent full-time position in Bangalore. The ideal candidate should have 5 to 8 years of experience with skills in AWS Glue, PySpark, and Python.Key Responsibilities:- Spark & PySpark Development: Design and implement scalable data processing pipelines using Apache Spark and PySpark for large-scale data transformations.- ETL Pipeline Development: Build, maintain, and optimize ETL processes for seamless data extraction, transformation, and loading across various data sources and destinations.- AWS Glue Integration: Utilize AWS Glue to create, run, and monitor serverless ETL jobs for data transformations and integrations in the cloud.- Python Scripting: Develop efficient, reusable Python scripts to support data manipulation, analysis, and transformation within the Spark and Glue environments.- Data Pipeline Optimization: Ensure that all data workflows are optimized for performance, scalability, and cost-efficiency on the AWS Cloud platform.- Collaboration: Work closely with data analysts, data scientists, and other engineering teams to create reliable data solutions that support business analytics and decision-making.- Documentation & Best Practices: Maintain clear documentation of processes, workflows, and code while adhering to best practices in data engineering, cloud architecture, and ETL design.Required Skills:- Expertise in Apache Spark and PySpark for large-scale data processing and transformation.- Hands-on experience with AWS Glue for building and managing ETL workflows in the cloud.- Strong programming skills in Python, with experience in data manipulation, automation, and integration with Spark and Glue.- In-depth knowledge of ETL principles and data pipeline design, including optimization techniques.- Proficiency in working with AWS services, such as S3, Glue, Lambda, and Redshift.- Strong skills in writing optimized SQL queries, with a focus on performance tuning.- Ability to translate complex business requirements into practical technical solutions.- Familiarity with Apache Airflow for orchestrating data workflows.- Knowledge of data warehousing concepts and cloud-native analytics tools.If you are passionate about data engineering and have the required skills and experience, we welcome you to apply for this position. Join us at Teksalt Solutions, where a pinch of us makes all the difference in the world of technology.,
Sign-in & see how your skills match this job
Sign-in & Get noticed by top recruiters and get hired fast
#J-18808-Ljbffr
-
Lead Data Scientist
6 days ago
Singapore Data Analytics Full timeGet to Know the Team At Grab, the Market Insights team drives impactful data-driven decisions by uncovering insights about the region's users, merchants, and driver partners. By analysing vast datasets across transactional and behavioural activities, we bridge the gap between raw data science capabilities and actionable business strategies. Our work is...
-
Data Engineer
1 day ago
Singapore NTT DATA, Inc. Full timeJoin to apply for the Data Engineer role at NTT DATA, Inc. . Overview As part of our data-driven transformation initiatives, we are looking for a motivated Associate Data Engineer to join our team. This role is ideal for early-career professionals who are passionate about building scalable data pipelines, integrating diverse data sources, and enabling...
-
Data Engineer(Cloud Migration)
2 weeks ago
Singapore NTT DATA Full timeRequirements / Qualifications - Bachelor's or master's degree in computer science, data engineering, or a related field. - Minimum 7 years of experience in data engineering, with expertise in AWS services, Databricks, and/or Informatica IDMC. - Proficiency in programming languages such as Python, Java, or Scala for building data pipelines. - Evaluate...
-
Data Engineer
2 weeks ago
Singapore DOZER DATA PTE. LTD. Full time**About the job**: This position is needed to build a highly scalable, reliable, and efficient data platform that makes it easy for users to get deep insights from vast amounts of distributed data. This role will be responsible for driving key technical decisions to completion for the organization and also guiding other engineers. **Responsibilities**: In...
-
Lead Data Engineer
1 week ago
Singapore UARROW PTE. LTD. Full timeKey Responsibilities: - Lead the design and implementation of large-scale data processing systems using Spark and Scala. - Architect, develop, and optimize data pipelines for efficient data transformation, aggregation, and processing of large datasets. - Work with cross-functional teams to define data engineering solutions that meet business and operational...
-
Azure Data engineer
1 week ago
Singapore NTT Data Singapore Full time $90,000 - $120,000 per yearJob Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...
-
Azure Data engineer
4 days ago
Singapore NTT Data Singapore Full timeJob Responsibilities: Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...
-
Data Engineering Lead
4 days ago
Singapore beBeeDataEngineering Full time $80,000 - $120,000Job Title: Data Engineering LeadWe are seeking a seasoned data engineering professional to join our team as a Data Engineering Lead. In this role, you will be responsible for designing, developing, and maintaining large-scale data systems that support various business applications.Key Responsibilities:Collaborate with cross-functional teams to identify data...
-
Data Engineering Lead
13 hours ago
Singapore TekSalt Solutions Full timeData Engineering Lead - AWS Glue & PySpark Specialist At Teksalt Solutions, we specialize in connecting top-tier talent with leading companies to create dynamic, productive workforces. Committed to delivering technology solutions that not only meet but exceed the demands of the modern business landscape, we are currently seeking a Data Engineering Lead with...
-
Data Engineering Lead
2 weeks ago
Singapore R Systems (Singapore) Pte Ltd Full timeAt least 3 full end to end project delivery experience in last 5+ years as Senior Data engineer as mentioned in the Qualifications and Job descriptions section above. - Have lead, at least 2 full projects as senior or lead data engineer - Familiarity with agile and DevOps principles, test-driven development, continuous integration, and other Software...