Data Engineering Lead

3 days ago

Singapore TekSalt Solutions Full time

At Teksalt Solutions, we specialize in connecting top-tier talent with leading companies to create dynamic, productive workforces. We are committed to delivering technology solutions that not only meet but exceed the demands of the modern business landscape.We are currently seeking a Data Engineering Lead - AWS Glue & PySpark Specialist for a permanent full-time position in Bangalore. The ideal candidate should have 5 to 8 years of experience with skills in AWS Glue, PySpark, and Python.Key Responsibilities:- Spark & PySpark Development: Design and implement scalable data processing pipelines using Apache Spark and PySpark for large-scale data transformations.- ETL Pipeline Development: Build, maintain, and optimize ETL processes for seamless data extraction, transformation, and loading across various data sources and destinations.- AWS Glue Integration: Utilize AWS Glue to create, run, and monitor serverless ETL jobs for data transformations and integrations in the cloud.- Python Scripting: Develop efficient, reusable Python scripts to support data manipulation, analysis, and transformation within the Spark and Glue environments.- Data Pipeline Optimization: Ensure that all data workflows are optimized for performance, scalability, and cost-efficiency on the AWS Cloud platform.- Collaboration: Work closely with data analysts, data scientists, and other engineering teams to create reliable data solutions that support business analytics and decision-making.- Documentation & Best Practices: Maintain clear documentation of processes, workflows, and code while adhering to best practices in data engineering, cloud architecture, and ETL design.Required Skills:- Expertise in Apache Spark and PySpark for large-scale data processing and transformation.- Hands-on experience with AWS Glue for building and managing ETL workflows in the cloud.- Strong programming skills in Python, with experience in data manipulation, automation, and integration with Spark and Glue.- In-depth knowledge of ETL principles and data pipeline design, including optimization techniques.- Proficiency in working with AWS services, such as S3, Glue, Lambda, and Redshift.- Strong skills in writing optimized SQL queries, with a focus on performance tuning.- Ability to translate complex business requirements into practical technical solutions.- Familiarity with Apache Airflow for orchestrating data workflows.- Knowledge of data warehousing concepts and cloud-native analytics tools.If you are passionate about data engineering and have the required skills and experience, we welcome you to apply for this position. Join us at Teksalt Solutions, where a pinch of us makes all the difference in the world of technology.,
Sign-in & see how your skills match this job
Sign-in & Get noticed by top recruiters and get hired fast
#J-18808-Ljbffr

  • Lead Data Scientist

    1 week ago

    Singapore Data Analytics Full time

    Get to Know the Team At Grab, the Market Insights team drives impactful data-driven decisions by uncovering insights about the region's users, merchants, and driver partners. By analysing vast datasets across transactional and behavioural activities, we bridge the gap between raw data science capabilities and actionable business strategies. Our work is...

  • Lead Data Scientist

    1 week ago

    Singapore Data Science Full time

    Get to Know the Team Our data science team works on developing cutting-edge algorithms for data mining, machine learning, and language applications. Each team member helps enhance user experiences and optimise platform efficiency to solve complex business challenges. Get to Know the Role We're looking for Data Scientists specialising in post-training...

  • Azure Data engineer

    1 week ago

    Singapore NTT Data Singapore Full time $120,000 - $180,000 per year

    Job Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...

  • Azure Data engineer

    5 days ago

    Singapore NTT Data Singapore Full time

    Job Responsibilities: Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...

  • Lead Data Engineer

    2 weeks ago

    Singapore AIRR LABS Full time

    Reporting to the Regional Head of Data & BI, this role requires a hands-on approach to lead a team of data engineers to build and upkeep data pipelines, data warehouse, and analytics platforms to ensure data accuracy, data integrity and security. This role requires the individual to be located onsite in Singapore. **Responsibilities**: - Lead the design,...

  • Lead Data Engineer

    1 week ago

    Singapore AVENSYS CONSULTING PTE. LTD. Full time

    Overview Tech Lead - Data Engineer We are seeking a highly skilled and hands-on Technical Lead to drive the design, delivery, and operational excellence of our next-generation Air Traffic Management (ATM) platform . This cloud-native platform is built for advanced data and analytics workloads. The Tech Lead will serve as the bridge between solution...

  • Lead Data Engineer

    2 weeks ago

    Singapore AVENSYS CONSULTING PTE. LTD. Full time

    Roles & Responsibilities Tech Lead - Data Engineer We are seeking a highly skilled and hands-on Technical Lead to drive the design, delivery, and operational excellence of our next-generation Air Traffic Management (ATM) platform. This cloud-native platform is built for advanced data and analytics workloads. The Tech Lead will serve as the bridge between...

  • Senior/Lead Python

    2 weeks ago

    Singapore Zuehlke Engineering Vietnam LLC. Full time

    Senior/Lead Python & Data Engineer page is loaded Senior/Lead Python & Data Engineer Apply locations Singapore time type Full time posted on Posted 3 Days Ago job requisition id JR Founded in Switzerland in 1968, Zühlke is owned by its partners and located across Europe and Asia. We are a global transformation partner, with engineering and innovation in...

  • Data Engineering Lead

    5 days ago

    Singapore R Systems (Singapore) Pte Ltd Full time

    At least 3 full end to end project delivery experience in last 5+ years as Senior Data engineer as mentioned in the Qualifications and Job descriptions section above. - Have lead, at least 2 full projects as senior or lead data engineer - Familiarity with agile and DevOps principles, test-driven development, continuous integration, and other Software...

  • Lead Data Engineer

    2 weeks ago

    Singapore AVENSYS CONSULTING PTE. LTD. Full time

    Roles & ResponsibilitiesTech Lead - Data EngineerWe are seeking a highly skilled and hands-on Technical Lead to drive the design, delivery, and operational excellence of our next-generation Air Traffic Management (ATM) platform. This cloud-native platform is built for advanced data and analytics workloads. The Tech Lead will serve as the bridge between...