Senior Data Engineer
5 days ago
About the job Senior Data Engineer (AWS & Confluent Data/AI Projects) | Remote Work Set-up: Remote Schedule: 10am-6pm SGT Responsibilities: Architect and Design Data Solutions: Lead the design and architecture of scalable, secure, and efficient data pipelines for both batch and real-time data processing on AWS. This includes data ingestion, transformation, storage, and consumption layers. Confluent Kafka Expertise: Design, implement, and optimize highly performant and reliable data streaming solutions using Confluent Platform (Kafka, ksqlDB, Kafka Connect, Schema Registry). Ensure efficient data flow for real-time analytics and AI applications. AWS Cloud Native Development: Develop and deploy data solutions leveraging a wide range of AWS services, including but not limited to: Data Storage: S3 (Data Lake), RDS, DynamoDB, Redshift, Lake Formation. Data Processing: Glue, EMR (Spark), Lambda, Kinesis, MSK (for Kafka integration). Orchestration: AWS Step Functions, Airflow (on EC2 or MWAA)Analytics & ML: Athena, QuickSight, SageMaker (for MLOps integration). Required Skills and Qualifications: Bachelor's or Master's degree in Computer Science, Software Engineering, or a related quantitative field. 3 to 5 years of experience in data engineering, with a significant focus on cloud-based solutions. Extensive hands‐on experience with Confluent Platform/Apache Kafka for building real‐time data streaming applications. Proficiency in programming languages such as Python, PySpark, Scala, or Java. Expertise in SQL and experience with various database systems (relational and NoSQL). Solid understanding of data warehousing, data lakes, and data modeling concepts (star schema, snowflake schema, etc.). Experience with CI/CD pipelines and DevOps practices (Git, Terraform, Jenkins, Azure DevOps, or similar). Preferred Qualifications (Nice to Have): AWS Certifications (e.g., AWS Certified Data Analytics - Specialty, AWS Certified Solutions Architect - Associate/Professional). Experience with other streaming technologies (e.g., Flink). Knowledge of containerization technologies (Docker, Kubernetes). Familiarity with Data Mesh or Data Fabric concepts. Experience with data visualization tools (e.g., Tableau, Power BI, QuickSight). Understanding of MLOps principles and tools. #J-18808-Ljbffr
-
Senior Backup Engineer SME
2 weeks ago
Singapore NTT DATA, Inc. Full timeJoin to apply for the Senior Backup Engineer SME role at NTT DATA, Inc. 2 days ago Be among the first 25 applicants Join to apply for the Senior Backup Engineer SME role at NTT DATA, Inc. Get AI-powered advice on this job and more exclusive features. Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are...
-
Senior Data Scientist
2 days ago
Singapore NTT DATA Full time $120,000 - $180,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior Data...
-
Azure Data engineer
1 week ago
Singapore NTT Data Singapore Full timeJob Responsibilities: Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...
-
Singapore NTT DATA, Inc. Full timeOverview Senior Associate Infrastructure Engineering and Operations Engineer at NTT DATA, Inc. Make an impact with NTT DATA. Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and...
-
Azure Data engineer
2 weeks ago
Singapore NTT Data Singapore Full time $60,000 - $180,000 per yearJob Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations to communicate complex...
-
Senior Data Scientist
5 days ago
Singapore Data Analytics Full timeGet to Know the Team Our Search and Personalisation Team focuses on advancing scalable machine learning and experimentation frameworks that power search relevance, ranking, and recommendations across Grab. By leveraging cutting-edge analytics and statistical methods, we continuously optimize how users connect with merchants, services, and content. Get to...
-
Senior Network engineer(Arista/Data Center)
5 hours ago
Singapore NTT Data Singapore Full time $120,000 - $200,000 per yearThe Implementation Engineer stands between the project manager, design engineer and operations. They support initiatives as they transition between design, implementation, and operations. They are active in all phases as an SME to support, solve program and facilitates decision making. The goal is to help the orderly and timely execution of projects and...
-
Senior Data Engineer
2 weeks ago
Singapore Handshakes by DC Frontiers Pte Ltd Full timeHandshakes is an award-winning DataTech company. We enable our clients to make safer, more informed decisions by delivering meaningful insights, harnessed from reliable data. We apply machine learning technology to analyze and provide corporate data from public and private domains. Our award-winning Handshakes App fuses these data to provide strategic...
-
Data Engineer/Senior Engineer
2 weeks ago
Singapore Sea Full timeJoin to apply for the Data Engineer/Senior Engineer role at Sea Join to apply for the Data Engineer/Senior Engineer role at Sea About Us Sea is the leading consumer internet company in Southeast Asia and Taiwan. Our mission is to better the lives of the consumers and small businesses of our region with technology. About the Team: About Us Sea is the leading...
-
Senior Hyperscale Solutions
1 week ago
Singapore NTT DATA, Inc. Full timeSenior Hyperscale Solutions & Sales Engineer, APAC Join to apply for the Senior Hyperscale Solutions & Sales Engineer, APAC role at NTT DATA, Inc. Overview The APAC Region Senior Hyperscale Solutions & Sales Engineer provides technical support to APAC Region Sales Engineering activities related to hyperscale clients and is responsible for developing and...