
Big Data Test Engineer
18 hours ago
About PatSnap PatSnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable insights that increase productivity for IP tasks by 75% and reduce R&D wastage by 25%. IP and R&D teams collaborate better with a user-friendly platform across the entire innovation lifecycle. Over 15,000 companies trust Patsnap to innovate faster with AI, including NASA, Tesla, PayPal, Sanofi, Dow Chemical, and Wilson Sonsini. About the Role We are looking for a Big Data Test Engineer to ensure the quality and reliability of our data platforms. The successful candidate will be responsible for ensuring the quality and reliability of our big data solutions through rigorous testing and validation processes, working with technologies like Hadoop and Spark while collaborating with our data engineering team. If you are passionate about automation testing, and big data testing platform development and are eager to grow your technical skills, this opportunity is for you. Key Responsibilities Responsible for testing and quality assurance of big data and data-related products. Participate in the development of big data testing frameworks or testing tools, and contribute to the construction of continuous integration platforms and automation development. Validate data quality, consistency, and accuracy across data pipelines. Analyze test results and provide detailed reports on software quality and test coverage. Monitor and validate data workflows and pipelines. Continuously improve testing processes and methodologies to enhance efficiency and effectiveness. Ensure data integrity and accuracy across various data sources and platforms. Work closely with data engineers to improve data quality. Desired Qualifications Bachelor's degree in Computer Science, Information Technology, or a related field. 2+ years of experience in software testing. Proficiency in programming languages such as Python or Java, experience with SQL and data querying for data validation. Familiarity with test automation tools and frameworks. Knowledge of version control systems (e.g., Git) and experience with CI/CD tools. Strong communication and interpersonal skills. Ability to work independently and collaboratively in a team environment. Attention to detail and a commitment to quality. Preferred Skills Experience with big data platforms (Hadoop, Spark, Hive, HBase). Knowledge of ETL processes and data warehousing concepts. Experience with performance testing tools (JMeter). AWS/Azure/GCP cloud platform experience. ISTQB certification or equivalent. Why Join Us - Work with cutting-edge big data technologies and tools. - Collaborative and innovative work environment. - Professional growth and learning opportunities. - Regular team events and knowledge sharing sessions. #J-18808-Ljbffr
-
Big Data Engineer
18 hours ago
Singapur, Singapore ALMR CONSULTING PTE. LTD. Full timeJob Summary We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. Key Responsibilities...
-
Big Data Engineer
1 week ago
Singapur, Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full timeJob Title: Big Data Engineer (Java, Spark, Hadoop) Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep...
-
Lead Big Data Engineer
4 weeks ago
Singapur, Singapore GREAT EASTERN Full timeJob Number: Lead Big Data Engineer (Job Number: WW ) About the JobWe are seeking a skilled and detail-oriented Data Engineer to design, develop, and maintain robust data pipelines and ETL solutions. This role involves working closely with cross-functional teams to ensure data quality, scalability, and alignment with business and technical requirements....
-
Big Data Platform Engineer
4 weeks ago
Singapur, Singapore Centre for Strategic Infocomm Technologies (CSIT) Full timeJoin to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT) 1 week ago Be among the first 25 applicants Join to apply for the Big Data Platform Engineer role at Centre for Strategic Infocomm Technologies (CSIT) Data processing is an essential part of national security in the modern world. As an engineer in...
-
Big Data Engineer
1 week ago
Singapur, Singapore Baidu, Inc. Full timeBuild the company's big data warehouse system, including batch and stream data flow construction. In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance. Responsible for data integration and ETL architecture design and development....
-
Big Data Engineer
2 weeks ago
Singapur, Singapore Helius Technologies Pte Ltd Full timeBig Data Engineer Job Requirement: 5 years of hands on work experience in Hadoop, Scala, Pyspark and Python. Work with Hadoop Distributed File System (HDFS) to manage and store large datasets Utilize tools like Hive, HBase, and Pig to process data in Hadoop Set up and manage data pipelines to extract, transform, and load (ETL) large datasets Develop and...
-
Big Data Engineer
3 days ago
Singapur, Singapore DCS CARD CENTRE PTE. LTD. Full timeKey Responsibilities Lead the design and implementation of a high-performance, real-time data platform for financial systems, supporting petabyte-scale daily transaction data across ingestion, storage, and computation layers. Architect a cloud-native data warehouse solution on AWS, incorporating Spark and Flink to support both batch and streaming use cases...
-
Testing Engineering Specialist
4 weeks ago
Singapur, Singapore NTT DATA North America Full timeNTT DATA is looking to bring on board a Testing Engineering Specialist to join their team in Bangalore, Karnataka, India. As a Junior Tester, you will play a key role in the testing process, with a particular focus on the banking domain and fraud claims. Your responsibilities will include analyzing requirements, designing and executing test cases, tracking...
-
Staff Platform Engineer
4 weeks ago
Singapur, Singapore Centre for Strategic Infocomm Technologies Full timeCSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of operations, including but not limited to Counter-terrorism and Computer NetworkDefence. We are looking for talented Senior Big Data Platform Staff Engineer. Join the awesome CSIT family and use cutting-edge technologies to protect the...
-
Staff Platform Engineer
4 weeks ago
Singapur, Singapore Centre for Strategic Infocomm Technologies (CSIT) Full timeJoin to apply for the Staff Platform Engineer - Big Data Platform Management role at Centre for Strategic Infocomm Technologies (CSIT) Continue with Google Continue with Google 1 month ago Be among the first 25 applicants Join to apply for the Staff Platform Engineer - Big Data Platform Management role at Centre for Strategic Infocomm Technologies (CSIT) ...