Senior Big Data Test Development Engineer

7 days ago


Singapur, Singapore PatSnap Full time
About PatSnap Patsnap empowers IP and R&D teams by providing better answers, so they can makefaster decisions with more confidence. Founded in 2007, Patsnap is the global leaderin AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on ourextensive proprietary innovation data, coupled with Hiro, our AI assistant, deliversactionable insights that increase productivity for IP tasks by 75% and reduce R&Dwastage by 25%. IP and R&D teams collaborate better with a user-friendly platformacross the entire innovation lifecycle. Over 15,000 companies trust Patsnap toinnovate faster with AI, including NASA, Tesla, PayPal, Sanofi, Dow Chemical, andWilson Sonsini. About the Role We are looking for a Big Data Test Engineer to ensure the quality and reliability of ourdata platforms. The successful candidate will be responsible for ensuring the qualityand reliability of our big data solutions through rigorous testing and validationprocesses, working with technologies like Hadoop and Spark while collaborating withour data engineering team. If you are passionate about automation testing, and bigdata testing platform development and are eager to grow your technical skills, thisopportunity is for you.

Key Responsibilities

Responsible for testing and quality assurance of big data and data-related products. Participate in the development of big data testing frameworks or testing tools, and contribute to the construction of continuous integration platforms and automation development. Validate data quality, consistency, and accuracy across data pipelines. Analyze test results and provide detailed reports on software quality and test coverage. Monitor and validate data workflows and pipelines. Continuously improve testing processes and methodologies to enhance efficiency and effectiveness. Ensure data integrity and accuracy across various data sources and platforms. Work closely with data engineers to improve data quality.

Desired Qualifications

Bachelor's degree in Computer Science, Information Technology, or a related field. 2+ years of experience in software testing. Proficiency in programming languages such as Python or Java, experience with SQL and data querying for data validation. Familiarity with test automation tools and frameworks. Knowledge of version control systems (, Git) and experience with CI/CD tools. Strong communication and interpersonal skills. Ability to work independently and collaboratively in a team environment. Attention to detail and a commitment to quality.

Preferred Skills

Experience with big data platforms (Hadoop, Spark, Hive, HBase). Knowledge of ETL processes and data warehousing concepts. Experience with performance testing tools (JMeter). AWS/Azure/GCP cloud platform experience. ISTQB certification or equivalent. Why Join Us - Work with cutting-edge big data technologies and tools.- Collaborative and innovative work environment.- Professional growth and learning opportunities.- Regular team events and knowledge sharing sessions.
  • Senior Data Engineer

    2 months ago


    Singapur, Singapore Helius Full time

    Job Title: Senior Data Engineer - Big DataHelius is seeking a highly skilled Senior Data Engineer - Big Data to join our team. As a Senior Data Engineer - Big Data, you will be responsible for designing, developing, and deploying large-scale data processing systems using Talend Big Data version 7+ and Hadoop.Key Responsibilities:Design and develop...


  • Singapur, Singapore Unison Consulting Pte Ltd Full time

    Senior Spark Scala DeveloperWe are seeking a highly skilled Spark Scala Developer to collaborate with our dynamic team in delivering cutting-edge data processing solutions. The ideal candidate will possess a deep understanding of big data technologies, particularly Apache Spark, and expertise in Scala programming.Key ResponsibilitiesDesign and Development:...

  • Big Data Engineer

    1 month ago


    Singapur, Singapore DBS Bank Full time

    Job SummaryDBS Bank is seeking an experienced Big Data Engineer to join our Group Technology and Operations team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining enterprise-class Big Data applications.Key ResponsibilitiesDesign and develop scalable Big Data architectures using Hadoop, Spark, and other related...

  • Big Data Developer

    2 months ago


    Singapur, Singapore Helius Full time

    Job Title: Big Data DeveloperHelius is seeking a highly skilled Big Data Developer to join our team. As a key member of our data integration team, you will be responsible for designing, developing, and deploying production-grade Talend Big Data jobs that meet our organization's architecture standards.Key Responsibilities:Design and develop Talend Big Data...


  • Singapur, Singapore NTT DATA Full time

    Job Title: Senior Automation Test EngineerJob Summary:We are seeking a highly skilled Senior Automation Test Engineer to join our team at NTT DATA. As a key member of our automation team, you will be responsible for designing and developing automated test cases using Cucumber BDD format and Selenium automation tools.Key Responsibilities:Design and develop...

  • Big Data Engineer

    2 months ago


    Singapur, Singapore Virtusa Full time

    Big Data EngineerVirtusa is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop data pipelines using ETL tools...


  • Singapur, Singapore TikTok Full time

    About the TeamTikTok's Tea platform is a cutting-edge analytics platform used by over 10,000 employees globally. As a key member of our global engineering team, you will be responsible for deploying, configuring, and maintaining big data platforms, as well as implementing and optimizing infrastructure for big data storage, processing, and computation.**Key...

  • Big Data Engineer

    1 month ago


    Singapur, Singapore Virtusa Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop big data...


  • Singapur, Singapore TikTok Full time

    About the team :Tea(Toutiao Event Analyze) is an in-house analytics platform that is heavily used by more than 10,000 employees globally. This is a data middle platform product built on user behavior data, providing data analysis services for various domestic and international businesses within ByteDance/TikTok, including Douyin, Toutiao, Xigua, TikTok,...

  • Big Data Specialist

    2 months ago


    Singapur, Singapore Epam Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data ingestion and processing jobs in big data environments.Key ResponsibilitiesAnalyze and document business data requirements to ensure seamless data access to...

  • Big Data Engineer

    3 weeks ago


    Singapur, Singapore TikTok Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our Data Platform Business Partnering team at TikTok. As a key member of our team, you will be responsible for designing and implementing data tools and applications that drive business growth.Key ResponsibilitiesTranslate business requirements into technical implementation for building...

  • Software Engineer

    3 months ago


    Singapur, Singapore Epam Full time

    Description We are looking for a Big Data Engineer to join our team! The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs as...

  • Data Engineer

    3 weeks ago


    Singapur, Singapore IITMatrix Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at IITMatrix. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable data processing systems using Big Data technologies such as Hadoop, Spark, and NoSQL...


  • Singapur, Singapore Nityo Infotech Full time

    Job Title: Big Data Solutions EngineerWe are seeking a highly skilled Big Data Solutions Engineer to join our team at Nityo Infotech. As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:Design and develop scalable...

  • Big Data Engineer

    3 weeks ago


    Singapur, Singapore Virtusa Full time

    Job Title: Big Data EngineerAt Virtusa, we are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop big data...

  • Big Data Engineer

    5 months ago


    Singapur, Singapore Virtusa Full time

    Big Data Engineer - 123101 Description Responsibilities Good understanding and completion of projects using waterfall/Agile methodology. • Good understanding of analytics and data warehouse implementations. • Ability to troubleshoot complex issues ranging from system resource to application stack traces. • Strong SQL, data modelling and data...

  • Data Engineer

    2 months ago


    Singapur, Singapore Nityo Infotech Full time

    Job Title: Data Engineer - Big Data SolutionsWe are seeking a highly skilled Data Engineer to join our team at Nityo Infotech. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:Design and develop scalable and efficient data processing...

  • Data Engineer

    3 weeks ago


    Singapur, Singapore Nityo Infotech Full time

    Job Title: Data Engineer - Big Data SolutionsWe are seeking a highly skilled Data Engineer to join our team at Nityo Infotech. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:* Design and develop scalable and efficient data...


  • Singapur, Singapore UTAC group Full time

    Job Title: Senior Test Development EngineerJob Summary:We are seeking a highly skilled Senior Test Development Engineer to join our team at UTAC Group. As a key member of our engineering team, you will be responsible for designing and implementing ATE test solutions for final test and/or wafer sort products for IC manufacturing.Key Responsibilities:Develop...

  • Big Data Engineer

    2 months ago


    Singapur, Singapore DBS Bank Full time

    About the RoleDBS Bank is seeking a highly skilled Big Data Engineer to join our Group Technology and Operations team. As a key member of our team, you will be responsible for designing, developing, and maintaining enterprise-class Big Data applications.Key ResponsibilitiesDesign and implement scalable Big Data architectures using Hadoop, Spark, and other...