Big Data Test Engineer

2 weeks ago

Singapore Patsnap Full time $80,000 - $120,000 per year

About PatSnap

Patsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers

actionable insights that increase productivity for IP tasks by 75% and reduce R&D wastage by 25%. IP and R&D teams collaborate better with a user-friendly platform across the entire innovation lifecycle. Over 15,000 companies trust Patsnap to innovate faster with AI, including NASA, Tesla, PayPal, Sanofi, Dow Chemical, and

Wilson Sonsini.

About the Role

We are looking for a Big Data Test Engineer to ensure the quality and reliability of our data platforms. The successful candidate will be responsible for ensuring the quality and reliability of our big data solutions through rigorous testing and validation processes, working with technologies like Hadoop and Spark while collaborating with our data engineering team. If you are passionate about automation testing, and big data testing platform development and are eager to grow your technical skills, this opportunity is for you.

Key Responsibilities
  • Responsible for testing and quality assurance of big data and data-related products.
  • Participate in the development of big data testing frameworks or testing tools, and contribute to the construction of continuous integration platforms and automation development.
  • Validate data quality, consistency, and accuracy across data pipelines.
  • Analyze test results and provide detailed reports on software quality and test coverage.
  • Monitor and validate data workflows and pipelines.
  • Continuously improve testing processes and methodologies to enhance efficiency and effectiveness.
  • Ensure data integrity and accuracy across various data sources and platforms.
  • Work closely with data engineers to improve data quality.
Desired Qualifications
  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 2+ years of experience in software testing.
  • Proficiency in programming languages such as Python or Java, experience with SQL and data querying for data validation.
  • Familiarity with test automation tools and frameworks.
  • Knowledge of version control systems (e.g., Git) and experience with CI/CD tools.
  • Strong communication and interpersonal skills.
  • Ability to work independently and collaboratively in a team environment.
  • Attention to detail and a commitment to quality.
Preferred Skills
  • Experience with big data platforms (Hadoop, Spark, Hive, HBase).
  • Knowledge of ETL processes and data warehousing concepts.
  • Experience with performance testing tools (JMeter).
  • AWS/Azure/GCP cloud platform experience.
  • ISTQB certification or equivalent.

Why Join Us

- Work with cutting-edge big data technologies and tools.

- Collaborative and innovative work environment.

- Professional growth and learning opportunities.

- Regular team events and knowledge sharing sessions.

  • Big Data Test Engineer

    2 weeks ago

    Singapore Patsnap Full time $90,000 - $120,000 per year

    About PatSnapPatsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, deliversactionable insights...

  • Big Data Engineer

    7 days ago

    Singapore ALMR CONSULTING PTE. LTD. Full time

    Job Summary We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. Key Responsibilities...

  • Big Data Engineer

    2 weeks ago

    Singapore ALMR CONSULTING PTE. LTD. Full time $100,000 - $150,000 per year

    Job Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.Key...

  • Big Data Engineer

    2 weeks ago

    Singapore ALMR Consulting Pte Ltd Full time $150,000 - $200,000 per year

    Roles & ResponsibilitiesJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting...

  • Big Data Engineer

    1 week ago

    Singapore Unison Consulting Pte Ltd Full time

    **SKILLS SET AND TRACK RECORD** - Good understanding and completion of projects using waterfall/Agile methodology. - Analytical, conceptualisation and problem-solving skills. - Good understanding of analytics and data warehouse implementations - Hands-on experience in big data engineering jobs using Python, Pyspark, Linux, and ETL tools like Informatica -...

  • Big Data Engineer

    2 weeks ago

    Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full time

    Job Title: Big Data Engineer (Java, Spark, Hadoop)Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep...

  • Big Data Engineer

    1 day ago

    Singapore INCOME INSURANCE LIMITED Full time

    Responsible for data pipeline setup and data transformation - Implementation including loading from disparate data sets, preprocessing data. - Scope and deliver various Big Data solutions - Ability to design solutions independently based on high-level architecture. - Maintain the production systems (Kafka, Hadoop, Elasticsearch, RDBMS and No-SQL) -...

  • Big Data Engineer

    1 week ago

    Singapore Tata Consultancy Services Limited Full time

    Requirements Proven experience as a Big Data Engineer or similar role. Strong proficiency in Apache Spark and Scala programming. Experience with big data technologies such as Hadoop, Hive, Kafka, etc. Familiarity with data warehousing concepts and tools. Knowledge of SQL and NoSQL databases. Excellent problem-solving skills and attention to detail. Strong...

  • Big Data Engineering Lead

    2 weeks ago

    Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full time

    We're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation. **Key Responsibilities**: - Design and...

  • Big Data Platform Engineer

    2 weeks ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...