Big Data Test Engineer

3 weeks ago

Singapur, Singapore Patsnap Full time

About PatSnap PatSnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers actionable insights that increase productivity for IP tasks by 75% and reduce R&D wastage by 25%. IP and R&D teams collaborate better with a user-friendly platform across the entire innovation lifecycle. Over 15,000 companies trust Patsnap to innovate faster with AI, including NASA, Tesla, PayPal, Sanofi, Dow Chemical, and Wilson Sonsini. About the Role We are looking for a Big Data Test Engineer to ensure the quality and reliability of our data platforms. The successful candidate will be responsible for ensuring the quality and reliability of our big data solutions through rigorous testing and validation processes, working with technologies like Hadoop and Spark while collaborating with our data engineering team. If you are passionate about automation testing, and big data testing platform development and are eager to grow your technical skills, this opportunity is for you. Key Responsibilities Responsible for testing and quality assurance of big data and data-related products. Participate in the development of big data testing frameworks or testing tools, and contribute to the construction of continuous integration platforms and automation development. Validate data quality, consistency, and accuracy across data pipelines. Analyze test results and provide detailed reports on software quality and test coverage. Monitor and validate data workflows and pipelines. Continuously improve testing processes and methodologies to enhance efficiency and effectiveness. Ensure data integrity and accuracy across various data sources and platforms. Work closely with data engineers to improve data quality. Desired Qualifications Bachelor's degree in Computer Science, Information Technology, or a related field. 2+ years of experience in software testing. Proficiency in programming languages such as Python or Java, experience with SQL and data querying for data validation. Familiarity with test automation tools and frameworks. Knowledge of version control systems (e.g., Git) and experience with CI/CD tools. Strong communication and interpersonal skills. Ability to work independently and collaboratively in a team environment. Attention to detail and a commitment to quality. Preferred Skills Experience with big data platforms (Hadoop, Spark, Hive, HBase). Knowledge of ETL processes and data warehousing concepts. Experience with performance testing tools (JMeter). AWS/Azure/GCP cloud platform experience. ISTQB certification or equivalent. Why Join Us - Work with cutting-edge big data technologies and tools. - Collaborative and innovative work environment. - Professional growth and learning opportunities. - Regular team events and knowledge sharing sessions. #J-18808-Ljbffr

  • Big Data Engineer

    3 weeks ago

    Singapur, Singapore ALMR CONSULTING PTE. LTD. Full time

    Job Summary We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. Key Responsibilities...

  • Big Data Engineer

    4 days ago

    Singapur, Singapore Tata Consultancy Services Limited Full time

    Requirements Proven experience as a Big Data Engineer or similar role. Strong proficiency in Apache Spark and Scala programming. Experience with big data technologies such as Hadoop, Hive, Kafka, etc. Familiarity with data warehousing concepts and tools. Knowledge of SQL and NoSQL databases. Excellent problem-solving skills and attention to detail. Strong...

  • Big Data Engineer

    4 days ago

    Singapur, Singapore OCBC Full time

    Who We Are As Singapore’s longest established bank, we have been dedicated to enabling individuals and businesses to achieve their aspirations since 1932. How? By taking the time to truly understand people. From there, we provide support, services, solutions, and career paths that meet their individual needs and desires. Today, we’re on a journey of...

  • Big Data Engineer

    3 weeks ago

    Singapur, Singapore ARYAN SOLUTIONS PTE. LTD. Full time

    Experience Hands-on Big Data experience using common open-source components (Hadoop, Hive, Spark, Presto, NiFi, MinIO, K8S, Kafka). Experience in stakeholder management in heterogeneous business/technology organizations. Experience in banking or financial business, with handling sensitive data across regions. Experience in large data migration projects with...

  • Senior Data Engineer

    2 weeks ago

    Singapur, Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Join us to apply for the Senior Data Engineer (Big Data Processing) role at Centre for Strategic Infocomm Technologies (CSIT) . CSIT develops products to advance Singapore's national security interests, including counter-terrorism and computer network defence. We seek talented senior data engineers to lead and develop mission-critical products that identify,...

  • Big Data Engineer

    11 hours ago

    Singapur, Singapore OCBC company Full time

    You may choose to display a cookie banner on the external site. You must specify the message in the cookie banner and may add a link to a relevant policy. If you are unfamiliar with these requirements, please seek the advice of legal counsel.You are about to enter websites controlled or offered by third parties. OCBC hereby disclaims liability for any...

  • Big Data Support Engineer

    2 days ago

    Singapur, Singapore ADVANCED E-SOLUTIONS PTE. LTD. Full time

    Overview POSITION OVERVIEW : Big Data Support Engineer General Duties and Tasks Skillset Up to 9 years of IT experience & 5+ Years on Teradata or Hadoop Last 3 years of relevant experience in banking/financial services industry Hands-on technologist, strong in SQL, UNIX and Hadoop/Teradata tools and technologies Demonstrable analytical skills with good...

  • Big Data Engineer

    3 weeks ago

    Singapur, Singapore DCS CARD CENTRE PTE. LTD. Full time

    Key Responsibilities Lead the design and implementation of a high-performance, real-time data platform for financial systems, supporting petabyte-scale daily transaction data across ingestion, storage, and computation layers. Architect a cloud-native data warehouse solution on AWS, incorporating Spark and Flink to support both batch and streaming use cases...

  • AI-Driven Big Data Engineer

    4 weeks ago

    Singapur, Singapore Pixalate, Inc Full time

    AI- Driven Big Data Engineer Employment Type: Full-TimeLocation : Remote, SingaporeLevel: Entry to Mid Level (PhD Required) Bridge Cutting-Edge AI Research with Petabyte-Scale Data Systems Pixalate is an online trust and safety platform that protects businesses, consumers and children from deceptive, fraudulent and non-compliant mobile, CTV apps and...

  • AI-Driven Big Data Engineer

    3 weeks ago

    Singapur, Singapore Pixalate Full time

    5 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Level Entry to Mid Level (PhD Required) Bridge Cutting-Edge AI Research with Petabyte-Scale Data Systems Pixalate is an online trust and safety platform that protects businesses, consumers and children from deceptive, fraudulent and non-compliant...