
Big Data Test Engineer
22 hours ago
About PatSnap
Patsnap empowers IP and R&D teams by providing better answers, so they can make faster decisions with more confidence. Founded in 2007, Patsnap is the global leader in AI-powered IP and R&D intelligence. Our domain-specific LLM, trained on our extensive proprietary innovation data, coupled with Hiro, our AI assistant, delivers
actionable insights that increase productivity for IP tasks by 75% and reduce R&D wastage by 25%. IP and R&D teams collaborate better with a user-friendly platform across the entire innovation lifecycle. Over 15,000 companies trust Patsnap to innovate faster with AI, including NASA, Tesla, PayPal, Sanofi, Dow Chemical, and
Wilson Sonsini.
About the Role
We are looking for a Big Data Test Engineer to ensure the quality and reliability of our data platforms. The successful candidate will be responsible for ensuring the quality and reliability of our big data solutions through rigorous testing and validation processes, working with technologies like Hadoop and Spark while collaborating with our data engineering team. If you are passionate about automation testing, and big data testing platform development and are eager to grow your technical skills, this opportunity is for you.
Key Responsibilities
Responsible for testing and quality assurance of big data and data-related products.
Participate in the development of big data testing frameworks or testing tools, and contribute to the construction of continuous integration platforms and automation development.
Validate data quality, consistency, and accuracy across data pipelines.
Analyze test results and provide detailed reports on software quality and test coverage.
Monitor and validate data workflows and pipelines.
Continuously improve testing processes and methodologies to enhance efficiency and effectiveness.
Ensure data integrity and accuracy across various data sources and platforms.
Work closely with data engineers to improve data quality.
Desired Qualifications
Bachelor's degree in Computer Science, Information Technology, or a related field.
2+ years of experience in software testing.
Proficiency in programming languages such as Python or Java, experience with SQL and data querying for data validation.
Familiarity with test automation tools and frameworks.
Knowledge of version control systems (e.g., Git) and experience with CI/CD tools.
Strong communication and interpersonal skills.
Ability to work independently and collaboratively in a team environment.
Attention to detail and a commitment to quality.
Preferred Skills
Experience with big data platforms (Hadoop, Spark, Hive, HBase).
Knowledge of ETL processes and data warehousing concepts.
Experience with performance testing tools (JMeter).
AWS/Azure/GCP cloud platform experience.
ISTQB certification or equivalent.
Why Join Us
- Work with cutting-edge big data technologies and tools.
- Collaborative and innovative work environment.
- Professional growth and learning opportunities.
- Regular team events and knowledge sharing sessions.
#J-18808-Ljbffr
-
Big Data Engineer
5 days ago
Singapore Unison Consulting Pte Ltd Full time $90,000 - $120,000 per yearWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 5 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing...
-
Big Data Engineer
1 week ago
Singapore Capgemini Full timeCapgemini SingaporePosted 3 hours ago Hybrid Permanent S$70k - S$90k - Posted by - Nirzham Shah- Talent Acquisition ManagerFollow - A Big Data Engineer is an information technology (IT) professional who is responsible for designing, building, testing and maintaining complex data processing systems that work with large data sets. **Job responsibilities**: -...
-
Big Data Engineer
22 hours ago
Singapore AXPARA SOLUTIONS PTE. LTD. Full timeJob Description: We are seeking a highly skilled and motivated Big Data Engineer to join our data team. The ideal candidate will play a key role in designing, developing, and maintaining scalable big data solutions while providing technical leadership. This role will also support strategic Data Governance initiatives, ensuring data integrity, privacy, and...
-
Data Engineer, Big Data
1 week ago
Singapore Grab Full time**Job Description**: **Life at Grab**: At Grab, every Grabber is guided by The Grab Way, which spells out our mission, how we believe we can achieve it, and our operating principles - the 4Hs: Heart, Hunger, Honour and Humility. These principles guide and help us make decisions as we work to create economic empowerment for the people of Southeast...
-
Big Data Engineer
2 days ago
Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time**Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...
-
Big Data Engineer Lead
6 days ago
Singapore Maltem Asia-Pacific Full timeMaltem Singapore is seeking a Big Data Engineer Lead for our Media Communications Client. Summary: We are looking for a highly skilled Lead Big Data Engineer to join our data team. The candidate will design, develop, and maintain scalable big data solutions and provide technical leadership. This role will support Data Governance initiatives, ensuring...
-
Data Engineer
4 days ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...
-
Data Engineer
4 days ago
Singapore TALENTSIS PTE. LTD. Full timeWe are looking for a skilled **Data Engineer**with a focus on **Big Data**to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. **Key Responsibilities**: - Build and maintain big data pipelines using technologies like...
-
Big Data Engineer
5 days ago
Singapore SAKSOFT PTE LIMITED Full timeExperience: 9+ Years Role: Big Data Engineer Skills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting(Good to have). Design...
-
Data Engineer
1 week ago
Singapore EVO OUTSOURCING SOLUTIONS PTE. LTD. Full timeAbout the Project To build scalable data solutions **Responsibilities**: - Responsible for developing and enhancing data pipelines and system architecture - Create and maintain the optimal data pipeline to enable ingestion from a wide variety of structured and unstructured data sources via Talend - Define and understand business requirements to develop...