
Specialist - Big Data Engineering
2 weeks ago
**Specialist, Big Data Engineering**
- Opportunity to **be a part of IT Engineering, Development & Integration organization in Singapore**:
- ** Based in Singapore, **the regional hub for Asia Pacific (AP) and top-ranked biopharmaceutical company on The Straits Times and Statista’s list of Best Employers in Singapore for two consecutive years (2020, 2021).
- Join the** premier biopharmaceutical company **that has been in Singapore for more than** 25 years and in AP for over 60 years.**
Our IT team operates as a business partner proposing ideas and innovative solutions that enable new organizational capabilities. We collaborate internationally to deliver the services and solutions that help everyone to be more productive and enable innovation.
Join us in the digital health revolution and tackle biggest opportunities and challenges at the intersection of healthcare, information and technology. Become a member of our IT Global Innovation Network in the heart of Singapore with start-up atmosphere and flat, friendly and collaborative environment. Enjoy a reward that technology careers don’t often bring: the satisfaction of helping to save lives.
We are seeking energetic, forward-thinking Big Data Developer that will work on the collecting, storing, processing, analyzing and visualizing of huge sets of data of disparate formats and data sources and integrating them into a single data lake for further visualization.
**WHAT YOU WILL DO**
The primary focus will be on choosing the appropriate big data technology, tool sets and frameworks to deliver optimal solutions to use for these purposes.
Besides great atmosphere and flexible working environment, we also offer:
- Competitive remuneration
- Position in a leading global healthcare company
- Challenging career
- Professional growth based on performance
- Innovative and flexible working environment
- Wide range of benefits
**WHAT YOU MUST HAVE**
To be successful in this role, you will have:
**Education Minimum Requirement**:
MSc Degree or BSc Degree with relevant experience in Computer Science or related field with 3-5 years of relevant experiences.
**Required Experience and Skills**:
Proven record of both backend data engineering and development with the following skills:
- Automation and Implementation of end-to-end ETL process of unstructured datasets.
- Hands on experience in Hadoop, MapReduce, HDFS, Hive, Spark.
- Experience with various messaging systems, at least one of the following, Kafka, RabbitMQ or its equivalent.
- Good knowledge in back-end programming languages, Java, Python, shell scripting, SQL, etc.
- Translate complex functional and technical requirements into detailed design.
- Minimum 3 years of working experience in both frontend and backend development on data-heavy projects (ie, data engineering and programming experience)
- Excellent knowledge of relational (SQL) and non-relational databases (no-SQL) as well as Big Data technology like HDFS, Hive, Sparks.
- Able to design optimal data model for different use-cases with or without Big Data technology.
- Advance skill in SQL or other data query languages and working experience in tuning queries for data retrieval.
- Hands-on experience in building data pipelines or ETL flows.
- Hands-on experience with either two of the following databases: Hive, Postgresql, AWS RedShift, DynamoDB, MongoDB.
- Hands-on experience with AWS Cloud Services.
- Experience with any data visualisation tools like spotfire, qliksense, Microsoft Power BI, etc a plus.
- Ability to investigate and propose alternative technology and architecture.
- Strong project management and organizational skills.
**Preferred Experience**:
- Experience developing dashboards using JavaScript frameworks like Angular, ReactJS, D3.js and others
- Proficient with programming language like Node.JS or Java EE/Spring platforms.
Our Support Functions deliver services and makes recommendations about ways to enhance our workplace and the experience of working at our organization. Our Support Functions include HR, Finance, Information Technology, Legal, Procurement, Administration, Facilities and Security.
**WHO WE ARE**
We are known as Merck & Co., Inc., Kenilworth, New Jersey, USA in the United States and Canada and MSD everywhere else. For more than a century, we have been inventing for life, bringing forward medicines and vaccines for many of the world's most challenging diseases. Today, our company continues to be at the forefront of research to deliver innovative health solutions and advance the prevention and treatment of diseases that threaten people and animals around the world.
**WHAT WE LOOK FOR**
Imagine getting up in the morning for a job as important as helping to save and improve lives around the world. Here, you have that opportunity. You can put your empathy, creativity, digital mastery, or scientific genius to work in collaboration with a diverse group of colleagues who pursue and bring hope to countless peopl
-
Big Data Engineer Specialist
2 days ago
Singapore beBeeDataEngineering Full time $80,000 - $120,000Big Data Engineer SpecialistWe are seeking a skilled Big Data Engineer to join our team. The successful candidate will be responsible for designing, maintaining and optimizing large-scale distributed systems.Key Responsibilities:Design and implement ETL/ELT pipelines using Spark for batch and streaming data.Manage and optimize Hadoop clusters (HDFS, YARN)...
-
Big Data Engineer
2 weeks ago
Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time**Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...
-
Big Data Engineering Specialist
1 week ago
Singapore beBeeData Full time $90,000 - $120,000Job Opportunity: Become a Big Data Engineer and Contribute to Large-Scale System DevelopmentThe data management team at our company is focused on creating solutions that handle the entire big data pipeline, from ingestion and integration to development, cataloging, security, and governance. Our mission is to design, build, optimize, and scale one of the...
-
Big Data Engineer
6 days ago
Singapore beBeeDataEngineering Full time $80,000 - $120,000Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing complex data pipelines using Apache Spark.Main Responsibilities:Design and optimize data pipelines using Apache SparkDevelop and maintain Hive tables, queries, and...
-
Big Data Engineer Specialist
3 days ago
Singapore beBeeData Full time $80,000 - $120,000Job Title: Big Data ArchitectThis is a critical role that requires the ability to design and implement data engineering solutions that meet analytical needs. The ideal candidate will have experience in big data environment management, including Cloudera Data Platform.Responsibilities:Develop and maintain data ingestion and processing jobs.Design and...
-
Data Architect
4 days ago
Singapore beBeeData Full time $120,000 - $150,000Big Data Platform SpecialistWe are seeking a highly skilled Big Data Platform Specialist to join our team. As a key member, you will design and implement big data platforms built on Hadoop, Spark, and Hive.About the RoleDesign and implement big data platforms using Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage...
-
Big Data Engineer
6 days ago
Singapore IITMATRIX Full timeWe are looking for a skilled **Big Data Engineer** to join our dynamic team. You will be responsible for designing, developing, and optimizing data solutions within the Big Data ecosystem. This role involves working with large datasets, ensuring high performance at scale, and collaborating with cross-functional teams to deliver data-driven insights and...
-
Big Data Specialist
6 days ago
Singapore beBeeDataEngineer Full time $100,000 - $140,000Data Engineer Job OpportunityWe are seeking an experienced and skilled Data Engineer to join our team. Our ideal candidate will have a strong background in data engineering, big data technologies, and programming skills.The successful applicant will be responsible for designing, building, and optimizing scalable data pipelines using Scala and Hadoop...
-
Big Data Reliability Engineer
2 weeks ago
Singapore beBeeSystem Full time $80,000 - $120,000Job Title:Data System Stability SpecialistOverview:The Data Platform Team is responsible for developing products that cover the entire lifecycle of data pipeline, including data ingestion and integration, data development, data catalog, data security and governance. These products support various businesses, so data engineers and scientists can greatly boost...
-
Big Data Engineer
4 days ago
Singapore AlgoriX Technology Pte. Ltd. Full time**Responsibilities** The Big Data Engineer is responsible for analyzing big data and optimizing the performance of our online advertising delivery system. They are also responsible for the research and development of the advertising system’s offline and real-time data streams. **Requirements**: - Bachelor’s degree or above, majoring in Computer...