Big Data Operations Engineer
3 days ago
At Julius Baer, we celebrate and value the individual qualities you bring, enabling you to be impactful, to be entrepreneurial, to be empowered, and to create value beyond wealth. Let’s shape the future of wealth management together.
Responsible for the implementation of methods and solutions to strengthen data reliability and quality. Collaborate with Data Scientists and Data Analysts to develop data models and pipelines for research, reporting, and machine learning.
**YOUR CHALLENGE**:
**GENERAL DESCRIPTION**
We are seeking a passionate Big Data Operations engineer to join our Global Data Platform team which is the bank wide single source of truth for reporting and analytics purposes. It also provides a common data model and a self-service data science workbench.
**KEY FEATURES OF THE POSITION**
**Functional / Technical**
- Daily support and troubleshooting of data pipelines from ingestion to consumption
- Ensure proper thresholds are met for data availability
- Actively support release cycles and advocate on changes to avoid production disruption
- Maintain and model JSON based schemas and metadata to re-use it across the organization (with central tools)
- Act as a Data Engineer to ensure corrective measures are implemented (historizing tables, running dependencies, catching quality issues and similar)
- Be responsible operationally of Common Data Model tables in a separate access zone
- You are part of the agile setup and support development team
- Manage the operating model to ensure support levels and effort sharing of operational tasks (e.g. monitoring of service availability and performance) with 1st and 2nd Level Support
- Continuously improve the service availability, performance, capacity & knowledge management
**Regulatory Responsibilities &/OR Risk Management**
- Ensure appropriate ethical and compliant behaviour within the area of responsibility by clear demonstration of appropriate values and behaviours including but not limited to standards on honesty and integrity, due care and diligence, fair dealing (treating customers fairly), management of conflicts of interest, competence and continuous development, adequate risk management, and compliance with applicable laws and regulations
**YOUR PROFILE**:
**SKILLS REQUIREMENTS OF THE POSITION**
**Professional**
- Higher Education in Computer Science (University, University of Applied Sciences or equivalent diploma)
- Very strong communication and planning / coordination skills
- Strong team player
- Proactive, collaborative, and customer-focused approach to solving problems and driving adoption
- Very good understanding of data technology and its operational management
- Passion for enabling a data-driven culture and empowering users thought data solutions
**Technical**
- At least 5 years of experience in cluster environment operations (Kubernetes, Kafka, Spark, Distributed Storage like S3/HDFS)
- Great Python proficiency
- Expert on processes and topics around Data Ops
- Experience working on Linux based infrastructure incl. advanced scripting
- Expert SQL skills, preferably in mixed environments (i.e. classic DWH and distributed)
- Day to day maintenance of the DBs and load processes, CI-CD pipelines etc.
- Several years of work experience in a similar capacity in the financial industry
- Strong experience in operating and working with complex data environment
- Good to have experience on Dataiku and Tableau
**Personal and Social**
- Good command of language skill (written and verbal)
- Very high level on self-motivation to drive initiatives and initiating changes
- Willingness to bring in new ideas and initiate changes
- Exceptional communication skills to interact with both technical teams and business stakeholders.
- Detail-oriented mindset with the ability to manage multiples tasks and prioritize effectively
-
Big Data Engineer
1 week ago
Singapore ALMR Consulting Pte Ltd Full time $150,000 - $200,000 per yearRoles & ResponsibilitiesJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting...
-
Big Data Engineer
1 week ago
Singapore ALMR CONSULTING PTE. LTD. Full time $100,000 - $150,000 per yearJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.Key...
-
Big Data Engineer
3 days ago
Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time**Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...
-
Big Data Platform Engineer
6 days ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time**SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...
-
Big Data Engineer
5 days ago
Singapore SAKSOFT PTE LIMITED Full timeExperience: 9+ Years Role: Big Data Engineer Skills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting(Good to have). Design...
-
Senior Engineer
3 days ago
Singapore Experis Full time**Senior Engineer (Big Data)**: - Location- Singapore- Job reference- BBBH130672_1691631585- Salary- Negotiable- Consultant name - Canete Christopher Miguel Consultant contact no. - EA License No. - 02C3423 - Consultant Registration No. - R23112144 **Job Description**: Experience in designing, creating, and managing large-scale data processing...
-
Big Data Engineer
2 weeks ago
Singapore Baidu, Inc. Full timeBuild the company's big data warehouse system, including batch and stream data flow construction. In-depth understanding of business systems, understanding of project customer needs, design and implement big data systems that meet user needs, and ensure smooth project acceptance. Responsible for data integration and ETL architecture design and development....
-
Big Data Engineering Lead
1 day ago
Singapore NEWBRIDGE ALLIANCE PTE. LTD. Full timeWe're looking for a seasoned Big Data Engineering Lead with expertise in Scala, Python, and PySpark to lead our client data engineering team. You'll be responsible for designing and implementing scalable, efficient, and fault-tolerant data pipelines, as well as mentoring team members and driving technical innovation. **Key Responsibilities**: - Design and...
-
Big Data Architect
1 week ago
Singapore Direct Search Global Full time**Job Detail**: - Job Reference - P5549 **Role**: Installing and maintaining operating environments Support in the Big Data stack area of responsibility Align the work of ongoing projects with the organization’s big data solution. Educating and supporting additional O&M team members and partners Accountable for the production environment’s Big Data...
-
Principal Big Data Engineer
5 days ago
Singapore QUESSCORP HOLDINGS PTE. LTD. Full time**Job Description**: - Design and implement scalable data pipelines to collect, process, and store large volumes of structured and unstructured data. - Ensure data quality, integrity, and consistency across various data sources. - Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that...