Big Data Platform Architect
1 day ago
**Job Title**: Big Data Platform Architect
**Job Location**: Singapore
**Job Purpose**
The Big Data Platform Architect is responsible for the technical design and implementation of big data platform, systems integration, processes and governance to operationalize the big data platform.
The Big Data Platform Architect is required to work closely with business stakeholders, project managers and third party vendors to develop technical solutions in areas of AI, Analytics and the use of the big data platform to fulfill various business use cases. He/She is expected to set data architecture principles, create models of data that enable the implementation of the intended business architecture, create diagrams showing key data entities, and create an inventory of the data needed to align with our enterprise architecture vision.
**The Job**
- Lead and facilitate techno-functional design workshops & project implementation involving big data platform (Hadoop, cloudera), data analytics solutions (e.g. SAS Viya, R, Python etc.), data visualization tools (e.g. Tableau), ETL/ELT tools (Talend, Informatica, Artificial Intelligence (AI) solutions, as well as open source technology (eg. Mariadb)etc.
- Understand data flows and lineage from operational data sources to analytical data sources.
- Review and approve project designs including data models and ETL.
- Establishing and enforcing standards, processes, frameworks, tools and best practices for process modeling, semantic modeling, and logical and physical data modelling.
- Work with project teams to ensure compliance with data management standards.
- Participate in the development and maintenance of corporate data architecture, data management standards and conventions, data dictionaries and data element naming standards and conventions for multiple computing environments.
- Work with Information Security to ensure proper classification and protection of enterprise data.
- Create ETL specifications and documentation used to develop data migration mappings and transformations for Data Warehouse loading.
- Provide comprehensive consultation to database administration, business analysts and business owners in resolving questions during the translation to a physical database.
- Research and evaluate alternative solutions and recommend the most efficient and cost effective data related solutions for improved data integrity.
- Regular review of emerging technologies to assess their relevance and viability in solving on-going information management challenges. Big Data, cloud computing, data visualization, data masking, enterprise business metadata management and Data SOA.
- Work closely with users to understand and help develop functional specifications.
- Prepares written reports of findings and recommendations.
**Our Requirements**:
- Bachelor’s degree in computer science, or other relevant field.
- Minimum 10 years of relevant data management experience, including architecting data management solutions and designing/developing data governance policies/standards.
- Experience in implementation of big data platform and data warehouse projects.
- Strong project leadership and management skills to lead organizational change to effectively meet strategic and tactical goals.
- Strong written and verbal communications skills required; must be equally comfortable discussing the enterprise information management (EIM) strategic perspective with executives and implementation details with operational staff and IT.
- Organizational/political agility with the ability to drive large, cross-functional data management programs involving coordination with multiple stakeholders.
- Ability to help define and articulate the enterprise data management strategic vision and translate it into tactical implementable steps to C level.
- Solid knowledge of the organization’s industry and its challenges in the use of data and information.
- Certification in data management and understanding of the various technologies of data management within an organization.
- Strategic decision-making skills with a high degree of latitude.
- Financial services domain knowledge, including expertise at the intersection of risk, finance and customer domains.
- Expertise in business and IT architecture, including familiarity with leading architectural standards such as TOGAF, FEA and/or Zachman.
- Familiarity with Enterprise Metadata Management (business and IT) and OMG standards.
- Information management program life cycle experience.
- Experience in operationalizing Data Governance, Data Stewardship and Data Quality.
- Familiarity with industry data models such as IBM BDW and IIW, Teradata FSLDM, and SAS IIA.
- End-to-end data warehousing program execution knowledge and leadership.
- Familiarity with software development lifecycles.
- Experience in defining business requirements for information management projects.
- Familiarity with process modeling, semantic modeling and data modelling.
**Salary**: Comme
-
Big Data Architect
3 days ago
Singapore Unison Consulting Pte Ltd Full timeDesign and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. - Optimize data...
-
Big Data Platform Architect
1 day ago
Singapore Intellect Minds Pte Ltd Full timeBachelor's degree in computer science, or other relevant field. - Minimum 10 years of relevant data management experience, including architecting data management solutions and designing/developing data governance policies/standards. - Experience in implementation of big data platform and data warehouse projects. - Strong project leadership and management...
-
Platform Engineer – Big Data
6 days ago
Singapore RISKDATA CONSULTING PTE. LTD. Full time $104,000 - $130,878 per yearWe are hiring Platform Engineer – Big Data (Hadoop / Spark / Hive) with below requirements;ResponsibilitiesDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN)...
-
Platform Engineer – Big Data
6 days ago
Singapore UARROW PTE. LTD. Full time $120,000 - $180,000 per yearDesign, implement, and manage big data platforms built on Hadoop, Spark, and Hive.Develop and optimize data ingestion, transformation, and storage frameworks for high-volume, high-velocity datasets.Maintain and fine-tune Hadoop clusters (HDFS, YARN) including capacity planning, monitoring, and troubleshooting.Build and support Hive-based data warehouses for...
-
Big Data Engineer, Data Platform
2 weeks ago
Singapore NodeFlair Full time**Job Summary**: **Salary** S$6,500 - S$13,000 / Monthly **Job Type** **Seniority** Junior **Years of Experience** At least 1 year **Tech Stacks** ETL ClickHouse Metastore Analytics R Flume Presto Hive Spark kafka Flink SQL **Responsibilities** TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require...
-
Big Data Platform Engineer
6 days ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time**SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...
-
Big Data Platform Development
6 days ago
Singapore INOVAS TECH PTE. LTD. Full time**Employer briefing**: Our client is a leading interactive entertainment company revolutionizing the gaming industry. With a strong focus on innovation and exceptional game development, our client creates immersive experiences that captivate players worldwide. As the mastermind behind popular titles like "Genshin Impact," our client pushes the boundaries of...
-
Big Data Engineer
2 weeks ago
Singapore BASIL TECHNOLOGIES PTE. LTD. Full timeDevelop data processing pipelines for ingestion, modelling, analysis, mining and reporting with Enterprise Big Data Lake - Responsible for the code writing of the core module of the system - Develop POC and build data pipeline architecture using of the overall technical framework of the software - Work closely with teams ensure timely delivery of...
-
Big Data Engineer
6 days ago
Singapore BASIL TECHNOLOGIES PTE. LTD. Full timeDevelop data processing pipelines for ingestion, modelling, analysis, mining and reporting with Enterprise Big Data Lake - Responsible for the code writing of the core module of the system - Develop POC and build data pipeline architecture using of the overall technical framework of the software - Work closely with teams ensure timely delivery of...
-
Big Data Architect
1 week ago
Singapore Direct Search Global Full time**Job Detail**: - Job Reference - P5549 **Role**: Installing and maintaining operating environments Support in the Big Data stack area of responsibility Align the work of ongoing projects with the organization’s big data solution. Educating and supporting additional O&M team members and partners Accountable for the production environment’s Big Data...