Big Data Engineer

2 days ago

Singapore D L RESOURCES PTE LTD Full time

BIG DATA ENGINEER / DATA SCIENTIST, FCC ANALYTICS

**Job Description**:
Big Data Engineering
Create, build and maintain the data infrastructure required for Extraction, Transformation and Loading of data from a wide variety of sources.
Ensure high-quality data is delivered to support Compliance / FCC model development.
Support the implementation of Data Analytics / Automation for Compliance teams and Business stakeholders
Liaise with relevant stakeholders (e.g., Data Management Office) to identify and assess suitability of data for Compliance / FCC Data models.
Liaise with Business stakeholders / analysts and ensure assembled data assets used for model development meet business requirements.
Build & maintain data dictionaries / data requirements of implemented data models and coordinate with Data Scientist(s) in developing model narratives.
Monitor the execution & performance of data models and liaise with IT for any technical / system outages
Keep track of datasets / tables in the working schema and support purging of unused tables periodically.
Perform data analysis required to troubleshoot data related issues and support the resolution of raised data issues.

Support model maintenance
Liaise with Business Analyst to receive and understand business feedback on model performance and incorporate feedback into models
Re-train and recalibrate existing FCC analytical models to prevent model drift periodically or as needed

New model development
Work closely with model end-users and other key stakeholders (e.g., Head of FCC Analytics, Business Analyst, Data and Ops Engineer, GC) to identify additional areas which require analytics support or future model build and include those models in development pipeline
Develop model narratives (e.g., purpose, logic, parameters, data requirements, output surfacing / structuring) in collaboration with the business and other relevant stakeholders
Work closely with other Data Scientist(s) and Business Analyst, and undertake the end-to-end FCC model development, including data wrangling, exploratory data analysis, feature selection, model selection, training, testing, etc.
Build a range of models (rule-based, supervised / unsupervised models, etc.) on structured, semi-structured, and/or unstructured data if needed

  • Big Data Engineer

    2 weeks ago

    Singapore LION & ELEPHANTS CONSULTANCY PTE. LTD. Full time

    Job Title: Big Data Engineer (Java, Spark, Hadoop)Location : Singapore Experience : 7- 12 years Employment Type : Full-Time Open to Citizens and SPR only | No Visa sponsorship available Job Summary We are looking for a Senior Big Data Engineer with 7–12 years of experience to join our growing data engineering team. The ideal candidate will bring deep...

  • Big Data Engineer

    1 week ago

    Singapore ALMR CONSULTING PTE. LTD. Full time

    Job Summary We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. Key Responsibilities...

  • Big Data Engineer

    4 days ago

    Singapore INCOME INSURANCE LIMITED Full time

    Responsible for data pipeline setup and data transformation - Implementation including loading from disparate data sets, preprocessing data. - Scope and deliver various Big Data solutions - Ability to design solutions independently based on high-level architecture. - Maintain the production systems (Kafka, Hadoop, Elasticsearch, RDBMS and No-SQL) -...

  • Big Data Engineer

    2 weeks ago

    Singapore Tata Consultancy Services Limited Full time

    Requirements Proven experience as a Big Data Engineer or similar role. Strong proficiency in Apache Spark and Scala programming. Experience with big data technologies such as Hadoop, Hive, Kafka, etc. Familiarity with data warehousing concepts and tools. Knowledge of SQL and NoSQL databases. Excellent problem-solving skills and attention to detail. Strong...

  • Big Data Platform Engineer

    2 weeks ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...

  • Senior Engineer

    6 days ago

    Singapore Reeracoen Singapore Pte Ltd Full time

    Our client is a dynamic technology consulting company specializing in digital transformation and innovative solutions. They are currently looking for a Senior Engineer (Big Data) to join their tech engineering team. - 【 What you will be doing 】- Responsible for designing, creating, and managing large-scale data processing systems. - Ensure that systems...

  • Senior Big Data Platform Engineer

    2 weeks ago

    Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...

  • Big Data Engineer

    2 weeks ago

    Singapore Unison Consulting Pte Ltd Full time

    **SKILLS SET AND TRACK RECORD** - Good understanding and completion of projects using waterfall/Agile methodology. - Analytical, conceptualisation and problem-solving skills. - Good understanding of analytics and data warehouse implementations - Hands-on experience in big data engineering jobs using Python, Pyspark, Linux, and ETL tools like Informatica -...

  • Big Data Engineer

    5 days ago

    Singapore Ascendion Full time

    Direct message the job poster from Ascendion Empowering Digital Transformation & Building Future-Ready Teams to Drive Innovation Role: We are seeking a skilled data engineer to design, build, and maintain cloud-based data pipelines and analytics solutions. You will work closely with data analysts, product teams, and business stakeholders to ensure...

  • Big Data Engineering Intern

    3 days ago

    Crimson House Singapore Rakuten Full time $60,000 - $90,000 per year

    Job Description:Situated in the heart of Singapore's Central Business District, Rakuten Asia Pte. Ltd. is Rakuten's Asia Regional headquarters. Established in August 2012 as part of Rakuten's global expansion strategy, Rakuten Asia comprises various businesses that provide essential value-added services to Rakuten's global ecosystem. Through advertisement...