Sr Big Data Engineer

1 week ago


Downtown Core, Singapore Intellect Minds Pte Ltd Full time

**We are a fast growing company that aims to help you with all in job finding matching to your skills.**:
**_Qualification & Experience:_**:

- **CS fundamentals**: At least a B.S. / MS in Computer Science, or related degree AND you have a strong ethos of continuous learning.**:

- **Commercial software engineering**: You have 6 to 10 years of professional software development experience with languages and systems such as Python, PySpark, Java and version control (git), with good analytical & debugging skills.**:

- **Big data**: You have extensive experience with data analytics and working knowledge of big data infrastructure such as Google Cloud, Big Query, Data Flow, Hadoop Eco System, HDFS, Spark. You’ve routinely built data pipelines with gigabytes/terabytes of data and understand the challenges of manipulating such large datasets.**:

- **Data Modeling**: Flair for data, schema, data model, PL/SQL, Star & snowflake schema, how to bring efficiency in data modeling for efficient querying data for analysis, understands criticality TDD and develops data validation techniques.**:

- **Real Time Systems**: Understands evolution of databases for in-memory, NoSQL & indexing technologies along with experience on real-time & stream processing systems like Google pub/sub, GCP technologies, Kafka, Storm, Spark Streaming.**:

- **Strong design skills**: with a proven track record of success on large/highly complex projects preferably in Enterprise Apps and Integration.**:

- **Project management**: You demonstrate excellent project and time management skills, exposure to scrum or other agile practices in JIRA.**:

- **Excellent verbal and written communication skills**: Must be able to effectively communicate & work with fellow team members and other functional team members to coordinate & meet deliverables.**:
**_Must Have Good to have_**:

- **Commercial software engineering**:
**Python, version control (git), analytical & debugging skills PySpark, Java.**:

- **Big Data**:
**Google Cloud Platform, Big Query, Data Flow Hadoop Eco System, HDFS, Spark**:

- **Data Modeling**:
**Data modeling, PL/SQL, star & snowflake schema design, in-memory**:
**NoSQL & indexing technologies.**:

- **Real Time Systems**:
**Google pub/sub, GCP technologies, Kafka Storm, Spark Streaming.**:
**To your success**
**The Recruitment Team**
**Intellect Minds Pte Ltd (Singapore)**:



  • Downtown Core, Singapore U3 InfoTech Pte Ltd Full time

    **Key Responsibilities**: - Design, implement, and optimize robust data pipelines and ETL/ELT workflows using SQL and Python. - Lead architecture discussions, including the creation and review of Entity Relationship Diagrams (ERDs) and overall system design. - Collaborate closely with Data Engineers, Analysts, and cross-functional engineering teams to meet...

  • Big Data Developer

    1 day ago


    Downtown Core, Singapore Intellect Minds Pte Ltd Full time

    **We are a fast growing company that aims to help you with all in job finding matching to your skills.**: - **Minimum 5 years of total IT experience; at least 4 years of experience in development with PySpark & Python;**: - **Good knowledge and experience on Big Data platform, Big Data Eco system tools, SPARK, Python, Etc.**: - **Experience with Banking...


  • Downtown Core, Singapore Institute of Data Full time

    **About the Institute of Data** The Institute of Data is a Professional Network of Data Scientists, Cyber Security Analysts, and Software Engineers. In partnership with leading universities in Australia, New Zealand & America, and the government of Singapore, we transform careers for a data-driven world through practical, industry-focused courses. **About...

  • Data Engineer

    3 days ago


    Downtown Core, Singapore Intellect Minds Pte Ltd Full time

    **We are a fast growing company that aims to help you with all in job finding matching to your skills.**: - **Degree in Computer Science, Data Science, or a related field**: - **Proficient in languages such as Python, JAVA, SQL, and experience with data science and engineering frameworks such as Scikit-learn, Pandas, Tensorflow, Spark, Hadoop, etc.**: -...


  • Downtown Core, Singapore U3 InfoTech Pte Ltd Full time

    **Position Details**: **Company : U3 Infotech (Payroll)** **Role : Data centre Facility Engineer** **Position : Contract** **Duration : 12+ Months (Extendable OR Renewable)** **Location : Singapore** 1. Monitor and maintain critical data centre infrastructure, including power distribution systems (UPS, generators), HVAC systems, fire suppression...

  • DevOps Engineer

    5 days ago


    Downtown Core, Singapore Lloyds List Intelligence Full time

    Lloyd’s List Intelligence are the trusted experts delivering transparent and actionable maritime data empowering 60,000 professionals around the globe to make confident decisions that drive the safe, efficient, and lawful movement of trade by sea. Our advanced analytics, artificial intelligence, and industry expertise transform our unparalleled data into...


  • Downtown Core, Singapore Deloitte & Touche LLP Full time $60,000 - $120,000 per year

    Company description: "Deloitte" is the brand under which tens of thousands of dedicated professionals in independent firms throughout the world collaborate to provide audit & assurance, tax & legal, strategy, risk & transactions, technology & transformation and related services to select clients. These firms are members of Deloitte Touche Tohmatsu Limited,...

  • Data Scientist

    3 days ago


    Downtown Core, Singapore Aon Corporation Full time

    Posting Description: **Data Scientist** **Aon is in the business of better decisions** At Aon, we shape decisions for the better to protect and enrich the lives of people around the world. As an organization, we are united through trust as one inclusive, diverse team, and we are passionate about helping our colleagues and clients succeed. **About...


  • Downtown Core, Singapore U3 InfoTech Pte Ltd Full time

    **Position Details**: **Company : U3 Infotech (Payroll)** **Role : Financial Data Analyst** **Position : Contract** **Duration : 12 Months (Extendable OR Renewable)** **Location : Singapore** **Job Objectives (Why does this job exist?)** This role supports the Group Finance Cost analytics team's financial analysis through data visualization,...


  • Downtown Core, Singapore U3 InfoTech Pte Ltd Full time

    1. Monitor and maintain critical data centre infrastructure, including power distribution systems (UPS, generators), HVAC systems, fire suppression systems, and access control systems. 2. Perform preventive maintenance on data centre equipment and systems. 3. Respond to alarms, troubleshoot issues, and ensure prompt resolution. 4. Liaise with the building...