Big Data Administrator

2 weeks ago


Singapore InfoCepts Full time

GovTech Singapore has awarded InfoCepts the provision of Data Science software and services for Government Ministries/Departments, statutory boards, organs of the state and participating entities.

**About InfoCepts**

We're presently seeking out aspiring / proven big data administrators to join our cause in helping customers Stay Modern, ahead of the technology curve

**Roles and Responsibilities**:

- Monitor cluster connectivity and performance
- Manage and review the Hadoop Distributed File System, YARN configuration files and log files
- Embark on backup and recovery related tasks
- Handle resource and security management matters
- Drive test execution and such reporting to all relevant stakeholders while documenting test cases and test results
- Strictly adhere to define Defect Management Processes
- Investigate and resolve all related technical issues through conducting detailed analyses
- Provide root cause analyses for all technical issues as necessary
- Render support in terms of software tool management coordination, e.g. patches and version evaluation with product vendors

**Skills Required**:

- Tertiary education in Software Engineering, Computer Science and/or related fields
- 3 to 5 years of ETL development experience
- Relevant experience with Cloudera platform - Cloudera DataFlow (Ambari)
- Knowledge of other data ingestion tools such as Azure DataBricks will be a plus
- Strong understanding of distributed querying, performance tuning, horizontal scaling and data partitioning concepts
- Knowledge of programming languages like SQL, Oracle, R, MATLAB, and Python
- Accuracy and attention to detail, with the ability to perform data analysis and report acute observations
- Adept at queries, writing reports, and making presentations
- Team-working skills
- Verbal and written communication skills

**Job Types**: Full-time, Permanent

**Salary**: $5,000.00 - $7,000.00 per month

**Benefits**:

- Health insurance
- Professional development

Schedule:

- Monday to Friday

**Experience**:

- Cloudera DataFlow: 1 year (preferred)
- Apache Ambari: 1 year (preferred)
- ETL: 1 year (preferred)
- Big data: 1 year (preferred)


  • Data Engineer

    2 weeks ago


    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...

  • Big Data Architect

    2 weeks ago


    Singapore People Profilers Full time

    Job Description: - Provide leadership and drive architecture and the design of Big Data solutions - Design and implement high performance systems supporting large volume real time and batched data processes - Ensure implementation Data Governance and security best practices for Big Data environments - Provide technical guidance and mentorship to the team to...

  • Big Data Architect

    2 weeks ago


    Singapore Unison Consulting Pte Ltd Full time

    Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. - Optimize data...

  • Big Data Engineer

    2 weeks ago


    Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time

    **Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...

  • Big Data Expert

    2 weeks ago


    Singapore beBeeAnalyst Full time $90,000 - $120,000

    Big-Data Analyst RoleWe are seeking a skilled and knowledgeable individual to take on the role of Big-Data Analyst. This position involves working with big data to analyze trends, identify patterns, and provide actionable insights.

  • Big Data Developer

    3 days ago


    Singapore DADACONSULTANTS PTE. LTD. Full time

    **Responsibilities** **1、**Design and develop scalable, high-performance data processing systems using Hadoop, Flink, and other Big Data technologies. 2、Develop and maintain data pipelines for data ingestion, processing, and analysis. 3、Design and implement data models to optimize data storage and retrieval efficiency. 4、Collaborate with...

  • Data Engineer

    2 weeks ago


    Singapore TALENTSIS PTE. LTD. Full time

    We are looking for a skilled **Data Engineer**with a focus on **Big Data**to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. **Key Responsibilities**: - Build and maintain big data pipelines using technologies like...

  • Big Data Expert

    1 week ago


    Singapore beBeeData Full time $80,000 - $120,000

    Job Description:The Resident Solutions Architect role involves working with clients on short to medium term engagements to solve big data problems using Apache Spark and the Data Intelligence Platform.You will guide our largest customers, implementing pipelines from data engineering through model building and deployment, and other technical tasks to help...

  • Big Data Developer

    6 days ago


    Singapore ALMR CONSULTING PTE. LTD. Full time $90,000 - $120,000 per year

    Responsibilities Designing, building, and maintaining systems that handle large volumes of data, enabling businesses to extract valuable insights and make data-driven decisions Creating scalable and efficient data pipelines, implementing data models, and integrating various data sources. Developing and deploying data processing applications using Big Data...

  • Big Data Developer

    2 weeks ago


    Singapore Zone IT Solutions Full time

    We are looking for Big Data Developers in the vibrant city of Singapore. This is a fantastic opportunity for someone who is passionate about big data and wants to take their career to new heights. **Requirements**: - Minimum of 5 years of experience as a Big Data Developer - Strong knowledge and experience with Big Data technologies such as Hadoop, Spark,...