BIg Data Developer

19 hours ago

Singapore ZENITH INFOTECH (S) PTE LTD. Full time
Roles & Responsibilities

ABOUT THE COMPANY

Zenith Infotech (S) Pte Ltd. was started in 1997, primarily with the vision of offering state-of-the-art IT Professionals and solutions to various organizations and thereby helping them increase their productivity and competitiveness. From deployment of one person to formation of whole IT teams, Zenith Infotech has helped clients with their staff augmentation needs. Zenith offers opportunity to be engaged in long term projects with large IT savvy companies, Consulting organizations, System Integrators, Government, and MNCs.

EA 20S0237

Industry

62011 - Development of software and applications (except games and cybersecurity)

Job Scope:


• Using the Talend ETL toolset, to create new and maintain existing ETL jobs.


• Design and implement ETLfor extracting and transforming data from diverse sources, such as: Hive, PostgreSQL, and SQL Server databases.


• Design and develop database tables necessary along with the necessary constraints as per the requirement.


• Collaborate with Team members to understand source system structures and data retrieval methods/techniques, and tools within the organization.


• Support the development of data transformation logic using ETL tools or scripting languages like SQL, Python, etc.


• Clean, validate, and transform data to confirm target schema and quality standards.


• Work with the Team to execute data quality improvement plans.


• Participate in troubleshooting activities to maintain data integrity and process efficiency.

Required skills

• Experience with Talend, Python and Spark

• Should have good knowledge and working experience in Datalake and Hadoop (Hive, Impala, HDFS).

• Hands-on experience in designing, developing, and optimizing Talend Big Data jobs leveraging the Spark engine

• Good understanding of Spark Catalyst Optimizer and spark executer parameters to optimize the Spark queries

• Strong experience in data-warehousing and data-modeling techniques

• Knowledge of industry-wide visualization and analytics tools

• Good interpersonal skills and positive attitude

Tell employers what skills you have

Talend
Troubleshooting
PostgreSQL
Big Data
Quality Improvement
Hadoop
Data Transformation
Scripting
ETL
Data Quality
SQL
SQL Server
Python
Consulting
Visualization
Databases

  • Big Data Developer

    2 days ago

    Singapore Zone IT Solutions Full time

    We are looking for Big Data Developers in the vibrant city of Singapore. This is a fantastic opportunity for someone who is passionate about big data and wants to take their career to new heights. **Requirements**: - Minimum of 5 years of experience as a Big Data Developer - Strong knowledge and experience with Big Data technologies such as Hadoop, Spark,...

  • Big Data Developer

    1 week ago

    Singapore Pan Asia Group Resources Full time

    JD: - Minimum 5 years of total IT experience; at least 4 years of experience in development with PySpark & Python; - Good knowledge and experience on Big Data platform, Big Data Eco system tools, SPARK, Python, Etc. - Experience with Banking domain is preferable. - Strong understanding of SDLC processes including all the project documentations. - Ability to...

  • Big Data Developer

    1 week ago

    Singapore TECHNOALLY PTE. LTD. Full time

    Requirement - 6+ years of experience in the field of Software Engineering with good communication skills. - Atleast 4 years of hands on experience in Hadoop, Hive and Oozie. - Atleast 2 years of hands on experience in Apache spark programming. - Atleast 2 years of experience working with AWS technologies. - Good knowledge and understanding on current big...

  • Big Data Developer

    2 weeks ago

    Singapore ROADGET BUSINESS PTE. LTD. Full time

    **Responsibilities**: - Responsible for analyzing data requirements and provide data technology solution for business departments - Responsible for data integration between the business system and big data platform, build a data warehouse - Responsible for business data ETL development, offline and real-time data development on the current big data...

  • Big Data Developer

    6 days ago

    Singapore Zenith Infotech Pte Ltd. Full time

    Join to apply for the Big Data Developer role at Zenith Infotech . Get AI-powered advice on this job and more exclusive features. This range is provided by Zenith Infotech. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Job Scope: Using the Talend ETL toolset, to create new and maintain...

  • Big Data Development Expert

    5 hours ago

    Singapore beBeeData Full time $60,000 - $80,000

    Job Overview:We are seeking a highly skilled professional to fill the role of Assistant Big Data Development Engineer. As a key contributor to our big data development team, you will be responsible for designing and building robust data warehouses and performing data analysis based on business requirements.Key Responsibilities:Develop and implement big data...

  • Big Data Developer

    1 day ago

    Singapore NodeFlair Full time

    **Job Summary**: **Job Type** Permanent **Seniority** Mid **Years of Experience** At least 3 years **Tech Stacks** ETL AWS Analytics R EMR pySpark Glue Athena RedShift Flume Presto Java Hive Spark kafka Flink SQL Scala Python **Responsibility**: - Designing and build scalable data pipelines to extract, transform, and load data from a variety of sources...

  • Big Data Developer

    6 days ago

    Singapore ROADGET BUSINESS PTE. LTD. Full time

    **Responsibilities**: - Responsible for analyzing data requirements and provide data technology solution for business departments. - Responsible for data integration between the business system and big data platform, build data warehouse. - Responsible for business data ETL development, offline and real-time data development on the current big data...

  • Senior Big Data Developer

    3 days ago

    Singapore beBeeBigDataDeveloper Full time $90,000 - $120,000

    As a Senior Big Data Developer, you will be working on designing and developing scalable data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses and data lakes.Your key responsibilities will include collaborating with cross-functional teams to understand data requirements and deliver high-quality data solutions....

  • Big Data Architect

    4 days ago

    Singapore People Profilers Full time

    Job Description: - Provide leadership and drive architecture and the design of Big Data solutions - Design and implement high performance systems supporting large volume real time and batched data processes - Ensure implementation Data Governance and security best practices for Big Data environments - Provide technical guidance and mentorship to the team to...