Big Data Developer
2 weeks ago
Requirement
- 6+ years of experience in the field of Software Engineering with good communication skills.
- Atleast 4 years of hands on experience in Hadoop, Hive and Oozie.
- Atleast 2 years of hands on experience in Apache spark programming.
- Atleast 2 years of experience working with AWS technologies.
- Good knowledge and understanding on current big data technolgies.
- Atleast 5 years of experience working on RDBMS systems such as Oracle, SQL Server and expert level SQL/PL-SQL programming skills.
- 3 years of experience working on Java/Python and experience in writing shell scrpits.
Good knowledge and **hands-on experience **with Big Data platforms covering
- Hadoop data platform/tools experience on anyone of these distribution - **Cloudera **/ Hortonworks
- **Must Have Hands on Developing experience in Apache Spark Framework/API's (1.6 / 2.x) - Streaming, Core, SQL**:
- **Must have Strong programming language background preferably on Scala or python along with SQL on Big Data context**:
- **Must have hands on experience in Big data Ingestion tools like Kafka, Sqoop, Flume with integration on DB, Message Queue, Flat files.**:
- Basic Knowledge of NoSQL storage (Hive / HBase / Impala / Kudu) & Hadoop File Format (Avro / Parquet)
- Basic Working knowledge Hadoop connectors across components like Kafka>Spark, Sqoop>HDFS, Flume>Kafka, Spark>HBase, Spark>Impala
- Good analytical and problem-solving skills with proven communication and experience in working Customer facing roles.
- Cloudera Certified developer certification, will be preferred
-
Big Data Developer
2 days ago
Singapore ALMR CONSULTING PTE. LTD. Full time $90,000 - $120,000 per yearResponsibilities Designing, building, and maintaining systems that handle large volumes of data, enabling businesses to extract valuable insights and make data-driven decisions Creating scalable and efficient data pipelines, implementing data models, and integrating various data sources. Developing and deploying data processing applications using Big Data...
-
Big Data Developer
6 days ago
Singapore Zone IT Solutions Full timeWe are looking for Big Data Developers in the vibrant city of Singapore. This is a fantastic opportunity for someone who is passionate about big data and wants to take their career to new heights. **Requirements**: - Minimum of 5 years of experience as a Big Data Developer - Strong knowledge and experience with Big Data technologies such as Hadoop, Spark,...
-
Big Data Developer
2 weeks ago
Singapore Pan Asia Group Resources Full timeJD: - Minimum 5 years of total IT experience; at least 4 years of experience in development with PySpark & Python; - Good knowledge and experience on Big Data platform, Big Data Eco system tools, SPARK, Python, Etc. - Experience with Banking domain is preferable. - Strong understanding of SDLC processes including all the project documentations. - Ability to...
-
Big Data Developer
1 week ago
Singapore Zenith Infotech Pte Ltd. Full timeJoin to apply for the Big Data Developer role at Zenith Infotech . Get AI-powered advice on this job and more exclusive features. This range is provided by Zenith Infotech. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Job Scope: Using the Talend ETL toolset, to create new and maintain...
-
Big Data Development Expert
4 days ago
Singapore beBeeData Full time $60,000 - $80,000Job Overview:We are seeking a highly skilled professional to fill the role of Assistant Big Data Development Engineer. As a key contributor to our big data development team, you will be responsible for designing and building robust data warehouses and performing data analysis based on business requirements.Key Responsibilities:Develop and implement big data...
-
Big Data Developer
6 days ago
Singapore NodeFlair Full time**Job Summary**: **Job Type** Permanent **Seniority** Mid **Years of Experience** At least 3 years **Tech Stacks** ETL AWS Analytics R EMR pySpark Glue Athena RedShift Flume Presto Java Hive Spark kafka Flink SQL Scala Python **Responsibility**: - Designing and build scalable data pipelines to extract, transform, and load data from a variety of sources...
-
Big Data Developer
1 week ago
Singapore ROADGET BUSINESS PTE. LTD. Full time**Responsibilities**: - Responsible for analyzing data requirements and provide data technology solution for business departments. - Responsible for data integration between the business system and big data platform, build data warehouse. - Responsible for business data ETL development, offline and real-time data development on the current big data...
-
BIg Data Developer
2 days ago
Singapore ZENITH INFOTECH (S) PTE LTD. Full timeRoles & Responsibilities ABOUT THE COMPANY Zenith Infotech (S) Pte Ltd. was started in 1997, primarily with the vision of offering state-of-the-art IT Professionals and solutions to various organizations and thereby helping them increase their productivity and competitiveness. From deployment of one person to formation of whole IT teams, Zenith Infotech...
-
Senior Big Data Developer
7 days ago
Singapore beBeeBigDataDeveloper Full time $90,000 - $120,000As a Senior Big Data Developer, you will be working on designing and developing scalable data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses and data lakes.Your key responsibilities will include collaborating with cross-functional teams to understand data requirements and deliver high-quality data solutions....
-
Big Data Architect
1 week ago
Singapore People Profilers Full timeJob Description: - Provide leadership and drive architecture and the design of Big Data solutions - Design and implement high performance systems supporting large volume real time and batched data processes - Ensure implementation Data Governance and security best practices for Big Data environments - Provide technical guidance and mentorship to the team to...