Big Data Developer

JD: - Minimum 5 years of total IT experience; at least 4 years of experience in development with PySpark & Python; - Good knowledge and experience on Big Data platform, Big Data Eco system tools, SPARK, Python, Etc. - Experience with Banking domain is preferable. - Strong understanding of SDLC processes including all the project documentations. - Ability to...

Requirement - 6+ years of experience in the field of Software Engineering with good communication skills. - Atleast 4 years of hands on experience in Hadoop, Hive and Oozie. - Atleast 2 years of hands on experience in Apache spark programming. - Atleast 2 years of experience working with AWS technologies. - Good knowledge and understanding on current big...

Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust - Deep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and Pyspark - HDFS file formats and their use cases (eg Parquet, ORC, Sequence etc) - Good knowledge in data warehousing system - Experienced in any scripting...

Capgemini SingaporePosted 3 hours ago Hybrid Permanent S$70k - S$90k - Posted by - Nirzham Shah- Talent Acquisition ManagerFollow - A Big Data Engineer is an information technology (IT) professional who is responsible for designing, building, testing and maintaining complex data processing systems that work with large data sets. **Job responsibilities**: -...

**Employer briefing**: Our client is a leading interactive entertainment company revolutionizing the gaming industry. With a strong focus on innovation and exceptional game development, our client creates immersive experiences that captivate players worldwide. As the mastermind behind popular titles like "Genshin Impact," our client pushes the boundaries of...

Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. - Optimize data...

**Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...

We are looking for a skilled **Data Engineer**with a focus on **Big Data**to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. **Key Responsibilities**: - Build and maintain big data pipelines using technologies like...

Job Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs.Key...

Roles & ResponsibilitiesJob Summary:We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting...