Big Data Developer
4 days ago
**Responsibilities**:
- Designing, building, and maintaining systems that handle large volumes of data, enabling businesses to extract valuable insights and make data-driven decisions
- Creating scalable and efficient data pipelines, implementing data models, and integrating various data sources.
- Write efficient and optimised code in programming languages like Java, Scala, Python to manipulate and analyse data
- Creating scalable and efficient data pipelines, implementing data models, and integrating diverse data sources to enable businesses to extract valuable insights
- Designing, developing, and implementing scalable and efficient data processing pipelines using Big Data technologies.
- Implementing a Kafka-based pipeline to feed event-driven data into a dynamic pricing model, enabling real-time pricing adjustments based on market conditions and customer
- Conduct testing and validation of data pipelines and analytical solutions to ensure accuracy, reliability, and performance.
- Developing and optimising ETL (Extract, Transform, Load) processes to ingest and transform large volumes of data from multiple sources.
**Requirements**:
- Relevant certification in Big Data technologies or related fields
- Strong exp in distributed computing principles and Big Data ecosystem components (e.g., Hadoop, Spark, Hive, HBase).
- Must have exp in investment banking, payment and transaction banking domain.
- Proficiency in programming languages and scripting (e.g., Java, Scala, Python, SQL) for data processing and analysis.
- Experience with cloud platforms and services for Big Data (e.g., AWS, Azure, Google Cloud)
-
Development Manager
2 weeks ago
Singapore TANGSPAC CONSULTING PTE LTD Full timeA large financial institution with large data team is looking for Application Development Manager / Lead with the following responsibilities : Managing an applicaiton development team of around 20+ members Managing the solutioning of Big Data and enterprise BI applications Building frameworks, best practices for the engineering team. Utilizing best big data...
-
Big Data Developer
4 days ago
Singapore ITCAN Pte. Ltd. Full time**Must Have**: - Strong foundational knowledge of data structures and algorithms - Experience in Java programming, Relational/NoSQL database, and SQL - Exposure to one or more Big Data technologies like Hadoop, Spark, Hive, Kafka **Good To Have**: - Experience in development in a CI/CD environment and familiarity with CI/CD tools is required **Job...
-
Big Data Developer
1 week ago
Singapore Tech Aalto Full time $60,000 - $120,000 per yearBig Data Developer Experience: Years)Job Requirements:Good understanding of concurrent software systems and building them in a way that is scalable, maintainable, and robust Experience in designing application solutions in hadoop ecosystemDeep understanding of the concepts in Hive, HDFS, yarn, Spark, Spark sql, Scala and PysparkHDFS file formats and their...
-
Software Developer
6 days ago
Singapore TRINITY CONSULTING SERVICES PTE. LTD. Full timeBachelor or Technical Degree in Computer Science, IS, or IT is preferred - At least 5 years of relevant working experience in Java/J2EE development - At least 2 years of experience in big data technology development. - Good understanding & working knowledge with Agile/Scrum - Hands-on experience of end-to-end design and implementation of complex IT systems -...
-
Big Data
1 week ago
Singapore AccionLabs Full time $60,000 - $150,000 per yearCompany Description Accion Labs is a global technology services firm with offering a full range of product life-cycle services in the emerging technology segment. This includes Web 2.0, Open Source, SaaS/Cloud, Mobility, IT Operations Management/ITSM, Big Data and traditional BI/DW.Through nine global offices and a rapid-response delivery model, Accion...
-
Senior Big Data Developer
2 weeks ago
Singapore TRINITY CONSULTING SERVICES PTE. LTD. Full timeBachelor or Technical Degree in Computer Science, IS, or IT is preferred - At least 8 years of relevant working experience in Java/J2EE development - Hands on experience in big data technology development is preferred - Good understanding & working knowledge with Agile/Scrum - Hands-on experience of end-to-end design and implementation of complex IT...
-
Big Data
1 week ago
Singapore AccionLabs Full time $120,000 - $240,000 per yearCompany Description Accion Labs is a global technology services firm with offering a full range of product life-cycle services in the emerging technology segment. This includes Web 2.0, Open Source, SaaS/Cloud, Mobility, IT Operations Management/ITSM, Big Data and traditional BI/DW.Through nine global offices and a rapid-response delivery model, Accion...
-
Big Data Engineer
1 week ago
Singapore ALMR CONSULTING PTE. LTD. Full time**Job Summary**: We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and reporting needs. **Key...
-
Big Data Engineer
1 week ago
Singapore ALMR Consulting Pte Ltd Full time**Roles & Responsibilities** **Job Summary**: We are looking for an experienced Big Data Engineer with at least 5 years of experience in managing data pipelines and processing within Big Data environments (e.g. Cloudera Data Platform). The role involves designing, developing, and maintaining data ingestion and transformation jobs to support analytics and...
-
Big Data Engineer
6 days ago
Singapore AlgoriX Technology Pte. Ltd. Full time**Responsibilities** The Big Data Engineer is responsible for analyzing big data and optimizing the performance of our online advertising delivery system. They are also responsible for the research and development of the advertising system’s offline and real-time data streams. **Requirements**: - Bachelor’s degree or above, majoring in Computer...