Data Developer

2 weeks ago

Singapore IIT MATRIX Full time

**JD for Spark Developer**

**Summary**:
This role will be responsible for designing, developing, and maintaining Applications using Apache Spark open-source framework. They work with different aspects of the Spark ecosystem, including Spark SQL, Data Frames, Datasets, and streaming.

**Role**:

- Help write analytics code, services and components in Java, Apache Spark and Kafka,
- Responsible for systems analysis - Design, Coding, Unit Testing and other SDLC activities
- Creating Technical design diagrams for business modules, code review with the peers.
- Requirement gathering and understanding, Analyze and convert functional requirements into concrete technical tasks and able to provide reasonable effort estimates
- Work proactively, independently and with global teams to address project requirements, and articulate issues/challenges with enough lead time to address project delivery risks
- Providing expertise in technical analysis and solving technical issues during project delivery
- Code reviews, test case reviews and ensure code developed meets the requirements

**Responsibilities**
- Experience with Java essential.
- Experience with Apache Spark streaming and batch framework
- Experience with Kafka, Storm, Zookeeper
- Agile/Scrum methodology experience is required.
- Service oriented architecture, and data standards like JSON, Avro, Protobuf
- Strong communication skills, should be able to communicate effectively with business and other stake holders
- Demonstrate ownership and initiative taking

**Qualifications**:

- Bachelor's degree in computer science, data science, or a related field
- Experience with Apache Spark, Java, SAS, Hive, Hadoop, and the Hadoop ecosystem
- Experience with data modeling, data wrangling, and data analysis
- Experience with cloud computing platforms (e.g., AWS, Azure, GCP)
- Strong problem-solving and analytical skills
- Excellent communication and teamwork skills
- Strong programming skills
- Experience with data migration
- Ability to work independently and as part of a team.

**Benefits**:

- Opportunity to work on cutting-edge projects.
- Collaborative and supportive work environment

**Job Types**: Full-time, Permanent

Pay: $8,000.00 - $11,000.00 per month

Schedule:

- Day shift
- Monday to Friday

  • Data Engineer

    2 weeks ago

    Singapore NTT Data Singapore Full time

    **The primary responsibilities**: - Lead architecture design, develop, document, and implement end-to-end data pipelines and data-driven solutions. - Define roadmap to transform data architecture focusing on scalability, performance, and stability for the entire data lifecycle; - Build data flow for data acquisition, aggregation, and modelling, using both...

  • Kdb+ Developer

    4 days ago

    Singapore Data Intellect Full time

    **Company Description** At Data Intellect, it’s never just about data or technology. These are our tools. What drives us is human intellect, collaboration, and solving the most complex challenges in finance and beyond.** We live by the [DI] code: We are **Problem Solvers** who are **Humble**, have a **Can-do Attitude**, and believe in...

  • Senior Data Scientist

    2 weeks ago

    Singapore Data Science Full time

    Get to Know the Team You'll be part of the SNP Data Science Personalization team, an established group dedicated to enhancing personalization experiences for Grab Food/Mart/Transport. We aim to develop cutting‐edge Deep Learning models to deliver best user experiences. Our team comprises passionate Data Scientists with various expertise. If personalization...

  • Data Engineer

    2 weeks ago

    Singapore NTT Data Singapore Full time

    Open roles:  Lead Data EngineerSenior Data EngineerJunior Data EngineerJunior Data Engineer 1 year renewable contract Primary Skills Informatica/IDMC, Databricks/Python (Hands on strong knowledge in any combination of two) Team Lead experience Secondary SkillsTableau/OAS, AWS Cloud PreferenceAWS Architect / Databricks / IDMC certification Key...

  • Senior Kdb+ Developer

    4 days ago

    Singapore Data Intellect Full time

    **Company Description** Every query matters. Every millisecond counts. Every system you build shapes the future of data-driven finance.** At **Data Intellect**, we thrive on solving complex data challenges in high-stakes environments. We’re a team of engineers, problem-solvers, and collaborators who believe in pushing boundaries, not egos. If you're a...

  • Senior Developer

    2 weeks ago

    Singapore Cresco Data Full time

    **Location **:Singapore/Australia **Experience Required **:5-7 yrs in relevant field CrescoData is an exciting market leader in the Commerce space. Headquartered in Singapore, it delivers Commerce-in-the-Cloud services to enterprise customers across the globe. This is a unique opportunity to work in an agile market-leading company in a fast growing sector...

  • Data Intern

    4 days ago

    Singapore Attribute Data Pte Ltd Full time

    Company Attribute Data Pte Ltd Designation Data Intern Date Listed 26 Sep 2024 Job Type Entry Level / Junior Executive - Intern/TS Job Period Immediate Start, For At Least 6 Months Profession IT / Information Technology Industry Computer and IT Location Name 7 Pahang Street, Singapore Address 7 Pahang St, Singapore 198608 Map Allowance /...

  • Azure Data engineer

    7 days ago

    Singapore NTT Data Singapore Full time

    Job Responsibilities:Data Analysis and Interpretation: Perform in-depth analysis of structured and unstructured data sets to identify trends, patterns, and valuable insights that drive business decisions and strategies. Data Visualization and Reporting: Develop intuitive and visually appealing dashboards, reports, and presentations...

  • Software Development Specialist

    1 week ago

    Singapore NTT DATA Full time

    **Req ID**: 326859 We are currently seeking a Software Development Specialist to join our team in Singapore, Central Singapore (SG-01), Singapore (SG). **Big Data Support Engineer** **Skillset** - Up to 9 years of IT experience & 5+ Years on Teradata or Hadoop - Last 3 years of relevant experience in banking/financial services industry - Hands-on...

  • Business Development Manager

    3 weeks ago

    Singapore, , Singapore Tech Data Full time

    Job Purpose: The Business Development Manager is the main interface between the Company's Customers and Suppliers. Business Development Manager is responsible for execution of the suppliers' strategy. The Business Development Manager is responsible for the complete sales cycle with an aim to maximizing revenue, Net Gross Profits and Customer satisfaction by...