Big Data Specialist

2 months ago

Singapur, Singapore Epam Full time

About the Role

We are seeking a highly skilled Data Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data ingestion and processing jobs in big data environments.

Key Responsibilities

  • Analyze and document business data requirements to ensure seamless data access to users.
  • Optimize data collection by migrating to efficient channels and implementing data engineering jobs.
  • Design and implement data warehousing and data modeling solutions to meet analytical needs.
  • Develop and execute test plans and scripts for system and user acceptance testing.
  • Collaborate with technical teams to ensure smooth deployment and adoption of data engineering solutions.
  • Maintain IT solution operations and service levels, ensuring high availability, performance, and security.

Requirements

  • Minimum 4 years of experience managing data engineering projects in a big data environment, such as Cloudera Data Platform.
  • Strong understanding of analytics, data warehousing, and data modeling.
  • Proven ability to troubleshoot complex technical issues.
  • Expert-level SQL skills and proficiency in data analysis.
  • Hands-on experience with big data technologies, including Python, PySpark, Linux, and ETL tools like Informatica.
  • Demonstrated success implementing systems using Hive, Impala, and Cloudera Data Platform.
  • Preferred experience with DevOps deployment, data virtualization (Denodo), and reporting/visualization tools (SAP BO, Tableau).
  • Strong project management skills in both waterfall and Agile methodologies.

About EPAM

EPAM is a leading global provider of digital platform engineering and development services. We have been expanding in Singapore and delivering the best solutions to our customers. As a recognized leader, EPAM Singapore achieved Great Place to Work Certification and is committed to providing our team with inspiring careers.

You will have the opportunity to work with fellow talented technologists and accelerate your career by participating in our numerous upskilling, training, and certification programs. We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey.

We are committed to building a lifelong learning culture at the workplace and have been awarded Gold for Best In-House Certification Programmes in the Employee Experience Awards and Silver in the SkillsFuture Employers Awards for our efforts in championing employees' skills development.

  • Big Data Engineer

    2 weeks ago

    Singapur, Singapore Virtusa Full time

    Job Title: Big Data EngineerAt Virtusa, we are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop big data...

  • Big Data Engineer

    1 month ago

    Singapur, Singapore Virtusa Full time

    Big Data EngineerVirtusa is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop data pipelines using ETL tools...

  • Big Data Developer

    4 weeks ago

    Singapur, Singapore KERRY CONSULTING GROUP PTE. LTD. Full time

    Job Title: Big Data DeveloperKerry Consulting Group PTE. LTD. is seeking a highly skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and implementing big data solutions using Cloudera Distributed Hadoop (CDH), Hive, Pig, Sqoop, Flume, Oozie, MapReduce, YARN, Spark, Storm, and Kafka.Key...

  • Big Data Engineer

    4 weeks ago

    Singapur, Singapore Virtusa Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using big data technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design and develop big data...

  • Big Data Developer

    4 weeks ago

    Singapur, Singapore KERRY CONSULTING GROUP PTE. LTD. Full time

    Roles & ResponsibilitiesKerry is currently hiring a Big Data Developer / Data Modeller that is proficient with Cloudera Distributed Hadoop (CDH), Big Data, Spark, and Informatica. This role will involve strong experience in testing life cycles as well as excellent verbal and written communications skills to add value to the client-facing experiences.If you...

  • Big Data Engineer

    1 month ago

    Singapur, Singapore DBS Bank Full time

    Job SummaryDBS Bank is seeking an experienced Big Data Engineer to join our Group Technology and Operations team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining enterprise-class Big Data applications.Key ResponsibilitiesDesign and develop scalable Big Data architectures using Hadoop, Spark, and other related...

  • Big Data Developer

    1 month ago

    Singapur, Singapore Helius Full time

    Job Title: Big Data DeveloperHelius is seeking a highly skilled Big Data Developer to join our team. As a key member of our data integration team, you will be responsible for designing, developing, and deploying production-grade Talend Big Data jobs that meet our organization's architecture standards.Key Responsibilities:Design and develop Talend Big Data...

  • Big Data Delivery Lead

    2 weeks ago

    Singapur, Singapore DBS Bank Full time

    Job Title: Big Data Delivery LeadDBS Bank is seeking a highly skilled Big Data Delivery Lead to join our Consumer Banking Group Technology team. As a key member of our team, you will be responsible for driving the delivery of big data solutions that meet the strategic goals of the bank.Responsibilities:Collaborate with cross-functional teams to design and...

  • Senior Data Engineer

    1 month ago

    Singapur, Singapore Helius Full time

    Job Title: Senior Data Engineer - Big DataHelius is seeking a highly skilled Senior Data Engineer - Big Data to join our team. As a Senior Data Engineer - Big Data, you will be responsible for designing, developing, and deploying large-scale data processing systems using Talend Big Data version 7+ and Hadoop.Key Responsibilities:Design and develop...

  • Big Data Engineer

    2 weeks ago

    Singapur, Singapore TikTok Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our Data Platform Business Partnering team at TikTok. As a key member of our team, you will be responsible for designing and implementing data tools and applications that drive business growth.Key ResponsibilitiesTranslate business requirements into technical implementation for building...

  • Big Data Engineer

    5 months ago

    Singapur, Singapore Virtusa Full time

    Big Data Engineer - 123101 Description Responsibilities Good understanding and completion of projects using waterfall/Agile methodology. • Good understanding of analytics and data warehouse implementations. • Ability to troubleshoot complex issues ranging from system resource to application stack traces. • Strong SQL, data modelling and data...

  • Data Engineer

    2 weeks ago

    Singapur, Singapore IITMatrix Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at IITMatrix. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable data processing systems using Big Data technologies such as Hadoop, Spark, and NoSQL...

  • Big Data Solutions Engineer

    2 weeks ago

    Singapur, Singapore Nityo Infotech Full time

    Job Title: Big Data Solutions EngineerWe are seeking a highly skilled Big Data Solutions Engineer to join our team at Nityo Infotech. As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:Design and develop scalable...

  • Data Engineer

    2 months ago

    Singapur, Singapore Unison Consulting Pte Ltd Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will be responsible for designing, developing, and implementing Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data.Key Responsibilities:Design and develop...

  • Big Data Development Engineer

    2 weeks ago

    Singapur, Singapore TikTok Full time

    About the TeamTikTok's Tea platform is a cutting-edge analytics platform used by over 10,000 employees globally. As a key member of our global engineering team, you will be responsible for deploying, configuring, and maintaining big data platforms, as well as implementing and optimizing infrastructure for big data storage, processing, and computation.**Key...

  • Data Engineer

    2 months ago

    Singapur, Singapore DBS Bank Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at DBS Bank. As a Data Engineer, you will play a key role in designing, building, and maintaining our Big Data platform.Key ResponsibilitiesDesign and implement scalable data pipelines using Big Data tools and technologiesCollaborate with cross-functional teams to define and deliver...

  • Data Engineer

    2 months ago

    Singapur, Singapore Unison Consulting Pte Ltd Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Unison Consulting Pte Ltd. As a Data Engineer, you will play a critical role in designing, developing, and implementing large-scale data processing pipelines using Spark Scala applications.Key ResponsibilitiesData Processing and IntegrationDesign and develop efficient data...

  • Data Engineer

    2 months ago

    Singapur, Singapore Nityo Infotech Full time

    Job Title: Data Engineer - Big Data SolutionsWe are seeking a highly skilled Data Engineer to join our team at Nityo Infotech. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:Design and develop scalable and efficient data processing...

  • Big Data Delivery Lead

    2 months ago

    Singapur, Singapore DBS Bank Full time

    Job SummaryWe are seeking a highly skilled Big Data Delivery Lead to join our Consumer Banking Technology team at DBS Bank. As a key member of our team, you will be responsible for driving the end-to-end delivery of big data use cases, collaborating with stakeholders to define delivery roadmaps, and ensuring transparency of demand and capacity planning.Key...

  • Data Engineer

    2 weeks ago

    Singapur, Singapore Nityo Infotech Full time

    Job Title: Data Engineer - Big Data SolutionsWe are seeking a highly skilled Data Engineer to join our team at Nityo Infotech. As a Data Engineer, you will play a crucial role in designing, developing, and optimizing big data solutions using Apache Spark, Scala, and Elasticsearch.Key Responsibilities:* Design and develop scalable and efficient data...