Big Data Engineer

2 weeks ago


Singapore NETEASE INTERACTIVE ENTERTAINMENT PTE. LTD. Full time

NetEase Games is one of the largest game developers worldwide by size and revenue. Over the years, NetEase Games has been focusing on developing high quality content and providing the best experience for gamers all around the world. So far, the company has more than 100 games in operation. Its recent games include Naraka: Bladepoint, Knives Out, Onmyoji, Identity V, Harry Potter: Magic Awakened, etc.

Along with its many creative partnerships, NetEase is expanding its portfolio of studios, including Bad Brain Game Studios, Jackalyptic Games, Jar of Sparks, and Quantic Dream.

**Responsibilities**:
Responsible for the operation and maintenance of the big data platform on public clouds, including deployment, management, troubleshooting, and optimization of open-source components and in-house platforms to ensure platform stability.

Understand the architecture and business processes of the big data platform, resolve issues encountered during business operations, and identify and resolve performance bottlenecks.

Develop scripts and tools for automation in operations, including monitoring, alerting, and fault handling.

**Job Requirements**:
Bachelor's degree or above with at least 2 years of relevant work experience.

Familiarity with the Linux operating system, TCP/IP fundamentals, and experience in system tuning are preferred.

Proficiency in Shell and Python scripting languages.

Familiarity with the architecture of public cloud platforms such as AWS, GCP, and possess skills in cloud-based business architecture design and operations.

Familiarity with operations systems, skilled in problem-solving, independent resolution of common issues, and experience in managing large-scale clusters are preferred.

Proactive, responsible, meticulous, with strong learning and communication abilities.

Familiarity with the architecture and basic principles of big data components such as Hadoop, Kafka, Flink, Elasticsearch are preferred.


  • Big Data Engineer

    2 weeks ago


    Singapore THE EDGE PARTNERSHIP HOLDINGS PTE. LTD. Full time

    **Big Data Engineer - 1-year contract **Key Responsibilities** - **Programming**:Utilize Java, Scala, or Python for efficient coding and problem-solving. - **Big Data Tools**:Work with various big data processing tools and techniques, including Airflow and Ctrl-M. - **Database Knowledge**:Leverage experience with RDBMS, data warehouses, and Unix shell...

  • Data Engineer

    2 weeks ago


    Singapore NodeFlair Full time

    **Job Summary**: **Salary** S$5,000 - S$9,000 / Monthly **Job Type** **Seniority** Mid **Years of Experience** At least 5 years **Tech Stacks** Snowflake yarn Oracle Shell Script CI Shell UNIX Presto Java MSSQL Airflow Spark Linux Python Astek is proposing an opportunity for **Data Engineer** (Big Data) to support our project based in**...

  • Big Data Engineer

    4 days ago


    Singapore IITMATRIX Full time

    We are looking for a skilled **Big Data Engineer** to join our dynamic team. You will be responsible for designing, developing, and optimizing data solutions within the Big Data ecosystem. This role involves working with large datasets, ensuring high performance at scale, and collaborating with cross-functional teams to deliver data-driven insights and...

  • Data Engineer

    2 weeks ago


    Singapore TALENTSIS PTE. LTD. Full time

    We are looking for a skilled **Data Engineer**with a focus on **Big Data**to design, develop, and manage large-scale data processing systems. If you're passionate about working with big data technologies and driving impactful solutions, we want to hear from you. **Key Responsibilities**: - Build and maintain big data pipelines using technologies like...

  • Big Data Engineer

    2 weeks ago


    Singapore SAKSOFT PTE LIMITED Full time

    Experience: 9+ Years Role: Big Data Engineer Skills from Primary Skill Cluster Spark, Big Data, Hive, Java, 5+yrs with hands-on on Java is Must Database knowledge and should be able to write the queries is Must. Handson on Unix Shell scripting is Must. Knowledge in Spark SQL (Good to have). Understand on Regulatory reporting(Good to have). Design...

  • Big Data Engineer

    20 hours ago


    Singapore AlgoriX Technology Pte. Ltd. Full time

    **Responsibilities** The Big Data Engineer is responsible for analyzing big data and optimizing the performance of our online advertising delivery system. They are also responsible for the research and development of the advertising system’s offline and real-time data streams. **Requirements**: - Bachelor’s degree or above, majoring in Computer...


  • Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    **SINGAPORE, SINGAPORE /** **SOFTWARE ENGINEERING - DATA PLATFORMS /** **FULL-TIME** - Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of...


  • Singapore Centre for Strategic Infocomm Technologies (CSIT) Full time

    Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion...


  • Singapore QUESSCORP HOLDINGS PTE. LTD. Full time

    **Job Description**: - Design and implement scalable data pipelines to collect, process, and store large volumes of structured and unstructured data. - Ensure data quality, integrity, and consistency across various data sources. - Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that...

  • Senior Engineer

    2 weeks ago


    Singapore Experis Full time

    **Senior Engineer (Big Data)**: - Location- Singapore- Job reference- BBBH130672_1691631585- Salary- Negotiable- Consultant name - Canete Christopher Miguel Consultant contact no. - EA License No. - 02C3423 - Consultant Registration No. - R23112144 **Job Description**: Experience in designing, creating, and managing large-scale data processing...