
Staff Platform Engineer
8 hours ago
CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of operations, including but not limited to Counter-terrorism and Computer NetworkDefence. We are looking for talented Senior Big Data Platform Staff Engineer. Join the awesome CSIT family and use cutting-edge technologies to protect the nation.
Role
We are seeking an experienced Big Data Platform Staff Engineer to join our team, responsible for managing and optimizing our Big Data infrastructure platform. The successful candidate will have a deep understanding of Big Data technologies, architectures, and systems, as well as experience with managing large-scale data processing and analytics environments. The role will involve designing, implementing, and maintaining the Big Data infrastructure platform, ensuring high availability, scalability, and performance.
Responsibilities
Design, implement, and manage the Big Data infrastructure platform, including Hadoop, Spark, NoSQL databases, and data lakes.
Manage Big Data clusters, including monitoring, troubleshooting, and optimizing cluster performance, as well as managing job scheduling and resource allocation.
Design and implement storage solutions for Big Data workloads, including HDFS, S3, and other object storage systems.
Ensure the security and governance of the Big Data infrastructure platform, including managing access controls, implementing data encryption, and conducting regular security audits.
Collaborate with data engineers and data scientists to optimize Big Data application performance and provide technical support and guidance on using the Big Data infrastructure platform.
Plan and manage Big Data resource capacity, including forecasting, procurement, and deployment of new hardware and software.
Requirements (Minimum Qualifications)
Bachelor's degree in Computer Science, Engineering, or a related field.
At least 8 years of experience in managing Big Data Platforms. Proven experience with technologies like Spark, Kafka, Hadoop, Elastic Stack, Kudu, NiFi and Kafka.
Strong knowledge of Big Data architectures, including data lakes, data warehouses, and data pipelines.
Experience in troubleshooting and resolving issues of the Big Data stack, ranging from hardware, networking, operating system to software
Strong understanding of data storage systems, including HDFS, S3, and other object storage systems.
Experience with scripting languages, such as Python, Scala, or Java.
Experience in managing physical and virtual infrastructures.
Experience in supporting search workloads in multi-terabytes and billions of records.
Experience in distributed systems.
Proven experience in using DevOps tools and CI/CD pipelines effectively.
Experience in leading engineering teams.
Nice to Have
Certifications in Big Data, such as Hadoop Certified Developer or Spark Certified Developer.
Experience with cloud-based Big Data platforms, such as AWS EMR, Google Cloud Dataproc, or Azure HDInsight.
Experience with machine learning and deep learning frameworks, such as TensorFlow, PyTorch, or Scikit-learn.
Familiarity with containerization, such as Docker or Kubernetes.
Experience with agile development methodologies and version control systems, such as Git.
Experience with cloud computing platforms, such as AWS, Azure, or Google Cloud.
Experience with containerization, such as Docker or Kubernetes.
Why join us?
The work is purposeful and meaningful
You will work with the best engineers
We work with modern technologies and tech stacks
We have excellent engineering culture and work-life balance
We aspire to engineering and operational excellence
We empower to innovate
We grow together as a family
As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.
#J-18808-Ljbffr
-
Staff Platform Engineer
2 weeks ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full timeJoin to apply for the Staff Platform Engineer - Big Data Platform Management role at Centre for Strategic Infocomm Technologies (CSIT)Continue with Google Continue with Google 1 month ago Be among the first 25 applicants Join to apply for the Staff Platform Engineer - Big Data Platform Management role at Centre for Strategic Infocomm Technologies (CSIT)CSIT...
-
Staff Platform Engineer
5 days ago
Central Singapore Emprego SG Full time**Location** Singapore, Central Singapore **Job Type** Permanent **Salary** $13,000 - $20,000 Per Month **Date Posted** 1 hour ago Additional Details **Job ID** 11914 **Job Views** 1 Roles & Responsibilities **ROLE SYNOPSIS**: You will be part of bp’s Data & Analytics Platform organisation, the group responsible for the platforms and services...
-
Staff Platform Engineer
1 week ago
Singapore Centre for Strategic Infocomm Technologies Full timeCSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of operations, including but not limited to Counter-terrorism and Computer NetworkDefence. We are looking for talented Senior Big Data Platform Staff Engineer. Join the awesome CSIT family and use cutting-edge technologies to protect the...
-
Staff Platform
4 days ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full timeOverview Join to apply for the Staff Platform & SRE Engineer (Workplace Technology)role at Centre for Strategic Infocomm Technologies (CSIT) . You will be leading the design, development, integration, and operations of digital workplace platforms and end-user technologies. Drive platform architecture, software and security engineering practices, and site...
-
Ai Platform Engineer
3 days ago
Singapore DELL GLOBAL B.V. (Singapore Branch) Full timeJoin us to do the best work of your career and make a profound social impact as a **AI Platform Engineer - Technical Staff**on our **Software Engineering**Team in **Singapore**. **What you’ll achieve** As a Technical Staff AI Platform Engineer, you will be a senior technical leader responsible for shaping and driving the architecture of Dell’s AI...
-
AI Platform Engineer
8 hours ago
Singapore DELL GLOBAL B.V. (Singapore Branch) Full timeOverview The Software Engineering team delivers next-generation software application enhancements and new products for a changing world. Working at the cutting edge, we design and develop software for platforms, peripherals, applications and diagnostics — all with the most advanced technologies, tools, software engineering methodologies and the...
-
Staff Platform Engineer
2 days ago
Singapore Centre for Strategic Infocomm Technologies (CSIT) Full timeJoin to apply for the Staff Platform Engineer - Big Data Platform Management role at Centre for Strategic Infocomm Technologies (CSIT) Continue with Google Continue with Google 1 month ago Be among the first 25 applicants Join to apply for the Staff Platform Engineer - Big Data Platform Management role at Centre for Strategic Infocomm Technologies...
-
Ai Platform Engineer
2 weeks ago
Singapore Dell Full timeJoin us to do the best work of your career and make a profound social impact as a AI Platform Engineer - Technical Staff on our Software Engineering Team in Singapore. **What you’ll achieve** As a Technical Staff AI Platform Engineer, you will be a senior technical leader responsible for shaping and driving the architecture of Dell’s AI platform. You...
-
Staff Platform
2 weeks ago
Singapore Centre for Strategic Infocomm Technologies Full timeYou will be leading the design, development, integration, and operations of digital workplace platforms and end-user technologies. Drive platform architecture, software and security engineering practices, and site reliability engineering (SRE) to ensure secure, scalable, and optimized systems. Champion modern engineering methodologies and contribute to...
-
Staff Platform
2 weeks ago
Singapore Centre for Strategic Infocomm Technologies Full time $90,000 - $120,000 per yearYou will be leading the design, development, integration, and optimizing enterprise-grade communication and collaboration platforms. Drive platform architecture, software and security engineering practices, and site reliability engineering (SRE) to ensure secure, scalable, and optimized systems. Champion modern engineering methodologies and contribute to...