TPU Performance Engineer for Cutting-Edge Inference

10 hours ago

singapore INFERACT SINGAPORE PTE. LTD. Full-time
Inferact Singapore is seeking a TPU performance engineer to advance vLLM as a premier inference engine on Google TPUs. You will develop and optimize TPU backends, compiler integrations, runtime paths, and benchmarking infrastructure using JAX, XLA, Pallas, and related tooling to achieve frontier inference performance on TPU hardware. You will work at the boundary of inference systems, kernels, compilers, and hardware architecture, delivering production-ready model serving with clear correctness,