Member of Technical Staff, Cloud Orchestration
At a glance
Senior Software Engineering role at Inferact. Singapore · full-time · SGD 200,000–SGD 400,000 base.
techroles summary, based on the employer's posting.
What you'll do
- Build cluster-management and deployment systems that keep vLLM running reliably at large scale
- Make deployments observable, debuggable and recoverable through production monitoring
- Develop infrastructure that lets teams serve AI models with less operational friction
What you bring
- A computer science, engineering or similar degree, or equivalent experience
- Strong Kubernetes and large-scale container orchestration experience, including building custom operators
- Proficiency in Python, Rust or Go, plus infrastructure-as-code tools such as Terraform or Helm
- Experience operating GPU clusters and troubleshooting hardware, across cloud platforms or on-premises
Who this fits
This senior role suits an engineer focused on cloud orchestration and reliable ML infrastructure. You’ll work onsite in Singapore. Visa sponsorship is considered case by case.
From the employer
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
About the Role
We're looking for an cloud orchestration engineer to build the operational backbone that keeps vLLM running reliably at massive scale. You'll design the systems for cluster management, deployment automation, and production monitoring that enable teams worldwide to serve AI models without friction. You'll ensure that vLLM deployments are observable, debuggable, and recoverable, turning operational complexity into infrastructure that just works.
Skills and Qualifications
Minimum qualifications:
Bachelor's degree or equivalent experience in computer science, engineering, or similar.
Strong experience with Kubernetes and container orchestration at scale.
Experience designing and implementing custom Kubernetes operators.
Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc).
Experience managing GPU clusters and debugging hardware issues.
Ability to work across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure.
Preferred qualifications:
Experience with ML-specific orchestration tools (Ray, Slurm).
Knowledge of GPU scheduling, multi-tenancy, and resource optimization.
Familiarity with vLLM deployment patterns and configuration.
Track record of improving operational reliability for ML systems.
Bonus points if you have:
Experience deploying inference systems on large-scale GPU (1,000+) clusters.
Logistics
Location: This role is based in Singapore.
Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is S$200,000 to S$400,000 annually + equity.
Visa sponsorship: We sponsor visas on a case-by-case basis.
Benefits: Inferact offers a generous benefits package, including medical, dental, and vision coverage.
Software Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Software Engineering
Find me workBy the team behind techroles.