Software Engineer - Infrastructure (Mid - Senior)
At a glance
Senior Software Engineering role at Julius AI. San Francisco · full-time · $150,000–$200,000 base.
techroles summary, based on the employer's posting.
What you'll do
- Build and run secure container environments for multiple customers, with rapid startup and autoscaling
- Deploy cloud infrastructure using Helm or Terraform, adding SSO, network safeguards and audit records
- Set reliability targets and improve visibility through metrics, traces and logs; lead incident response
- Tune container images, scheduling, networking and costs, then add fair-use and rate controls
What you bring
- You have production experience with Kubernetes and container internals such as Docker or containerd
- You bring solid networking fundamentals and experience with cloud platforms and infrastructure-as-code tools
- You know security practices for container systems shared by multiple tenants
- You have worked with monitoring and logging tools such as Prometheus, Grafana or OpenTelemetry
Who this fits
This role suits a mid- to senior-level infrastructure engineer who wants to own reliability, performance and security for shared compute. The position is based in San Francisco.
From the employer
Compensation: Competitive base salary and meaningful equity
Benefits: Health & dental insurance, gym reimbursement, daily team meals, commuter benefits
We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes (isolated remote containers) that we manage. We’re revenue‑generating and backed by AI Grant, YCombinator, Bessemer Venture Partners and the founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.
The Role
Build and scale the code‑execution sandboxes that power Julius across cloud environments (AWS and GCP). We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute.
What You’ll Do
Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.
Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.
Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.
Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls.
What You Bring
Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.
Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).
Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).
Security best practices for containerized, multi‑tenant systems.
Nice to Have
gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).
You’ve built an AI side project and enjoy tinkering with LLMs.
Why Julius
Small, senior team; massive impact surface; hard infra problems at meaningful scale.
Software Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Software Engineering$150k+
Find me workBy the team behind techroles.