Software Engineer - Infrastructure (Mid - Senior)

at Julius — AI Data Scientist

San Francisco, CA / Remote (US; CA)Full-time3+ years$150K - $200KYC-S22

What the role involves

Compensation

Competitive base salary + meaningful equity

Benefits

Health & dental, gym reimbursement, daily team meals, commuter benefit

About Julius

We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes (isolated remote containers) that we manage. We’re revenue‑generating and backed by AI Grant, YCombinator, Bessemer Venture Partners and the founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.

The Role

Build and scale the code‑execution sandboxes that power Julius across cloud environments (AWS and GCP). We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute.

What You’ll Do

  • Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.
  • Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.
  • Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.
  • Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls.

What You Bring

  • Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.
  • Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).
  • Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).
  • Security best practices for containerized, multi‑tenant systems.

Nice to Have

  • gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).
  • You’ve built an AI side project and enjoy tinkering with LLMs.
  • Why Julius
  • Small, senior team; massive impact surface; hard infra problems at meaningful scale.

What they ask for

Amazon Web Services (AWS)Google CloudKubernetesPostgreSQLDistributed SystemsDockerTerraform

About Julius

Julius is an AI Data Scientist that can analyze and visualize massive datasets, perform complex analysis like forecasting and regression, and even train ML models

Full Julius profile

Other roles at Julius

Similar Engineering, Devops elsewhere

jobo is a browser extension. Open this on a computer to install it.