Senior Software Engineer, Observability
At a glance
Senior Software Engineering role at Together AI. San Francisco · $200,000–$280,000 base.
techroles summary, based on the employer's posting.
What you'll do
- Build a scalable system for metrics, logs and traces, including pipelines that collect telemetry and consolidate logs
- Set up automated alerts and anomaly detection, then define service targets, response guides and predictive analysis
- Create observability tools and infrastructure-as-code with Go, Python, Terraform, Ansible and Helm
- Improve tracing and application monitoring with engineering teams, and lead incident reviews after outages
- Set observability standards for engineering teams
What you bring
- Strong command of Prometheus, Grafana, ClickStack or OpenTelemetry, plus monitoring services on AWS, GCP or Azure
- Proficiency in Go, Python or a similar language, and infrastructure-as-code tools such as Terraform, Ansible or Helm
- Experience building and operating large distributed systems and pipelines for heavy data ingestion and live queries
- A solid grasp of Docker, Kubernetes, and databases including PostgreSQL, MongoDB or Redis
Who this fits
This senior engineering role suits someone focused on observability for distributed systems and high-volume data pipelines. The work includes incident leadership and setting practices, alongside hands-on tooling and infrastructure development. The stated US base salary range is $200,000 to $280,000, plus equity and benefits.
From the employer
About the Role
Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.
The AI Infrastructure team at Together AI is at the forefront of building and scaling the foundational systems that power our generative AI platform. The storage and observability team is crucial for designing, implementing, and maintaining robust distributed storage solutions, ensuring seamless data access and management. They are also responsible for developing comprehensive observability platforms, providing critical insights into system performance and GPU utilization, and proactively identifying and resolving issues.
Responsibilities
- Design and implement a scalable observability platform (metrics, logs, traces) using tools like Prometheus, Grafana, ClickHouse, ClickStack, and OpenTelemetry, including telemetry data pipelines and log aggregation workflows.
- Develop automated monitoring, alerting, and anomaly detection systems, including SLIs/SLOs, runbooks, and predictive analytics for critical services.
- Build and deploy custom observability tools and infrastructure-as-code using Go, Python, Terraform, Ansible, and Helm.
- Collaborate with engineering teams to enhance distributed tracing and application monitoring, and lead incident response with post-mortem analysis.
- Define observability best practices.
Requirements
- Expertise in observability platforms (Prometheus, Grafana, ClickStack, OpenTelemetry) and cloud-native monitoring services (AWS, GCP, Azure).
- Strong programming skills in Go, Python, or similar languages, with proficiency in infrastructure-as-code tools (Terraform, Ansible, Helm).
- Experience designing, operating, and scaling large-scale distributed systems and pipelines for high-volume data ingestion and real-time querying.
- Deep understanding of containerization (Docker) and orchestration (Kubernetes).
- Knowledge of microservices architecture, service mesh technologies, CI/CD pipelines, and GitOps workflows.
- Expertise in managing databases (PostgreSQL, MongoDB, Redis) and time-series databases with high-cardinality data.
Preferred
- Experience monitoring AI/ML infrastructure, GPU clusters, and custom metrics for model performance and training pipelines.
- Background in high-frequency, low-latency systems monitoring, chaos engineering, and reliability testing.
- Contributions to open-source observability projects.
- Familiarity with security monitoring and compliance frameworks.
About Together AI
Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.
Compensation
We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $200,000 - $280,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our privacy policy at https://www.together.ai/privacy
Software Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Software Engineering$200k+
Find me workBy the team behind techroles.