/
© 2026 RiffOn. All rights reserved.

Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

  1. The Growth Podcast
  2. Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI
Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI

The Growth Podcast · Sep 14, 2026

Inside Together AI's $8.3B product team: See their AI stack for shared context, automated PRDs, and agent-driven development.

Together AI Uses AI for Collective Productivity to Avoid 'Launching Slop'

The team intentionally focused on using AI to make the group more productive, not just individuals. This prevents a scenario where everyone generates massive amounts of uncoordinated code and content, leading to chaos rather than progress.

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI thumbnail

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI

The Growth Podcast·19 days ago

At Together AI, Prototypes Generated from 1-Pagers Have Replaced 20-Page PRDs

Moving away from long-form documents, the team writes short 1-2 page PRDs focused on defining the customer problem. The primary output and center of debate is a functional prototype generated by an AI agent from that short document.

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI thumbnail

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI

The Growth Podcast·19 days ago

A Shared Markdown Repo for AI Agent Context Powers Together AI's Product Team

The team centralizes crucial context—product strategy, customer intelligence, meeting outcomes—into a repository of markdown files. This ensures all AI agents and team members pull from a single, up-to-date source of truth, making their outputs relevant and consistent.

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI thumbnail

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI

The Growth Podcast·19 days ago

Together AI Structures AI Skills by Proximity to Code, Not by Individual Preference

A clear rule governs their shared skills repository: skills referencing specific code live within that code's repository. General-purpose skills go into a shared repo. This structure keeps skills co-located with their work, while personal experiments stay in private branches until proven valuable.

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI thumbnail

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI

The Growth Podcast·19 days ago

Together AI's 'Orchestrator' Tool Gives Leadership a Bird's-Eye View of All Product Repos

Instead of forcing everyone to maintain a complex local environment with all team contexts, they built "Orchestrator." This internal tool provides a unified interface to query any team's codebase and use their specific AI skills without deep setup, enabling casual cross-functional work.

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI thumbnail

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI

The Growth Podcast·19 days ago

Together AI's 'PRD Writer' Agent Interviews PMs to Challenge Assumptions

To avoid shallow, AI-generated documents, their custom agent acts as a sparring partner. It conducts a turn-by-turn interview with the Product Manager, using a question bank to probe for tradeoffs and challenge assumptions before drafting the initial PRD.

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI thumbnail

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI

The Growth Podcast·19 days ago

Together AI Uses an 'Agent Evals' Tool to Continuously Test Product Design and Docs

Believing agents are a key user, the company built a tool that runs a suite of tests where an AI agent attempts to complete tasks using their product. This provides immediate, objective feedback on API design, SDK usability, and documentation clarity, replacing slow user testing.

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI thumbnail

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI

The Growth Podcast·19 days ago

AI Compresses Research and Coding, Not Human Coordination

The team reports significant velocity gains from AI but dismisses "3x" claims. While AI compresses research, coding, and testing, it doesn't solve the inherently human and time-consuming aspects of software development like debate, discovery, re-evaluation, and coordination.

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI thumbnail

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI

The Growth Podcast·19 days ago

Together AI Divides Product Work: Humans Handle Strategy, AI Automates Execution

Their workflow clearly separates human-centric tasks from automated ones. PMs are "human in the loop" for discovery, alignment, and defining API abstractions. Once those strategic decisions are made, the process of writing production-ready code is largely automated via AI agents.

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI thumbnail

Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI

The Growth Podcast·19 days ago