George Hotz outlines a contrarian AI infrastructure strategy. Instead of expensive enterprise hardware, Tiny Corp plans to use upcoming consumer AMD GPUs, pair them with extremely cheap power in Oregon (~$0.03/kWh), and sell compute tokens on existing platforms. This low-overhead model aims to undercut traditional cloud providers.

As AI agents become more sophisticated, they will autonomously seek out and use the cheapest decentralized services for tasks like storage and processing. This creates a relentless, 24/7 market pressure that will continuously drive down the fundamental costs of computing for everyone.

Unlike compute-rich giants, AppLovin's bootstrapped culture enforces extreme efficiency in its AI infrastructure. Engineers don't have unlimited GPUs, forcing them to optimize code and models for cost and performance. This constraint-driven approach leads to significant cost savings and a lean operational model.

AI applications often have long waiting periods for model responses or user input, but traditional cloud platforms charge for this idle time. Vercel's "Fluid Compute" is designed so customers only pay when the application is actively processing, making it fundamentally more cost-effective for AI workloads.

Projects like BitTensor represent a fundamental threat to the centralized, capital-intensive AI labs. By distributing the model training process via open-source orchestration, they offer an "orthogonal attack vector" that could democratize AI if capital markets stop writing multi-billion dollar checks for compute.

Model performance isn't just about architecture; it's also about compute budget. A less sophisticated AI model, if allowed to run for longer or iterate more times, can often match the output of a state-of-the-art model. This suggests access to cheap energy could be a greater advantage than access to the best chips.

A key challenge with cloud-deployed agents is their lack of cost discipline; they often keep expensive GPU instances running unnecessarily. This is fueling a trend towards using powerful, one-time-purchase local hardware like the DGX Spark for agent development and deployment.

Templar's decentralized AI training model doesn't require specific GPUs. Instead, it defines the validation criteria for a correct output. This forces miners to find the most economically efficient hardware and software combination to solve the problem, a process Sam Dare calls "emergence," where optimal solutions arise from the incentive structure itself.

The success of personal AI assistants signals a massive shift in compute usage. While training models is resource-intensive, the next 10x in demand will come from widespread, continuous inference as millions of users run these agents. This effectively means consumers are buying fractions of datacenter GPUs like the GB200.