Relying on third-party APIs for AI is becoming unsustainable due to high token costs and the inherent security risk of uploading sensitive data. This will force a market shift toward powerful local hardware for running private, cost-effective models.

While SaaStr's AI agents cost only $257/month to run, the truly significant cost is the executive and founder time spent on their development. This massive 'soft cost' makes buying a pre-built AI solution, even one costing $50k/year, far more economical than building one from scratch.

Historically, a developer's primary cost was salary. Now, the constant use of powerful AI coding assistants creates a new, variable infrastructure expense for LLM tokens. This changes the economic model of software development, with costs per engineer potentially rising by dollars per hour.

Rising token costs from agentic workloads, geopolitical volatility shutting down key models, and predicted long-term compute shortages are creating a compelling business case for enterprises to adopt local AI to reduce vendor dependency and ensure continuity.

Building a custom tool with AI to replace a SaaS subscription seems cost-effective, but building is only 10% of the work. The other 90% is the often-forgotten overhead of maintenance, on-call support, security, and bug fixes that SaaS vendors typically handle.

Howie Lu advises against anchoring AI costs to cheap software subscriptions. Instead, evaluate token costs against the opportunity cost of an equivalent human's time. A $150 agent-written board memo is cheap if it saves days of a CEO's time and produces a superior result.

The current model of paying per AI token is a temporary phase. Drawing a parallel to computing history, any resource constraint that requires payment eventually moves to the user's local device and becomes free. On-device AI processing will follow this pattern, ultimately eliminating token costs.

The high operational cost of using proprietary LLMs creates 'token junkies' who burn through cash rapidly. This intense cost pressure is a primary driver for power users to adopt cheaper, local, open-source models they can run on their own hardware, creating a distinct market segment.

Heavy use of AI agents and API calls is generating significant costs, with some agents costing $100,000 annually. This creates a new financial reality where companies must budget for 'tokens' per employee, potentially making the AI's cost more than the human's salary.