When using LLMs to judge other models' output, they consistently rate towards the middle of the curve, akin to humans giving a generic "7 out of 10." These AI judges are not "spiky" enough, failing to recognize unique or exceptional qualities that a human evaluator with strong taste would identify.

Standard benchmarks are insufficient. A more effective evaluation method is a hybrid approach, weighting a human's qualitative 'taste test' (e.g., 70%) more heavily than an LLM judge's automated score (e.g., 30%). This prioritizes subjective qualities like design, usability, and writing style.

Rather than optimizing solely for performance on standard industry benchmarks, Ideogram focuses on embedding a subjective quality of "taste" into its models. This requires using human designers for evaluation, as they believe current AI is poor at judging aesthetic nuances, giving them a unique creative edge.

Creating AI that can reliably judge aesthetics is a frontier problem. Unlike tasks with clear right or wrong answers, aesthetics is subjective. This lack of a clear, objective benchmark makes it difficult to apply standard model improvement techniques, making it a better fit for Reinforcement Learning from Human Feedback (RLHF).

While AI labs tout performance on standardized tests like math olympiads, these metrics often don't correlate with real-world usefulness or qualitative user experience. Users may prefer a model like Anthropic's Claude for its conversational style, a factor not measured by benchmarks.

AI models excel at coding because correctness is easy to evaluate. Design is harder because "good" is subjective and tied to human taste, making it difficult to create a training feedback loop. Furthermore, design values novelty and cultural context, whereas software engineering prefers established, reliable patterns.

The host's personal "vibe check" rankings of AI models were the inverse of the scores from an automated, LLM-judged benchmark. This highlights the gap between quantitative metrics and subjective human taste, suggesting that relying solely on AI judges misses crucial aspects of quality and real-world usability.

Despite AI's ability to generate functional code, replicating the nuanced, subjective quality of a specific designer's "taste" remains extremely difficult. Felix Lee, after spending weeks attempting to codify his own taste into an AI model with little success, notes it's a significant unsolved challenge.

Current benchmarks focus on whether code passes tests. The future of AI evaluation must assess qualitative, human-centric aspects like 'design taste,' code maintainability, and alignment with a team's specific coding style. These are hard to measure automatically and signal a shift toward more complex, human-in-the-loop or LLM-judged evaluation frameworks.