Get your free personalized podcast brief

We scan new podcasts and send you the top 5 insights daily.

While one could fine-tune a custom AI to evade detection, the most capable models are centralized and expensive. This market concentration means most users rely on a few common models (like from OpenAI or Anthropic), making their distinct "fingerprints" easier for detectors like Pangram to identify.

Related Insights

Effective AI detection frames the problem as large-scale authorship identification. By training on paired examples of human versus LLM-generated text on the same prompts, detection models learn to recognize the unique statistical "smell" or stylistic signature of each major AI model.

Despite creating supposedly superintelligent models, leading AI labs still rely on crude access restrictions to prevent 'distillation'—an existential threat where competitors replicate their models. This reveals a critical capability gap: their AI is not yet smart enough to detect and prevent its own theft.

AI detection can identify text from new LLMs because most models share a common "ancestry." They are either trained on the same foundational corpora, like Common Crawl, or fine-tuned with synthetic data from major models, giving them a detectable shared statistical fingerprint.

Large, centralized AI models are vulnerable to 'distillation attacks,' where a smaller model can be trained cheaply by querying the larger one. This technical reality, combined with the moral hypocrisy of creators restricting copying after scraping the internet, strongly suggests a future dominated by decentralized, open-source models.

An analysis suggests most AI startups claiming proprietary tech are just wrappers around major LLMs. This can be verified by 'fingerprinting' their APIs; if a startup's service has the exact same unique, exponential rate-limiting pattern as OpenAI's, it's a clear sign they are just reselling the underlying service.

According to Pangram's CEO, different LLMs have unique "voices." Anthropic's Claude tends to be verbose and hedges statements, while OpenAI's ChatGPT is more curt and favors short, staccato sentences. These stylistic fingerprints allow detection tools to not only identify AI text but also its likely source.

Pangram Labs' detector isn't hard-coded. It's a deep learning model trained on millions of examples. For each human text (e.g., a Yelp review), it sees an AI-generated equivalent, learning the subtle, often inarticulable, differences in word choice and structure that separate them.

A new form of analysis compares the semantic similarities (e.g., diction, phrasing) of outputs from different AI models. This technique is being used to create 'fingerprints' that can suggest if one model was illicitly 'distilled' or trained on the outputs of another, a key concern in the AI arms race.

API providers like Anthropic struggle to differentiate between users distilling models for competitive purposes and those conducting large-scale evaluations. Both activities generate similar high-volume, repetitive API calls, creating a detection challenge that also raises user privacy concerns.

To stay ahead in the cat-and-mouse game of AI detection, Pangram internally develops its own "humanizer" tools—software designed to make AI text undetectable. They use these adversarial tools to train their detection model against the latest evasion techniques, without ever releasing the humanizers publicly.