"LLM Council"

Yesterday afternoon, Andrej Karpathy posted llm-council on github:

His description:

The idea of this repo is that instead of asking a question to your favorite LLM provider (e.g. OpenAI GPT 5.1, Google Gemini 3.0 Pro, Anthropic Claude Sonnet 4.5, xAI Grok 4, eg.c), you can group them into your "LLM Council". This repo is a simple, local web app that essentially looks like ChatGPT except it uses OpenRouter to send your query to multiple LLMs, it then asks them to review and rank each other's work, and finally a Chairman LLM produces the final response.

Though I have too many other things to do, I'm tempted to install it and see what the Council thinks of Grok's weird recent re-programming:

Incredible headline.

[image or embed]

— Tim Onion (@bencollins.bsky.social) November 20, 2025 at 5:01 PM

(…which apparently is real?…)

I may succumb to temptation, if someone else doesn't do it first…