Knowledge Compilation Over Knowledge Retrieval: Karpathy's New Second Brain Paradigm
You've been collecting articles for three years. A thousand notes in Notion. But when you actually need something, you open a new Google tab.The problem isn't t
Long-form analysis at the intersection of AI and life sciences — all spells, sorted by time.
You've been collecting articles for three years. A thousand notes in Notion. But when you actually need something, you open a new Google tab.The problem isn't t
RAG has become the default architecture for AI applications. Chunk your documents, store them in a vector database, retrieve the relevant pieces, hand them to t
"Just tell the AI to write it" has become standard practice for engineers. But data shows that 45% of AI-generated code contains security vulnerabilities. The p
Every time you send a message to an AI, the system re-reads everything you've ever said in that conversation. Imagine calling customer support and having to re-
ChatGPT, Claude, Gemini — every modern AI runs on a Transformer at its core, and the soul of the Transformer is the attention mechanism. It uses three matrices
If you thought having AI write your code was impressive, what comes next will force you to recalibrate your definition of "impressive": there is now an AI whose