Knowledge Management in the AI Era
The Central Problem
How do you maintain a body of knowledge that AI can use effectively over time — not just for a single session, but persistently, with cross-references, synthesis, and cumulative learning?
Traditional note-taking assumes human readers. AI-native knowledge management assumes AI readers — a fundamentally different design challenge.
The LLM Wiki Pattern
This vault uses the LLM Wiki pattern, inspired by Andrej Karpathy’s work on LLM-based personal knowledge systems.
Core Architecture
Raw Sources (raw/) → Immutable, AI reads but never modifies
↓ Ingest
Wiki (wiki/) → LLM-written and maintained
├── sources/ → Source summaries
├── entities/ → People, companies, concepts
├── topics/ → Synthesized domain knowledge
├── analyses/ → Custom comparisons, insights
└── index.md + log.md → Schema and tracking
Why This Beats Traditional RAG
RAG (Retrieval-Augmented Generation): On each query, retrieve relevant documents from a corpus and add to context.
Problems with RAG:
- No cross-references between documents
- Retrieved documents may conflict with each other
- No synthesis — just retrieval
- Same information retrieved multiple times in different forms
LLM Wiki advantages:
- Cross-references already exist in the wiki
- Contradictions are flagged and resolved
- Synthesis is cumulative — built once, maintained incrementally
- Knowledge is compiled for reuse, not re-derived on each query
Karpathy’s position: RAG is dead. The context window problem it solves will disappear as windows grow. The real solution is a compiled, maintained knowledge artifact.
Karpathy’s Method — Six Steps
From “AI大神卡帕西的知识管理方法刷屏,用Get笔记六步抄作业”:
- Capture everything — Save articles, notes, screenshots without judgment
- Use AI to process — Let AI read and extract key insights
- Link and cross-reference — Connect new information to existing knowledge
- Review regularly — AI-generated summaries keep knowledge fresh
- Use for queries — The wiki becomes the knowledge source for AI
- Iterate and improve — Each interaction refines the knowledge base
Key Tools in His Stack:
- nanochat — Minimal ~500-line ChatGPT implementation as teaching tool
- nano RAM — Minimal working memory demonstration
- Personal OS for AI agents — File system as database
Obsidian as the Foundation
Obsidian is the preferred tool for LLM Wiki implementations because:
| Feature | Benefit |
|---|---|
| Local Markdown files | No lock-in, git-versionable |
| Wiki-links | Native cross-referencing |
| Dataview plugin | Frontmatter queries for dynamic organization |
| Graph view | Visualize knowledge connections |
| Web Clipper | Save web content directly |
| Templates | Consistent note structure |
Key Obsidian Plugins for AI Knowledge Management:
| Plugin | Purpose |
|---|---|
| Dataview | Query notes by frontmatter tags/dates |
| Web Clipper | Save articles with one click |
| Templater | Structured note templates |
| Graph View | Visualize connections |
| Local REST API | Expose vault to AI agents |
Graphify — Knowledge Visualization
Graphify (71.5x improvement claim) converts Obsidian notes into knowledge maps:
- Parses all vault notes
- Identifies entities, concepts, relationships
- Generates visual knowledge graphs
- Highlights bridge concepts (connecting different domains)
- Makes implicit relationships explicit
Use case: When starting a new project, use Graphify to see all existing related notes — surfacing connections humans might miss.
Context Engineering — Designing AI’s Information Diet
The most sophisticated knowledge management systems are designed with context engineering in mind:
The principle: LLMs don’t treat all context equally. Information earlier in the context gets more “attention weight.” System prompts (like SOUL.md, AGENTS.md) should be written to be read first and carry the most weight.
Structured context hierarchy (from OpenClaw):
- Identity (SOUL.md) — Who is the agent? What are its values?
- Operations (AGENTS.md) — What rules govern its work?
- Skills (loaded on demand) — What specific capabilities does it need now?
- Shared context — What do multiple agents need to know?
The “Second Brain” Reborn
The “Building a Second Brain” (BASB) movement (Tiago Forte) predates the AI era but has been completely transformed by it:
| BASB (Pre-AI) | AI-Native |
|---|---|
| Notes for human future self | Notes for AI agents |
| Progressive summarization | AI synthesizes continuously |
| Organize by project/action | Organize by entity/concept |
| Retrieve when needed | Inject proactively |
The key shift: the second brain is no longer for human retrieval — it’s for AI context. This changes what makes a note “good”: not how useful it is when re-read, but how useful it is when injected into an AI’s context window.
Practical Implementation in This Vault
This vault follows the LLM Wiki schema in CLAUDE.md:
raw/: Immutable sources — never modifiedwiki/: LLM-owned and maintained — the compiled knowledgewiki/log.md: Activity tracking — what was ingested, whenwiki/index.md: Master navigation — all pages in one place- Frontmatter: YAML metadata for Dataview queries
Ingest workflow: New source → Read → Extract insights → Create/update wiki pages → Update index → Log
Key Tools & Systems
LLM Wiki Implementations
| Tool | Description | Link |
|---|---|---|
| Graphify | 知识图谱生成,71.5x token 节省 | Graphify |
| GBrain | YC CEO 开源的全息记忆系统 | GBrain |
| LLM Wiki | 跨平台桌面应用(3300+ Stars) | 2026-04-29-LLM-Wiki-OpenSource |
| Wechat-Cli | 微信聊天记录导入 Wiki | Wechat-Cli |
Knowledge Management Tools
| Tool | Description | Link |
|---|---|---|
| NotebookLM | Google 的知识利用工具 | NotebookLM |
| Cubox | 个人阅读记忆系统 | Cubox |
| Obsidian Skills | AI 智能体精通 Obsidian | 2026-03-08-Obsidian-Skills-AI-Knowledge-Management |
Second Brain Systems
| System | Core Concept | Source |
|---|---|---|
| Karpathy V2.0 | 三步编译法 + 复利效应 | 2026-04-07-Karpathy-LLM-Wiki-Second-Brain |
| Get笔记六步法 | 对话式实现 Karpathy 方法 | 2026-04-07-Karpathy-GetNote-Six-Steps |
| GBrain | 三层记忆 + 全息记忆 | 2026-04-13-YC-CEO-GBrain-OpenSource |
三层架构核心概念
raw/ → wiki/ → outputs/
raw/ # 原始资料,不做修改
articles/ # Web Clipper 剪藏的文章
podcasts/ # 播客转录
tweets/ # 推文收藏
wiki/ # 编译产物,由 LLM 维护
summaries/ # 逐篇三步编译摘要
concepts/ # 概念条目
indexes/ # 自动维护的索引
outputs/ # 运行时输出
qa/ # 问答沉淀
health/ # 健康检查报告
三步编译法
- 浓缩(第一性原理 + 剃刀法则):抓主线,用剃刀法则删减
- 质疑(芒格反驳法):逻辑链检查、前提假设、不适用场景
- 对标(它山之石可以攻玉):跨域类比、迁移应用
AI Deep Research Methodology
Anthropic 的 Research(深度研究)模式展示了 AI 如何进行系统性知识调研:
- 任务拆解:将宽泛问题分解为研究矩阵(层级 x 内容类型 x 行业 x 语言)
- 广度搜索:大量短关键词建立全景认知(找到地图)
- 深度搜索:围绕关键节点深入展开(案例深挖)
- 交叉验证:同一数据点 2-3 来源确认
- 寻找原始来源:从二手报道追溯到一手资料(X 原帖、学术论文 PDF)
- 填补空白:发现维度缺失后补搜
- 综合与结构化:上百数据点整合为有内在逻辑的叙事
信息优先级:一手 > 专业垂直 > 主流媒体 > 二手分析。主动寻找批判性反叙事平衡 VC 乐观叙事。
详见 ../sources/深度搜索如何实现。这对 LLM Wiki 的 Query 工作流有直接参考价值。
Enterprise Deep Research Backend Pattern (NVIDIA AI-Q)
NVIDIA AI-Q (source) turns deep research into a deployed knowledge pipeline rather than an improvised prompt workflow. Compared with generic web research, AI-Q emphasizes enterprise constraints:
- Data stays where it lives: AI-Q can run inside the same governed environment as internal documents.
- Auth-aware retrieval: MCP servers can be connected with service accounts or signed-in user tokens.
- Clarification before retrieval: a human-in-the-loop clarifier resolves ambiguity before long-running research begins.
- Cited reports as output: the harness receives structured, source-attributed synthesis rather than raw document access.
- Evaluated research quality: FreshQA, Deep Research Bench, DeepSearchQA, and local eval harnesses make research quality measurable.
For an LLM Wiki, the lesson is that “deep research” should be treated as a workflow with routing, source attribution, evaluation, and audit logs—not merely as a longer answer.
Related Pages
- Andrej Karpathy — Originator of the pattern
- Steph Ango — Obsidian CEO, Obsidian Skills author
- AI Agent Memory — How agents use knowledge
- Skills & MCP — Tools for knowledge extension
- OpenClaw — OpenClaw’s knowledge integration
Sources
- Karpathy LLM Wiki 第二大脑 V2.0
- Get笔记六步抄作业
- YC CEO GBrain 开源
- Wechat-Cli 导入 Wiki
- Graphify 知识地图
- LLM Wiki 开源实现
- Obsidian Skills
- Obsidian Skills 深度解析
- Obsidian 小而美
- 投资人70天龙虾协作
- NotebookLM 对比
- Cubox CLI
- Karpathy CLAUDE.md 原则验证
Related Sources
- LLM-Wiki-OpenSource
- Karpathy 的 AI 知识库 理念,已经有人开源在 GitHub 上了。-2026-04-29
- 一个CLAUDE霸榜GitHub第一,蒸馏自Karpathy,6万码农抄作业-36氪-2026-04-21
- Kimi K2.6 + Hermes 实测!Karpathy同款保姆级教程来了-2026-04-21
- [[../sources/2026-04-18-Alan の分享 🧠 Obsidian Brain OS LLM Wiki 推荐|[Alan の分享] 🧠 Obsidian Brain OS [LLM Wiki 推荐]-2026-04-18]]
- Karpathy 又整活了:以后不用分享代码了,直接分享「Idea」!-2026-04-18
- 精简CLAUDE:从 Claude Code 源码机制验证Karpathy 的四条原则技术正确性-2026-04-16
- Karpathy-CLAUDE-MD-Principles
- Wechat-Cli:将微信聊天记录导入 Karpathy 的 LLM Wiki-2026-04-13
- Wechat-Cli-Karpathy-LLM-Wiki
- Karpathy 亲手终结了RAG的草莽时代-2026-04-07
- Karpathy-LLM-Wiki-Second-Brain
- Karpathy-LLM-Wiki-终结RAG草莽时代
- Karpathy又双叒叕发新概念了,这次我替你找到了那个产品-2026-04-07
- Karpathy-GetNote-Six-Steps
- 收藏 2000 篇文章却从没看过?用 Karpathy 的 LLM + Obsidian 思路,一晚上把我的「第二…
- 我用 Karpathy 的方法,2 小时建了一个太空经济知识库-2026-04-06
- Karpathy强推,大厂抢着「复古」命令行,Star数全都上千了-2026-04-06
- Meta 放出大招:让 AI 实现自我进化,Karpathy 的 autoresearch 沦为小弟-2026-0…
- 我用 Claude 写周报,结果被老板骂了——后来我用 Karpathy 的 autoresearch 方法,把 …
- Karpathy刚开源的autoresearch,我拿来优化龙虾skill,成功率从56%飙到92%-2026-0…
- 刚刚,Karpathy紧急删库!AI职业末日图爆火,6000万白领岗危了-2026-03-17
- 刚刚,Karpathy惊呼「后AGI」!AI通宵狂改110次代码,他去蒸桑拿-2026-03-10
- 300万人围观,Karpathy怒喷OpenClaw。然后推荐了一个500行的替代品。-2026-02-27
- Karpathy-OpenClaw-NanoClaw
- 别再学做App了:Karpathy预言Agent将淘汰App Store,软件进入“用完即丢”时代-2026-02-22
- 学AI别再刷朋友圈!AI大神Karpathy的92个信源公布了-2026-02-08
- 软件行业正在发生9级大地震!Andrej Karpathy也感到焦虑了:他从未感觉如此落伍-2025-12-27
- AI大佬Karpathy焦虑了:作为程序员,我从未感到如此落后-2025-12-27
- Andrej Karpathy 2025年度重磅复盘:我们在召唤幽灵!-2025-12-22
- Karpathy 一夜 5000+ Star 的有趣项目:LLM Council-2025-12-18
- Karpathy 在 Vibe Coding 什么?他把 LLM 变成“评审团”和“读书伴侣”-2025-12-16
- Andrej Karpathy:做个好人,未来的 LLM 正在看着你-2025-12-15
- Karpathy-HN-Time-Capsule
- 12-11 - Karpathy 发布短文 - OpenAI 加强模型防御能力 - Gemini 3 Deep T…
- 看完 Karpathy 这条推文,我找到了 AI 创业的筛选标准-2025-11-20
- Google悄悄上线Code Wiki,让你在一个页面理解整个仓库-2025-11-16
- 听了Andrej Karpathy最新2小时访谈,我对Agent彻底祛魅了-2025-10-20
- AI赛博活佛Andrej Karpathy最新访谈:我学到了他最核心的思维方式-2025-10-20
- Andrej Karpathy 开炮:智能体都在装样子,强化学习很糟糕,AGI 十年也出不来-2025-10-18
- Karpathy-nanochat-Alibaba
- 8000行Python+Rust手搓ChatGPT,日收14.5k星!Karpathy:Agent只会帮倒忙-20…
- Karpathy-nanochat-8000-lines
- 10-14 - OpenAI 宣布正在自主设计芯片 - Karpathy 发布新项目:nanochat!-2025…
- Karpathy-nanochat-OpenAI-Chip
- Karpathy-nanochat
- Karpathy-nanochat-100USD
- 100美元、8000行代码手搓ChatGPT,Karpathy最新开源项目爆火,一夜近5k star-2025-1…
- 新鲜出炉!Andrej Karpathy全新项目来了:从零手搓一个ChatGPT-2025-10-14
- Karpathy-nanochat-100-chatgpt
AIHOT — Information Curation System (2026-05)
From AIHOT: A practical example of AI-assisted knowledge management for content creation. Monitors 168 sources, uses DeepSeek V3.2 for pre-screening and V4 Pro for 5-dimension scoring. Key lesson: iterated scoring 11 times, ultimately separating model scoring from code-based decision making. Model only does scoring; weighting, thresholds, and curation handled by deterministic code. Prompt reduced from 600 lines to 200 lines.
Academic Writing as Knowledge Management (2026-05)
From nature-skills: Packaging Nature-standard writing rules into AI skills (figure generation, polishing, citation search, paper-to-PPT, data compliance). Core philosophy: “Scientists’ time should be spent on science” — automates the “unscientific but important” manual work.
研究助理型知识库与私有数据路线之争 [2026-08-06]
- 研究助理型知识库:Claude Code 9h 知识库——Claude Code 长会话搭建 Obsidian 四层库(papers/concepts/ideas/surveys),每日自动”选文→精读→推送→反馈→回写”闭环;“主干节点”(高链接概念)成为生长中心。与本 vault LLM Wiki 高度同构,但缺不可变 raw 层(溯源/防幻觉弱)。
- 内容生产导向(桑梓三库法):经历/成绩/风格三库,查询时上传文件的无状态喂料——与编译型路线对照,见 源页。
- 私有数据 Deep Research 的路线之争:DeepSearcher(Zilliz,LLM + Milvus 向量检索,数据不出域)代表 RAG 路线;本页既有的 Karpathy “RAG 已死、编译型知识库” 立场为对立路线。私有数据深度研究最终走向向量检索还是知识编译,值得跟踪(星标数矛盾已在实体页标注)。
KnowFlow vs Linkly AI:学习流程原生化 vs 文献库 MCP 接入 [2026-08-10]
| 维度 | KnowFlow | Linkly AI | |------|-----------|------------| | 问题规模 | 单篇学习流程 | 大规模文献库(1000+ 篇论文) | | 流程 | 剪藏 → 清洗 → 摘要 → 知识图谱(Mermaid)→ 测验 | search → outline → read 渐进式消费 | | 接入方式 | Obsidian 原生插件(侧边栏随当前笔记切换四种上下文模式) | MCP Server(暴露给 Claude、Cursor 等任意 Agent 客户端) | | 产物落点 | Markdown/frontmatter(本地、弃用无锁定) | 本地文件原话引用(反幻觉) | | 成熟度 | 0.1.0 闭源,承诺 1.0.0 开源 | 产品方自述配置流程,无第三方基准 |
两者代表 AI 时代知识管理的两种互补形态:单篇深度学习原生长进笔记环境(把 AI 能力搬进数据所在地),大规模语料服务化供任意 Agent 消费(把数据经标准协议暴露出去)。共同出发点是消灭工具切换与手工上下文传递的摩擦——KnowFlow 作者从 Codex Skills 迁移回 Obsidian 插件,正是因为”每处理一篇文章都要离开 Obsidian 重新描述文件”。对照分析见 AI 工作流的原生化模式。