Andrej Karpathy:AI agents are inspiring but may still take years to build product

四个模块
- 规划 Planning
- 分解(Decomposition):将大任务拆分为可解决的小任务
- Chain of Thought
- Chain of Tree
- 改进(Refinement)
- 自我反思,从错误中总结经验
- ReAct:Thought → Action → Observation …Loop
- 记忆 Memory
- 短期记忆 Short-term Memory
- In Context learning
- 长期记忆 Long-term Memory
- 向量数据库
- Embedding + 语义搜索 Semantic Search
- 工具 Tools
- Web access 接入互联网
- APIs:Plugin
- Execute code:Code Interpreter
- 操纵 Steering
- Function calling
面临的挑战
上下文窗口
长期任务的计划