CodeAct vs Lumos

Side-by-side comparison of two AI agent tools

Short answer

  • CodeAct is growing faster: +11 GitHub stars in the last 30 days vs +0 for Lumos.
  • Pick CodeAct for: official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi. Pick Lumos for: code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs".

From GitHub data refreshed daily.

CodeActopen-source

Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji.

Lumosopen-source

Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"

Metrics

CodeActLumos
Stars1.7k477
Star velocity /mo10.8947368421052640.3157894736842105
Commits (90d)00
Releases (6m)00
Overall score0.19286531965040450.13906464371434624

Pros

  • +统一动作空间设计显著提升了智能体在复杂任务上的成功率，相比传统Text/JSON方法提升高达20%
  • +集成Python解释器支持代码执行和动态修正，提供了强大的自我纠错和迭代改进能力
  • +提供完整的开源生态系统，包括训练数据集、预训练模型和部署工具，支持研究和生产应用
  • +Modular architecture with separate planning, grounding, and execution components enables flexible customization and debugging
  • +Unified data format supports multiple task types (web navigation, QA, math, multimodal) within a single framework
  • +Competitive performance with much larger proprietary models while being fully open-source and based on smaller LLAMA-2 models

Cons

  • -需要Python环境和代码执行权限，在受限环境下部署存在安全性考虑
  • -模型推理和代码执行的双重开销可能增加延迟和计算成本
  • -对代码生成质量依赖较高，错误的代码可能导致任务失败或系统异常
  • -Based on LLAMA-2 architecture which is older and may not incorporate latest language model advances
  • -Primarily research-focused with limited documentation for production deployment
  • -Requires significant computational resources for training and may need fine-tuning for domain-specific applications

Use Cases

  • •自动化API集成和数据处理任务，智能体可以动态调用各种API并处理响应数据
  • •复杂的多步骤问题解决，如数据分析、文件操作和系统管理任务
  • •教育和研究场景中的交互式编程助手，能够执行代码并根据结果调整解决方案
  • •Research into open-source language agents and comparative studies against proprietary models
  • •Web navigation and automation tasks requiring multi-step planning and execution
  • •Complex question answering systems that need to break down problems into actionable subgoals
View CodeAct DetailsView Lumos Details

FAQ

Which is more popular, CodeAct or Lumos?
CodeAct has more GitHub stars (1,705 vs 477).
Which is more actively developed, CodeAct or Lumos?
CodeAct had more commits in the last 90 days (0 vs 0).
Should I use CodeAct or Lumos?
Compare their capabilities, limitations and "best for" notes above. Both are open source, so trying each on a small task is the fastest way to decide.