Skip to main content

A lightweight framework for building LLM-based agents

Project description

👋 join us on 𝕏 (Twitter), Discord and WeChat

Getting Started

Please see the overview for the general introduction of Lagent. Meanwhile, we provide extremely simple code for quick start. You may refer to examples for more details.

Installation

Install with pip (Recommended).

pip install lagent

Run a Web Demo

You need to install Streamlit first.

# pip install streamlit
streamlit run examples/internlm2_agent_web_demo.py

What's Lagent?

Lagent is a lightweight open-source framework that allows users to efficiently build large language model(LLM)-based agents. It also provides some typical tools to augment LLM. The overview of our framework is shown below:

image

Major Features

  • Stream Output: Provides the stream_chat interface for streaming output, allowing cool streaming demos right at your local setup.
  • Interfacing is unified, with a comprehensive design upgrade for enhanced extensibility, including:
    • Model: Whether it's the OpenAI API, Transformers, or LMDeploy inference acceleration framework, you can seamlessly switch between models.
    • Action: Simple inheritance and decoration allow you to create your own personal toolkit, adaptable to both InternLM and GPT.
    • Agent: Consistent with the Model's input interface, the transformation from model to intelligent agent only takes one step, facilitating the exploration and implementation of various agents.
  • Documentation has been thoroughly upgraded with full API documentation coverage.

💻Tech Stack

python

All Thanks To Our Contributors:

Citation

If you find this project useful in your research, please consider cite:

@misc{lagent2023,
    title={{Lagent: InternLM} a lightweight open-source framework that allows users to efficiently build large language model(LLM)-based agents},
    author={Lagent Developer Team},
    howpublished = {\url{https://github.com/InternLM/lagent}},
    year={2023}
}

License

This project is released under the Apache 2.0 license.

🔼 Back to top

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lagent-0.2.2.tar.gz (50.2 kB view hashes)

Uploaded Source

Built Distribution

lagent-0.2.2-py3-none-any.whl (69.7 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page