🔥LLM4GPT 为大模型而生🔥
Install
pip install -U llm4gpt
Docs
Usages
from llm.qa import QA
from llm.kb import FaissANN
from llm.chatllm import ChatLLM
from llm.utils import llm_load
from meutils.pipe import *
# 解析知识库
texts = []
metadatas = []
for p in Path('data').glob('*.txt'):
texts.append(p.read_text())
metadatas.append({'source': p})
# 文档向量化
faissann = FaissANN(model_name_or_path="shibing624/text2vec-base-chinese")
faissann.add_texts(texts, metadatas)
# 构建pipeline
model, tokenizer = llm_load(model_name_or_path="THUDM/chatglm-6b", device='cpu')
glm = ChatLLM()
glm.chat_func = partial(model.chat, tokenizer=tokenizer)
qa = QA(glm, faiss_ann=faissann.faiss_ann)
qa.get_knowledge_based_answer('周杰伦在干吗')
qa.get_knowledge_based_answer('姚明住哪里')
TODO
-
增加UI
-
增加本地知识库组件
-
增加互联网搜索组件
-
增加知识图谱组件
-
增加微调模块
-
增加流式输出
======= History
0.0.0 (2023-04-11)
- First release on PyPI.
1 maintainer
Metadata
1 maintainer
Release files for llm4gpt 2023.4.21.19.25.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| llm4gpt-2023.4.21.19.25.3.tar.gz | 3.8 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| llm4gpt-2023.4.21.19.25.3-py2.py3-none-any.whl | Python 3, Python 2 | none | any | Details |
Total release size: 3.8 MB
Release files / llm4gpt-2023.4.21.19.25.3.tar.gz
| Download URL | llm4gpt-2023.4.21.19.25.3.tar.gz |
|---|---|
| Size | 3.8 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
2c5cbc8a2110ff17aca101c804b3a7da35a1aa9f3e0dc2e10854fb4f8b2f1cd5
|
|
BLAKE2b-256 checksum How to use checksums |
194a3f0c537b5566efb97f0f83ee225f4d08b3250f2b8ff027da0fbc12d66dfa
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.8.13
|
Release files / llm4gpt-2023.4.21.19.25.3-py2.py3-none-any.whl
| Download URL | llm4gpt-2023.4.21.19.25.3-py2.py3-none-any.whl |
|---|---|
| Size | 15.7 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
43a2474bc5bfc11f4a44113fbfdd698ca2f0cc8534d10de31929ed56a983c967
|
|
BLAKE2b-256 checksum How to use checksums |
3cde7203786df97ac44978dba15ff2cb19172312d89e2203367346a9b8df5f21
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.8.13
|
