Create a Python package.
Project description
🔥LLM4GPT 为大模型而生🔥
Install
pip install -U llm4gpt
Docs
Usages
from llm.qa import QA
from llm.utils import llm_load
from llm.chatllm import ChatLLM
from llm.kb.FaissANN import FaissANN
from meutils.pipe import *
# 解析知识库
texts = []
metadatas = []
for p in Path('data').glob('*.txt'):
texts.append(p.read_text())
metadatas.append({'source': p})
# 文档向量化
faissann = FaissANN(model_name_or_path="shibing624/text2vec-base-chinese")
faissann.add_texts(texts, metadatas)
# 构建pipeline
model, tokenizer = llm_load(model_name_or_path="THUDM/chatglm-6b", device='cpu')
glm = ChatLLM()
glm.chat_func = partial(model.chat, tokenizer=tokenizer)
qa = QA(glm, faiss_ann=faissann.faiss_ann)
qa.get_knowledge_based_answer('周杰伦在干吗')
qa.get_knowledge_based_answer('姚明住哪里')
TODO
-
增加UI
-
增加本地知识库组件
-
增加互联网搜索组件
-
增加知识图谱组件
-[ ] 增加微调模块
-[ ] 增加流式输出
======= History
0.0.0 (2023-04-11)
- First release on PyPI.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
llm4gpt-2023.4.20.19.18.41.tar.gz
(21.0 kB
view hashes)
Built Distribution
Close
Hashes for llm4gpt-2023.4.20.19.18.41.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 95fc0787299df28e75a169c64166beb2b1a6cc28b47599bb2243b282537a5568 |
|
MD5 | 1a646f18165334cd6aef91b3045ab149 |
|
BLAKE2b-256 | 032724bd15456d74a21e398f06722ce74a579577f54dce8da4c8fb24bd4a74c2 |
Close
Hashes for llm4gpt-2023.4.20.19.18.41-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8c4eb450a3b138851c02d2c20b7db778f33f26fd4f84f04a241c6e7726ee6c1e |
|
MD5 | 395ea9221577e1c2cfdc66cccbbb9b0d |
|
BLAKE2b-256 | 779fe765e0782806c5ac2aa917a23289cd2a4f80e5563a3ade2b9e16a0403c48 |