llm dataset
Project description
LLM dataset
How to use
pip install llmdataset
- setting
dataloader = llmdataset.dataloader(
data_type='train',
batch_size=4,
seed=3655,
max_data=5
)
- execution
for i in dataloader:
print('------')
print(i)
Useful dataset
llmdataset = main.LLMdataset(dataset_name="gsm8k", subset='main')
llmdataset = main.LLMdataset(dataset_name="ChilleD/MultiArith")
- Big Bench
llmdataset = main.LLMdataset(dataset_name="tasksource/bigbench", subset = "abstract_narrative_understanding")
- Big Bench Hard
llmdataset = main.LLMdataset(dataset_name="reasoning-machines/gsm-hard", subset="boolean_expressions")
llmdataset = main.LLMdataset(dataset_name="reasoning-machines/gsm-hard")
- wikitablequestions
llmdataset = main.LLMdataset(dataset_name="wikitablequestions")
llmdataset = main.LLMdataset(dataset_name="ChilleD/StrategyQA")
llmdataset = main.LLMdataset(dataset_name="allenai/ai2_arc", subset = "ARC-Challenge")
llmdataset = main.LLMdataset(dataset_name="aqua_rat", subset = "raw")
llmdataset = main.LLMdataset(dataset_name="Idavidrein/gpqa", subset = "gpqa_diamond")
llmdataset = main.LLMdataset(dataset_name="ChilleD/SVAMP")
- CommonsenseQA
llmdataset = main.LLMdataset(dataset_name="tau/commonsense_qa")
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
llmdataset-1.0.0.tar.gz
(4.6 kB
view details)
Built Distribution
File details
Details for the file llmdataset-1.0.0.tar.gz
.
File metadata
- Download URL: llmdataset-1.0.0.tar.gz
- Upload date:
- Size: 4.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.5.1 CPython/3.9.18 Darwin/23.2.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 48198ff9010d7c6f51676bd0654a4e09a3a3a2f0ab68729b9d1d3133470b588e |
|
MD5 | c49f03320f35ba5d711547147e0125d8 |
|
BLAKE2b-256 | 9937cbe4e047af8d060b9f17f4c0fd4efc3ed72c3dad891e1fea951cac9f8e28 |
File details
Details for the file llmdataset-1.0.0-py3-none-any.whl
.
File metadata
- Download URL: llmdataset-1.0.0-py3-none-any.whl
- Upload date:
- Size: 8.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.5.1 CPython/3.9.18 Darwin/23.2.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2442bfa14835d80c3445a9f4c36457fedda20961501e9e1b083075a594ebd86b |
|
MD5 | 74c999b4c2da2c27198ddb38fde2cfb3 |
|
BLAKE2b-256 | adc046ad93bfe787ae0d089739918d5ed21e3eb0e83cd2338ef4c69ad5302f33 |