llm dataset
Project description
LLM dataset
How to use
pip install llmdataset
- setting
dataloader = llmdataset.dataloader(
data_type='train',
batch_size=4,
seed=3655,
max_data=5
)
- execution
for i in dataloader:
print('------')
print(i)
Useful dataset
llmdataset = main.LLMdataset(dataset_name="gsm8k", subset='main')
llmdataset = main.LLMdataset(dataset_name="ChilleD/MultiArith")
- Big Bench
llmdataset = main.LLMdataset(dataset_name="tasksource/bigbench", subset = "abstract_narrative_understanding")
- Big Bench Hard
llmdataset = main.LLMdataset(dataset_name="reasoning-machines/gsm-hard", subset="boolean_expressions")
llmdataset = main.LLMdataset(dataset_name="reasoning-machines/gsm-hard")
- wikitablequestions
llmdataset = main.LLMdataset(dataset_name="wikitablequestions")
llmdataset = main.LLMdataset(dataset_name="ChilleD/StrategyQA")
llmdataset = main.LLMdataset(dataset_name="allenai/ai2_arc", subset = "ARC-Challenge")
llmdataset = main.LLMdataset(dataset_name="aqua_rat", subset = "raw")
llmdataset = main.LLMdataset(dataset_name="Idavidrein/gpqa", subset = "gpqa_diamond")
llmdataset = main.LLMdataset(dataset_name="ChilleD/SVAMP")
- CommonsenseQA
llmdataset = main.LLMdataset(dataset_name="tau/commonsense_qa")
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
llmdataset-1.0.0.tar.gz
(4.6 kB
view hashes)
Built Distribution
Close
Hashes for llmdataset-1.0.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2442bfa14835d80c3445a9f4c36457fedda20961501e9e1b083075a594ebd86b |
|
MD5 | 74c999b4c2da2c27198ddb38fde2cfb3 |
|
BLAKE2b-256 | adc046ad93bfe787ae0d089739918d5ed21e3eb0e83cd2338ef4c69ad5302f33 |