Skip to main content

llm dataset

Project description

LLM dataset

How to use

pip install llmdataset
  • setting
dataloader = llmdataset.dataloader(
    data_type='train',
    batch_size=4,
    seed=3655,
    max_data=5
    )
  • execution
for i in dataloader:
    print('------')
    print(i)

Useful dataset

llmdataset = main.LLMdataset(dataset_name="gsm8k", subset='main')
llmdataset = main.LLMdataset(dataset_name="ChilleD/MultiArith")
llmdataset = main.LLMdataset(dataset_name="tasksource/bigbench", subset = "abstract_narrative_understanding")
llmdataset = main.LLMdataset(dataset_name="reasoning-machines/gsm-hard", subset="boolean_expressions")
llmdataset = main.LLMdataset(dataset_name="reasoning-machines/gsm-hard")
llmdataset = main.LLMdataset(dataset_name="wikitablequestions")
llmdataset = main.LLMdataset(dataset_name="ChilleD/StrategyQA")
llmdataset = main.LLMdataset(dataset_name="allenai/ai2_arc", subset = "ARC-Challenge")
llmdataset = main.LLMdataset(dataset_name="aqua_rat", subset = "raw")
llmdataset = main.LLMdataset(dataset_name="Idavidrein/gpqa", subset = "gpqa_diamond")
llmdataset = main.LLMdataset(dataset_name="ChilleD/SVAMP")
llmdataset = main.LLMdataset(dataset_name="tau/commonsense_qa")

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llmdataset-1.0.0.tar.gz (4.6 kB view details)

Uploaded Source

Built Distribution

llmdataset-1.0.0-py3-none-any.whl (8.1 kB view details)

Uploaded Python 3

File details

Details for the file llmdataset-1.0.0.tar.gz.

File metadata

  • Download URL: llmdataset-1.0.0.tar.gz
  • Upload date:
  • Size: 4.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.5.1 CPython/3.9.18 Darwin/23.2.0

File hashes

Hashes for llmdataset-1.0.0.tar.gz
Algorithm Hash digest
SHA256 48198ff9010d7c6f51676bd0654a4e09a3a3a2f0ab68729b9d1d3133470b588e
MD5 c49f03320f35ba5d711547147e0125d8
BLAKE2b-256 9937cbe4e047af8d060b9f17f4c0fd4efc3ed72c3dad891e1fea951cac9f8e28

See more details on using hashes here.

File details

Details for the file llmdataset-1.0.0-py3-none-any.whl.

File metadata

  • Download URL: llmdataset-1.0.0-py3-none-any.whl
  • Upload date:
  • Size: 8.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.5.1 CPython/3.9.18 Darwin/23.2.0

File hashes

Hashes for llmdataset-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2442bfa14835d80c3445a9f4c36457fedda20961501e9e1b083075a594ebd86b
MD5 74c999b4c2da2c27198ddb38fde2cfb3
BLAKE2b-256 adc046ad93bfe787ae0d089739918d5ed21e3eb0e83cd2338ef4c69ad5302f33

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page