Skip to main content

A dataset module for your projects

Project description

DataNexus

DataNexus is a simple to use Python module that you can use in your projects to get transcripts, datasets, etc. The module also allows you to extract character lines from transcripts witch makes it easyer for you to be able to do finetunning of a GPT2 model as an example.

Key feactures

  • Downloading of Datasets and Transcripts
  • Extract Characters from Transcripts

Installation

To get started:

pip install datanexus

Usage

⚠️ | Full documenation link to come in the future and the code may be unstable as in testing!

Downloading of Datasets/Transcripts

from datanexus import download_dataset_raw, download_dataset

datanexus = datanexus('Models/') # Insert your directory that you would like to use

model = datanexus.download_dataset(model='ironman') # Choose a model
print(model)

Extract character's from transcripts

print(character)

Support

If you have any question or any issues then feel free to create an issue on Github.

Feel free to join The Workshop discord server and send me a ping (_Ethan_)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

datanexus-0.0.5.tar.gz (2.6 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page