Skip to main content

Code copier for multi experiments

Project description

DFRUN

gadget for dl experiments

What it does:
  1. create a folder to copy all the code in the current directory to freeze one training process
  2. switch to the working path to the folder created, and run the command
  3. if gpu resources is needed, nvidia-ml-py package is needed. In python 2.x, pip install nvidia-ml-py, while in python 3.x, pip install nvidia-ml-py3
Dependencies:

​ Code is tested on python 3.4 and it's supposed to run in python 3 environment.

Install:
pip install dfrun

or clone this repository and run:

python setup.py install
Usage:
dfrun -d [experiment folder] -n [experiment name] -g [NUMxMEM] [command]
What does the project folder look like:

Proj

|__ [CODE FILES]

|__ .dfignore (contains the files/folders ignored in the copy process)

|__ Experiment Folder (--exp-dir -d)

​ |__ Experiment Name (--exp-name -n)

​ | |__ [CODE FILES COPIED]

​ | Other Exp Names....

Contact:

mayeoliver@163.com

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dfrun-0.1.4.tar.gz (4.1 kB view details)

Uploaded Source

Built Distribution

dfrun-0.1.4-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file dfrun-0.1.4.tar.gz.

File metadata

  • Download URL: dfrun-0.1.4.tar.gz
  • Upload date:
  • Size: 4.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.18.4 setuptools/42.0.1 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.5.4

File hashes

Hashes for dfrun-0.1.4.tar.gz
Algorithm Hash digest
SHA256 e1925d5aa24cf436ea0a16b9a19036cddd4c45c0e0a0c198ee278409c02f3f8a
MD5 af244475dd7d2456cb99c86af02f1d46
BLAKE2b-256 986c75f02595aa2940be6c4ebb8a9440d84380f3f09340a1343f027b25c920e3

See more details on using hashes here.

Provenance

File details

Details for the file dfrun-0.1.4-py3-none-any.whl.

File metadata

  • Download URL: dfrun-0.1.4-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.18.4 setuptools/42.0.1 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.5.4

File hashes

Hashes for dfrun-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 d38095bbbd2b9d48f5c1751b6819d767122a91e2b439f598d507e899183a661b
MD5 38d2c54965c4e54c2d80875b67393ad2
BLAKE2b-256 6901d768270c8c50d13dfdbaa8c67542ee0160b52f47256efbeeb0cf44dd356a

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page