Skip to main content

Code copier for multi experiments

Project description

DFRUN

gadget for dl experiments

What it does:
  1. create a folder to copy all the code in the current directory to freeze one training process
  2. switch to the working path to the folder created, and run the command
  3. if gpu resources is needed, nvidia-ml-py package is needed. In python 2.x, pip install nvidia-ml-py, while in python 3.x, pip install nvidia-ml-py3
Dependencies:

​ Code is tested on python 3.4 and it's supposed to run in python 3 environment.

Install:
pip install dfrun

or clone this repository and run:

python setup.py install
Usage:
dfrun -d [experiment folder] -n [experiment name] -g [NUMxMEM] [command]
What does the project folder look like:

Proj

|__ [CODE FILES]

|__ .dfignore (contains the files/folders ignored in the copy process)

|__ Experiment Folder (--exp-dir -d)

​ |__ Experiment Name (--exp-name -n)

​ | |__ [CODE FILES COPIED]

​ | Other Exp Names....

Contact:

mayeoliver@163.com

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dfrun-0.1.5.tar.gz (4.0 kB view details)

Uploaded Source

Built Distribution

dfrun-0.1.5-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file dfrun-0.1.5.tar.gz.

File metadata

  • Download URL: dfrun-0.1.5.tar.gz
  • Upload date:
  • Size: 4.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.1 CPython/3.7.3

File hashes

Hashes for dfrun-0.1.5.tar.gz
Algorithm Hash digest
SHA256 7a7db3909bafed43b7951d871b7b34f5fcb76f1ce5d5de30a1e98851411336ba
MD5 02c77b532593cd1bc839bd9d07ad612e
BLAKE2b-256 a7c6d6a45746c0705e810e6caae7272f8d67ae055be4ce81d555f453ac951e4f

See more details on using hashes here.

Provenance

File details

Details for the file dfrun-0.1.5-py3-none-any.whl.

File metadata

  • Download URL: dfrun-0.1.5-py3-none-any.whl
  • Upload date:
  • Size: 5.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.1 CPython/3.7.3

File hashes

Hashes for dfrun-0.1.5-py3-none-any.whl
Algorithm Hash digest
SHA256 8b4431d9a1c0836d109a468d11fefb78357a61cbb18831c854a75d9cfb614b11
MD5 a78a026a2286c13a6cfe4283de6d97a3
BLAKE2b-256 a75fc03a40876c1601a2c4a0566e080aee0e9eee32fbb08a976fc5b572c6d8ce

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page