Skip to main content

A small manager for versioned data

Project description

Flexible version control for files and folders.

Install

The simplest way is to get it from PyPi:

pip install bev

Or if you want to try the latest version from GitHub:

git clone https://github.com/neuro-ml/bev.git
cd bev
pip install -e .

# or let pip handle the cloning:
pip install git+https://github.com/neuro-ml/bev.git

Why not DVC?

DVC is a great project, and we took inspiration from it while designing bev. However, out lab has several requirements that DVC doesn't meet:

  1. Our data caches are spread across multiple HDDs - we need support for multiple cache locations
  2. We have multiple machines, and each of them has a different storage configuration: locations, number of HDDs, their volumes - we need a flexible way of choosing the right config depending on the machine
  3. Often we simultaneously conduct experiments on different versions of the same data - we need easy access to multiple version of the same data
  4. The need for dvc checkout after git checkout is error-prone, because it can lead to situations when the data is not consistent with the current commit - we need a more constrained relation between data and git

bev supports all four out of the box!

However, if these requirements are not essential to your project, you may want to stick with DVC - its community and tests coverage is much larger.

Getting started

Here are some tutorials to quickly get you started:

  1. Create a repository - needed only at first time setup
  2. Adding files
  3. Accessing files

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bev-0.0.6.tar.gz (12.1 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page