vectice 0.22.0

Vectice Python library

Enabling all enterprise’s AI/ML initiatives to result in consistent and positive impact. Data scientists deserve a solution that makes all their experiment reproducible, every asset discoverable and simplifies knowledge transfer. Managers deserve a dedicated data science solution. to secure knowledge, automate reporting and simplify reviews and processes.

Contents

• Supported Python Versions

• Documentation

• Installing

• Getting Started

• Auto versioning

• Integrations

• MLflow

• Examples

Supported Python Versions

Python >= 3.6

Documentation

Official documentation for Vectice can be found at https://doc.vectice.com

Installing

To install Vectice without any extras and get started. The following code snippet can be used.

pip install vectice

To install Vectice with any extras and get started. The following code snippet can be used. All the provided extras can be found in the documentation.

pip install vectice[extra_required]

Getting Started

The following code is just an example to test that the Vectice SDK is working as it should be. You can use an IDE or a notebook to execute this code. It’s intializing a vectice object that connects to vectice. If everything is working as it should be you’ll recieve no errors.

from vectice import Vectice
vectice = Vectice(project_token="PROJECT_TOKEN")

The Vectice SDK leverages runs as the terminology used when capturing metadata from the work you do. Thus, if you want to clean data, for example, and capture what you’ve done, you would create the inputs of the data that will be cleaned, create a run and then start it. Then you’d perform the data cleaning.

ds_version = [vectice.create_dataset_version().with_parent_name("DATASET_NAME_IN_VECTICE_APP")]
run = vectice.create_run("RUN_NAME")
vectice.start_run(run, inputs = ds_version)

Once you’ve performed the data cleaning or any other actions you end the run by simple creating outputs and then calling the end_run method.

outputs = [vectice.create_dataset_version().with_parent_name("DATASET_NAME_IN_VECTICE_APP")]
vectice.end_run(outputs)

Auto versioning

The Vectice SDK enables you to leverage auto versioning for a variety of artifacts such as datasets, models and code. Below is an example of auto versioning your code, to find out more see code auto versioning.

vectice = Vectice(PROJECT_TOKEN, autocode=True)
run = vectice.create_run("auto-code-capture")
vectice.start_run(run)
vectice.end_run()

Integrations

Vectice integrates with popular data science tools. There are already a few integrations and MLflow is just one example and the roadmap has more exciting integrations on the way. If you would like to see more, please refer to the integrations in the documentation

MLflow

The Vectice API has MLflow integrated and the possibility to either capture metadata after a run or in a fully integrated manner. This can be achieved by using the Vectice API at a high level. To see more, refer to the MLflow how to or MLflowAdapter API for all the available functionality.

inputs = [Vectice.create_dataset_version().with_parent_name("standalone").with_tag("a_tag", "a tag value")]
# MLflow run
Vectice.save_after_run(PROJECT_TOKEN, run, "MLflow", inputs)

The fully integrated use of MLflow with Vectice uses the Python context manager to easily leverage MLflow with the Vectice API. The MLflow metadata is leveraged by the Vectice API and autolog allows all the metadata to be captured. Furthermore, more parameters and metrics can be captured by using MLflow methods.

mlflow.autolog()
vectice = Vectice(project_token=PROJECT_TOKEN, lib="MLflow")
vectice.create_run(MLFLOW_EXPERIMENT_NAME)

with vectice.start_run(inputs=inputs):
    mlflow.log_param("algorithm", "linear regression")
    mlflow.log_metric("MAE", MAE)

Examples

There is an examples repository dedicated to providing examples of how to leverage the Vectice SDK and Vectice App, you will find integration examples and ways to leverage Vectice in a standalone approach. This can be found in the vectice-examples repository.