Skip to main content

Vespa for Data Scientists

Motivation

This library contains application specific code related to data manipulation and analysis of different Vespa use cases. The Vespa python API is used to interact with Vespa applications from python for faster exploration.

The main goal of this space is to facilitate prototyping and experimentation for data scientists. Please visit Vespa sample apps for producuction-ready use cases and Vespa docs for in-depth Vespa documentation.

Install

Code to support and reproduce the usecases documented here can be found in the learntorank library.

Install via PyPI:

pip install learntorank

Development

All the code and content of this repo is created using nbdev by editting notebooks. We will give a summary below about the main points required to contribute, but we suggest going through nbdev tutorials to learn more.

Setting up environment

  1. Create and activate a virtual environment of your choice. We recommend pipenv.

    pipenv shell
    
  2. Install Jupyter Lab (or Jupyter Notebook if you prefer).

    pip3 install jupyterlab
    
  3. Create a new kernel for Jupyter that uses the virtual environment created at step 1.

    • Check where the current list of kernels is located with jupyter kernelspec list.
    • Copy one of the existing folder and rename it to learntorank.
    • Modify the kernel.json file that is inside the new folder to reflect the python3executable associated with your virtual env.
  4. Install nbdev library:

    pip3 install nbdev
    
  5. Install learntorank in development mode:

    pip3 install -e .[dev]
    

Most used nbdev commands

From your terminal:

  • nbdev_help: List all nbdev commands available.

  • nbdev_readme: Update README.md based on index.ipynb

  • Preview documentation while editing the notebooks:

    • nbdev_preview --port 3000
  • Workflow before pushing code:

    • nbdev_test --n_workers 2: Execute all the tests inside notebooks.
      • Tests can run in parallel but since we create Docker containers we suggest a low number of workers to preserve memory.
    • nbdev_export: Export code from notebooks to the python library.
    • nbdev_clean: Clean notebooks to avoid merge conflicts.
  • Publish library

    • nbdev_bump_version: Bump library version.
    • nbdev_pypi: Publish library to PyPI.

Metadata

Release files for learntorank 0.0.21

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for learntorank 0.0.21
File Size Uploaded Provenance Actions
learntorank-0.0.21.tar.gz 33.3 kB Without provenance Details for learntorank-0.0.21.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for learntorank 0.0.21
File Interpreter ABI Platform Actions
learntorank-0.0.21-py3-none-any.whl Python 3 none any Details for learntorank-0.0.21-py3-none-any.whl

Total release size: 71.4 kB

Release files / learntorank-0.0.21.tar.gz

Download URL learntorank-0.0.21.tar.gz
Size 33.3 kB
Tags Source
SHA-256 checksum
How to use checksums
19371c6829f46947a1fded75e35e18eda692d0d78a4a2476500c2e2e47c905c6
BLAKE2b-256 checksum
How to use checksums
555c0bba52ee32e91989e79f7302b19326404d433427769c156a4863e8f6b9e8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.9.15

Release files / learntorank-0.0.21-py3-none-any.whl

Download URL learntorank-0.0.21-py3-none-any.whl
Size 38.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
ed6fdc51da5584d09d4979f3a7fc6cfbb2bfd53ace5a7389f03b70d06cbff25c
BLAKE2b-256 checksum
How to use checksums
7016a38031ff3ebf1ba16870c43d071c96f8ed6b99d9080e1a7f8f6613f47fa1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.9.15

Security for learntorank 0.0.21

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page