Skip to main content

devpi-server: reliable private and pypi.org caching server

Project description

devpi-server: pypi server for caching and private indexes

consistent robust pypi-cache

You can point pip or easy_install to the root/pypi/+simple/ index, serving as a self-updating transparent cache for pypi-hosted and external packages. Cache-invalidation uses the latest and greatest PyPI protocols. The cache index continues to serve when offline and will resume cache-updates once network is available.

user specific indexes

Each user (which can represent a person or a project, team) can have multiple indexes and upload packages and docs via standard setup.py invocations command. Users and indexes can be manipulated through a RESTful HTTP API.

index inheritance

Each index can be configured to merge in other indexes so that it serves both its uploads and all releases from other index(es). For example, an index using root/pypi as a parent is a good place to test out a release candidate before you push it to PyPI.

good defaults and easy deployment

Get started easily and create a permanent devpi-server deployment including pre-configured templates for nginx and cron.

separate tool for Packaging/Testing activities

The complementary devpi-client tool helps to manage users, indexes, logins and typical setup.py-based upload and installation workflows.

See https://doc.devpi.net for getting started and documentation.

Changelog

4.8.0 (2018-11-16)

Features

  • feature #193: ensuring that the description_content_type and provides_extras fields are handled.

    This is used to add support for using alternative content types in the package descriptions such as text/markdown.

  • The PATCH method of indexes supports a list of arguments with operations in the form of key=value for setting values and for lists in the form of key+=value and key-=value to add and remove items. This prevents undoing changes sent in concurrent PATCH requests.

Bug Fixes

  • fix #598: streaming download now uses BytesIO to avoid performance issues for downloads with more than a few MB.

    Thanks to Dom Hudson from http://www.thoughtriver.com for the report and initial benchmark code.

  • handle mirrors that don’t return a correct X-PYPI-LAST-SERIAL header.

4.7.1 (2018-09-10)

Bug Fixes

  • Fix missing releases in simple pages for data from previous devpi-server versions.

  • Fixed key error ‘requires_python’ for data from previous devpi-server versions.

4.7.0 (2018-09-08)

Deprecations and Removals

  • Deprecated DEVPI_SERVERDIR environment variable in favor of DEVPISERVER_SERVERDIR to be consistent with the other option overwrites.

Features

  • fix #502: add support for YAML config files.

  • environment variables can now be used for configuration. The option name needs to be changed to uppercase, prefixed with DEVPISERVER_ and dashes replaced by underscores. For example --restrict-modify becomes DEVPISERVER_RESTRICT_MODIFY.

  • fix #511: support PEP508 requires-python attribute on links. Thanks to Sergey Kolosov for the parsing parts.

  • Allow deletion of mirrored package releases.

  • Allow deletion of mirrored projects and their releases.

  • Allow deletion of specific package versions on a mirror. Only the downloaded files will be removed. The file will be fetched again from the mirror source on request.

  • Better handling of 404s in mirror indexes. Every project not found would create an entry in the database which would grow it unnecessarily.

Bug Fixes

  • Allow deleting releases even if the file was removed from the filesystem outside of devpi.

  • fix #491: when a file was previously fetched in a mirror index, but is now missing and needs to be fetched again then skip writing an empty changeset with new serial.

  • When deleting a mirror, delete all it’s data as well. Previously deleting a mirror and recreating it would result in old entries showing up.

  • In offline mode the full project list returns all projects with locally stored releases.

  • In offline mode no bogus 503 responses show up in the log anymore.

  • when a file was missing on a replica and has to be fetched from master, it is now written to disk, so it doesn’t have to be fetched again.

  • Only projects with locally stored releases show up in the full project list of mirrors if upstream can’t be reached.

4.6.0 (2018-07-13)

Features

  • implement #448: allow deletion of single release files.

  • implement #530: set caching headers for release files to expire far in the future.

  • implement #535: Generate absolute URLs on project simple index pages when --absolute-urls option is used or X-DEVPI-ABSOLUTE-URLS header is set.

  • add –max-request-body-size option to control maximum upload size

  • add –request-timeout option to provide adjustable request timeout

Bug Fixes

  • fix #549: reduce timeout for requests to PyPI etc from 30 to 5 seconds. This can be changed with the --request-timeout option.

  • fix raising of UpstreamError by using correct status_code attribute of response instead of not existing status.

  • Fix cumulating log tags for request numbers by wrapping the responsible code in a try/finally block to always remove the tag, even when there was an exception.

4.5.0 (2018-05-04)

Features

  • add devpiserver_on_remove_file hook to handle removal of files in plugins. Thanks to Dr Colin Kong for the PR.

  • Use pypi.org as new default for root/pypi mirror index.

Bug Fixes

  • adjust minimum version of pyramid to 1.8 (related to #430)

  • fix #494: PEP 503 compliance, html and redirect fixes.

  • fix #510: catch another possible error when trying to open sqlite db with uri keyword.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

devpi-server-4.8.0.tar.gz (181.3 kB view details)

Uploaded Source

Built Distribution

devpi_server-4.8.0-py2.py3-none-any.whl (186.7 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file devpi-server-4.8.0.tar.gz.

File metadata

  • Download URL: devpi-server-4.8.0.tar.gz
  • Upload date:
  • Size: 181.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: devpi-server/4.7.1 (py2.7.13; linux2)

File hashes

Hashes for devpi-server-4.8.0.tar.gz
Algorithm Hash digest
SHA256 2535c7165f745f1d2865be56fa01658e316f8941c875a21ced630ddb33805340
MD5 395379f54a9cc6f3cf061ddf159cb594
BLAKE2b-256 263834bd783207350b757c5dd19a5129241d76a77043eddce67157f1740d7920

See more details on using hashes here.

File details

Details for the file devpi_server-4.8.0-py2.py3-none-any.whl.

File metadata

  • Download URL: devpi_server-4.8.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 186.7 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: devpi-server/4.7.1 (py2.7.13; linux2)

File hashes

Hashes for devpi_server-4.8.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 5a5744a75b654c3ddb243e21486d2bfbd1befccb3f8f961450d878786692008a
MD5 5ec3e6ab00d89f83eb2c145b14efb576
BLAKE2b-256 5794c4e5d963699a160e247ef10fe029f26699bf6b162103e51768b10eea4b2b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page