Structured data collected by sparecores-crawler.
Project description
Spare Cores Data
SC Data is a Python package and related tools making use of
sparecores-crawler
to pull and
standardize data on cloud compute resources. This repository actually
runs the crawler every 5 minutes to update spot prices, and every hour
to update all cloud resources in an internal SCD table and public
SQLite snapshot as well.
Installation
Stable version from PyPI:
pip install sparecores-data
Most recent version from GitHub:
pip install "sparecores-data @ git+https://git@github.com/SpareCores/sc-data.git"
Usage
For easy access to the SQLite database file, import the db
object
of the sc_data
Python package, which runs an updater thread in the
background to keep the SQLite file up-to-date:
from sc_data import db
print(db.path)
By default, the SQLite file will be updated every 600 seconds, which
can be overwritten by the sc_data_db_refresh_seconds
builtins
attribute or the SC_DATA_DB_REFRESH_SECONDS
environment variable.
References
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for sparecores_data-0.2.1.post1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | a2f1aae7f7201d0ec3acd7f896c33d4d1fef49885e6cd4460408ff9358458166 |
|
MD5 | 722060b9e3281df442e3ccb0badbaa53 |
|
BLAKE2b-256 | d5a60590227536b6955e158de0308def43b2817b3b9fd3d57a66eb6e0d4cf78a |
Hashes for sparecores_data-0.2.1.post1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5cf78c63e3f459c3d1eb19c3d240c2eeb5cb1ce1376d43ee452ca892ef4874bf |
|
MD5 | 6d534079e68776576ed93bc52afe8726 |
|
BLAKE2b-256 | 1cc230faef7882cf41e6fd24a2bcacb61fbc6fc1f2ba60e8feb7eabfb6a09443 |