datasets
motivation
This repository provides a production-grade Python library (tgedr-datasets) for building and running automated data pipelines that collect, validate, and store financial market data. It orchestrates the extraction of stock tickers, daily OHLCV prices (via Yahoo Finance), and news articles (via Alpha Vantage, NewsAPI, and Finnhub), transforms them into structured formats, validates them against ODCS data contracts, and loads them into Hugging Face datasets.
datalake pipelines
articles
prices
tickers
development
-
main requirements:
- uv
- bash
-
Clone the repository like this:
git clone git@github.com:jtviegas/datasets
-
cd into the folder:
cd datasets -
install requirements:
./helper.sh reqs
1 maintainer
Metadata
1 maintainer
Release files for tgedr-datasets 2.0.21
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| tgedr_datasets-2.0.21.tar.gz | 25.9 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| tgedr_datasets-2.0.21-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 63.9 kB
Release files / tgedr_datasets-2.0.21.tar.gz
| Download URL | tgedr_datasets-2.0.21.tar.gz |
|---|---|
| Size | 25.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9f926c9b100b0d5dc0fdcb870b5e134d487059acc5d5938446b12213c5d51173
|
|
BLAKE2b-256 checksum How to use checksums |
7e2023ca415ea8a207142ab04d9bb8db52a903afc113134561594818d2240ec5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / tgedr_datasets-2.0.21-py3-none-any.whl
| Download URL | tgedr_datasets-2.0.21-py3-none-any.whl |
|---|---|
| Size | 38.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
8d297d846d4f0c937ca5734935c58607a81a504b212eb988bafeec12ac7c84b6
|
|
BLAKE2b-256 checksum How to use checksums |
cddd423bf2a58f53a715c25a40c7fbd66728cee40703147206d4c41cfcda6c8a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
