A library for working with text and timeseries data.
Project description
News Signals
Example Colab Notebooks
These notebooks let you try out news-signals
without installing anything!
- Find Emerging Categories in a Newsfeed - Video
- Searching the Aylien NewsAPI Using An Entity Name - Video
- An Overview of News Signals Datasets - Video
The Colab notebooks above are also available as jupyter notebooks in research/news-signals-example-notebooks
Quickstart
Install news-signals in a new environment
conda create -n test-signals-pypi python=3.8
conda activate test-signals-pypi
pip install news-signals
Look at a sample dataset
Do pip install jupyter
in your environment to run this code
in a jupyter notebook or in ipython, or just type python
in your terminal.
from news_signals.signals_dataset import SignalsDataset
# nasdaq100 sample dataset
dataset_url = 'https://drive.google.com/uc?id=150mfU2YA4ScfTlJvO6Duzto4aT_Q7K3D'
dataset = SignalsDataset.load(dataset_url)
Now try:
import matplotlib.pyplot as plt
fig = dataset.plot()
plt.show()
Installation from source
Install news-signals in a new environment
Run conda create -n news-signals python=3.8
if you're using Anaconda, alternatively python3.8 -m venv news-signals
or similar.
Note python>=3.8 is required.
source activate news-signals
git clone https://github.com/AYLIEN/news-signals-datasets.git
cd news-signals-datasets
pip install -r requirements.txt
pip install -e . # install in editable mode
make test # run tests
Generating a new Dataset
python bin/generate_dataset.py \
--start 2022/01/01 \
--end 2022/02/01 \
--input-csv resources/test/nasdaq100.small.csv \
--id-field "Wikidata ID" \
--name-field "Wikidata Label" \
--output-dataset-dir sample_dataset_output
Transforming a Dataset
python bin/transform_dataset.py \
--input-dataset-dir sample_dataset_output \
--config resources/default_transform_config.json
This adds anomaly scores, summary headlines and Wikimedia pageviews to each signal in a dataset (specified in config file).
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for news_signals-0.1.11-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f7ce9a9a606191ab3d3f03587c32722f65a137db7cf253cd3ee6ff066381cb6a |
|
MD5 | a8249a4921faac3103cd9e88301a60e1 |
|
BLAKE2b-256 | 522f60d233ceed690873a3d9514fb5ccfdf4a9a6d1b13077e72e75000fb8a6cf |