Downloads BGPStream info solely for research purposes
Project description
bgpstream_website_collector
Package Description
This package downloads information from bgpstream.com and stores it in a CSV
As a caveat, I wrote this a very long time ago when I was still an undergrad. I've cleaned it up a bit, but this has a long way to go before it's good code quality PRs welcome. Also, almost everything is type ignored because mypy spazzes out with bs4 Also, the tests could really use a good update
Usage
from a script:
from pathlib import Path
from bgpstream_website_collector import BGPStreamWebsiteCollector
def main():
csv_path: Path = Path.home() / "Desktop" / "bgpstream_website.csv"
BGPStreamWebsiteCollector(csv_path=csv_path).run()
if __name__ == "__main__":
main()
From the command line:
bgpstream_website_collector
Installation
Install python and pip if you have not already.
Then run:
pip3 install pip --upgrade
pip3 install wheel
For production:
pip3 install bgpstream_website_collector
This will install the package and all of it's python dependencies.
If you want to install the project for development:
git clone https://github.com/jfuruness/bgpstream_website_collector.git
cd bgpstream_website_collector
pip3 install -e .[test]
pre-commit install
To test the development package: Testing
Testing
To test the package after installation:
cd bgpstream_website_collector
pytest bgpstream_website_collector
ruff bgpstream_website_collector
black bgpstream_website_collector
mypy bgpstream_website_collector
If you want to run it across multiple environments, and have python 3.10 and 3.11 installed:
cd bgpstream_website_collector
tox
Credits
Huge contributions to original version in lib_bgp_data to the testing from Tony Zheng
History
TODO
Development/Contributing
- Fork it!
- Create your feature branch:
git checkout -b my-new-feature
- Test it
- Run tox
- Commit your changes:
git commit -am 'Add some feature'
- Push to the branch:
git push origin my-new-feature
- Ensure github actions are passing tests
- Email me at jfuruness@gmail.com if it's been a while and I haven't seen it
License
BSD License (see license file)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for bgpstream_website_collector-1.0.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | f4b4c63d1accbfdeaf857c5c20bd1abacd94296a43e27ee12cee153d73ad6de2 |
|
MD5 | 9c51be400a6f3a221b048b86f305fe3d |
|
BLAKE2b-256 | 4357443859152aa0706ca85e1e5bbf3a9b7a12ba0a34f28eb9c447213a2cd16e |
Hashes for bgpstream_website_collector-1.0.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 61cec90a86602f567ab3fa17959cd06eca83a0c135719a86df98b64181dc338d |
|
MD5 | 45c29596736fd3c1dd35842094b1d9d2 |
|
BLAKE2b-256 | c8082e8ca2d3a1826b611d850fe716e396945c4ae357981cabddc8f2caae5ea3 |