A package for getting getting Australian legal data from various sources with cache support.
Project description
Legal Data
A package for crawling Australian legal data from legislation.com.au and austlii.edu.au with cache support.
Please be respectful of server host resources by using a reasonable crawl delay, honouring robots.txt and crawling at times when the server load is lighter.
Install from PyPi
pip install legaldata
legislation.com.au example
This example will crawl Commonwealth Acts from legislation.com.au and copy files (docx, pdf, zip) to the save path.
from legaldata.legislation.crawler import ActCrawler
crawler = ActCrawler()
save_path = "./legislation.com.au/"
for index_url in crawler.get_index_pages():
acts = crawler.get_acts_from_index(index_url, save_path)
austlii.edu.au example
This example will crawl Commonwealth Acts from austlii.edu.au/ and copy files (rtf, txt) to the save path.
from legaldata.austlii.crawler import ActCrawler
crawler = ActCrawler()
save_path = "./austlii.edu.au/"
for index_url in crawler.get_index_pages():
acts = crawler.get_acts_from_index(index_url, save_path)
Legal Data is distributed under the MIT license.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file legaldata-0.1.1.tar.gz
.
File metadata
- Download URL: legaldata-0.1.1.tar.gz
- Upload date:
- Size: 2.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.7.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 58862d38be44a71907dc74aaa96672165bec772847aca82a4e0f4e5a9f842192 |
|
MD5 | e003fbb0e58e66ca685ad267e2ba72b7 |
|
BLAKE2b-256 | 29b75fc3b25878b7bfc761018d6e86902c8f7c1b8637eac09d7290ee1b493b2b |
File details
Details for the file legaldata-0.1.1-py3-none-any.whl
.
File metadata
- Download URL: legaldata-0.1.1-py3-none-any.whl
- Upload date:
- Size: 2.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.7.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | bf69e5a2d1b35091da6e8414f536a0996a76cda76adeed2ae449d2e8452ac626 |
|
MD5 | c458eb7a6fd88aeab6a94e5275675069 |
|
BLAKE2b-256 | 3a756c3bcd3724c627b3994f14d26d6d031c135c42281adee230990461605673 |