the boy for net
Project description
super fast web crawler
Note: this package is still in beta. Use with caution !
Quickstart
Install netboy:
pip install netboy
Use netboy:
if __name__ == '__main__': setup_log('netboy') data = [ 'http://www.bing.com',] boy = NetBoy() boy.use_queue( 'worker' ).use_spider( 'pycurl' ).use_filter( ['url', 'title', 'code'] ).use_workers().use_triggers([ 'test.functional.netboy.screen.print_screen' ]) resp = boy.run(data)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Filename, size | File type | Python version | Upload date | Hashes |
---|---|---|---|---|
Filename, size netboy-2018.8.7-py3-none-any.whl (3.9 MB) | File type Wheel | Python version 3.6 | Upload date | Hashes View |
Close
Hashes for netboy-2018.8.7-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f7603294b2353a6efb17367faa8df2f348230d1362b472a0464c20d4f4e8126e |
|
MD5 | d76bd42a00362e6614b8e4f7e3c0decb |
|
BLAKE2-256 | 5c59a6b37dacef0c54f2e1da06c035b56ba9bffafa0425c62fd2a1e013f35b87 |