Small framework to crawl misc data sources and process records.
Project description
Small framework to crawl misc data sources and process records.
Installation guide
pip install monkey.crawler
User guide
Crawler attributes -source_name: the name that identifies the data source -handler: the handler that will process every record -offset: the number of record that will be skipped by the crawler before to start
CSV Crawler _SOURCE_DELIMITER_KEY = ‘source_delimiter’ _SOURCE_FILE_ENCODING_KEY = ‘source_encoding’ _SOURCE_FILE_KEY = ‘source_file’ _SOURCE_QUOTE_CHAR_KEY = ‘source_quote_char’ _COLUMN_MAP_KEY = ‘column_map’ _COLUMN_MAP_DELIMITER_KEY = ‘column_map_delimiter’
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
monkey.crawler-1.0.0.dev6.tar.gz
(15.0 kB
view hashes)
Built Distribution
Close
Hashes for monkey.crawler-1.0.0.dev6.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 3b766387485d3e57395de50beb8673d742ab7962574b429a01a0c57d98c21dd8 |
|
| MD5 | c4dd89296019e928d3e146d7a463bdf5 |
|
| BLAKE2b-256 | 0d08513aa613c9384d4e5df86fafca87133c5816af37314e1a0fcb574653f3a9 |
Close
Hashes for monkey.crawler-1.0.0.dev6-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 24c4d86b11be186a628676108fa5097ba3c0d4120a9ef69df81372d442b973bf |
|
| MD5 | ce631f50a4c9c592fe3569900af26103 |
|
| BLAKE2b-256 | 78bb44ba155ae059b8114bf40a65eab1f3901d38f8168ca38646d7ab50a31326 |
