pholcidae - Tiny python web crawler library
Project description
pholcidae - Tiny python web crawler library
=========
Pholcidae
------------
Pholcidae, commonly known as cellar spiders, are a spider family in the suborder Araneomorphae.
About
------------
Pholcidae is a tiny Python module allows you to write your own crawl spider fast and easy.
Dependencies
------------
* python >= 2.6.x
Basic example
------------
from pholcidae import Pholcidae
class MySpider(Pholcidae):
settings = {'domain': 'www.test.com', 'start_page': '/sitemap/'}
def crawl(self, data):
print(data.url)
spider = MySpider()
spider.start()
=========
Pholcidae
------------
Pholcidae, commonly known as cellar spiders, are a spider family in the suborder Araneomorphae.
About
------------
Pholcidae is a tiny Python module allows you to write your own crawl spider fast and easy.
Dependencies
------------
* python >= 2.6.x
Basic example
------------
from pholcidae import Pholcidae
class MySpider(Pholcidae):
settings = {'domain': 'www.test.com', 'start_page': '/sitemap/'}
def crawl(self, data):
print(data.url)
spider = MySpider()
spider.start()
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pholcidae-0.0.3.zip
(5.0 kB
view details)
File details
Details for the file pholcidae-0.0.3.zip.
File metadata
- Download URL: pholcidae-0.0.3.zip
- Upload date:
- Size: 5.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | c27f03efeed335eb68edc4377c5e254a932ebe7c299897021cf7263382f7e53f |
|
| MD5 | 0dcfbc045f2c4efd26a2d8a82088dff7 |
|
| BLAKE2b-256 | cd642616b471857e9a4eeeb9cb98efc7f9a90fd4c9276d296bde1f28c1e2f608 |
