Skip to main content
pholcidae - Tiny python web crawler library
=========

Pholcidae
------------

Pholcidae, commonly known as cellar spiders, are a spider family in the suborder Araneomorphae.

About
------------

Pholcidae is a tiny Python module allows you to write your own crawl spider fast and easy.

Dependencies
------------

* python >= 2.6.x

Basic example
------------

from pholcidae import Pholcidae

class MySpider(Pholcidae):

settings = {'domain': 'www.test.com', 'start_page': '/sitemap/'}

def crawl(self, data):
print(data.url)

spider = MySpider()
spider.start()

Metadata

Release files for pholcidae 0.0.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pholcidae 0.0.3
File Size Uploaded
pholcidae-0.0.3.zip 5.0 kB Details

Release files / pholcidae-0.0.3.zip

Download URL pholcidae-0.0.3.zip
Size 5.0 kB
Tags Source
SHA-256 checksum
How to use checksums
c27f03efeed335eb68edc4377c5e254a932ebe7c299897021cf7263382f7e53f
BLAKE2b-256 checksum
How to use checksums
cd642616b471857e9a4eeeb9cb98efc7f9a90fd4c9276d296bde1f28c1e2f608
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release history Release notifications | RSS feed

This release

0.0.3 This release

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page