Skip to main content
https://travis-ci.org/MacHu-GWU/crawl_trulia-project.svg?branch=master https://img.shields.io/pypi/v/crawl_trulia.svg https://img.shields.io/pypi/l/crawl_trulia.svg https://img.shields.io/pypi/pyversions/crawl_trulia.svg

Welcome to crawl_trulia Documentation

This is a small project provide url route, html parse tools to crawl www.trulia.com.

Usage

A real example:

>>> from crawl_trulia.urlencoder import urlencoder
>>> from crawl_trulia.htmlparser import htmlparser
>>> from crawlib.spider import spider # install crawlib first

# use address, city and zipcode
>>> address = "22 Yew Rd"
>>> city = "Baltimore"
>>> zipcode = "21221"

>>> url = urlencoder.by_address_city_and_zipcode(address, city, zipcode)
>>> html = spider.get_html(url)
>>> house_detail_data = htmlparser.get_house_detail(html)
>>> house_detail_data
{
    "features": {},
    "public_records": {
        "AC": "a/c",
        "basement_type": "improved basement (finished)",
        "bathroom": 2,
        "build_year": 1986,
        "county": "baltimore county",
        "exterior_walls": "siding (alum/vinyl)",
        "heating": "heat pump",
        "lot_size": 7505,
        "lot_size_unit": "sqft",
        "partial_bathroom": 1,
        "roof": "composition shingle",
        "sqft": 998
    }
}

# usually combination of address and zipcode is enough
>>> address = "2004 Birch Rd"
>>> zipcode = "21221"

>>> url = urlencoder.by_address_and_zipcode(address, zipcode)
>>> html = spider.get_html(url)
>>> house_detail_data = htmlparser.get_house_detail(html)

Install

crawl_trulia is released on PyPI, so all you need is:

$ pip install crawl_trulia

To upgrade to latest version:

$ pip install --upgrade crawl_trulia

Metadata

Release files for crawl_trulia 0.0.4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for crawl_trulia 0.0.4
File Size Uploaded Provenance Actions
crawl_trulia-0.0.4.zip 22.5 kB Without provenance Details for crawl_trulia-0.0.4.zip

Release files / crawl_trulia-0.0.4.zip

Download URL crawl_trulia-0.0.4.zip
Size 22.5 kB
Tags Source
SHA-256 checksum
How to use checksums
eb11b1c974b52fcc6330e543338c6051f534d61e3c891dc4841646696b3f9124
BLAKE2b-256 checksum
How to use checksums
d009234199a82d99a59c3eea0ba5d644bd7279ca65d5fd144ac3ab47f5ef1ceb
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Security for crawl_trulia 0.0.4

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page