Skip to main content

analyze_site is a python application to crawl a site and return a count of the keywords, provided in a file, found in the web pages of the site. The application will also return counts of the most used verb, nouns, adverbs and adjectives.

analyze_site requires Python version 3 and the following libraries:

  • nltk - Natural Language Toolkit with maxent_treebank_pos_tagger

usage: analyze_site.py [-h] [-d DEPTH] [-r PATH_REGEX] [–verbose]

keywords_file url

positional arguments:

keywords_file Path to keywords file url URL to crawl

optional arguments:
-h, --help

show this help message and exit

-d DEPTH, --depth DEPTH

Depth to crawl

-r PATH_REGEX, --path_regex PATH_REGEX

Regular expression to match URL

--verbose

Increase logging level

Release files for analyze_site 0.1.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for analyze_site 0.1.3
File Size Uploaded
analyze_site-0.1.3.tar.gz 4.7 kB Details

Release files / analyze_site-0.1.3.tar.gz

Download URL analyze_site-0.1.3.tar.gz
Size 4.7 kB
Tags Source
SHA-256 checksum
How to use checksums
7f7a942feada7dcb81494e538f6d8946c78f4dac9286b89b73aef64882ccc244
BLAKE2b-256 checksum
How to use checksums
61f5df251f0e6bd25b7ee51aa628edf47589d2905ee3408c12aa3a52b3cf53d1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release history Release notifications | RSS feed

This release

0.1.3 This release

1 release file

0.1.2

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page