count-web-content 0.1.0

No project description provided

Python package to count web content at a given URL

Installation

$ poetry install

Usage

Simple usage:

count, in_root_count, add_dict = count_page.count_pages(
    root_url="https://mame77.com/",
    is_print_working=True,
    additional_url=["https://mame77.com/posts/", "https://mame77.com/about"],
    output_url_file_name="output_url.txt",
)

Arguments

• root_url : This package counts the number of files in the content of the URL.
• additional_url : If specified, You can specify additional URLs to count the number of files.
  This is optional and must be under the same domain as the root_url.
• sleep_sec: The number of seconds to sleep between requests.
• is_print_working: If True, the package will print the URL it is currently working on and the number of remaining URLs.
• output_url_file_name: If specified, the package will output the URLs to a file.