Skip to main content

Create a word-list from a scraped webpage.

Project description

WikiScraper

WikiScraper is a Python module for creating custom word-lists from a webpage.

Installation

Use the package manager pip to install WikiScraper.

pip install WikiScraper-dustpole

Stand Alone Usage

python -m WikiScraper

Stand Alone Usage - Example

python -m WikiScraper

Source URL to be scraped for words: 
https://en.wikipedia.org/wiki/List_of_Pok%C3%A9mon

Minimum character length of words in wordlist: 
2

Output wordlist filename: 
wordlist

Do you want to filter out common stop words? (yes, no): 
no

Imported Module Usage

import WikiScraper

WikiScraper.WordList(url, minimumlength, outputfile, stop_words_value)

Imported Module Usage - Example

import WikiScraper

WikiScraper.WordList(https://en.wikipedia.org/wiki/List_of_Pok%C3%A9mon, 2, wordlist, yes)

License

MIT

Project details


Release history Release notifications | RSS feed

This version

1.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

WikiScraper_dustpole-1.1.tar.gz (8.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

WikiScraper_dustpole-1.1-py3-none-any.whl (10.0 kB view details)

Uploaded Python 3

File details

Details for the file WikiScraper_dustpole-1.1.tar.gz.

File metadata

  • Download URL: WikiScraper_dustpole-1.1.tar.gz
  • Upload date:
  • Size: 8.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.12.1

File hashes

Hashes for WikiScraper_dustpole-1.1.tar.gz
Algorithm Hash digest
SHA256 0d05ac53023765558715196148dac053b5b4a25a933185c0ea1d6373621f9bb8
MD5 d8bf056621c3cda0d9e626befea0d52d
BLAKE2b-256 be4189c0c0de91ca60eb2a16733ea169a0f2878796f9af26d97bb533f683ea4a

See more details on using hashes here.

File details

Details for the file WikiScraper_dustpole-1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for WikiScraper_dustpole-1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 e51bd7c08926b9c26dcc14b0947a67d71ec0ef7975de4d1a1eff490880ec4b6b
MD5 c0158d4e00fddab48b7062fedf7e60cb
BLAKE2b-256 b08ebe59d17f6b8fcc13c08c02617fe12cf5ad79929003d5108b2870578e3936

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page