urban-scraper 1.2

Easy to use Urban Dictionary asynchronous and synchronous scraper.

Asynchronous and Synchronous Urban Dictionary Scraper

It uses selectolax to parse the HTML and httpx for sending HTTP requests.

Asynchronous Example

import asyncio
from urban_scraper import adefine


async def main():
    definitions = await adefine('hello')
    async for definition in definitions:
        ...

asyncio.run(main())

Synchronous Example

from urban_scraper import define

definitions = define('hello')

for definition in definitions:
    ...

In both examples, definition is urban_scraper.Definition

Attributes and Methods of urban_scraper.Definition

Attributes

• defid
• name
• meaning
• example
• author
  • name
  • url
• date
• upvote
• downvote

Methods

• as_dict()
  • Converts the dataclass to a dict object and returns it.

How To Install

• Using pip: pip install urban-scraper
• Manual:
  • Clone the folder somewhere
  • CD to the location
  • Install the packages listed in requirements.txt (pip install -r requirements.txt)
  • Copy the folder, urban_scraper where you want to use it.