Asynchronous and Synchronous Urban Dictionary Scraper

It uses selectolax to parse the HTML and httpx for sending HTTP requests.

Asynchronous Example

import asyncio
from urban_scraper import adefine


async def main():
    definitions = await adefine('hello')
    async for definition in definitions:
        ...

asyncio.run(main())

Synchronous Example

from urban_scraper import define

definitions = define('hello')

for definition in definitions:
    ...

In both examples, definition is urban_scraper.Definition

Attributes and Methods of urban_scraper.Definition

Attributes

• defid
• name
• meaning
• example
• author
  • name
  • url
• date
• upvote
• downvote

Methods

• as_dict()
  • Converts the dataclass to a dict object and returns it.

How To Install

• Using pip: pip install urban-scraper
• Manual:
  • Clone the folder somewhere
  • CD to the location
  • Install the packages listed in requirements.txt (pip install -r requirements.txt)
  • Copy the folder, urban_scraper where you want to use it.