pooled-job-scraper 0.1.0

Generic job listings scraper with baseline dedupe and optional Netlify cache submission.

Generic Job Listings Scraper

This scraper accepts one or more business websites, infers careers/listings structure, extracts candidate job listings, and writes:

• all scraped rows
• rows not found in the April 2026 JobPool baseline dataset

It can also POST unique rows to the Netlify cache function for review.

Run

py scripts/generic_job_listings_scraper.py `
  --business-url https://mossyhonda.hireology.careers/ `
  --company-name "Mossy Honda" `
  --output output/mossy-scraped.csv `
  --unique-output output/mossy-unique.csv

Send Unique Rows To Netlify Cache

py scripts/generic_job_listings_scraper.py `
  --business-url https://mossyhonda.hireology.careers/ `
  --company-name "Mossy Honda" `
  --cache-endpoint https://<your-netlify-site>/api/scrape-cache `
  --output output/mossy-scraped.csv `
  --unique-output output/mossy-unique.csv

The scraper infers user_name from local environment/git config and sends:

• user_name
• request_timestamp
• source_business_urls
• listings (including the standard listing fields and any additional fields present)

Cache API

• POST /api/scrape-cache stores a scrape request payload.
• GET /api/scrape-cache?limit=25&user_name=<name> returns recent cached submissions.