python-job-scraper

Scrape job listings from multiple job sites with one function call. Results land in a single, normalized pandas.DataFrame.

Supported sites:

• Indeed
• Glassdoor
• LinkedIn
• Naukri
• Foundit
• Shine
• Internshala
• Upwork
• Apna

from jobscraper import scrape_jobs

jobs = scrape_jobs(
    site_name=["indeed", "glassdoor", "linkedin"],
    search_term="software engineer",
    location="Bangalore",
    results_wanted=20,
)

No API keys. No accounts. Chrome 120 TLS fingerprinting keeps requests looking like a real browser.

Installation

Requirements: Python 3.13+

With pip

pip install python-job-scraper

With uv

uv pip install python-job-scraper

From source

git clone https://github.com/seeedstack/job-scraper.git
cd job-scraper

pip install .

Usage

Single site

jobs = scrape_jobs(
    site_name="indeed",
    search_term="data scientist",
    location="Mumbai",
    results_wanted=15,
    hours_old=48,          # only jobs posted in the last 48 hours
    job_type="fulltime",
)
print(jobs[["title", "company", "location", "date_posted", "min_amount"]].head())

Multiple sites in parallel

jobs = scrape_jobs(
    site_name=["indeed", "glassdoor", "linkedin"],
    search_term="product manager",
    location="Delhi",
    results_wanted=10,     # 10 per site → up to 30 total
    description_format="markdown",
)

LinkedIn with authentication (richer data)

Without a cookie, LinkedIn returns public job cards — title, company, location, date. With your li_at cookie, the Voyager API unlocks salary ranges, full descriptions, and direct apply URLs.

LI_AT=your_cookie python examples/test_linkedin.py

jobs = scrape_jobs(
    site_name="linkedin",
    search_term="machine learning engineer",
    location="Hyderabad",
    cookies={"li_at": "your_li_at_cookie_value"},
    is_remote=True,
)

Parameters

Output columns

All-NA columns are dropped automatically. Use enforce_annual_salary=True to normalize hourly/monthly/daily rates to annual before comparing across sites.

Running tests

# Unit tests only
pytest tests/

# Include live integration tests (hits real sites)
pytest tests/ -m integration

License

MIT © 2026 saran

This library is intended for personal and research use. Scraping job sites may conflict with their Terms of Service — use responsibly and at your own risk. No warranty is provided for the accuracy or availability of scraped data.