pudim-hunter-driver-simply-hired 0.0.3

Simply Hired driver implementation for The Pudim Hunter platform

pudim-hunter-driver-simply-hired

A specialized Simply Hired job scraper package built on top of pudim-hunter-driver. This package provides a robust implementation for scraping job listings from Simply Hired while effectively avoiding bot detection mechanisms.

Table of Contents

• Features
• Installation
• Usage
• Development Setup
• Project Structure
• Testing
• Contributing
• License

Features

• Specialized Simply Hired job scraping implementation
• Advanced anti-bot detection using PhantomPlaywrightScraper
• Headless browser automation with Playwright
• Robust error handling and retry mechanisms
• Clean job data extraction and transformation

Installation

From PyPI

pip install pudim-hunter-driver-simply-hired

For Development

git clone [e-mail]:luismr/pudim-hunter-driver-simply-hired.git
cd pudim-hunter-driver-simply-hired
pip install -e .

Usage

from pudim_hunter_driver.models import JobQuery
from pudim_hunter_driver_simply_hired import SimplyHiredJobDriver

# Initialize the driver
driver = SimplyHiredJobDriver()

# Create a job search query
query = JobQuery(
    keywords="software engineer",
    location="San Francisco",
    page=1,
    items_per_page=20
)

# Fetch jobs
job_list = driver.fetch_jobs(query)
for job in job_list.jobs:
    print(f"{job.title} at {job.company}")

Anti-Bot Detection

The SimplyHiredJobDriver uses PhantomPlaywrightScraper internally to implement advanced anti-bot detection measures, ensuring reliable scraping from Simply Hired. This includes:

• Browser fingerprint randomization
• Stealth mode configurations
• Automated request pattern variation
• Advanced header management

Project Structure

pudim-hunter-driver-simply-hired/
├── src/
│   └── pudim_hunter_driver_simply_hired/
│       ├── __init__.py
│       └── driver.py            # SimplyHiredJobDriver implementation
├── tests/
│   ├── __init__.py
│   └── test_simply_hired.py     # SimplyHiredJobDriver tests
├── README.md
├── requirements.txt
├── setup.py
└── pyproject.toml

Development Setup

Prerequisites

• Python 3.9 or higher
• pip (Python package installer)
• venv module

Setup Instructions

1. Create and activate virtual environment:

python3.9 -m venv venv
source venv/bin/activate  # On Windows: .\venv\Scripts\activate

2. Install dependencies:

pip install -r requirements.txt
pip install -e .

3. Install Playwright browsers:

playwright install chromium

Testing

Run the tests:

pytest tests/

The main test file:

• test_simply_hired.py: Tests for SimplyHiredJobDriver implementation and its anti-bot capabilities

Contributing

Getting Started

1. Fork and clone the repository:

git clone [e-mail]:luismr/pudim-hunter-driver-simply-hired.git
cd pudim-hunter-driver-simply-hired

2. Create your feature branch:

git checkout -b feature/amazing-feature

3. Set up development environment as described above

Pull Request Process

1. Update documentation as needed
2. Add/update tests as needed
3. Ensure all tests pass
4. Submit PR for review

License

This project is licensed under the MIT License - see the LICENSE.md file for details.

Copyright (c) 2024-2025 Luis Machado Reis