Staff scraper library for LinkedIn
Project description
StaffSpy is a staff scraper library for LinkedIn.
Features
- Scrapes staff from a company on LinkedIn
- Obtains skills, experiences, certifications & more
- Aggregates the employees in a Pandas DataFrame
Installation
pip install -U staffspy
Python version >= 3.10 required
Usage
from staffspy import scrape_staff
from pathlib import Path
session_file = Path(__file__).resolve().parent / "session.pkl"
staff = scrape_staff(
company_name="openai",
search_term="software engineer",
extra_profile_data=True,
max_results=50,
session_file=str(session_file),
log_level=1,
)
filename = f"staff.csv"
staff.to_csv(filename, index=False)
A browser will open to sign in to LinkedIn on the first sign-in. Press enter after signing in to begin scraping.
Parameters for scrape_staff()
├── company_name (str):
| company identifier on linkedin
| e.g. openai from https://www.linkedin.com/company/openai
Optional
├── search_term (str):
| employee title to search for
| e.g. software engineer
│
├── extra_profile_data (bool)
| fetches educations, experiences, skills, certifications (Default false)
│
├── max_results (int):
| number of employees to fetch, default/max is 1000 for a search imposed by LinkedIn
│
├── session_file (str):
| file path to save session cookies, so only one manual login is needed.
| can use mult profiles this way
│
├── log_level (int):
| Controls the verbosity of the runtime printouts
| (0 prints only errors, 1 is info, 2 is all logs. Default is 0.)
Staff Schema
Staff
Staff
├── search_term
├── id
├── name
|
├── position
├── profile_id
├── profile_link
├── first_name
├── last_name
|
├── followers
├── connections
|
├── location
├── company
├── school
|
├── influencer
├── creator
├── premium
|
├── profile_photo
|
├── skills
│ ├── name
│ └── endorsements
├── experiences
│ ├── from_date
│ ├── to_date
│ ├── duration
│ ├── title
│ ├── company
│ ├── location
│ └── emp_type
├── certifications
│ ├── title
│ ├── issuer
│ ├── date_issued
│ ├── cert_id
│ └── cert_link
└── schools
├── years
├── school
└── degree
Frequently Asked Questions
Q: Can I get my account banned?
A: It is a possiblity, although there are no recorded incidents. Let me know if you are the first.
Q: Encountering issues with your queries?
A: If problems
persist, submit an issue.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
staffspy-0.1.4.tar.gz
(10.0 kB
view hashes)
Built Distribution
staffspy-0.1.4-py3-none-any.whl
(10.5 kB
view hashes)