Simple wrapper for crawling jobs data at Stack Overflow Jobs portal.
Project description
stackoverflow-jobs
Simple wrapper for crawling jobs data at Stack Overflow Jobs portal.
Basic usage
Creating a query is pretty straightforward:
from stackoverflow_jobs.query import Query
q = Query()
All query filters are available inside filters
module. In case you want to
add new filters, all you need to do is to append them to the Query
object:
from stackoverflow_jobs.query import Query
from stackoverflow_jobs.filters import Role, Remote, Description
q = Query() \
+ Description("Android Developer") \
+ Remote() \
+ Role([Role.Type.MOBILE])
After you build your query, call execute()
to fetch the data:
data = q.execute()
By default, queries requests are timed out after 60 seconds. You can change the timeout value in two different ways:
Query(timeout)
: Every query will end up after the specifiedtimeout
.execute(timeout)
: Set up timeout for a specific query execution.
q1 = Query() # Timeout default value: 60 seconds
q2 = Query(25) # Timeout custom value: 25 seconds
q1.execute() # timeout: 60 seconds
q2.execute() # timeout: 25 seconds
q1.execute(5) # timeout: 5 seconds
q2.execute(5) # timeout: 5 seconds
Important note: The library queries Stack Overflow Jobs RSS feed. This means that you need to parse the XML afterwards.
You can also retrieve the query URL using build_query()
method, in case you
need to:
q.build_query()
>>> 'https://stackoverflow.com/jobs/feed?q=Android+Developer&r=true&dr=MobileDeveloper'
Installing
stackoverflow-jobs
is available in pypi repository:
pip install stackoverflow-jobs
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for stackoverflow_jobs-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1976f819331a4e3d35f847aca3a8d1d00a2743075f7b3578a8d9dd43c6523421 |
|
MD5 | 68e85c6495c73db8283b08fb18f548ac |
|
BLAKE2b-256 | 83250bd5e4279f0a30ec0307ca20e90999d6683bd3b0eb802a7f9ecc50ce2425 |