Declarative web parsers
Project description
Soupstars :stew: :star: :boom:
Soupstars makes it fast and easy to build web parsers in Python.
It supports python 3.7+
Quickstart
Install it with pip.
pip install soupstars
Create a new parser in the file myparser.py.
soupstars create -m myparser.py
Parsers are python modules that can be executed directly. For a tutorial on building your own see the documentation.
cat myparser.py
...
You can test that the parser functions correctly.
soupstars test myparser.py
More feature are available in the CLI.
soupstars --help
Additional help is available in the documentation.
Deploying to soupstars.cloud
You can deploy your parsers to be ran on our managed infrastructure.
Use the CLI to create an account. You'll be prompted for a username and password.
soupstars register
Upload your parser.
soupstars push myparser.py
You can now run the parser from our service.
soupstars run myparser.py
Development
Clone this repo.
git clone git@github.com:tjwaterman99/soupstars.git &&
cd soupstars
Install the package in development mode.
python setup.py develop
To develop against a local install of the latest version of the web API,
download and run the soupstars-api package.
git clone ...
docker-compose up --build --detach
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file soupstars-2.0.0.tar.gz.
File metadata
- Download URL: soupstars-2.0.0.tar.gz
- Upload date:
- Size: 5.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.20.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.34.0 CPython/3.7.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3284ce461aa56b465a609c53c04c10d6a3b16a450776dc64dfb7cd9eb0d0cefb
|
|
| MD5 |
0a9d9f7a98954d20294e5c9511b8e8bb
|
|
| BLAKE2b-256 |
87d1af29347af70cad33e8865c2ae5f279966d7a59d5a22711b31a897ac383fc
|
File details
Details for the file soupstars-2.0.0-py3-none-any.whl.
File metadata
- Download URL: soupstars-2.0.0-py3-none-any.whl
- Upload date:
- Size: 8.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.20.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.34.0 CPython/3.7.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f4fb90eb8af96bf8c64ebcfde3a3c70658b7f17005b9774e7a77641c06b4250b
|
|
| MD5 |
b43a2e952e79a1a2e2b4f8a79072c59b
|
|
| BLAKE2b-256 |
35ff2422831f6e39cc925f6c7c221a344399ffb0e413e6e07e8ff886289a52f8
|
