Skip to main content

Django KAOS web clipper

Clip web pages html and store in Django

Quick start

pip install dj-kaos-webclipper

Add webclipper to INSTALLED_APPS if you want to use the generic webclip model, or extend AbstractWebClip if you want to customize it on your application.

If you go with the generic WebClip model, you can get REST endpoint by using the router defined in rest.routes.

Your end users will send the title, URL and HTML content of the page using the REST API endpoint, and they get saved to the models. You can extend the WebClip model in a proxy model, and extend RawItemMixin from the library, which gives you an interface to parse the page using Scrapy's API.

Development and Testing

IDE Setup

Add the example directory to the PYTHONPATH in your IDE to avoid seeing import warnings in the tests modules. If you are using PyCharm, this is already set up.

Running the Tests

Install requirements

pip install -r requirements.txt

For local environment

pytest

For all supported environments

tox

Metadata

Release files for dj-kaos-webclipper 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dj-kaos-webclipper 0.1.0
File Size Uploaded Provenance
dj-kaos-webclipper-0.1.0.tar.gz 6.7 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for dj-kaos-webclipper 0.1.0
File Interpreter ABI Platform
dj_kaos_webclipper-0.1.0-py3-none-any.whl Python 3 none any Details

Total release size: 17.5 kB

Release files / dj-kaos-webclipper-0.1.0.tar.gz

Download URL dj-kaos-webclipper-0.1.0.tar.gz
Size 6.7 kB
Tags Source
SHA-256 checksum
How to use checksums
c83ef9ef0d927279a63828c2342e02dc41173085b90793f6b8d1be7ba5ffac38
BLAKE2b-256 checksum
How to use checksums
8108397d8ee27546c51e90c45468ff9ff01e8df971b516e71b4de82a5e61fdd8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.0 CPython/3.9.10

Release files / dj_kaos_webclipper-0.1.0-py3-none-any.whl

Download URL dj_kaos_webclipper-0.1.0-py3-none-any.whl
Size 10.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
064cb282124885bf5b0c4c0c2ba6c0694b24d0996e3e0a7952b3be677249b129
BLAKE2b-256 checksum
How to use checksums
32284349a0f3f002a5bf95cc521c12db94da349cacc02b6f85bc28bbfbffea1b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.0 CPython/3.9.10

Security for dj-kaos-webclipper 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page