watchdogs 
Watchdogs to keep an eye on the world's change.
Intro
- This is a web app based on fastapi, databases, uniparser.
- The implementation of views is to be plug-in and portable, which means it can be mounted on other web apps as a sub app:
app.mount("/uniparser", uniparser_app)
- Quite simple to create new crawler with the Web UI.
- All the crawlers runs in the async environment.
- Almost all the buttons has a title attribute to describe the features in Web UI, so docs will not come very early.
Usage
-
pip install -U watchdogs
-
python -m watchdogs
-
view the page on browser: http://127.0.0.1:9901
Args
python -m watchdogs -- -h
- db_url:
sqlite / mysql / postgresql(not test) url, which databases support. Defaults to 'sqlite:///{HOME_PATH}/watchdogs/storage.sqlite'
- password:
init password, if null can be set on the first visit on web.
- ignore_stdout_log:
remove stdout logging
- ignore_file_log:
remove file logging located at {HOME_PATH}/watchdogs folder.
- md5_salt:
md5_salt for custom md5(password) / md5(rss_tag)
- config_dir:
config dir to save the logs and config files, if using sqlite include sqlite file. defaults to {HOME_PATH}/watchdogs
- use_default_cdn:
If Config.cdn_urls not set, and use_default_cdn is True, will use online js/css cdn from staticfile.org.
- **uvicorn_kwargs:
uvicorn startup kwargs, such as port, host. Which can be set like:
python -m watchdogs --port=9999 --host=127.0.0.1
Screenshots
- Welcome Page (Tasks Page).
Here you can see all the tasks meta, goto RSS / Mobile Lite Page, and do some operations to the tasks.
- New Task Page.
Here based on the latest uniparser web app, to create new rules and also tasks.
- Rules Page.
Do some operations for the rules.
- API page.
Based on fastapi
/docswhich is generated automatically.
- Mobile Page (Lite View).
For mobile phone to glimpse the latest result for the current 30 tasks.
1 maintainer
Metadata
1 maintainer
Release files for watchdogs 1.1.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| watchdogs-1.1.6-py3-none-any.whl | Python 3 | none | any | Details |
Release files / watchdogs-1.1.6-py3-none-any.whl
| Download URL | watchdogs-1.1.6-py3-none-any.whl |
|---|---|
| Size | 296.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
265ff7c2b9ad609b8e0a4d2b5219c52264f910f7ee4628ed001bddf667796d66
|
|
BLAKE2b-256 checksum How to use checksums |
30b27a346512e62617ca85c900d5a53252857a8c3a0fcd619e6e7a1a36fded4a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.13.0 pkginfo/1.4.2 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.1
|
