Skip to main content

Scraping and Web Crawling Framework

Project description

## Getting started

❯ git clone
❯ cd daenerys
❯ virtualenv venv
❯ source venv/bin/activate
❯ pip install -r requirements.txt
# 安装配置Redis和MongoDB
❯ cd demo
❯ python # 启动worker(默认5个进程)
❯ python # 新开启一个终端,启动Beat服务生成任务
❯ ipython # 发布一个需要获取执行结果的任务
In [1]: from messaging import sync_get

In [2]: sync_get('flask')
PUT flask
{u'author': u'Armin Ronacher',
u'download_url': u'',
u'name': u'flask',
u'version': u'0.12.1'}

Project details

Release history Release notifications

This version
History Node


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
daenerys-0.1-py3-none-any.whl (7.2 kB) Copy SHA256 hash SHA256 Wheel py3
daenerys-0.1.tar.gz (4.9 kB) Copy SHA256 hash SHA256 Source None

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page