Skip to main content

Yongle local data collection CLI

Project description

yongle-worker

yongle-worker 是永乐数据平台的本地采集 CLI。采集任务在你的电脑上执行,平台账号用于登录、余额校验和任务结算。

安装

pip install yongle-worker

建议使用 Python 3.10 或更高版本。

快速开始

启动交互模式:

yongle-worker

登录账号:

/login YOUR_API_KEY

公网服务地址已内置,正常使用不需要额外配置。

查看可用模型:

yongle-worker run --list-models

运行携程采集:

yongle-worker run --model 携程 --city 杭州 --pages 3 --items 20 --comments 5

运行 BOSS 采集:

yongle-worker auth boss import-browser --browser auto
yongle-worker run --model Boss直聘 --keyword 爬虫工程师 --city 上海 --pages 2

常用命令

yongle-worker
yongle-worker run --list-models
yongle-worker run --interactive
yongle-worker doctor
yongle-worker doctor --provider boss --skip-control
yongle-worker auth boss import-browser --browser auto

说明:

  • run:正式任务入口,执行前会展示任务预览和预计点数。
  • run --interactive:按步骤填写任务参数。
  • doctor:检查本机运行环境和账号状态。
  • auth boss import-browser:从本机浏览器导入 BOSS 登录态,用于本机采集。

登录与本地数据

  • CLI 默认连接永乐数据公网服务,不需要额外配置服务地址。
  • API Key 只用于当前设备登录和任务结算,请不要发给他人。
  • 登录态默认保存在本机,并尽量使用本机加密能力保护。
  • BOSS Cookie 只用于本机采集,不需要手动粘贴到平台页面。
  • 如不想保存本机登录态,可设置 YONGLE_PERSIST_LOGIN_SESSION=0

常见问题

401 或 API Key 无效

确认 API Key 是否复制完整,并重新执行:

/login YOUR_API_KEY

余额不足

减少任务页数、条数或评论数,或先完成充值后重试。

BOSS 任务提示未登录

先在本机浏览器登录 BOSS,再执行:

yongle-worker auth boss import-browser --browser auto

网络连接失败

执行:

yongle-worker doctor

如果只是临时网络问题,稍后重试即可。

隐私边界

  • 采集过程在用户本机执行。
  • 请只在你有合法授权的场景下使用本工具。
  • 不要在公开聊天、截图或工单中暴露 API Key、浏览器 Cookie、验证码、支付订单号等敏感信息。

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

yongle_worker-0.1.1.tar.gz (104.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

yongle_worker-0.1.1-py3-none-any.whl (107.4 kB view details)

Uploaded Python 3

File details

Details for the file yongle_worker-0.1.1.tar.gz.

File metadata

  • Download URL: yongle_worker-0.1.1.tar.gz
  • Upload date:
  • Size: 104.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.10

File hashes

Hashes for yongle_worker-0.1.1.tar.gz
Algorithm Hash digest
SHA256 b59b5310d3881f0328168fe9d8da59b425d6bb3171dba2fbd873ed844be07c1a
MD5 eb70c5f9643498938adad410ea8845dc
BLAKE2b-256 6fe41201e24f9d97f57945f5744bd63ea5a3c54086128c062004dbc5c76e4e9b

See more details on using hashes here.

File details

Details for the file yongle_worker-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: yongle_worker-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 107.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.10

File hashes

Hashes for yongle_worker-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 fa98565999fc78713fe7e9a42459a8ec98e4b36dafd5ab3deddc59c5e5628d7f
MD5 97525543f763c2526586d42c537f5cb2
BLAKE2b-256 40f5b6862d25fcf3f92452a43841178a8c65d4843a43913d8049605c6236667b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page