MCP Aim Crawler
这是一个基于MCP协议的网站爬虫项目。
项目结构
mcp_aim_crawler/
├── tests/ # 测试用例目录
└── mcp_aim_crawler/ # 主要源代码目录
├── crawler.py # 爬虫核心逻辑
└── logger.py # 日志配置
环境要求
- Python 3.12.9
- Poetry
- pyenv
安装方法
- 使用pyenv安装Python 3.12.9:
pyenv install 3.12.9
pyenv local 3.12.9
- 安装项目依赖:
poetry install
运行方法
poetry run python -m mcp_aim_crawler
环境变量
在项目根目录创建 .env 文件，包含以下配置:
WEBSITE_URL: 目标网站URLUSERNAME: 登录用户名PASSWORD: 登录密码MCP_TOKEN: MCP令牌
1 maintainer
Metadata
1 maintainer
Release files for mcp-aim-crawler 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| mcp_aim_crawler-0.1.0.tar.gz | 27.1 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| mcp_aim_crawler-0.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 34.3 kB
Release files / mcp_aim_crawler-0.1.0.tar.gz
| Download URL | mcp_aim_crawler-0.1.0.tar.gz |
|---|---|
| Size | 27.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
ddddb2445a492ef8de7a4c2a23fb979525dbeef0f9e63a54f65fbfcb8c0950ef
|
|
BLAKE2b-256 checksum How to use checksums |
d00903c9571c1f6a1158856f17c335bd04cd4e9ae685a15cdbb6a54366e52bb9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.9
|
Release files / mcp_aim_crawler-0.1.0-py3-none-any.whl
| Download URL | mcp_aim_crawler-0.1.0-py3-none-any.whl |
|---|---|
| Size | 7.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
96e5c8fd684c9b160e988e4ab5f8c903813c51aa1ef6b5e09b980951b67189d1
|
|
BLAKE2b-256 checksum How to use checksums |
ed2dde799a235757f393fa7f0ff2139d2e302b60160b49b88652d3bc948ba012
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.9
|
