Skip to main content

A python3 library for download Movie comment from Maoyan

Project description

# 猫眼电影数据爬虫

### __两行代码 爬取想要的影评__

* 环境配置
1. Docker方式(推荐)

使用 打包好的Dockerfile构建(暂未提供)

2. 传统部署(默认已安装python环境)
***
步骤:
1. pip install requirement.txt 安装工程所需模块
2. sudo apt install mongodb 安装mongodb(使用txt保存数据可跳过)


---
* 使用方法
```python
# 引入Maoyan类
from crawel_utils.download import Maoyan

if __name__ == '__main__':
# movie_id是电影对应的猫眼id,pegesize是选择下载评论的页数,thread_max仅用于多线程下载,为线程数
maoyan = Maoyan(movie_id=1175253, page_size=40, thread_max=20)
# 保存到mongodb
maoyan.multi_thread_download(func=maoyan.save_to_mongo)
# 保存到txt文本
maoyan.multi_thread_download(func=maoyan.save_to_txt)

```


Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

SimpleCat-1.1.0-py2.py3-none-any.whl (3.1 kB view details)

Uploaded Python 2Python 3

File details

Details for the file SimpleCat-1.1.0-py2.py3-none-any.whl.

File metadata

  • Download URL: SimpleCat-1.1.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 3.1 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.14.2 setuptools/36.4.0 requests-toolbelt/0.8.0 tqdm/4.15.0 CPython/3.6.2

File hashes

Hashes for SimpleCat-1.1.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 be8adb366d4d461caef25c2a4e69d3bc1c9847f68af983bdf72dc21282598ddb
MD5 251669a17cc3a6d3fc04d6d0d37f9fd9
BLAKE2b-256 7789dd289529125fde73670b427fbdd91d5f2c9628ace9dd6b6cac4714c8cd5a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page