sense_text_extractor
Project description
sense-text-extractor
sense-text-extractor是正文抽取客户端库
安装方式(当前版本0.0.1)
pip install sense-text-extractor
使用指南
基于sense-core的settings.ini的label配置调用:
from sense_text_extractor import SenseTextExtractor
extractor = SenseTextExtractor(label='text_extractor')
text = extractor.extract_text("http://sports.sina.com.cn/g/pl/2019-01-11/doc-ihqhqcis5048507.shtml", "穆里尼奥在等待复出")
print(text)
使用host和port的调用:
extractor = SenseTextExtractor('52.83.143.61', '6681')
text = extractor.extract_text("http://sports.sina.com.cn/g/pl/2019-01-11/doc-ihqhqcis5048507.shtml", "穆里尼奥在等待复出")
print(text)
使用说明
extract_text方法可能抛出异常,需要自己捕捉。返回结果是string,如果是''字符串,表示可能没有抽取出正文。 如果用于爬虫,extract_text需要传入第三个参数,也就是下载的html源码,否则extractor的sever端因为获取超时而抛出异常,也容易被反爬虫限制。
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for sense-text-extractor-0.0.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 93f992ac95c7f0a16ad942b9ef0f95817a2cd332c2bf2f794ba5745855a6bb1e |
|
MD5 | 3dba2e32fa172bf537f843ad86da8bb8 |
|
BLAKE2b-256 | a16836cce1fdd65022979a5e11336f92647dd2aca83118bff4e4339ca6d38cd1 |
Close
Hashes for sense_text_extractor-0.0.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 364f8f00e48d972b33ce26e74875f5c6e0846acdb9ea55e887fe42227771be5f |
|
MD5 | 7cb0c009273e8c30d6cc309479840e57 |
|
BLAKE2b-256 | 372ba5b8fd6b18436ffa39a590bb4ebc769ba5bad47ecb65748259ea7c425aa8 |