sense_text_extractor
Project description
sense-text-extractor
sense-text-extractor是正文抽取客户端库
安装方式(当前版本0.0.1)
pip install sense-text-extractor
使用指南
基于sense-core的settings.ini的label配置调用:
from sense_text_extractor import SenseTextExtractor
extractor = SenseTextExtractor(label='text_extractor')
text = extractor.extract_text("http://sports.sina.com.cn/g/pl/2019-01-11/doc-ihqhqcis5048507.shtml", "穆里尼奥在等待复出")
print(text)
使用host和port的调用:
extractor = SenseTextExtractor('52.83.143.61', '6681')
text = extractor.extract_text("http://sports.sina.com.cn/g/pl/2019-01-11/doc-ihqhqcis5048507.shtml", "穆里尼奥在等待复出")
print(text)
使用说明
extract_text方法可能抛出异常,需要自己捕捉。返回结果是string,如果是''字符串,表示可能没有抽取出正文。 如果用于爬虫,extract_text需要传入第三个参数,也就是下载的html源码,否则extractor的sever端因为获取超时而抛出异常,也容易被反爬虫限制。
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for sense-text-extractor-0.0.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5a228b7018ff6da2841ca3c20a03ce13a605b40f7f5b9192811d471f4904c39d |
|
MD5 | 53c27cec66313b3ae01a2aa445c57e23 |
|
BLAKE2b-256 | 6726fd429b14b5ccb4f993a5e0444737de80e506ebaf4ad39b232331a339b159 |
Close
Hashes for sense_text_extractor-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 534b68fa53f1a40214b3d9b44403b8707307be26e07a56abeff73f964fed7fea |
|
MD5 | a8875104384a8dc0957553327a730f01 |
|
BLAKE2b-256 | ef7c48f52299440f15fcfd6d4d646cc5be517170a7e0e421fe60a2d4932dc3b7 |