Skip to main content

支持AI总结的社交媒体聚合解析器

Project description

ParseHub

支持AI总结的社交媒体聚合解析器
Social Media Aggregation Analyzer Supported by AI Summarization

视频总结使用 whisper-1 模型

基于该项目开发的 Tg Bot:
@ParsehubBot | https://github.com/z-mio/parse_hub_bot

支持的平台:
Twitter 视频|图文
Instagram 视频|图文
微博 视频|图文
贴吧 视频|图文
小红书 视频|图文
Youtube 视频|音乐
Facebook 视频
Bilibili 视频|动态
抖音|TikTok 视频|图文
微信公众号 图文
最右 视频|图文
酷安 视频|图文 ......

安装

pip install parsehub


[!IMPORTANT]

注意

Linux用户在导入skia-python包时可能会遇到以下报错

libGL.so.1: cannot open shared object file: No such file or directory

Windows用户在缺少Microsoft Visual C++ Runtime时可能会遇到以下报错

ImportError: DLL load failed while importing skia: The specified module could not be found.

解决方法

ubuntu用户

# Ubuntu 22 安装
apt install libgl1-mesa-glx
# Ubuntu 24 安装
apt install libgl1 libglx-mesa0

ArchLinux用户

pacman -S libgl

centos用户

yum install mesa-libGL -y

Windows用户

下载链接Microsoft Visual C++ 2015 Redistributable Update 3 RC

使用

from parsehub import ParseHub
from parsehub.config import ParseConfig, DownloadConfig
import asyncio


async def main():
    ph = ParseHub(config=ParseConfig())
    result = await ph.parse('https://twitter.com/aobuta_anime/status/1827284717848424696')
    print(result)

    # dr = await result.download()
    # print(dr.media)
    # sr = await dr.summary()
    # await dr.delete()

    sr = await result.summary(download_config=DownloadConfig())
    print(sr.content)


if __name__ == '__main__':
    asyncio.run(main())

环境变量

名称 描述 默认值
PROVIDER 模型提供商, 支持: openai openai
API_KEY API Key
BASE_URL API 地址 https://api.openai.com/v1
MODEL AI总结使用的模型 gpt-4o-mini
PROMPT AI总结提示词 You are a useful assistant to summarize the main points of articles and video captions. Summarize 3 to 8 points in "Simplified Chinese" and summarize them all at the end.
TRANSCRIPTIONS_PROVIDER 语音转文本模型提供商 支持: openai,azure,fast_whisper openai
AZURE_SPEECH_REGION 语音转文本 azure端点
AZURE_SPEECH_KEY 语音转文本 azure密钥

参考项目

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

parsehub-1.2.11.tar.gz (62.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

parsehub-1.2.11-py3-none-any.whl (87.3 kB view details)

Uploaded Python 3

File details

Details for the file parsehub-1.2.11.tar.gz.

File metadata

  • Download URL: parsehub-1.2.11.tar.gz
  • Upload date:
  • Size: 62.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.6.12

File hashes

Hashes for parsehub-1.2.11.tar.gz
Algorithm Hash digest
SHA256 6d6634525c905034094954872c48f5b4ad8ab44a6cd2a1b3657b6ee5c1092b5e
MD5 0bf3e6145ad9909f25dca8b641216c8a
BLAKE2b-256 4149b895344d76f8b6a49fb71ba41d9d45f0539301fa2cc8b14432b097092440

See more details on using hashes here.

File details

Details for the file parsehub-1.2.11-py3-none-any.whl.

File metadata

  • Download URL: parsehub-1.2.11-py3-none-any.whl
  • Upload date:
  • Size: 87.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.6.12

File hashes

Hashes for parsehub-1.2.11-py3-none-any.whl
Algorithm Hash digest
SHA256 0337eef4aec1951f1651b9a682ebcba1346681536310ed3775a70cb0073c5c0d
MD5 33225abb9e1bc7464f8b4a95d20c50d8
BLAKE2b-256 e60ffc161cfe55baa9cc423e71a52cab5b57206edb1e49f15a3b74d176098ce6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page