Skip to main content

A library to extract data from Baidu SERP and output it as JSON objects

Project description

English | 中文

Baidu SERP API

A Python library to extract data from Baidu Search Engine Results Pages (SERP) and output it as JSON objects.

Installation

pip install baidu-serp-api

Usage

from baidu_serp_api import BaiduPc, BaiduMobile

pc_serp = BaiduPc()
results = pc_serp.search('keyword', date_range='20240501,20240531', pn='2', proxies={'http': 'http://your-proxy-server:port'})
print(results)

m_serp = BaiduMobile()
results = m_serp.search('keyword', date_range='day', pn='2', proxies={'http': 'http://your-proxy-server:port'})
print(results)

# Filter the specified content. The following returned results do not contain 'recommend', 'last_page', 'match_count'
results = m_serp.search('关键词', exclude=['recommend', 'last_page', 'match_count'])

Parameters

  • keyword: The search keyword.
  • date_range (optional): Search for results within the specified date range. the format should be a time range string like '20240501,20240531', representing searching results between May 1, 2024, and May 31, 2024.
  • pn (optional): Search for results on the specified page.
  • proxies (optional): Use proxies for searching.

Return Values

  • {'code': 500, 'msg': '网络请求错误'}: Network request exception.
  • {'code': 501, 'msg': '百度安全验证'}: Baidu security verification required.
  • {'code': 404, 'msg': '未找到相关结果'}: No relevant results found.
  • {'code': 403, 'msg': '疑似违禁词'}: Suspected prohibited word.
  • {'code': 200, 'msg': 'ok', 'data': {'results': [], 'recommend': [], last_page': True}}: Successful response.
    • results search results list.
    • recommend recommend keywords.
    • last_page indicates whether it's the last page.

Disclaimer

This project is intended for educational purposes only and must not be used for commercial purposes or for large-scale scraping of Baidu data. This project is licensed under the GPLv3 open-source license. If other projects utilize the content of this project, they must be open-sourced and acknowledge the source. Additionally, the author of this project shall not be held responsible for any legal risks resulting from misuse. Violators will bear the consequences at their own risk.

百度SERP API

一个用于从百度搜索结果页面(SERP)提取数据并将其输出为JSON对象的Python库。

安装

pip install baidu-serp-api

使用

from baidu_serp_api import BaiduPc, BaiduMobile

pc_serp = BaiduPc()
results = pc_serp.search('关键词', date_range='20240501,20240531', pn='2', proxies={'http': 'http://你的代理服务器:端口'})
print(results)

m_serp = BaiduMobile()
results = m_serp.search('关键词', date_range='20240501,20240531', pn='2', proxies={'http': 'http://你的代理服务器:端口'})
print(results)

# 过滤指定内容,以下返回的结果不含'recommend', 'last_page', 'match_count'
results = m_serp.search('关键词', exclude=['recommend', 'last_page', 'match_count'])

参数

  • keyword: 搜索关键词。
  • date_range (可选): 在指定日期范围内搜索结果。格式应为一个时间范围字符串,如 '20240501,20240531',表示搜索2024年5月1日至2024年5月31日之间的结果。
  • pn (可选): 搜索指定页码的结果。
  • proxies (可选): 使用代理进行搜索。

返回值

  • {'code': 500, 'msg': '网络请求错误'}: 网络请求失败需要重试。
  • {'code': 502, 'msg': '百度安全验证'}: 需要进行百度安全验证。
  • {'code': 404, 'msg': '未找到相关结果'}: 未找到相关结果。
  • {'code': 403, 'msg': '疑似违禁词'}: 疑似违禁词。
  • {'code': 200, 'msg': 'ok', 'data': {'results': [], 'last_page': True}}: 成功响应。
    • results 搜索结果列表。
    • recommend 推荐相关搜索词。
    • last_page 表示是否为最后一页。

免责声明

本项目仅供学习之用,不可用于商业目的或大规模爬取百度数据。本项目采用GPLv3开源许可,若涉及到其他项目使用本项目内容,需开源并注明来源。同时,本项目作者不对滥用行为可能导致的法律风险承担责任,违者自负后果。

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

baidu_serp_api-1.0.9.tar.gz (23.0 kB view details)

Uploaded Source

Built Distribution

baidu_serp_api-1.0.9-py3-none-any.whl (24.3 kB view details)

Uploaded Python 3

File details

Details for the file baidu_serp_api-1.0.9.tar.gz.

File metadata

  • Download URL: baidu_serp_api-1.0.9.tar.gz
  • Upload date:
  • Size: 23.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.12.7

File hashes

Hashes for baidu_serp_api-1.0.9.tar.gz
Algorithm Hash digest
SHA256 abbfb5bbfa9272bada426883b122d933092f23bedc10edd0574a6e8bfcd79106
MD5 0da2eb647220b831c3dae1834cf4e3e1
BLAKE2b-256 3492b44dc1a6d8231c05096f258f95b54551337b26b04f7d70268208fd23781d

See more details on using hashes here.

File details

Details for the file baidu_serp_api-1.0.9-py3-none-any.whl.

File metadata

File hashes

Hashes for baidu_serp_api-1.0.9-py3-none-any.whl
Algorithm Hash digest
SHA256 99014e21499ffb47ecc32594e60d6cac267148e35584309bf3f84146c5b80924
MD5 6339c61c6ef565ee382344d2c0b61306
BLAKE2b-256 f87acbbe3a3b43b70c014dd9f2c396e696331f71af6a65b573b9e345cc6a4525

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page