Skip to main content

changedotorgscraper is an Python package that allows you to scrape online petition data from change.org.

pypi package GitHub Source Code

Installation

To install in python, simply do the following:

pip install changedotorgscraper 

Quick Start

Here we provide a quick example on how you can use changedotorgscraper to scrape petition data right from change.org.

from changedotorgscraper import scrape_petitions

# Specify the url of your scrape.org searches
## for instance, we shall scrape petitions from the search "supplemental nutrition assistance program"
url='https://www.change.org/search?q=Supplemental%20Nutrition%20Assistance%20Program&offset=0'

# scrape the petition data from change.org
SNAP_petitions_df=scrape_petitions(url)
print(SNAP_petitions_df)

It returns a dataframe with all the petitions data, which contains details such as the petition(s) title, description, date created, target audience signature count, location created, victory status, etc.

Requirements

Required packages

To use changedotorgscraper, you are required to have the following packages installed:

  • requests
  • beautifulsoup4
  • tqdm
  • lxml
  • selenium
  • webdriver-manager
  • pandas
  • ast (Python standard library)
  • re (Python standard library)
  • json (Python standard library)
  • time (Python standard library)

If you do not have these packages installed in python, you can do the following:

pip install requests beautifulsoup4 lxml tqdm pandas selenium webdriver-manager

Citation

This package was made as part of a larger study on policy-related opinion mining.

If you wish to cite, you may cite:

Alba, C., Warner, B. C., Saxena, A., Huang, J., & An, R. (2025, July). Towards robust sentiment analysis of temporally-sensitive policy-related online text. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop) (pp. 958-976). doi: 10.18653/v1/2025.acl-srw.70

Questions?

Contact me at alba@wustl.edu

Metadata

Release files for changedotorgscraper 0.1.5

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for changedotorgscraper 0.1.5
File Size Uploaded Provenance
changedotorgscraper-0.1.5.tar.gz 7.6 kB Without provenance Details

Release files / changedotorgscraper-0.1.5.tar.gz

Download URL changedotorgscraper-0.1.5.tar.gz
Size 7.6 kB
Tags Source
SHA-256 checksum
How to use checksums
09ebf77b5ac33c18db6655c8875c8e00e82af15dc3b4f289d810d3e3cf0aced3
BLAKE2b-256 checksum
How to use checksums
5a1ff1a4b4bafd76438deafc1a7c6617a93730166d2b0f6fa4c9a6908c397a9d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.8

Security for changedotorgscraper 0.1.5

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page