Skip to main content

Scrapes online petition data from change.org

Project description

ChangeDotOrgScraper is an Python package that allows you to scrape online petition data from change.org.

pypi package GitHub Source Code

Installation

To install in python, simply do the following:

pip install ChangeDotOrgScraper

Quick Start

Here we provide a quick example on how you can use ChangeDotOrgScraper to scrape petition data right from change.org.

from ChangeDotOrgScraper import scrape_petitions



# Specify the url of your scrape.org searches

## for instance, we shall scrape petitions from the search "supplemental nutrition assistance program"

url='https://www.change.org/search?q=Supplemental%20Nutrition%20Assistance%20Program&offset=0'



# scrape the petition data from change.org

SNAP_petitions_df=scrape_petitions(url)

print(SNAP_petitions_df)

It returns a dataframe with all the petitions data, which contains details such as the petition(s) title, description, date created, target audience signature count, location created, victory status, etc.

Requirements

Required packages

To use ChangeDotOrgScraper, you are required to have the following packages installed:

  • requests

  • beautifulsoup4

  • tqdm

  • pandas

  • ast (Python standard library)

  • re (Python standard library)

  • json (Python standard library)

If you do not have these packages installed in python, you can do the following:

pip install requests beautifulsoup4 tqdm pandas

Citation

This package was made as part of a larger study on food stamps (i.e., SNAP), therefore, we do not have the paper ready just yet.

However, if you wish to cite, you may cite:

C Alba (2024) ChangeDotOrgScraper: A python package to scrape petition data from change.org. PyPi.

Questions?

Contact me at alba@wusl.edu

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

changedotorgscraper-0.0.8.tar.gz (5.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ChangeDotOrgScraper-0.0.8-py3-none-any.whl (5.9 kB view details)

Uploaded Python 3

File details

Details for the file changedotorgscraper-0.0.8.tar.gz.

File metadata

  • Download URL: changedotorgscraper-0.0.8.tar.gz
  • Upload date:
  • Size: 5.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.4

File hashes

Hashes for changedotorgscraper-0.0.8.tar.gz
Algorithm Hash digest
SHA256 397ab7cdbb7ed598ef8b3fca4851e927a33aca4e5c5ff62878412d6a8840d46f
MD5 683584f659d3a1934718e3600a7c96ad
BLAKE2b-256 110957aa8f7d6860ec72263283ea37d0dca4e2890dcfc8b79f97a0dd277a0471

See more details on using hashes here.

File details

Details for the file ChangeDotOrgScraper-0.0.8-py3-none-any.whl.

File metadata

File hashes

Hashes for ChangeDotOrgScraper-0.0.8-py3-none-any.whl
Algorithm Hash digest
SHA256 73cbbcf517c3a21fe6a2ce83467631786e1f18c7d1a5446a3bd6854f26a0bf0e
MD5 7447655f193b848f5e505d1e09773741
BLAKE2b-256 7d631d268f75cdd08e2584d2d20367f31fae84d0f3ecbcbd83f4ef245bb53a0c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page