Skip to main content

Scrapes VK user's photos

Project description

VK Scraper

Python 3.5, 3.6, 3.7 PyPI AUR Travis

vk-scraper is a command-line application written in Python that scrapes and downloads VK user's / community's data. Use responsibly.

To get a closer look at how it works, read the docs.

Inspired by instagram-scraper.

Features

  • Scrape user's photos
  • Scrape user's videos (both uploaded and external)
  • Scrape user's saved photos
  • Scrape user's stories

Install

Arch GNU/Linux

For the stable version:

$ trizen -S vk-scraper

For the git version:

$ trizen -S vk-scraper-git

Other distros

For the stable version:

$ pip3 install vk-scraper --upgrade --user

For the git version:

$ pip3 install git+https://github.com/vanyasem/VK-Scraper.git --upgrade --user

Usage

To scrape user's media:

vk-scraper <username> -u <your username> -p <your password>

By default, downloaded media will be placed in <current working directory>/<username>.

To specify multiple users, pass a delimited list of users:

vk-scraper username1,username2,username3

You can also supply a file containing a list of usernames:

vk-scraper -f vk_users.txt
# vk_users.txt

username1
username2
username3

# and so on...

Usernames may be separated by newlines, commas, semicolons, or whitespace.

Arguments

--help -h             Show help message and exit

--login-user  -u      VK username

--login-pass  -p      VK password

--filename    -f      Path to a file containing a list of users / communities to scrape

--destination -d      Specify the download destination. By default, media will
                      be downloaded to <current working directory>/<username>

--retain-username -n  Creates a username subdirectory when the destination flag is set

--media-types -t      Specify media types to scrape. Enter as space separated values.
                      Valid values are image, saved, video, story, or none
                      (defaults to image)

--latest              Scrape only new media since the last scrape. Uses the last modified
                      time of the latest media item in the destination directory to compare

--quiet       -q      Be quiet while scraping

--maximum     -m      Maximum number of items to scrape

Contributing

  1. Check open issues or open a new one to start a discussion around your idea or a bug you found
  2. Fork the repository and make your changes
  3. Send a pull request

Futurelog

  • Scrape by hashtag
  • Scrape by location
  • Save metadata to a file (likes, comments, etc)
  • Sort photos by their albums

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

VK-Scraper-2.0.3.tar.gz (19.7 kB view details)

Uploaded Source

File details

Details for the file VK-Scraper-2.0.3.tar.gz.

File metadata

  • Download URL: VK-Scraper-2.0.3.tar.gz
  • Upload date:
  • Size: 19.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.1

File hashes

Hashes for VK-Scraper-2.0.3.tar.gz
Algorithm Hash digest
SHA256 3e0b34f1825c3f412b400166026523cad99b3f3c53ba18865dc27e49e66f3a8b
MD5 76e5ae3b6f4060585a6fff745c4a7d20
BLAKE2b-256 bb2ff4ad521a9f307a7c9dfcc942b3fcf4e042a3c2ca03ca605ef6d375102126

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page