content-downloader
Python package with command line utility to download files on any topic in bulk.
content-downloader supports Python 2 as well as Python 3.
Feature update: Download files parallely.
Installation
To install content-downloader, simply,
$ pip install ctdl
Command line usage
$ ctdl [-h] [-f FILE_TYPE] [-l LIMIT] [-d DIRECTORY] [-a] [-p] [query]
Optional arguments are:
-f FILE_TYPE : set the file type. (can take values like ppt, pdf, xml, etc.)
Default value: pdf
-l LIMIT : specify the number of files to download.
Default value: 10
-d DIRECTORY : specify the directory where files will be stored.
Default: A directory with same name as the search query in the current directory.
-p : for parallel downloading.
Here are some examples:
To get list of available filetypes:
$ ctdl -a
To download pdf files on topic ‘python’:
$ ctdl python This is the default behaviour which will download 10 pdf files in a folder named ‘python’ in current directory.
To download 3 ppt files on ‘health’:
$ ctdl -f ppt -l 3 health
To expicitly specify download folder:
$ ctdl -d /home/nikhil/Desktop/ml-pdfs machine learning
To download files parallely: $ ctdl -f pdf -p python
Usage in Python files
from ctdl import ctdl
filetype = 'ppt'
limit = 5
directory = '/home/nikhil/Desktop/ml-pdfs'
query = 'machine learning using python'
ctdl.download_content(query, filetype, directory, limit)
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file ctdl-1.3.tar.gz.
File metadata
- Download URL: ctdl-1.3.tar.gz
- Upload date:
- Size: 4.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
937fac0de604aa159937a0c79cfa3a322d0a464a012b8430f1f918b7d72d7583
|
|
| MD5 |
42fb298a5e7df00b25dd100ae87b1b48
|
|
| BLAKE2b-256 |
fe2c6dfd46e5f3d361fe56f8300eb0e14f9f0dfdd4401ed6966b53211c9dfe77
|
