A collection of command-line tools that facilitate the obtaining, scrubbing and exploring of data.
Project description
# datalogy
[![Build Status](https://secure.travis-ci.org/michaeljoseph/datalogy.png)](http://travis-ci.org/michaeljoseph/datalogy) [![Stories in Ready](https://badge.waffle.io/michaeljoseph/datalogy.png?label=ready)](https://waffle.io/michaeljoseph/datalogy) [![pypi version](https://badge.fury.io/py/datalogy.png)](http://badge.fury.io/py/datalogy) [![# of downloads](https://pypip.in/d/datalogy/badge.png)](https://crate.io/packages/datalogy?version=latest) [![code coverage](https://coveralls.io/repos/michaeljoseph/datalogy/badge.png?branch=master)](https://coveralls.io/r/michaeljoseph/datalogy?branch=master)
![datalogy](https://github.com/michaeljoseph/datalogy/raw/master/resources/datalogy.jpg)
A collection of python tools that facilitate the obtaining, scrubbing and exploring of data.
## scrape
Extract HTML elements using an XPath query or CSS3 selector.
### Example usage
- curl -s http://en.wikipedia.org/wiki/List_of_sovereign_states |
scrape -be ‘table.wikitable > tr > td > b > a’
## random-sample
Output lines from stdin to stdout with a given probability, for a given duration, and with a given delay between lines.
### Example usage
seq 100 | random-sample -r 20% -d 1000
## Testing
Install development requirements:
pip install -r requirements.txt
Run the tests with:
nosetests
Lint the project with:
flake8 datalogy tests
## API documentation
To generate the documentation:
cd docs && PYTHONPATH=.. make singlehtml
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file datalogy-0.1.0.tar.gz
.
File metadata
- Download URL: datalogy-0.1.0.tar.gz
- Upload date:
- Size: 18.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5854efc49f1ed796338b5a470c3441c2f3c9836f93888efd72aa16010391eab5 |
|
MD5 | 5cc3bdff2230a1ee69bedaccaaf4a0e9 |
|
BLAKE2b-256 | f74ca77185da9f87dfb019134f9dc3910b83ca4ddef140792609bb1224b42da1 |