Skip to main content

A collection of command-line tools that facilitate the obtaining, scrubbing and exploring of data.

Project description

# datalogy

[![Build Status](https://secure.travis-ci.org/michaeljoseph/datalogy.png)](http://travis-ci.org/michaeljoseph/datalogy) [![Stories in Ready](https://badge.waffle.io/michaeljoseph/datalogy.png?label=ready)](https://waffle.io/michaeljoseph/datalogy) [![pypi version](https://badge.fury.io/py/datalogy.png)](http://badge.fury.io/py/datalogy) [![# of downloads](https://pypip.in/d/datalogy/badge.png)](https://crate.io/packages/datalogy?version=latest) [![code coverage](https://coveralls.io/repos/michaeljoseph/datalogy/badge.png?branch=master)](https://coveralls.io/r/michaeljoseph/datalogy?branch=master)

![datalogy](https://github.com/michaeljoseph/datalogy/raw/master/resources/datalogy.jpg)

A collection of python tools that facilitate the obtaining, scrubbing and exploring of data.

## scrape

Extract HTML elements using an XPath query or CSS3 selector.

### Example usage

curl -s http://en.wikipedia.org/wiki/List_of_sovereign_states |

scrape -be ‘table.wikitable > tr > td > b > a’

## random-sample

Output lines from stdin to stdout with a given probability, for a given duration, and with a given delay between lines.

### Example usage

seq 100 | random-sample -r 20% -d 1000

## Testing

Install development requirements:

pip install -r requirements.txt

Run the tests with:

nosetests

Lint the project with:

flake8 datalogy tests

## API documentation

To generate the documentation:

cd docs && PYTHONPATH=.. make singlehtml

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

datalogy-0.1.0.tar.gz (18.6 kB view details)

Uploaded Source

File details

Details for the file datalogy-0.1.0.tar.gz.

File metadata

  • Download URL: datalogy-0.1.0.tar.gz
  • Upload date:
  • Size: 18.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for datalogy-0.1.0.tar.gz
Algorithm Hash digest
SHA256 5854efc49f1ed796338b5a470c3441c2f3c9836f93888efd72aa16010391eab5
MD5 5cc3bdff2230a1ee69bedaccaaf4a0e9
BLAKE2b-256 f74ca77185da9f87dfb019134f9dc3910b83ca4ddef140792609bb1224b42da1

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page