Skip to main content

a data exploration UI

Project description

## snorkel

snorkel is a real time data analysis tool, meant to answer questions about the now. At its heart, snorkel is built on the idea that iterative analysis is key to understanding. In other words - when graphs move, it should be easy to drill down on what is happening and why, not a frustrating exercise in adjusting failed queries.

Using [sybil](https://github.com/logv/sybil) as a backend, snorkel can support querying datasets with tens of millions of samples in realtime.

snorkel-lite is a re-implementation of snorkel in python, to read more about why we moved to python from nodejs, [see the motivation docs](https://github.com/logv/snorkel/blob/slite/docs/MOTIVATION.md)

## build status

[![CircleCI](https://circleci.com/gh/logv/snorkel/tree/slite.svg?style=svg)](https://circleci.com/gh/logv/snorkel/tree/slite)

## screengifs

<img src=”https://i.imgur.com/7E4vKK2.gif” width=”800”/>

### Status

June 2019

Initial E2E testing with cypress has been setup, now CircleCI will run e2e tests on snorkel.

Map View has been added, but it is only python2 compatible for now.

Feb 2019

snorkel-lite is now in Alpha status. All but one view (map view) has been ported over from snorkel, data ingestion works and grafana endpoints are compatible. I have switched over from using the original snorkel to using snorkel-lite since November of 2018.

Sept. 2018

Development has started on porting snorkel to python.

### Installation

#### Deployment

The simplest way to deploy snorkel will be to use the snorkel-lite pypi package and [the instructions on the wiki](https://github.com/logv/snorkel/wiki/Installation).

#### Development

To develop on snorkel, clone snorkel and get going:

` git clone git@github.com:logv/snorkel.git cd snorkel `

for python2:

` make virtualenv2 source dev2/bin/activate `

for python3:

` make virtualenv3 source dev3/bin/activate `

to finish installation:

` make setup make run `

### configuration

[see docs/SETUP.md](https://github.com/logv/snorkel/blob/slite/docs/SETUP.md)

## documents

[motivation](https://github.com/logv/snorkel/blob/slite/docs/MOTIVATION.md) and [features](https://github.com/logv/snorkel/blob/slite/docs/FEATURES.md)

[try a demo](https://github.com/logV/snorkel/wiki/Demo)

[read the quick start](https://github.com/logV/snorkel/wiki/QuickStart)

[usage guide](https://github.com/logV/snorkel/wiki/Guide)

[grafana snorkel datasource](https://github.com/logV/grafana-snorkel-datasource) is a plugin for grafana (3.0+) to query snorkel. While this plugin is in early stages, grafana is quite amazing.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

snorkel_lite-0.0.30-cp36-cp36m-manylinux1_x86_64.whl (6.8 MB view details)

Uploaded CPython 3.6m

snorkel_lite-0.0.30-cp36-cp36m-macosx_10_11_x86_64.whl (6.9 MB view details)

Uploaded CPython 3.6mmacOS 10.11+ x86-64

snorkel_lite-0.0.30-cp27-cp27mu-manylinux1_x86_64.whl (6.8 MB view details)

Uploaded CPython 2.7mu

snorkel_lite-0.0.30-cp27-cp27mu-macosx_10_11_x86_64.whl (6.9 MB view details)

Uploaded CPython 2.7mumacOS 10.11+ x86-64

File details

Details for the file snorkel_lite-0.0.30-cp36-cp36m-manylinux1_x86_64.whl.

File metadata

File hashes

Hashes for snorkel_lite-0.0.30-cp36-cp36m-manylinux1_x86_64.whl
Algorithm Hash digest
SHA256 d7084c770e78dddcd66d138706cadc09c9527fd1d8cf30aef3726ceb1e360e8a
MD5 42bd1d42485bc864f8ba20e35e677b8d
BLAKE2b-256 03e1c15cb58af91cf2c32d2a525d0de0c52330b677748acce0cd8d42c4d377dc

See more details on using hashes here.

File details

Details for the file snorkel_lite-0.0.30-cp36-cp36m-macosx_10_11_x86_64.whl.

File metadata

File hashes

Hashes for snorkel_lite-0.0.30-cp36-cp36m-macosx_10_11_x86_64.whl
Algorithm Hash digest
SHA256 a2cfb8b26981039405b3a15a6a4f28861be3048e30dd4725638b637869b7f53b
MD5 9a13970bbacc97b43a89a2ff80c201b2
BLAKE2b-256 c8afda36492faf204f6f643bfa8038b1e0226eaf9d2469d9dbc581925337632e

See more details on using hashes here.

File details

Details for the file snorkel_lite-0.0.30-cp27-cp27mu-manylinux1_x86_64.whl.

File metadata

File hashes

Hashes for snorkel_lite-0.0.30-cp27-cp27mu-manylinux1_x86_64.whl
Algorithm Hash digest
SHA256 a71cfc89e6ecd3b88dcde1c460651dbecc7ea2dcf83cf2f2805c2eed29a1de1a
MD5 539afd146407de34ee34fa3674590f9f
BLAKE2b-256 42d0d9af711f31d66d22c7c000a437c98c91132df6ebff3e45b337495b10318c

See more details on using hashes here.

File details

Details for the file snorkel_lite-0.0.30-cp27-cp27mu-macosx_10_11_x86_64.whl.

File metadata

File hashes

Hashes for snorkel_lite-0.0.30-cp27-cp27mu-macosx_10_11_x86_64.whl
Algorithm Hash digest
SHA256 76067939e4f0e89ec976ea61eee9a2c4eeb6d3831d0f5957caf725ac94a6565a
MD5 7f97e132d09ffb1bc5533a8536bae2f3
BLAKE2b-256 06c42231d3d2e3e767fc0881a553018a6aaf27da859560dec0b6397d4df0492f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page