## snorkel
snorkel is a real time data analysis tool, meant to answer questions about the now. At its heart, snorkel is built on the idea that iterative analysis is key to understanding. In other words - when graphs move, it should be easy to drill down on what is happening and why, not a frustrating exercise in adjusting failed queries.
Using [sybil](https://github.com/logv/sybil) as a backend, snorkel can support querying datasets with tens of millions of samples in realtime.
snorkel-lite is a re-implementation of snorkel in python, to read more about why we moved to python from nodejs, [see the motivation docs](https://github.com/logv/snorkel/blob/slite/docs/MOTIVATION.md)
## build status
[](https://circleci.com/gh/logv/snorkel/tree/slite)
## screengifs
<img src=”https://i.imgur.com/7E4vKK2.gif” width=”800”/>
### Status
June 2019
Initial E2E testing with cypress has been setup, now CircleCI will run e2e tests on snorkel.
Map View has been added, but it is only python2 compatible for now.
Feb 2019
snorkel-lite is now in Alpha status. All but one view (map view) has been ported over from snorkel, data ingestion works and grafana endpoints are compatible. I have switched over from using the original snorkel to using snorkel-lite since November of 2018.
Sept. 2018
Development has started on porting snorkel to python.
### Installation
#### Deployment
The simplest way to deploy snorkel will be to use the snorkel-lite pypi package and [the instructions on the wiki](https://github.com/logv/snorkel/wiki/Installation).
#### Development
To develop on snorkel, clone snorkel and get going:
` git clone git@github.com:logv/snorkel.git cd snorkel `
for python2:
` make virtualenv2 source dev2/bin/activate `
for python3:
` make virtualenv3 source dev3/bin/activate `
to finish installation:
` make setup make run `
### configuration
[see docs/SETUP.md](https://github.com/logv/snorkel/blob/slite/docs/SETUP.md)
## documents
[motivation](https://github.com/logv/snorkel/blob/slite/docs/MOTIVATION.md) and [features](https://github.com/logv/snorkel/blob/slite/docs/FEATURES.md)
[try a demo](https://github.com/logV/snorkel/wiki/Demo)
[read the quick start](https://github.com/logV/snorkel/wiki/QuickStart)
[usage guide](https://github.com/logV/snorkel/wiki/Guide)
[grafana snorkel datasource](https://github.com/logV/grafana-snorkel-datasource) is a plugin for grafana (3.0+) to query snorkel. While this plugin is in early stages, grafana is quite amazing.
1 maintainer
Metadata
1 maintainer
Release files for snorkel-lite 0.0.30
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
| File | Reset | |||
|---|---|---|---|---|
| snorkel_lite-0.0.30-cp36-cp36m-manylinux1_x86_64.whl | CPython 3.6 | CPython 3.6 pymalloc | Linux glibc 2.5+ x86-64 | Details |
| snorkel_lite-0.0.30-cp36-cp36m-macosx_10_11_x86_64.whl | CPython 3.6 | CPython 3.6 pymalloc | macOS 10.11+ x86-64 | Details |
| snorkel_lite-0.0.30-cp27-cp27mu-manylinux1_x86_64.whl | CPython 2.7 | CPython 2.7 pymalloc wide-unicode | Linux glibc 2.5+ x86-64 | Details |
| snorkel_lite-0.0.30-cp27-cp27mu-macosx_10_11_x86_64.whl | CPython 2.7 | CPython 2.7 pymalloc wide-unicode | macOS 10.11+ x86-64 | Details |
Total release size: 27.5 MB
Release files / snorkel_lite-0.0.30-cp36-cp36m-manylinux1_x86_64.whl
| Download URL | snorkel_lite-0.0.30-cp36-cp36m-manylinux1_x86_64.whl |
|---|---|
| Size | 6.8 MB |
| Tags | CPython 3.6 CPython 3.6 pymalloc Linux glibc 2.5+ x86-64 |
|
SHA-256 checksum How to use checksums |
d7084c770e78dddcd66d138706cadc09c9527fd1d8cf30aef3726ceb1e360e8a
|
|
BLAKE2b-256 checksum How to use checksums |
03e1c15cb58af91cf2c32d2a525d0de0c52330b677748acce0cd8d42c4d377dc
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
Python-urllib/3.6
|
Release files / snorkel_lite-0.0.30-cp36-cp36m-macosx_10_11_x86_64.whl
| Download URL | snorkel_lite-0.0.30-cp36-cp36m-macosx_10_11_x86_64.whl |
|---|---|
| Size | 6.9 MB |
| Tags | CPython 3.6 CPython 3.6 pymalloc macOS 10.11+ x86-64 |
|
SHA-256 checksum How to use checksums |
a2cfb8b26981039405b3a15a6a4f28861be3048e30dd4725638b637869b7f53b
|
|
BLAKE2b-256 checksum How to use checksums |
c8afda36492faf204f6f643bfa8038b1e0226eaf9d2469d9dbc581925337632e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
Python-urllib/3.6
|
Release files / snorkel_lite-0.0.30-cp27-cp27mu-manylinux1_x86_64.whl
| Download URL | snorkel_lite-0.0.30-cp27-cp27mu-manylinux1_x86_64.whl |
|---|---|
| Size | 6.8 MB |
| Tags | CPython 2.7 CPython 2.7 pymalloc wide-unicode Linux glibc 2.5+ x86-64 |
|
SHA-256 checksum How to use checksums |
a71cfc89e6ecd3b88dcde1c460651dbecc7ea2dcf83cf2f2805c2eed29a1de1a
|
|
BLAKE2b-256 checksum How to use checksums |
42d0d9af711f31d66d22c7c000a437c98c91132df6ebff3e45b337495b10318c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
Python-urllib/2.7
|
Release files / snorkel_lite-0.0.30-cp27-cp27mu-macosx_10_11_x86_64.whl
| Download URL | snorkel_lite-0.0.30-cp27-cp27mu-macosx_10_11_x86_64.whl |
|---|---|
| Size | 6.9 MB |
| Tags | CPython 2.7 CPython 2.7 pymalloc wide-unicode macOS 10.11+ x86-64 |
|
SHA-256 checksum How to use checksums |
76067939e4f0e89ec976ea61eee9a2c4eeb6d3831d0f5957caf725ac94a6565a
|
|
BLAKE2b-256 checksum How to use checksums |
06c42231d3d2e3e767fc0881a553018a6aaf27da859560dec0b6397d4df0492f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
Python-urllib/2.7
|
Security for snorkel-lite 0.0.30
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
](https://circleci.com/gh/logv/snorkel/tree/slite){kind=link}
