This is a pre-production deployment of Warehouse. Changes made here affect the production instance of PyPI (pypi.python.org).
Help us improve Python packaging - Donate today!

Library for data analysis - extracting, storing and retrieving features

Project Description

mldatalib

mldatalib (Machine Learning Data Library) provides a Python library which simplifies processing and extracting features (for machine learning) from files. Stores features in a SQLite database, has label transformation options, functions which convert features to NumPy arrays, etc. Original idea and feature list by Viktor Evstratov (viktor.evst@gmail.com). Originally designed for use with the Galaxy Zoo challenge on Kaggle. Requires numpy and SQLAlchemy.

Why?

This is an attempt to minimize the amount of effort needed to extract, save and retrieve new features and allow a user to spend more time on more ‘scientific’ work. If several users are working on the same project, they can each extract independent sets of features and then share the database files and copy the features they are missing.

Functionality

Basic functionality includes: Extracting features and storing them in a database (the user provides the extractor function), retrieving features by name, extracting and transforming labels from a file and storing them in a database, copying features from one database to another, returning features as a numpy array.

Roadmap

Add a pure SQL way of storing and retrieving features (by converting them to JSON format and creating columns via ALTER TABLE statements), thus allowing easy use from other languages. At least add this functionality for numpy arrays and lists.

Add a dataset class for CSV files (where all data is stored in a single CSV file).

Release History

Release History

This version
History Node

0.2.1

History Node

0.2

History Node

0.1.4

History Node

0.1.3

History Node

0.1.2

History Node

0.1.1

History Node

0.1

Download Files

Download Files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

File Name & Checksum SHA256 Checksum Help Version File Type Upload Date
mldatalib-0.2.1.tar.gz (12.2 kB) Copy SHA256 Checksum SHA256 Source Mar 27, 2014

Supported By

WebFaction WebFaction Technical Writing Elastic Elastic Search Pingdom Pingdom Monitoring Dyn Dyn DNS Sentry Sentry Error Logging CloudAMQP CloudAMQP RabbitMQ Heroku Heroku PaaS Kabu Creative Kabu Creative UX & Design Fastly Fastly CDN DigiCert DigiCert EV Certificate Rackspace Rackspace Cloud Servers DreamHost DreamHost Log Hosting