Skip to main content

Large Margin Nearest Neighbor implementation in python

Project description

# pylmnn

**pylmnn** is a python implementation of the [Large Margin Nearest Neighbor](#paper) algorithm for metric learning.

This implementation follows closely the original MATLAB code by Kilian Weinberger found at [https://bitbucket.org/mlcircus/lmnn](https://bitbucket.org/mlcircus/lmnn). This version solves the unconstrained optimisation problem and finds a linear transformation using L-BFGS as the backend optimizer.

This package also uses Bayesian Optimization to find the optimal hyper-parameters for LMNN using the excellent [GPyOpt](http://github.com/SheffieldML/GPyOpt) package.


#### Installation

The code was developed in python 3.5 under Ubuntu 16.04. You can clone the repo with:
```
git clone https://github.com/johny-c/pylmnn.git
```

or install it via pip:
```
pip3 install pylmnn
```

#### Dependencies

* numpy>=1.11.2
* scipy>=0.18.1
* scikit_learn>=0.18.1
* GPyOpt>=1.0.3
* matplotlib>=1.5.3

#### Usage

The simplest use case would be something like:

X, y = load_my_data(dataset_name)
xtr, xte, ytr, yte = train_test_split(X, y, train_size=0.5, stratify=y)
Klmnn, Knn, outdim, maxiter = 3, 1, X.shape[1], 180
lmnn = LMNN(verbose=True, k=Klmnn, max_iter=maxiter, outdim=outdim)
lmnn, loss, details = lmnn.fit(xtr, ytr)
test_acc = test_knn(xtr, ytr, xte, yte, k=Knn, L=lmnn.L)

You can check the examples directory for examples of how to use the code.

#### References

If you use this code in your work, please cite the following <a name="paper">publication</a>.

@ARTICLE{weinberger09distance,
title={Distance metric learning for large margin nearest neighbor classification},
author={Weinberger, K.Q. and Saul, L.K.},
journal={The Journal of Machine Learning Research},
volume={10},
pages={207--244},
year={2009},
publisher={MIT Press}
}


#### License and Contact

This work is released under the [GNU General Public License Version 3 (GPLv3)](http://www.gnu.org/licenses/gpl.html).

Contact **John Chiotellis** [:envelope:](mailto:johnyc.code@gmail.com) for questions, comments and reporting bugs.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

PyLMNN-1.0.0.tar.gz (14.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

PyLMNN-1.0.0-py3-none-any.whl (28.1 kB view details)

Uploaded Python 3

File details

Details for the file PyLMNN-1.0.0.tar.gz.

File metadata

  • Download URL: PyLMNN-1.0.0.tar.gz
  • Upload date:
  • Size: 14.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for PyLMNN-1.0.0.tar.gz
Algorithm Hash digest
SHA256 9280d9e450312c01d1d8f0d410b2a9edabac206f539892378de610bb1c4b4288
MD5 3938d34e1985eae662e30a0068fc75d5
BLAKE2b-256 fe4c3215b1fb4c1cf526139406ab2a970998c488f548b25974643f16c1f3311e

See more details on using hashes here.

File details

Details for the file PyLMNN-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for PyLMNN-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 0e3c4984a3baae1fa82e2eccd27a939f3e3dc51fcd91d3c203662d134cd43e78
MD5 417f0971b75ff00626b288d275a39f0f
BLAKE2b-256 287e85d7f36020670f375b8acf44c6025028f61afdf902d22df85a470f5e48e7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page