Skip to main content

fast rolling rank for numpy

Project description

rollingrank

rollingrank is a fast implementation of rolling rank transformation (described as the following code).

import pandas as pd

# x is numpy array
def rollingrank(x, window=None):
    def to_rank(x):
        # result[i] is the rank of x[i] in x
        return np.sum(np.less(x, x[-1]))
    return pd.Series(x).rolling(window).apply(to_rank).values

Motivation

Rolling rank is a good tool to create features for time series prediction. However, rolling rank was not easy to use in python. There were no exact methods to do it. The simple implementation using pandas and numpy is too slow.

Performance

Implementation Complexity
rollingrank O(n * log(w)) (not implemented)
pandas rolling + numpy O(n * w)

n: input length w: rolling window size

Install

pip install rollingrank

Example

import numpy as np
import rollingrank

x = np.array([0.1, 0.2, 0.3, 0.25, 0.1, 0.2, 0.3])
y = rollingrank.rollingrank(x, window=3)
print(y)
# [nan nan  2.  1.  0.  1.  2.]

y = rollingrank.rollingrank(x, window=3, pct=True)
print(y)
# [nan nan 1.  0.5 0.  0.5 1. ]

Kaggle Example

https://www.kaggle.com/bakuage/rollingrank-example

Development

test

python -m unittest discover tests

build/upload

python setup.py sdist
twine upload --repository pypitest dist/*
twine upload --repository pypi dist/*

TODO

  • support axis
  • O(n * log(w)) algorithm

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rollingrank-0.1.1.tar.gz (3.4 kB view details)

Uploaded Source

File details

Details for the file rollingrank-0.1.1.tar.gz.

File metadata

  • Download URL: rollingrank-0.1.1.tar.gz
  • Upload date:
  • Size: 3.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.6.7

File hashes

Hashes for rollingrank-0.1.1.tar.gz
Algorithm Hash digest
SHA256 5d6a81428d88a1289eae45773e66eac0e045ccb3f5cc04989385670466724de2
MD5 5f2236bf0a0ac4bdccc365bc7a22f131
BLAKE2b-256 a543b53e7a09d247b79cc96a33877648b0712981c603f43d5845736b2f505524

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page