A Python package to remove outliers from a dataset
Project description
Project OUTLIER DETECTION AND REMOVAL
Name Kriti Pandey
Roll no 101703292
Group 3COE13
DESCRIPTION
Outliers are extreme values that deviate from other observations on data , they may indicate a variability in a measurement, experimental errors or a novelty. Outliers can be of two kinds: univariate and multivariate. Univariate outliers can be found when looking at a distribution of values in a single feature space. Multivariate outliers can be found in a n-dimensional space (of n-features). Outliers can also come in different flavours, depending on the environment: point outliers, contextual outliers, or collective outliers. Point outliers are single data points that lay far from the rest of the distribution. Contextual outliers can be noise in data, such as punctuation symbols when realizing text analysis or background noise signal when doing speech recognition. Collective outliers can be subsets of novelties in data such as a signal that may indicate the discovery of new phenomena.
Most common causes of outliers on a data set:
-
Data entry errors (human errors)
-
Measurement errors (instrument errors)
-
Experimental errors (data extraction or experiment planning/executing errors)
-
Intentional (dummy outliers made to test detection methods)
-
Data processing errors (data manipulation or data set unintended mutations)
-
Sampling errors (extracting or mixing data from wrong or various sources)
-
Natural (not an error, novelties in data)
Ways of finding an outlier:
-
Box plot
-
Scatter plot
-
Interquartile Range
-
Z score
Installation
Use the package manager pip to install OUTLIER_101703292.
pip install OUTLIER_101703292
Usage
Enter csv filename followed by .csv extentsion
OUTLIER_101703292 data.csv
Constraint
Your csv file should not have categorical data
License
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for OUTLIER_101703292-1.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cbb855d43c561911ead08a47f679bb710756c55590f929259438f8577184a2c0 |
|
MD5 | d7a4a6c0175e4571c930be72dec2725d |
|
BLAKE2b-256 | 11dfae6c878cfc091130a62852d0a55085b6a1e755442c4b9e0ff51a3a7af742 |