Skip to main content

Full workflow for ETL, statistics, and Machine learning modelling of (usually) time-stamped industrial facilities data.

Project description

Industrial Data Science Workflow

Industrial Data Science Workflow: full workflow for ETL, statistics, and Machine learning modelling of (usually) time-stamped industrial facilities data.

Not only applicable to monitoring quality and industrial facilities systems, the package can be applied to data manipulation, characterization and modelling of different numeric and categorical datasets to boost your work and replace tradicional tools like SAS, Minitab and Statistica software.

Authors:

  • Marco Cesar Prado Soares, Data Scientist Specialist at Bayer (Crop Science)

  • Gabriel Fernandes Luz, Senior Data Scientist

  • If you cannot install the last version from idsw package directly from PyPI using pip install idsw:

  1. Open the terminal and:

Run:

git clone "https://github.com/marcosoares-92/IndustrialDataScienceWorkflow" 

to clone all the files (you could also fork them).

  1. Go to the directory called idsw.
  2. Now, open the Python terminal and:

Navigate to the idsw folder to run:

pip install .
  • You can use command cd "...\idsw", providing the full idsw path to navigate to it. Alternatively, run pip install ".\*.tar.gz" in the folder terminal.

After cloning the directory, you can also run the package without installing it:

  1. Copy the whole idsw folder to the working directory where your python or jupyter notebook file is saved.
  • There must be an idsw folder on the python file directory.
  1. In your Python file:

Run the command or run a cell (Jupyter notebook) with:

from idsw import *

for importing all idsw functions without the alias idsw; or:

import idsw

to import the package with the alias idsw.

History

1.2.0

Fixed

  • Deprecated structures

Added

  • New functionalities added.

Reshape of project design.

  • New division into modules and new names for functions and classes.

Removed

  • Removed support for Python < 3.7

1.2.1

Fixed

  • Setup issues.

1.2.2

Fixed

  • Setup issues: need for rigid and specific versions of the libraries.

1.2.3

Fixed

  • Setup issues.

1.2.4

Fixed

  • Import bugs.
  • Introduced function for Excel writing.

1.2.5

Fixed

  • Matplotlib export figures bugs.
  • 'quality' argument is no longer supported by plt.savefig function (Matplotlib), so it was removed.
  • This modification was needed for allowing the correct functioning of the steelindustrysimulator, which is based on idsw.
  • Check simulator project on: https://github.com/marcosoares-92/steelindustrysimulator
    • The Ideal Tool for Process Improvement, and Data Collection, Analyzing and Modelling Training.

1.2.6

Fixed

  • Export of figures generated a message like with '{new_file_path}.png.png'. Fixed to '{new_file_path}.png'.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

idsw-1.2.6.tar.gz (5.1 kB view details)

Uploaded Source

Built Distribution

idsw-1.2.6-py3-none-any.whl (3.7 kB view details)

Uploaded Python 3

File details

Details for the file idsw-1.2.6.tar.gz.

File metadata

  • Download URL: idsw-1.2.6.tar.gz
  • Upload date:
  • Size: 5.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.9

File hashes

Hashes for idsw-1.2.6.tar.gz
Algorithm Hash digest
SHA256 42efb646e851ad6ee51f1223d129cd99bf6e79d5e55de42d4a42f58e005ea37b
MD5 d67cdbec9f1a09e3e6a968c297b269c3
BLAKE2b-256 05d91306e85f0478b92fc34bb3e4226cf6d1947f215cbb89822eaf16e7c5c933

See more details on using hashes here.

File details

Details for the file idsw-1.2.6-py3-none-any.whl.

File metadata

  • Download URL: idsw-1.2.6-py3-none-any.whl
  • Upload date:
  • Size: 3.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.9

File hashes

Hashes for idsw-1.2.6-py3-none-any.whl
Algorithm Hash digest
SHA256 c0202143c3e7eb951147657dc53cbe6a7a84adf7f165a5b30475d8ee9ffb782f
MD5 6d5e8ecc59ed163a0f5a7364b33c8e50
BLAKE2b-256 e490be55d5014686d4ef2e5e3ee9bf4025f890f8435922e3405d5ddece54f48c

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page