Skip to main content

Use to train neural networks, A Package for optimize models, transfer or copy files from one directory to other, use for nlp short word treatment, choosing optimal data for ML models, use for Image Scraping , use in timeseries problem to split the data into train and test, Deal with emojis and emoticons in nlp, word tokenize, token, get the list of Punctuation marks and English Pronouns too, can be used to read text files

Project description

A package to increase the accuracy of ML models, training neural networks, converting text into tokens, transfer or copy files from one directory to other, gives you the best data for model training, works on text data also, short word treatment for NLP problems, can be used for Image Scraping also, use it to split the timeseries data into training and testing, deal with emojis and emoticons, word tokenizer, tokenize words, can be used to remove stop words too, Punctuations and get English Pronouns list too, use to read text files # Optilearn

Optilearn is a versatile package designed to improve the accuracy of machine learning models, handle neural network training, and offer various utilities for NLP, image scraping, and timeseries data manipulation.

Features:

  • Neural Network Training: Use the optilearn.nn module to train neural networks.
  • Optimal Data Combination: Use optilearn.optimal to find the best data combination for ML and DL models.
  • Image Scraping: Use optilearn.images to download images from websites.
  • Text and NLP Processing: Use optilearn.text and optilearn.words for text tokenization, short word treatment, and more NLP tasks.
  • File Handling: Use optilearn.files to transfer and copy files between directories.
  • Timeseries Data Handling: Use optilearn.sequential to split sequential data like timeseries into training and testing sets.

Installation

!pip install optilearn

1. Neural network training

from optilearn.nn import Sequential,Dense,Dropout,EarlyStopping,ReduceLearningRate

model2=Sequential() model2.add(Dense(300,input_dim=784,activation='relu')) model2.add(Dropout(0.3)) model2.add(Dense(100,activation='relu')) model2.add(Dropout(0.3)) model2.add(Dense(150,activation='relu')) model2.add(Dropout(0.3)) model2.add(Dense(100,activation='relu')) model2.add(Dropout(0.3)) model2.add(Dense(50,activation='relu')) model2.add(Dropout(0.1)) model2.add(Dense(10,activation='softmax'))

model2.compile(loss='categorical_crossentropy',optimizer='adam',learning_rate=0.01)

rl= ReduceLearningRate(monitor='val_accuracy',factor=0.1,patience=20,verbose=1,min_delta=0.001,cooldown=3,min_lr=0.0001) es = EarlyStopping(monitor = 'val_accuracy',min_delta=0.0001,mode='max',verbose=1,patience=30,restore_best_weights=True,baseline=0.99)

g1=model2.fit(x_train,y_train,validation_data=[x_test,y_test],epochs=500,verbose=1,batch_size=128,callbacks=[rl,es])

2. Get best data combination for ML and DL models

from optilearn.optimal import OptimalDataSelector

x_train,y_train,x_test,y_test = OptimalDataSelector(X,Y,combination=15000,train_size=0.8,active_checkpoint=True,bs_problem='reg',scaling='st_normal')

3. Dealing NLP Problems

from optilearn.text import EmoTextHandler,word_tokenizer,Punctuation,EnglishPronouns,read_txt,text_to_tokens from optilearn.word import short_word_treatment`

4. File Transfering from one to another folder

from optilearn.files import FilePathway

5. Image scrapping from websites

from optilearn.images import web_image_downloader

6. splitting timeseries based data into training and testing

from optilearn.sequential import timeseries_split

x_train,x_test,y_train,y_test=timeseries_split(df1,'08:00:00',n_previous_values=50,train_size=0.8) x_train.shape,x_test.shape,y_train.shape,y_test.shape

*** For more detailed documentation, visit our GitHub Page --> https://github.com/about-optilearn.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

optilearn-1.3.0.tar.gz (50.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

optilearn-1.3.0-py3-none-any.whl (72.8 kB view details)

Uploaded Python 3

File details

Details for the file optilearn-1.3.0.tar.gz.

File metadata

  • Download URL: optilearn-1.3.0.tar.gz
  • Upload date:
  • Size: 50.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.0 CPython/3.12.3

File hashes

Hashes for optilearn-1.3.0.tar.gz
Algorithm Hash digest
SHA256 742760aa60c6b822713cc541ba05958310d51985e86be34e5a254bd3677e9f26
MD5 cb9ee2832ce7161178eea43686c98d75
BLAKE2b-256 1b79122a0d63107c9c0a0f3b293d592dd1a4b7fc1b04a228202c2589cd0a6e71

See more details on using hashes here.

File details

Details for the file optilearn-1.3.0-py3-none-any.whl.

File metadata

  • Download URL: optilearn-1.3.0-py3-none-any.whl
  • Upload date:
  • Size: 72.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.0 CPython/3.12.3

File hashes

Hashes for optilearn-1.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 7313932174de5ae3fc2615a13a9773834135a9cbde53bc4135953a8accfcfcf4
MD5 ae69ca0c535486976a7c40242874fcc9
BLAKE2b-256 893a8eec8ed347b60d93066c299c0ad141c6ff80cb6b166889a45904e02d439c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page