Skip to main content

Data Preprocessing model based on Keras preprocessing layers

Project description

🚀 Welcome to Keras Data Processor: Unleash Preprocessing Power with TensorFlow Keras!

Embark on a Data Preprocessing Adventure!

Venture into the thrilling realm of machine learning and data science with ease! 🌌 We're thrilled to introduce an advanced data preprocessing model that harnesses the power of TensorFlow Keras and its innovative preprocessing layers.

Bid farewell to the drudgery of data prep and embrace a world where data pipelines are not only streamlined but also efficient and scalable. Whether you're a battle-tested data warrior or a budding data enthusiast, our toolkit is engineered to amplify your ML endeavors, propelling your workflows to unprecedented speeds and robustness!

🌟 Stellar Features:

  • Automated Feature Engineering: Watch in awe as our tool deftly navigates through your dataset, intuitively applying the perfect preprocessing maneuvers for each feature type.

  • Tailor-Made Preprocessing Pipelines: Craft your preprocessing odyssey with unparalleled ease, selecting from a vast universe of options for numeric, categorical, and the intricate dance of feature crosses.

  • Galactic Scalability and Efficiency: Built for the performance-hungry, our model effortlessly devours large datasets, all thanks to TensorFlow's might.

  • Seamless Integration: Merge seamlessly into the TensorFlow Keras cosmos, transitioning from raw data to a fully-trained model at warp speed.

🚀 Getting Started:

Embarking with us requires the installation of poetry for dependency management. Here's how you can set sail:

Install Dependencies:

poetry install

Enter the Poetry Shell:

poetry shell

Configure Your Preprocessor:

from kdp import PreprocessingModel, FeatureType

# DEFINING THE STARS OF YOUR DATA GALAXY
features_spec = {
    "num_1": FeatureType.FLOAT,
    "num_2": "float",
    "cat_1": FeatureType.STRING_CATEGORICAL,
    "cat_2": FeatureType.INTEGER_CATEGORICAL,
}

# BRINGING YOUR PREPROCESSOR TO LIFE
ppr = PreprocessingModel(
    path_data="data/my_data.csv",
    features_specs=features_spec,
)
# Forging the preprocessing pipelines
ppr.build_preprocessor()

The Marvelous Output:

{
    'model': <Functional name=preprocessor, built=True>,
    'inputs': {
        'num_1': <KerasTensor shape=(None, 1), dtype=float32, name=num_1>,
        'num_2': <KerasTensor shape=(None, 1), dtype=float32, name=num_2>,
        'cat_1': <KerasTensor shape=(None, 1), dtype=string, name=cat_1>
        'cat_2': <KerasTensor shape=(None, 1), dtype=int32, name=cat_2>,
    },
    'signature': {...},
    'output_dims': 9
}

Seamlessly Integrate into Your Keras Model:

class FunctionalModelWithPreprocessing(tf.keras.Model):
    # Your adventure with a fully integrated preprocessing model begins here...

🌠 Dive Deeper:

Journey through our comprehensive documentation to exploit the full might of this preprocessing toolkit. Delve into the art of feature crosses, bucketization strategies, and uncovering the mysteries of embedding sizes to craft the perfect preprocessing pipeline for your celestial quest.

Embark on this exhilarating adventure with us and redefine the boundaries of machine learning. Let's turn your data preprocessing dreams into reality! 🚀

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kdp-1.0.0.tar.gz (89.3 kB view details)

Uploaded Source

Built Distribution

kdp-1.0.0-py3-none-any.whl (87.7 kB view details)

Uploaded Python 3

File details

Details for the file kdp-1.0.0.tar.gz.

File metadata

  • Download URL: kdp-1.0.0.tar.gz
  • Upload date:
  • Size: 89.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.5.1 CPython/3.9.12 Darwin/22.1.0

File hashes

Hashes for kdp-1.0.0.tar.gz
Algorithm Hash digest
SHA256 88f50ef1cf4ebd90aec916e26e0def01dbb125ab1fae05ddbca5d5008e28c351
MD5 baa99ce67d1aee459157a181f19f0ccb
BLAKE2b-256 55236af5a44f7b1b45cce6c4df8c6aa55519cc865a3571a80ffec07992f5229d

See more details on using hashes here.

File details

Details for the file kdp-1.0.0-py3-none-any.whl.

File metadata

  • Download URL: kdp-1.0.0-py3-none-any.whl
  • Upload date:
  • Size: 87.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.5.1 CPython/3.9.12 Darwin/22.1.0

File hashes

Hashes for kdp-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 544a5dd6e35c0f864d44855f8a383cbc04dff23eb522a78eb68e39df771e268f
MD5 b93ab45c8ed99aab56286421a0c47c75
BLAKE2b-256 96aab2be797064fafe1141be7dd8193d35b7f74b3eccbb650da2916e133d1bdb

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page