ai-helpers-pyspark-utils 0.1.0a0

Common pyspark utils

AI Helpers - PySpark utils

pyspark-utils is a Python module that provides a collection of utilities to simplify and enhance the use of PySpark. These utilities are designed to make working with PySpark more efficient and to reduce boilerplate code.

Table of Contents

• AI Helpers - Pyspark utils
  • Table of Contents
  • Installation
  • Getting Started
  • Utilities
  • Examples
  • Contributing

Installation

You can install the pyspark-utils module via pip:

pip install pyspark-utils

Getting Started

First, import the module in your Python script:

import pyspark_utils as pu

Now you can use the utilities provided by pyspark-utils.

Utilities

TODO

Examples

TODO

Contributing

We welcome contributions to pyspark-utils. To contribute, please follow these steps:

1. Fork the repository.
2. Create a new branch (git checkout -b feature-branch).
3. Make your changes.
4. Commit your changes (git commit -am 'Add some feature').
5. Push to the branch (git push origin feature-branch).
6. Create a new Pull Request.

Please ensure your code follows the project's coding standards and includes appropriate tests.