Skip to main content

Wrapper around fs libraries to synchronized files between different system types including SMB, SFTP, FSTP.

Project description

Filepass Package

Filepass package is a comprehensive Python package designed to facilitate the transfer of the files across different locations and protocols with ease. It supports SFTP, SMB, and LOCAL file systems, and offers functionalities like file renaming (in single file mode) and selective file transfer based on assigned filter. It also offeres advanced file management features such as conditional deletion of files. With support for both custom handler and local logging, 'Filepass' ensures that you can keep a detailed log of your file trasnfers, making troubleshooting and monitoring a breeze.

This package is available as:

  • A PyPI library, which can be installed via pip.
  • A GitHub Container Registry (GHCR) package, allowing you to pull and run it via docker.

Features

  • Multiple Protocols Support: Seamlessly transfer files using SFTP, SMB, and LOCAL file systems.

  • Flexible File Selection: Use 'from_filter' parameter to specify exactly which files to transfer, supporting both specific filenames and wildcards for multiple files.

  • File Renaming (in single file transfer mode) Easily rename files during single file transfer mode.

  • Connection Objects: Utilize the pre-defined connnection objects for efficient and secure connections to server.

  • Conditional File Deletion: Automatically delete older files at the destination before transfer using 'to_delete', or remove source files after a successful transfer using 'from_delete'.

  • Advanced Logging: Enable custom logging handler by defining the server name, port number and adding the handler to the logger defined. Otherwise, default to local logging to stdout for monitoring and troubleshooting.

Installation

From PyPI

To install the package from PyPI, run:

pip install filepass

From GitHub Container Registry

To pull and run the image using Docker, run:

docker pull ghcr.io/cityofkamloops/filepass:latest

docker run ghcr.io/cityofkamloops/filepass:latest

Quick Start

  1. Import Filepass package: e.g.: from filepass import file_pass, ConnectionDetails, FilepassMethod

  2. Set up connection - create a connection object (ConnectionDetails) based on your protocol of choice. FilepassMethod offers three protocols: SFTP, SMB, and LOCAL. e.g.:

sourceServer = ConnectionDetails(
method=FilepassMethod.SMB,
user="user",
password="password",
server="servername",
port="portnumber",
dir="directory/folder",
share="SMB share",
)
destinationServer = ConnectionDetails(
    method=FilepassMethod.SFTP,
    user="user",
    password="password",
    server="servername",
    port="portnumber",
    dir="directory/folder",
)
  1. Configure Logging:(Optional) If you want to enable custom handler logging, such as Graylog logging. Set the server details as follows: Example: Graylog
  • Import the required library for custom logging - import graypy
  • Add the handler to your defined logger:
handler = graypy. graypy.GELFTCPHandler(
    ("servername"), int("portnumber")
)

If you want to simply use local logging:

  • Import python logging package.
  • Define the logger and handler.
      • E.g., handler = logging.StreamHandler(sys.stdout)
  • Add the handler to your defined logger.
  1. Define the required parameters for file transfer:
  • from_filter = "filename/wildcard" e.g.
from_filter = "*.txt"  #transfers all files in the directory, with .txt extension.
from_filter = "transfer_file.csv"  #transfers the selected file.
  • to_delete = "yes or no".
  • from_delete = "yes or no".
  • logger = set custom handler or local handler.
  1. Rename file in single file transfer mode: Rename a file during transfer by specifying the new_filename parameter such as:
  • e.g.,
new_filename = "newfilename"

Defaults to 'None', if parameter is not defined.

  1. Transfer Files: Use the file_pass method to move files to move files from one location to another.
  • e.g.,
file_pass(
    logger,
    from_conn,
    to_conn,
    from_filter,
    to_delete,
    from_delete,
    new_filename,
)

Support

If you encounter any issues or have questions, please file an issue on our GitHub Issues Page

Contributing

Contributions to Filepass are welcome! Please refer to our Contribution Guidelines

Ways to Contribute

  • Submit bug reports and feature requests.
  • Write and improve documentation.
  • Write code for new features and bug fixes.
  • Review pull requests.
  • Enhance the package's test coverage.

Code of Conduct

  • Participation in this project is governed by The City of Kamloops Code of Conduct. We expect everyone to uphold the principles of respect, kindness and cooperation.

How to submit contributions

  • Reporting bugs:
  • Use the issue tracker to report bugs.
  • Describe the bug and include steps to reproduce.
  • Feature Requests:
  • Submit feature requests using the issue tracker.
  • Please include an explanation why the feature would be useful, and how it should work if possible.
  • Pull Requests:
  • Fork the repository and create your branch from 'main'.
  • If you have added code, please include tests.
  • Ensure your project lints and follows the project's coding conventions.
  • Write a clear and descriptive commit message.
  • Open a pull request with a clear title and description.

Thank you!!

Happy file transferring!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

filepass-1.0.2.tar.gz (12.1 kB view details)

Uploaded Source

Built Distribution

filepass-1.0.2-py3-none-any.whl (10.3 kB view details)

Uploaded Python 3

File details

Details for the file filepass-1.0.2.tar.gz.

File metadata

  • Download URL: filepass-1.0.2.tar.gz
  • Upload date:
  • Size: 12.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/5.1.1 CPython/3.12.6

File hashes

Hashes for filepass-1.0.2.tar.gz
Algorithm Hash digest
SHA256 a4331b13eabfe655d353aa12040b3830e787ec82b71ae114fefc747c291e3fcf
MD5 7e76773a462c81a22ca5178745a07e65
BLAKE2b-256 914bebac7184deb0cddba514d1158414e27289cbf98ec5ca977a7d7b7a93a82f

See more details on using hashes here.

File details

Details for the file filepass-1.0.2-py3-none-any.whl.

File metadata

  • Download URL: filepass-1.0.2-py3-none-any.whl
  • Upload date:
  • Size: 10.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/5.1.1 CPython/3.12.6

File hashes

Hashes for filepass-1.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 091c931a8e2b574e26b1c9f657ad58d70ba0fb2597de8e78f889dd02020416bf
MD5 9fe4619f3c5f63cbba1ad44ca17b377d
BLAKE2b-256 c80d594acb58cebdfee7794d2ec02e6bf731b6d41c3d266ab24bf30ba4a4bee7

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page