sabia-utils 0.0.6

Group of utilities for Sabia

Sabia Utils

This is a collection of utilities for Sabia.

Concat Module

This module is used to concatenate files.

Concatenate all files from a path

• Returns a concatenated dataframe from all files in a path.
• Can save the concatenated dataframe to a file.

from sabia_utils import concat

concat.concatenate_all_from_path(
    path='path/to/files',
    output_file='output/file/path', # optional
    fine_name='file_name'           # optional 
)

Concatenate some files from a path

• Returns a concatenated dataframe from some files in a path.
• Can save the concatenated dataframe to a file.

from sabia_utils import concat

concat.concatenate_files(
    path='path/to/files',
    files=['file1', 'file2'],
    output_file='output/file/path', # optional
    fine_name='file_name'           # optional 
)

Copy files from a path to another

• Verify if the files exist in the path before copy.

from sabia_utils import group

group.copy_new_files(
    PATH_TST='path/to/files1',
    PATH_SABIA='path/to/files2'
)

Process files in both paths

• Verify if the files exist in the path before process.

from sabia_utils import group

group.process_existent_files(
    PATH_TST='path/to/files1',
    PATH_SABIA='path/to/files2'
)

Process all files

• apply the function of copy and process files between the paths.

from sabia_utils import group

group.process_all_files(
    PATH_TST='path/to/files1',
    PATH_SABIA='path/to/files2'
)