file-ripper 1.0.0

No project description provided

file-ripper

A small lightweight library to parse your flat files and deliver the data inside.

Install

file-ripper is available on PyPI.

FileDefinition and FieldDefinition

file-ripper provides multiple ways for you to parse your files. Using file-ripper's FileDefinition and FieldDefinition contracts, you decide how to persist your file configurations:

FieldDefinition fields:

• field_name - str - required - the name of the field in the result set
• start_position - int - required for fixed width files - the start position of the field in its row
• field_length - int - required for fixed width files - the length of the field
• xml_node_name - str - required for xml files - the xml node containing the data

FileDefinition fields:

• file_type - str - required - the type of the file. DELIMITED, FIXED, and XML are currently supported
• field_definitions - List[FieldDefintion] - required - list of FieldDefinition objects to define data fields
• has_header - bool - optional - whether the file has a header row to skip or not
• delimiter - str - required for DELIMITED files - character or string of characters that delimit fields
• record_element_name - str - required for xml files - name of the xml node that represents a full record

from file_ripper import FieldDefinition, FileDefinition, file_constants as fc


def build_delimited_file_definition():
    field_definitions = [
        FieldDefinition('name'),
        FieldDefinition('age'),
        FieldDefinition('dob')
    ]
    
    return FileDefinition(fc.DELIMITED, field_definitions)


def build_fixed_file_definition():
    field_definitions = [
        FieldDefinition('name', start_position=0, field_length=20),
        FieldDefinition('age', start_position=20, field_length=5),
        FieldDefinition('dob', start_position=25, field_length=10)
    ]
    
    return FileDefinition(fc.FIXED, field_definitions)


def build_xml_file_definition():
    field_definitions = [
        FieldDefinition('name', xml_node_name='name'),
        FieldDefinition('age', xml_node_name='age'),
        FieldDefinition('dob', xml_node_name='dateOfBirth')
    ]

    return FileDefinition(fc.FIXED, field_definitions)

Ripping Files

file-ripper provides easy access to your file data. The rip_file function takes a file-like object and a FileDefinition. It returns a tuple containing your file's name and your records as a list of dicts

from file_ripper import rip_file, FileDefinition, FieldDefinition, file_constants as fc

field_definitions = [
    FieldDefinition('name'),
    FieldDefinition('age'),
    FieldDefinition('dob')
]
    
file_definition = FileDefinition(fc.DELIMITED, field_definitions)
with open('path/to/file.txt', 'r') as file:
    file_name, file_records = rip_file(file, file_definition)    

The FileRipper class also supports ripping multiple files using the rip_files function.

from file_ripper import rip_files, FileDefinition, FieldDefinition, file_constants as fc
from typing import List, Tuple

field_definitions = [
    FieldDefinition('name'),
    FieldDefinition('age'),
    FieldDefinition('dob')
]
    
file_definition = FileDefinition(fc.DELIMITED, field_definitions)
with open('path/to/file.txt', 'r') as file:
    file_results: List[Tuple[str, dict]] = rip_files([file], file_definition)