Skip to main content

A package for pseudonymizing travel-specific PII data

Project description

TravelSpecificPIIPseudonymization

TravelSpecificPIIPseudonymization is a Python-based tool designed to detect and pseudonymize personally identifiable information (PII) in travel-related documents. It leverages custom recognizers and fake data generators for specific aviation industry entities such as Passenger Name Records (PNRs), e-tickets, flight numbers, airline and aircraft codes, and airport codes. The pseudonymization tool ensures the privacy and confidentiality of sensitive data commonly found in aviation documents, making it suitable for airline companies, travel agencies, and other organizations dealing with flight information.

Features

  • Pseudonymization of Travel-Related PII: Detects and pseudonymizes common entities in airline and aviation-related documents such as:

    • Passenger Name Records (PNRs)
    • E-tickets
    • Aircraft registration numbers
    • IATA/ICAO aircraft and airline codes
    • IATA/ICAO/FAA airport codes
    • Contact information (phone numbers, email addresses)
  • Custom Recognizers: Includes custom patterns to detect industry-specific codes such as flight numbers, e-ticket prefixes, and more.

  • Faker Integration: Replaces sensitive data with synthetic data using the Faker library, while also providing flexibility for adding custom fake data generators (e.g., generating fake PNRs, e-tickets).

  • Reversible Pseudonymization: The tool provides mapping between the original and pseudonymized data, allowing for reversible pseudonymization when required (useful for testing or regulatory purposes).

Files Overview:

  1. tspii.py: This is the main entry point for the project. It handles document input, pseudonymization execution, and saving the pseudonymized document to a file.

  2. pseudonymizer.py: Contains the core class CustomPseudonymizer, which performs the pseudonymization process and stores the depseudonymization mappings. It integrates with custom recognizers and synthetic data generators.

  3. recognizers.py: Defines custom recognizers to detect specific PII entities in travel-related documents (e.g., PNR, e-tickets, IATA/ICAO codes).

  4. generators.py: Implements custom fake data generators that create realistic synthetic data for aviation-related entities (e.g., generating fake PNRs or e-tickets).

  5. tests: Contains unit tests for the CustomPseudonymizer class, validating the accuracy of the pseudonymization process and ensuring that sensitive information is properly anonymized while maintaining a correct mapping for potential deanonymization.

Usage

To use the tool, follow these steps:

  pip install travel-pii-anonymisation

  travel_pii

Would you like to (1) Load a document from a file or (2) Use the sample document? Enter 1 or 2:
If you choose 1, you need to specify a file path. (you can use sample.txt in this repository)

Minimum Requirements:

Ensure you have at least 1 GB of free storage and a stable internet connection, as this software requires downloading the en-core-web package which is approximately 500 MB.

Contributing

Contributions to improve the tool are welcome! Feel free to open issues for bugs or feature requests, or submit pull requests for enhancements.

Acknowledgements

This project utilizes various libraries, including LangChain for document processing and Presidio for PII detection and anonymization.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

travel_pii_anonymisation-0.3.2.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

travel_pii_anonymisation-0.3.2-py3-none-any.whl (4.1 kB view details)

Uploaded Python 3

File details

Details for the file travel_pii_anonymisation-0.3.2.tar.gz.

File metadata

File hashes

Hashes for travel_pii_anonymisation-0.3.2.tar.gz
Algorithm Hash digest
SHA256 7970fa99ab0025a09b3c4577273e4bceb7aa60739782b796e366664649f7e7a4
MD5 c1bd38127cfe7de2574e1f14e656ac4b
BLAKE2b-256 dddbc1c1c83859c5b2189c1337f373203893cae1b168d957ed28019bd792dbac

See more details on using hashes here.

File details

Details for the file travel_pii_anonymisation-0.3.2-py3-none-any.whl.

File metadata

File hashes

Hashes for travel_pii_anonymisation-0.3.2-py3-none-any.whl
Algorithm Hash digest
SHA256 b2c28e8a59b3eb19cc70f6d1f509d482b720ddd268b87fee2c44577c07d20868
MD5 69cb1d4748164f1ba6b104bd48382418
BLAKE2b-256 baaab1b7ce50c52e8df83dc00f780f408dd16a98554c9742006bf647c10a42bf

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page