Yanked

This release has been yanked by its maintainers, and will be ignored by installers, except when explicitly specified.
Consider using release 81.2.26 instead.

    ___    __                          __         
   /   |  / /___  _________  _________/ /__  _____
  / /| | / / __ `/ ___/ __ \/ ___/ __  / _ \/ ___/
 / ___ |/ / /_/ / /__/ /_/ / /  / /_/ /  __/ /    
/_/  |_/_/\__,_/\___/\____/_/   \__,_/\___/_/     

	ALACORDER beta 75

Getting Started with Alacorder

^{GitHub | PyPI | Report an issue}

Alacorder processes case detail PDFs into data tables suitable for research purposes. Alacorder also generates compressed text archives from the source PDFs to speed future data collection from the same set of cases.

Installation

Alacorder can run on most devices. If your device can run Python 3.7 or later, it can run Alacorder.

To install on Windows and Mac, open Command Prompt (Terminal) and enter pip install alacorder or pip3 install alacorder.
On Mac, open the Terminal and enter pip install alacorder or pip3 install alacorder.
Install Anaconda Distribution to install Alacorder if the above methods do not work, or if you would like to open an interactive browser notebook equipped with Alacorder on your desktop.
- After installation, create a virtual environment, open a terminal, and then repeat these instructions. If your copy of Alacorder is corrupted, use pip uninstall alacorder or pip3 uninstall alacorder and then reinstall it. There may be a newer version available.

Alacorder should automatically download and install missing dependencies upon setup, but you can also install them yourself with pip: pandas, numpy, PyPDF2, openpyxl, xlrd, xlwt, xarray, numexpr, bottleneck, pyarrow, jupyter, and click. Recommended dependencies: xlsxwriter, tabulate, matplotlib.

pip install alacorder

Using the guided interface

Once you have a Python environment up and running, you can launch the guided interface in two ways:

Utilize the alacorder command line tool in Python: Use the command line tool python -m alacorder, or python3 -m alacorder. If the guided version is launched instead of the command line tool, update your installation with pip install --upgrade alacorder.
Conduct custom searches with alac: Use the import statement import alacorder as alac to use the Alacorder APIs to collect custom data from case detail PDFs. See how you can make alacorder work for you in the code snippets below.

Alacorder can be used without writing any code, and exports to common formats like Excel (`.xls`, `.xlsx`), Stata (`.dta`), CSV (`.csv`), and JSON (`.json`).

Alacorder compresses case text into pickle archives (.pkl.xz) to save storage and processing time. If you need to unpack a pickle archive without importing alac, use a .xz compression tool, then read the pickle into Python with the pandas method pd.read_pickle().

from alacorder import alac

Special Queries with `alac`

For more advanced queries, the `alac` module can extract fields and tables from case records with just a few lines of code.

Call alac.setinputs("/pdf/dir/") and alac.setoutputs("/to/table.xlsx") to configure your input and output paths. Then call alac.set(input_conf, output_conf, **kwargs) to complete the configuration process. Feed the output to any of the alac.write...() functions to start a task.
Call alac.archive(config) to export a full text archive. It's recommended that you create a full text archive (.pkl.xz) file before making tables from your data. Full text archives can be scanned faster than PDF directories and require less storage. Full text archives can be imported to Alacorder the same way as PDF directories.
Call alac.tables(config) to export detailed case information tables. If export type is .xls or .xlsx, the cases, fees, and charges tables will be exported.
Call alac.charges(config) to export charges table only.
Call alac.fees(config) to export fees table only.
Call alac.caseinfo(config) to export cases table only.

import warnings
warnings.filterwarnings('ignore')

from alacorder import alac

pdf_directory = "/Users/crimson/Desktop/Tutwiler/"
archive = "/Users/crimson/Desktop/Tutwiler.pkl.xz"
tables = "/Users/crimson/Desktop/Tutwiler.xlsx"

pdfconf = alac.setinputs(pdf_directory)
arcconf = alac.setoutputs(archive)

# write archive to Tutwiler.pkl.xz
c = alac.set(pdfconf, arcconf)
alac.archive(c) 

print("Full text archive complete. Now processing case information into tables at " + tables)

d = alac.setpaths(archive, tables) # runs setinputs(), setoutputs() and set() at once
alac.tables(d)

# write tables to Tutwiler.xlsx
alac.tables(tabconf)

Custom Parsing with `alac.map()`

If you need to conduct a custom search of case records, Alacorder has the tools you need to extract custom fields from case PDFs without any fuss. Try out `alac.map()` to search thousands of cases in seconds.

from alacorder import alac
import re

archive = "/Users/crimson/Desktop/Tutwiler.pkl.xz"
tables = "/Users/crimson/Desktop/Tutwiler.xlsx"

def findName(text):
    name = ""
    if bool(re.search(r'(?a)(VS\.|V\.{1})(.+)(Case)*', text, re.MULTILINE)) == True:
        name = re.search(r'(?a)(VS\.|V\.{1})(.+)(Case)*', text, re.MULTILINE).group(2).replace("Case Number:","").strip()
    else:
        if bool(re.search(r'(?:DOB)(.+)(?:Name)', text, re.MULTILINE)) == True:
            name = re.search(r'(?:DOB)(.+)(?:Name)', text, re.MULTILINE).group(1).replace(":","").replace("Case Number:","").strip()
    return name

c = alac.setpaths(archive, tables, count=2000) # set configuration

alac.map(c, findName, alac.getConvictions) # Name, Convictions table

Method	Description
`getPDFText(path) -> text`	Returns full text of case
`getCaseInfo(text) -> [case_number, name, alias, date_of_birth, race, sex, address, phone]`	Returns basic case details
`getFeeSheet(text, cnum = '') -> [total_amtdue, total_balance, total_d999, feecodes_w_bal, all_fee_codes, table_string, feesheet: pd.DataFrame]`	Returns fee sheet and summary as `str` and `pd.DataFrame`
`getCharges(text, cnum = '') -> [convictions_string, disposition_charges, filing_charges, cerv_eligible_convictions, pardon_to_vote_convictions, permanently_disqualifying_convictions, conviction_count, charge_count, cerv_charge_count, pardontovote_charge_count, permanent_dq_charge_count, cerv_convictions_count, pardontovote_convictions_count, charge_codes, conviction_codes, all_charges_string, charges: pd.DataFrame]`	Returns charges table and summary as `str`, `int`, and `pd.DataFrame`
`getCaseNumber(text) -> case_number`	Returns case number
`getName(text) -> name`	Returns name
`getFeeTotals(text) -> [total_row, tdue, tpaid, tbal, tdue]`	Return totals without parsing fee sheet

Working with case data in Python

Out of the box, Alacorder exports to `.xlsx`, `.xls`, `.csv`, `.json`, and `.dta`. But you can use `alac`, `pandas`, and other python libraries to create your own data collection workflows and design custom exports.

The snippet below prints the fee sheets from a directory of case PDFs as it reads them.

from alacorder import alac

c = alac.setpaths("/Users/crimson/Desktop/Tutwiler/","/Users/crimson/Desktop/Tutwiler.xls")

for path in c['contents']:
    text = alac.getPDFText(path)
    cnum = alac.getCaseNumber(text)
    charges_outputs = alac.getCharges(text, cnum)
    if len(charges_outputs[0]) > 1:
        print(charges_outputs[0])

Extending Alacorder with `pandas` and other tools

Alacorder runs on pandas, a python library you can use to perform calculations, process text data, and make tables and charts. pandas can read from and write to all major data storage formats. It can connect to a wide variety of services to provide for easy export. When Alacorder table data is exported to .pkl.xz, it is stored as a pd.DataFrame and can be imported into other python modules and scripts with pd.read_pickle() like below:

import pandas as pd
contents = pd.read_pickle("/path/to/pkl")

If you would like to visualize data without exporting to Excel or another format, create a jupyter notebook and import a data visualization library like matplotlib to get started. The resources below can help you get started. jupyter is a Python kernel you can use to create interactive notebooks for data analysis and other purposes. It can be installed using pip install jupyter or pip3 install jupyter and launched using jupyter notebook. Your device may already be equipped to view .ipynb notebooks.

Resources

License
- OSI Approved :: MIT License
Operating System
- OS Independent
Programming Language
- Python :: 3

Release files for alacorder 75

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for alacorder 75
File	Size	Uploaded
alacorder-75.tar.gz	35.0 kB	Feb 25, 2023	Details

Built distribution (wheel)

Table of built distributions (wheels) for alacorder 75
File	Interpreter	ABI	Platform	Reset
alacorder-75-py3-none-any.whl 31.6 kB Feb 25, 2023	Python 3	none	any	Details

Total release size: 66.7 kB

Release files / alacorder-75.tar.gz

Download URL	alacorder-75.tar.gz
Size	35.0 kB
Tags	Source
SHA-256 checksum How to use checksums	`00baf23109869f107ee7d93d84e905a3a10f8f71a8e01db7d116c609e415be3c`
BLAKE2b-256 checksum How to use checksums	`179690b60c97cd95754826eea5e758581a95a6bb1e27add225a03b68cfae2be2`
Upload date	Feb 25, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.11.1`

Release files / alacorder-75-py3-none-any.whl

Download URL	alacorder-75-py3-none-any.whl
Size	31.6 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`72c71e2247c100500d2ffbc0f50dc1ac78384202619245d287307541b288b6d0`
BLAKE2b-256 checksum How to use checksums	`50d0bb3f9ff36d25163261c34243dd0423662d094edcfebc4e57363179f1cc77`
Upload date	Feb 25, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.11.1`