A python library to define and validate data types in Docling.
Project description
Docling Core
Docling Core is a library that defines the data types in Docling, leveraging pydantic models.
Installation
To use Docling Core, simply install docling-core
from your package manager, e.g. pip:
pip install docling-core
Development setup
To develop for Docling Core, you need Python 3.9 / 3.10 / 3.11 / 3.12 / 3.13 and Poetry. You can then install from your local clone's root dir:
poetry install
To run the pytest suite, execute:
poetry run pytest test
Basic Usage
-
You can validate your JSON objects using the pydantic class definition.
from docling_core.types import DoclingDocument data_dict = {...} # here the object you want to validate, as a dictionary DoclingDocument.model_validate(data_dict) data_str = {...} # here the object as a JSON string DoclingDocument.model_validate_json(data_str)
-
You can generate the JSON schema of a model with the script
generate_jsonschema
.# for the `DoclingDocument` type generate_jsonschema DoclingDocument # for the use `Record` type generate_jsonschema Record
Documentation
Docling Core contains 3 top-level data types:
- DoclingDocument for publications like books, articles, reports, or patents. The JSON that can be exported using Docling follows this schema. The DoclingDocument type also models the metadata that may be attached to the converted document. Check DoclingDocument for the full JSON schema.
- Record for structured database records, centered on an entity or subject that is provided with a list of attributes. Related to records, the statements can represent annotations on text by Natural Language Processing (NLP) tools. Check Record for the full JSON schema.
- Generic for any data representation, ensuring minimal configuration and maximum flexibility. Check Generic for the full JSON schema.
The data schemas are defined using pydantic models, which provide built-in processes to support the creation of data that adhere to those models.
Contributing
Please read Contributing to Docling Core for details.
References
If you use Docling Core in your projects, please consider citing the following:
@techreport{Docling,
author = "Deep Search Team",
month = 8,
title = "Docling Technical Report",
url = "https://arxiv.org/abs/2408.09869",
eprint = "2408.09869",
doi = "10.48550/arXiv.2408.09869",
version = "1.0.0",
year = 2024
}
License
The Docling Core codebase is under MIT license. For individual model usage, please refer to the model licenses found in the original packages.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file docling_core-2.4.0.tar.gz
.
File metadata
- Download URL: docling_core-2.4.0.tar.gz
- Upload date:
- Size: 54.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.3 CPython/3.10.12 Linux/6.5.0-1025-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 93f817b0105d564bbd334f8314b359b8a3fb234ec47b5013a020c9cb6ebd2e87 |
|
MD5 | e0b7621268a3cf3d4eb68563c0ef7588 |
|
BLAKE2b-256 | 8379ba8ca414045fef0be84510562f3cb588ce27a2a931557de598035bc522e4 |
File details
Details for the file docling_core-2.4.0-py3-none-any.whl
.
File metadata
- Download URL: docling_core-2.4.0-py3-none-any.whl
- Upload date:
- Size: 71.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.3 CPython/3.10.12 Linux/6.5.0-1025-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | dbc6b48d9d8b20800a9eb796d69a33660202c761bf53092697b7b07d28842cc3 |
|
MD5 | 09c0d3482cd6cc94634d08233e0aab6b |
|
BLAKE2b-256 | 70f7144178699ef7097710ffc5d93254563df7ae2d39e4fdee893ecee9cc222f |