Skip to main content

A python library to define and validate data types in Docling.

Project description

Docling Core

PyPI version Python Poetry Code style: black Imports: isort Checked with mypy Pydantic v2 pre-commit License MIT

Docling Core is a library that defines the data types in Docling, leveraging pydantic models.

Installation

To use Docling Core, simply install docling-core from your package manager, e.g. pip:

pip install docling-core

Development setup

To develop for Docling Core, you need Python 3.9 / 3.10 / 3.11 / 3.12 / 3.13 and Poetry. You can then install from your local clone's root dir:

poetry install --all-extras

To run the pytest suite, execute:

poetry run pytest test

Basic Usage

  • You can validate your JSON objects using the pydantic class definition.

    from docling_core.types import DoclingDocument
    
    data_dict = {...}  # here the object you want to validate, as a dictionary
    DoclingDocument.model_validate(data_dict)
    
    data_str = {...}  # here the object as a JSON string
    DoclingDocument.model_validate_json(data_str)
    
  • You can generate the JSON schema of a model with the script generate_jsonschema.

    # for the `DoclingDocument` type
    generate_jsonschema DoclingDocument
    
    # for the use `Record` type
    generate_jsonschema Record
    

Documentation

Docling Core contains 3 top-level data types:

  • DoclingDocument for publications like books, articles, reports, or patents. The JSON that can be exported using Docling follows this schema. The DoclingDocument type also models the metadata that may be attached to the converted document. Check DoclingDocument for the full JSON schema.
  • Record for structured database records, centered on an entity or subject that is provided with a list of attributes. Related to records, the statements can represent annotations on text by Natural Language Processing (NLP) tools. Check Record for the full JSON schema.
  • Generic for any data representation, ensuring minimal configuration and maximum flexibility. Check Generic for the full JSON schema.

The data schemas are defined using pydantic models, which provide built-in processes to support the creation of data that adhere to those models.

Contributing

Please read Contributing to Docling Core for details.

References

If you use Docling Core in your projects, please consider citing the following:

@techreport{Docling,
  author = "Deep Search Team",
  month = 8,
  title = "Docling Technical Report",
  url = "https://arxiv.org/abs/2408.09869",
  eprint = "2408.09869",
  doi = "10.48550/arXiv.2408.09869",
  version = "1.0.0",
  year = 2024
}

License

The Docling Core codebase is under MIT license. For individual model usage, please refer to the model licenses found in the original packages.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

docling_core-2.26.1.tar.gz (107.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

docling_core-2.26.1-py3-none-any.whl (133.4 kB view details)

Uploaded Python 3

File details

Details for the file docling_core-2.26.1.tar.gz.

File metadata

  • Download URL: docling_core-2.26.1.tar.gz
  • Upload date:
  • Size: 107.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.12.3 Linux/6.8.0-1021-azure

File hashes

Hashes for docling_core-2.26.1.tar.gz
Algorithm Hash digest
SHA256 6d1c9c2fa179c6d14b7d7f6785a93f92cd3c23fa20da4349c8b63d48732b41c7
MD5 94ddf510bfc37a83f497b32a30177bfb
BLAKE2b-256 3011af4f94afa6916f5fe6060fe2ca28ae8419b2dcc4b0662f31c4a2684a20a6

See more details on using hashes here.

File details

Details for the file docling_core-2.26.1-py3-none-any.whl.

File metadata

  • Download URL: docling_core-2.26.1-py3-none-any.whl
  • Upload date:
  • Size: 133.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.12.3 Linux/6.8.0-1021-azure

File hashes

Hashes for docling_core-2.26.1-py3-none-any.whl
Algorithm Hash digest
SHA256 8dbe5accbfceddc1d9fa9d1782c2ee173743e776453901066dd38455333c474b
MD5 6db33f8d61d54a639f4f58cbc26d790e
BLAKE2b-256 a2c3f4c5389f12affd99575dfdf8f67f94cd1b7432e6683256c6b2d9d3add821

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page