Skip to main content

pyJedAI


An open-source library that leverages Python’s data science ecosystem to build
powerful end-to-end Entity Resolution workflows.

Overview

pyJedAI is a python framework, aiming to offer experts and novice users, robust and fast solutions for multiple types of Entity Resolution problems. It is builded using state-of-the-art python frameworks. pyJedAI constitutes the sole open-source Link Discovery tool that is capable of exploiting the latest breakthroughs in Deep Learning and NLP techniques, which are publicly available through the Python data science ecosystem. This applies to both blocking and matching, thus ensuring high time efficiency, high scalability as well as high effectiveness, without requiring any labelled instances from the user.

Key-Features

  • Input data-type independent. Both structured and semi-structured data can be processed.
  • Various implemented algorithms.
  • Easy-to-use.
  • Utilizes some of the famous and cutting-edge machine learning packages.
  • Offers supervised and un-supervised ML techniques.

Open demos are available in:

       

Google Colab Hands-on demo:

Install

pyJedAI has been tested in Windows and Linux OS.

Basic requirements:

  • Python version greater or equal to 3.8.
  • For Windows, Microsoft Visual C++ 14.0 is required. Download it from Microsoft Official site.

PyPI

Install the latest version of pyjedai:

pip install pyjedai

More on PyPI.

Git

Set up locally:

git clone https://github.com/AI-team-UoA/pyJedAI.git

go to the root directory with cd pyJedAI and type:

pip install .

Docker

Available at Docker Hub, or clone this repo and:

docker build -f Dockerfile

Dependencies

         


           

See the full list of dependencies and all versions used, in this file.

Status

Tests PyPi made-with-python codecov

Statistics & Info

PyPI - Downloads PyPI version

Bugs, Discussions & News

GitHub Discussions is the discussion forum for general questions and discussions and our recommended starting point. Please report any bugs that you find here.

Java - Web Application

pyJedAI

For Java users checkout the initial JedAI. There you can find Java based code and a Web Application for interactive creation of ER workflows.

JedAI constitutes an open source, high scalability toolkit that offers out-of-the-box solutions for any data integration task, e.g., Record Linkage, Entity Resolution and Link Discovery. At its core lies a set of domain-independent, state-of-the-art techniques that apply to both RDF and relational data.


Team & Authors

pyJedAI

This is a research project by the AI-Team of the Department of Informatics and Telecommunications at the University of Athens.

Cite us

If you use this code or find it helpful in your research, here's the .bibtex:

@inproceedings{DBLP:conf/semweb/Nikoletos0K22,
  author       = {Konstantinos Nikoletos and
                  George Papadakis and
                  Manolis Koubarakis},
  editor       = {Anastasia Dimou and
                  Armin Haller and
                  Anna Lisa Gentile and
                  Petar Ristoski},
  title        = {pyJedAI: a Lightsaber for Link Discovery},
  booktitle    = {Proceedings of the {ISWC} 2022 Posters, Demos and Industry Tracks:
                  From Novel Ideas to Industrial Practice co-located with 21st International
                  Semantic Web Conference {(ISWC} 2022), Virtual Conference, Hangzhou,
                  China, October 23-27, 2022},
  series       = {{CEUR} Workshop Proceedings},
  volume       = {3254},
  publisher    = {CEUR-WS.org},
  year         = {2022},
  url          = {https://ceur-ws.org/Vol-3254/paper366.pdf},
  timestamp    = {Fri, 10 Mar 2023 16:23:05 +0100},
  biburl       = {https://dblp.org/rec/conf/semweb/Nikoletos0K22.bib},
  bibsource    = {dblp computer science bibliography, https://dblp.org}
}

License

Released under the Apache-2.0 license (see LICENSE.txt).

Copyright © 2024 AI-Team, University of Athens



       

This project is being funded in the context of STELAR that is an HORIZON-Europe project.

Metadata

Release files for pyjedai 0.3.6

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pyjedai 0.3.6
File Size Uploaded Provenance
pyjedai-0.3.6.tar.gz 112.6 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for pyjedai 0.3.6
File Interpreter ABI Platform
pyjedai-0.3.6-py3-none-any.whl Python 3 none any Details

Total release size: 232.1 kB

Release files / pyjedai-0.3.6.tar.gz

Download URL pyjedai-0.3.6.tar.gz
Size 112.6 kB
Tags Source
SHA-256 checksum
How to use checksums
77f1da62c6b69e4f9469f297b3fa5dcce4e4c6f80b286031f1b8ec2e497e3b1b
BLAKE2b-256 checksum
How to use checksums
735e3f5de57cdeff10a3f30c3de0a64864281de2e4ef952426955b19b993318e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.14.0

Release files / pyjedai-0.3.6-py3-none-any.whl

Download URL pyjedai-0.3.6-py3-none-any.whl
Size 119.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
c8c91700dac5e013a4c72a723bd2e25d8c7b31320c18cbc40c2d586b38abfdcf
BLAKE2b-256 checksum
How to use checksums
cb2e2147136f91c05600f66d7628de136c30383407b21e1b5571deee3ff4e69f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.14.0

Security for pyjedai 0.3.6

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.3.6 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page