puremagic is a pure python module that will identify a file based off it’s magic numbers.
It is designed to be minimalistic and inherently cross platform compatible. It is also designed to be a stand in for python-magic, it incorporates the functions from_file(filename[, mime]) and from_string(string[, mime]) however the magic_file() and magic_string() are more powerful and will also display confidence and duplicate matches.
It does NOT try to match files off non-magic string. In other words it will not search for a string within a certain window of bytes like others might.
Advantages over using a wrapper for ‘file’ or ‘libmagic’:
Faster
Lightweight
Cross platform compatible
No dependencies
Disadvantages:
Does not have as many file types
No multilingual comments
Duplications due to small or reused magic numbers
(Help fix the first two disadvantages by contributing!)
Compatibility
Python 3.5+
Pypy
Using travis-ci to run continuous integration tests on listed platforms.
Install
In either a virtualenv or globally, simply run:
$ python setup.py installUsage
“from_file” will return the most likely file extension. “magic_file” will give you every possible result it finds, as well as the confidence.
import puremagic
filename = "test/resources/images/test.gif"
ext = puremagic.from_file(filename)
# '.gif'
puremagic.magic_file(filename)
# [['.gif', 'image/gif', 'Graphics interchange format file (GIF87a)', 0.7],
# ['.gif', '', 'GIF file', 0.5]]With “magic_file” it gives each match, highest confidence first:
possible extension(s)
mime type
description
confidence (All headers have to perfectly match to make the list, however this orders it by longest header, therefore most precise, first)
Script
Usage
$ python -m puremagic [options] filename <filename2>...Examples
$ python -m puremagic test/resources/images/test.gif
'test/resources/images/test.gif' : .gif
$ python -m puremagic -m test/resources/images/test.gif test/resources/audio/test.mp3
'test/resources/images/test.gif' : image/gif
'test/resources/audio/test.mp3' : audio/mpegFAQ
The file type is actually X but it’s showing up as Y with higher confidence?
This can happen when the file’s signature happens to match a subset of a file standard. The subset signature will be longer, therefore report with greater confidence, because it will have both the base file type signature plus the additional subset one.
You don’t have sliding offsets that could better detect plenty of common formats, why’s that?
Design choice, so it will be a lot faster and more accurate. Without more intelligent or deeper identification past a sliding offset I don’t feel comfortable including it as part of a ‘magic number’ library.
Your version isn’t as complete as I want it to be, where else should I look?
Look into python modules that wrap around libmagic or use something like Apache Tika.
Acknowledgements
Gary C. Kessler
For use of his File Signature Tables, available at: http://www.garykessler.net/library/file_sigs.html
Freedesktop.org
For use of their shared-mime-info file (even if they do use XML, blea), available at: https://cgit.freedesktop.org/xdg/shared-mime-info/
License
MIT Licenced, see LICENSE, Copyright (c) 2013-2020 Chris Griffith
1 maintainer
Release files for puremagic 1.10
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| puremagic-1.10.tar.gz | 35.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| puremagic-1.10-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 66.5 kB
Release files / puremagic-1.10.tar.gz
| Download URL | puremagic-1.10.tar.gz |
|---|---|
| Size | 35.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
6ffea02b80ceec1381f9df513e0120b701a74b6efad92311ea80281c7081b108
|
|
BLAKE2b-256 checksum How to use checksums |
73b03c362e6bc8e5a0e4bfd7b1e65dd7a2a82c4db929c986d071dc17cce6d178
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.5.0.1 requests/2.24.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.8.3
|
Release files / puremagic-1.10-py3-none-any.whl
| Download URL | puremagic-1.10-py3-none-any.whl |
|---|---|
| Size | 31.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
3603ac88bfa06689b4a3a2e90ef30f8cc5769df2f269bf546620bfe6b18c06d6
|
|
BLAKE2b-256 checksum How to use checksums |
d56e62d1cef9a0d8edf2d9c44b0a1b91b0b29b66fb693c94af278a0c76ddfd8c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.5.0.1 requests/2.24.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.8.3
|
