Skip to main content

Thin wrapper for pandoc.

Project description

pypandoc

Build Status GitHub Releases Pypandoc PyPI Version Pypandoc Binary PyPI Version PyPandoc PyPi Downloads PyPandoc Binary PyPI Downloads conda version Development Status PyPandoc Python version PyPandoc Binary Python version License

Pypandoc provides a thin wrapper for pandoc, a universal document converter.

Installation

Pypandoc uses pandoc, so it needs an available installation of pandoc. Pypandoc provides 2 packages, "pypandoc" and "pypandoc_binary", with the second one including pandoc out of the box. The 2 packages are identical, with the only difference being that one includes pandoc, while the other don't.

If pandoc is already installed (i.e. pandoc is in the PATH), pypandoc uses the version with the higher version number, and if both are the same, the already installed version. See Specifying the location of pandoc binaries for more.

To use pandoc filters, you must have the relevant filters installed on your machine.

Installing via pip

If you want to install pandoc yourself or are on a unsupported platform, you'll need to install "pypandoc" and install pandoc manually

pip install pypandoc

If you want pandoc included out of the box, you can utilize our pypandoc_binary package, which are identical to the "pypandoc" package, but with pandoc included.

pip install pypandoc_binary

Prebuilt wheels for Windows and Mac OS X

If you use Linux and have your own wheelhouse, you can build a wheel which include pandoc with python setup_binary.py download_pandoc; python setup.py bdist_wheel. Be aware that this works only on 64bit intel systems, as we only download it from the official releases.

Installing via conda

Pypandoc is included in conda-forge. The conda packages will also install the pandoc package, so pandoc is available in the installation.

Install via conda install -c conda-forge pypandoc.

You can also add the channel to your conda config via conda config --add channels conda-forge. This makes it possible to use conda install pypandoc directly and also lets you update via conda update pypandoc.

Installing pandoc

If you don't already have pandoc on your system, or have installed the pypandoc_binary package, which includes pandoc, you need to install pandoc by yourself.

Installing pandoc via pypandoc

Installing via pypandoc is possible on Windows, Mac OS X or Linux (Intel-based, 64-bit):

pip install pypandoc
from pypandoc.pandoc_download import download_pandoc
# see the documentation how to customize the installation path
# but be aware that you then need to include it in the `PATH`
download_pandoc()

The default install location is included in the search path for pandoc, so you don't need to add it to the PATH.

By default, the latest pandoc version is installed. If you want to specify your own version, say 1.19.1, use download_pandoc(version='1.19.1') instead.

Installing pandoc manually

Installing manually via the system mechanism is also possible. Such installation mechanism make pandoc available on many more platforms:

  • Ubuntu/Debian: sudo apt-get install pandoc
  • Fedora/Red Hat: sudo yum install pandoc
  • Arch: sudo pacman -S pandoc
  • Mac OS X with Homebrew: brew install pandoc pandoc-citeproc Caskroom/cask/mactex
  • Machine with Haskell: cabal-install pandoc
  • Windows: There is an installer available here
  • FreeBSD with pkg: pkg install hs-pandoc
  • Or see Pandoc - Installing pandoc

Be aware that not all install mechanisms put pandoc in the PATH, so you either have to change the PATH yourself or set the full PATH to pandoc in PYPANDOC_PANDOC. See the next section for more information.

Specifying the location of pandoc binaries

You can point to a specific pandoc version by setting the environment variable PYPANDOC_PANDOC to the full PATH to the pandoc binary (PYPANDOC_PANDOC=/home/x/whatever/pandoc or PYPANDOC_PANDOC=c:\pandoc\pandoc.exe). If this environment variable is set, this is the only place where pandoc is searched for.

In certain cases, e.g. pandoc is installed but a web server with its own user cannot find the binaries, it is useful to specify the location at runtime:

import os
os.environ.setdefault('PYPANDOC_PANDOC', '/home/x/whatever/pandoc')

Usage

There are two basic ways to use pypandoc: with input files or with input strings.

import pypandoc

# With an input file: it will infer the input format from the filename
output = pypandoc.convert_file('somefile.md', 'rst')

# ...but you can overwrite the format via the `format` argument:
output = pypandoc.convert_file('somefile.txt', 'rst', format='md')

# alternatively you could just pass some string. In this case you need to
# define the input format:
output = pypandoc.convert_text('# some title', 'rst', format='md')
# output == 'some title\r\n==========\r\n\r\n'

convert_text expects this string to be unicode or utf-8 encoded bytes. convert_* will always return a unicode string.

It's also possible to directly let pandoc write the output to a file. This is the only way to convert to some output formats (e.g. odt, docx, epub, epub3, pdf). In that case convert_*() will return an empty string.

import pypandoc

output = pypandoc.convert_file('somefile.md', 'docx', outputfile="somefile.docx")
assert output == ""

It's also possible to specify multiple input files to pandoc, either as absolute paths, relative paths or file patterns.

import pypandoc

# convert all markdown files in a chapters/ subdirectory.
pypandoc.convert_file('chapters/*.md', 'docx', outputfile="somefile.docx")

# convert all markdown files in the book1 and book2 directories.
pypandoc.convert_file(['book1/*.md', 'book2/*.md'], 'docx', outputfile="somefile.docx")

# convert the front from another drive, and all markdown files in the chapter directory.
pypandoc.convert_file(['D:/book_front.md', 'book2/*.md'], 'docx', outputfile="somefile.docx")

pathlib is also supported.

import pypandoc
from pathlib import Path

# single file
input = Path('somefile.md')
output = input.with_suffix('.docx')
pypandoc.convert_file(input, 'docx', outputfile=output)

# convert all markdown files in a chapters/ subdirectory.
pypandoc.convert_file(Path('chapters').glob('*.md'), 'docx', outputfile="somefile.docx")

# convert all markdown files in the book1 and book2 directories.
pypandoc.convert_file([*Path('book1').glob('*.md'), *Path('book2').glob('*.md')], 'docx', outputfile="somefile.docx")
# pathlib globs must be unpacked if they are inside lists.

In addition to format, it is possible to pass extra_args. That makes it possible to access various pandoc options easily.

output = pypandoc.convert_text(
    '<h1>Primary Heading</h1>',
    'md', format='html',
    extra_args=['--atx-headers'])
# output == '# Primary Heading\r\n'
output = pypandoc.convert_text(
    '# Primary Heading',
    'html', format='md',
    extra_args=['--base-header-level=2'])
# output == '<h2 id="primary-heading">Primary Heading</h2>\r\n'

pypandoc now supports easy addition of pandoc filters.

filters = ['pandoc-citeproc']
pdoc_args = ['--mathjax',
             '--smart']
output = pypandoc.convert_file(filename,
                               to='html5',
                               format='md',
                               extra_args=pdoc_args,
                               filters=filters)

Please pass any filters in as a list and not as a string.

Please refer to pandoc -h and the official documentation for further details.

Dealing with Formatting Arguments

Pandoc supports custom formatting though -V parameter. In order to use it through pypandoc, use code such as this:

output = pypandoc.convert_file('demo.md', 'pdf', outputfile='demo.pdf',
  extra_args=['-V', 'geometry:margin=1.5cm'])

Note: it's important to separate -V and its argument within a list like that or else it won't work. This gotcha has to do with the way subprocess.Popen works.

Logging Messages

Pypandoc logs messages using the Python logging library. By default, it will send messages to the console, including any messages generated by Pandoc. If desired, this behaviour can be changed by adding handlers to the pypandoc logger before calling any functions. For example, to mute all logging add a null handler:

import logging
logging.getLogger('pypandoc').addHandler(logging.NullHandler())

Getting Pandoc Version

As it can be useful sometimes to check what pandoc version is available at your system or which particular pandoc binary is used by pypandoc. For that, pypandoc provides the following utility functions. Example:

print(pypandoc.get_pandoc_version())
print(pypandoc.get_pandoc_path())
print(pypandoc.get_pandoc_formats())

Related

  • pydocverter is a client for a service called Docverter, which offers pandoc as a service (plus some extra goodies).
  • See pyandoc for an alternative implementation of a pandoc wrapper from Kenneth Reitz. This one hasn't been active in a while though.
  • See panflute which provides convert_text similar to pypandoc's. Its focus is on writing and running pandoc filters though.

Contributing

Contributions are welcome. When opening a PR, please keep the following guidelines in mind:

  1. Before implementing, please open an issue for discussion.
  2. Make sure you have tests for the new logic.
  3. Make sure your code passes flake8 pypandoc/*.py tests.py
  4. Add yourself to contributors at README.md unless you are already there. In that case tweak your contributions.

Note that for citeproc tests to pass you'll need to have pandoc-citeproc installed. If you installed a prebuilt wheel or conda package, it is already included.

Contributors

  • Jessica Tegner - New maintainer as of 1. Juli 2021
  • Valentin Haenel - String conversion fix
  • Daniel Sanchez - Automatic parsing of input/output formats
  • Thomas G. - Python 3 support
  • Ben Jao Ming - Fail gracefully if pandoc is missing
  • Ross Crawford-d'Heureuse - Encode input in UTF-8 and add Django example
  • Michael Chow - Decode output in UTF-8
  • Janusz Skonieczny - Support Windows newlines and allow encoding to be specified.
  • gabeos - Fix help parsing
  • Marc Abramowitz - Make setup.py fail hard if pandoc is missing, Travis, Dockerfile, PyPI badge, Tox, PEP-8, improved documentation
  • Daniel L. - Add extra_args example to README
  • Amy Guy - Exception handling for unicode errors
  • Florian Eßer - Allow Markdown extensions in output format
  • Philipp Wendler - Allow Markdown extensions in input format
  • Jan Katins - Handling output to a file, Travis to work on newer version of pandoc, return code checking, get_pandoc_version. Helped to fix the Travis build, new convert_* API. Former maintainer of pypandoc
  • Aaron Gonzales - Added better filter handling
  • David Lukes - Enabled input from non-plain-text files and made sure tests clean up template files correctly if they fail
  • valholl - Set up licensing information correctly and include examples to distribution version
  • Cyrille Rossant - Fixed bug by trimming out stars in the list of pandoc formats. Helped to fix the Travis build.
  • Paul Osborne - Don't require pandoc to install pypandoc.
  • Felix Yan - Added installation instructions for Arch Linux.
  • Kolen Cheung - Implement _get_pandoc_urls for installing arbitrary version as well as the latest version of pandoc. Minor: README, Travis, setup.py.
  • Rebecca Heineman - Added scanning code for finding pandoc in Windows
  • Andrew Barraford - Download destination.
  • Jesse Widner & Dominic Thorn - Add support for lua filters
  • Alex Kneisel - Added pathlib.Path support to convert_file.
  • Juho Vepsäläinen - Creator and former maintainer of pypandoc
  • Connor - Updated Dockerfile to Python 3.9 image and added docker compose file
  • Colin Bull - Added ability to control whether files are sorted before being passed to pandoc process.

License

Pypandoc is available under MIT license. See LICENSE for more details. Pandoc itself is available under the GPL2 license.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

pypandoc_binary-1.15-py3-none-win_amd64.whl (38.6 MB view details)

Uploaded Python 3Windows x86-64

pypandoc_binary-1.15-py3-none-musllinux_1_1_x86_64.whl (32.6 MB view details)

Uploaded Python 3musllinux: musl 1.1+ x86-64

pypandoc_binary-1.15-py3-none-musllinux_1_1_aarch64.whl (35.4 MB view details)

Uploaded Python 3musllinux: musl 1.1+ ARM64

pypandoc_binary-1.15-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (35.4 MB view details)

Uploaded Python 3manylinux: glibc 2.17+ ARM64

pypandoc_binary-1.15-py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (32.6 MB view details)

Uploaded Python 3manylinux: glibc 2.17+ x86-64manylinux: glibc 2.5+ x86-64

pypandoc_binary-1.15-py3-none-macosx_11_0_arm64.whl (22.1 MB view details)

Uploaded Python 3macOS 11.0+ ARM64

pypandoc_binary-1.15-py3-none-macosx_10_9_x86_64.whl (22.1 MB view details)

Uploaded Python 3macOS 10.9+ x86-64

File details

Details for the file pypandoc_binary-1.15-py3-none-win_amd64.whl.

File metadata

File hashes

Hashes for pypandoc_binary-1.15-py3-none-win_amd64.whl
Algorithm Hash digest
SHA256 de7a234ffb674a4e650490acc7a5986161e2fd8b5bb106f1c9ffc30d76d2cf23
MD5 66eb0776fdaaa572902b4be1fa56728f
BLAKE2b-256 fda72295d4f1036cedbd27b4d6c220fe3bc40601b618245bfd5837623ecee4cb

See more details on using hashes here.

Provenance

The following attestation bundles were made for pypandoc_binary-1.15-py3-none-win_amd64.whl:

Publisher: ci.yaml on JessicaTegner/pypandoc

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pypandoc_binary-1.15-py3-none-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for pypandoc_binary-1.15-py3-none-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 f9ebdf92059e9c1ae5231ee193d1fdafbc0188d5ec9d5f53e95fa21a42339481
MD5 bcf3f4d4811d69f30bd1122d24d0c768
BLAKE2b-256 d9a95c3c2fba01a008e7aa784268fa88b612c3ef94b89d60c1e838d96b5a1735

See more details on using hashes here.

Provenance

The following attestation bundles were made for pypandoc_binary-1.15-py3-none-musllinux_1_1_x86_64.whl:

Publisher: ci.yaml on JessicaTegner/pypandoc

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pypandoc_binary-1.15-py3-none-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for pypandoc_binary-1.15-py3-none-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 e465a09e8aac18e8fda37516a6d1a891e51cdd1d066ab585f85a81620de575e2
MD5 4645ab6aa0fff9120abec6f844d47536
BLAKE2b-256 808b341d6a298a97ba66b6a5f93583f03e027cb0e3322ce6d46082eca0e95c93

See more details on using hashes here.

Provenance

The following attestation bundles were made for pypandoc_binary-1.15-py3-none-musllinux_1_1_aarch64.whl:

Publisher: ci.yaml on JessicaTegner/pypandoc

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pypandoc_binary-1.15-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for pypandoc_binary-1.15-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 fa29176f4eb9eb93f555dac6926a8d53c6ab4fd2deba3a1edb002e04899b237d
MD5 c34491c60382ceef4118d7980d9cb495
BLAKE2b-256 e174970c50ef0f62b69afbae957d7be92072748b1f2d9b690c763c1afc81e326

See more details on using hashes here.

Provenance

The following attestation bundles were made for pypandoc_binary-1.15-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: ci.yaml on JessicaTegner/pypandoc

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pypandoc_binary-1.15-py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for pypandoc_binary-1.15-py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 df54edb00331a8fc80516c71cd81de69954512163037c3d4577c315091a0d6f6
MD5 edf594291fe611935a051769a21f0c42
BLAKE2b-256 cb00dc9377725392fa3c7d5f04dc42ab012d1cd40a0a0705b6eb794444559072

See more details on using hashes here.

Provenance

The following attestation bundles were made for pypandoc_binary-1.15-py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: ci.yaml on JessicaTegner/pypandoc

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pypandoc_binary-1.15-py3-none-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for pypandoc_binary-1.15-py3-none-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 79b215279a6470d3e2a24135826b446f44259f6abce361e31d713ac1b0b5aa69
MD5 81ba331a1cfbd0f24673b0cd68c5cf70
BLAKE2b-256 59d6ef3b4927797bbf4146fdcb54b12a8ce766d077b44f37bcef0581a931a8a6

See more details on using hashes here.

Provenance

The following attestation bundles were made for pypandoc_binary-1.15-py3-none-macosx_11_0_arm64.whl:

Publisher: ci.yaml on JessicaTegner/pypandoc

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pypandoc_binary-1.15-py3-none-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for pypandoc_binary-1.15-py3-none-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 12a43df66f59cb489a9a2659b6f049ec103132e43e4f284b7e33e7ae4dd9cadb
MD5 a543bb64fa2da049914bf5b53802df43
BLAKE2b-256 a359ad3a065f512c3fc3bdf8d97d30e82fb40a292b3f38b06ef13f9c2f69df29

See more details on using hashes here.

Provenance

The following attestation bundles were made for pypandoc_binary-1.15-py3-none-macosx_10_9_x86_64.whl:

Publisher: ci.yaml on JessicaTegner/pypandoc

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page