Skip to main content

Python module for reading and writing Apache ORC file format.

Project description

PyORC

Azure Pipelines Status Codecov code coverage Documentation Status

Python module for reading and writing Apache ORC file format. It uses the Apache ORC’s Core C++ API under the hood, and provides a similar interface as the csv module in the Python standard library.

Supports only Python 3.6 or newer and ORC 1.6.0.

Features

  • Reading ORC files.
  • Writing ORC files.
  • While using Python’s stream/file-like object IO interface.

That sums up quite well the purpose of this project.

Example

Minimal example for reading an ORC file:

import pyorc

with open("./data.orc", "rb") as data:
    reader = pyorc.Reader(data)
    for row in reader:
        print(row)

And another for writing one:

import pyorc

with open("./new_data.orc", "wb") as data:
    with pyorc.Writer(data, "struct<col0:int,col1:string>") as writer:
        writer.write((1, "ORC from Python"))

Contribution

Any contributions are welcome. If you would like to help in development fork or report issue here on Github. You can also help in improving the documentation.

Project details


Release history Release notifications

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for pyorc, version 0.1.0
Filename, size File type Python version Upload date Hashes
Filename, size pyorc-0.1.0-cp36-cp36m-manylinux2010_x86_64.whl (5.6 MB) File type Wheel Python version cp36 Upload date Hashes View hashes
Filename, size pyorc-0.1.0-cp37-cp37m-macosx_10_13_x86_64.whl (1.9 MB) File type Wheel Python version cp37 Upload date Hashes View hashes
Filename, size pyorc-0.1.0-cp37-cp37m-manylinux2010_x86_64.whl (5.7 MB) File type Wheel Python version cp37 Upload date Hashes View hashes
Filename, size pyorc-0.1.0-cp38-cp38-macosx_10_13_x86_64.whl (1.9 MB) File type Wheel Python version cp38 Upload date Hashes View hashes
Filename, size pyorc-0.1.0-cp38-cp38-manylinux2010_x86_64.whl (5.6 MB) File type Wheel Python version cp38 Upload date Hashes View hashes
Filename, size pyorc-0.1.0.tar.gz (34.8 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page