Skip to main content

A python module to deal with (very) big Excel files.

Project description

This library is intended to help you deal with big Excel files from within Python. After trying pandas, openpyxl, xlwings, and even win32com it seems that none have the ability to iterate over large Excel files without loading them completely into memory. So when you are dealing with files that are extremely large, this can be burdensome (especially if you only want to examine a bit of the file - the first 10 rows say). This library solves that by parsing the SpreadsheetML / XML xlsx files using a streaming parser. So you can see the first ten rows of any tab within any Excel file extremely quickly.

Getting Started

There are no dependancies to install. You just need to:

pip install sxl

Once installed, you can iterate through the entire file without using much memory by doing the following:

from sxl import Workbook
wb = Workbook("filepath")
ws = wb.sheets['sheet name'] # or, for example, wb.sheets[1]
for row in ws.rows:
    print(row)

Note that by default we assume the workbook is encoded with UTF-8. If you need to specifiy a different encoding, you can do so when opening the workbook:

wb = Workbook("filepath", encoding='cp1252')

If you are only interested in a few rows:

head = ws.head(5)
print(head)

Running Tests

To run tests:

python -m tests.test_sxl

License

The project is licensed under the MIT License - see the LICENSE.md file for details

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sxl-0.0.1a10.tar.gz (8.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sxl-0.0.1a10-py3-none-any.whl (8.2 kB view details)

Uploaded Python 3

File details

Details for the file sxl-0.0.1a10.tar.gz.

File metadata

  • Download URL: sxl-0.0.1a10.tar.gz
  • Upload date:
  • Size: 8.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.8.2

File hashes

Hashes for sxl-0.0.1a10.tar.gz
Algorithm Hash digest
SHA256 39026c89fb354e7557704a6ff4ea57c0249bb260572b3a74d901b45188fcf9e7
MD5 7a9f042dad64b0b7571b30dfceb65673
BLAKE2b-256 8156b00de90fc4dff0968d652fc8f9d613e5ad0659a6af6ccfaf3228f0254cb4

See more details on using hashes here.

File details

Details for the file sxl-0.0.1a10-py3-none-any.whl.

File metadata

  • Download URL: sxl-0.0.1a10-py3-none-any.whl
  • Upload date:
  • Size: 8.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.46.1 CPython/3.8.2

File hashes

Hashes for sxl-0.0.1a10-py3-none-any.whl
Algorithm Hash digest
SHA256 e6c49b95be4be7dce1b0285bb9f1edda40845a6d062d2be3ed585e8fc683c1ef
MD5 be2b0f8a29c69965a543a5c45172050f
BLAKE2b-256 fce5f0cee57f15d5df607501476b8954be7b238669cce324fe67b522c014f302

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page