pyxet 0.1.1

pyxet is a Python library that provides a lightweight interface for the XetHub platform.

pyxet: Python bindings for Xethub

What is it?

pyxet is a Python library that provides a lightweight interface for the XetHub platform.

Main features

1. A filesystem interface.
   • fssspec
     • copy
     • remove
     • list
     • etc.
   • glob
   • pathlib.Path(WIP)
2. Mount.
   • Read-only optimize for speed; perfect for data exploration and analysis and building data-apps and model inference.
3. Integrations:
   • GitHub submodule
   • pandas
   • polars
   • pyarrow
   • duckdb
   • dask
   • ray

For API documentation and full examples, please see the documentation

Where to get it

git config --global user.name "Foo Bar"
git config --global user.email "[e-mail]"
pip install pyxet

License

BSD 3

Getting Help

Go to the GitHub project, join the Discord server, and file issues

Development Environment

To set up build env, switch to this directory and run:

python -m venv .env
source .env/bin/activate
pip install maturin
pip install fsspec
pip install ipython (for convenience)

To develop:

source ./develop.sh

To build locally

maturin develop

Then running python and import pyxet should work

See https://www.maturin.rs/develop.html for details

Building a release

On mac:

MACOSX_DEPLOYMENT_TARGET=10.9 maturin build --release --target universal2-apple-darwin