Skip to main content

Provide bytes to fsspec over HTTP from any backend

Project description

fsspec proxy and client

Allows reading/writing files via standard fsspec/python operations via a proxy, which doesn't expose any of its internal credentials.

This is particularly useful for pyscript, which cannot call the backend packages required to talk to remote filesystems, like botocore.

Demo

This is for running the example locally. Further docs will be written when we have agreed on a final layout of this repo and code.

With a prepared environment including s3fs.

$ git clone https://github.com/fsspec/fsspec-proxy
$ cd fsspec-proxy
$ pip install ./fsspec-proxy
$ fsspec-proxy
$ # new console, same directory
$ cd example
$ uvx pyscript run . --port 8899

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fsspec_proxy-0.1.2.tar.gz (7.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

fsspec_proxy-0.1.2-py3-none-any.whl (9.2 kB view details)

Uploaded Python 3

File details

Details for the file fsspec_proxy-0.1.2.tar.gz.

File metadata

  • Download URL: fsspec_proxy-0.1.2.tar.gz
  • Upload date:
  • Size: 7.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.11

File hashes

Hashes for fsspec_proxy-0.1.2.tar.gz
Algorithm Hash digest
SHA256 b48a99935851d8a03c2e1d2b5e616f88265b939c334ab2b7a7a36aa28c963841
MD5 a457519f84b0747b261726707c2309c6
BLAKE2b-256 e6eb41ef6fda30ae2ca687e4e6d4253bdf774b2751da10bdfbddbf18f4bebdf6

See more details on using hashes here.

File details

Details for the file fsspec_proxy-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: fsspec_proxy-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 9.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.11

File hashes

Hashes for fsspec_proxy-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 d715dd875fdc7f6ea15162ed881feb5b599efbe2365e85044b059ad29ddbd62c
MD5 ab83650b2f732dc86eb15339781a9241
BLAKE2b-256 d1a3137074c1ce72bdbe3a4ac989100cd60953f4bf6ea4710bc60c8285379ec8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page