Skip to main content

memory-foam

pypi tests codecov

memory-foam is a Python package that provides performant iterators for loading files from S3, GCS and Azure into memory for easy processing.

Features

  • Unified Interface: Seamlessly interact with files stored in S3, GCS and Azure.
  • Asynchronous Support: Efficiently load files using asynchronous iterators.

Installation

You can install memory-foam using pip:

pip install memory-foam

Example usage

from memory_foam import iter_files

...

for pointer, contents in iter_files(uri, glob, modified_after, client_config):
    results = process(contents)
    data = pointer.to_dict_with(results)
    save(data)

Credentials

This package uses the fsspec implementations for S3, GCS and Azure. Entries from the client_config dictionary are passed to the respective fsspec clients.

However, you can use the same authentication setup as the individual fsspec packages.

The documentation for each of the clients is linked below:

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

memory_foam-0.4.2.tar.gz (25.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

memory_foam-0.4.2-py3-none-any.whl (18.0 kB view details)

Uploaded Python 3

File details

Details for the file memory_foam-0.4.2.tar.gz.

File metadata

  • Download URL: memory_foam-0.4.2.tar.gz
  • Upload date:
  • Size: 25.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for memory_foam-0.4.2.tar.gz
Algorithm Hash digest
SHA256 bd421501dceeae31780e640844546f44f6880e647081903e56e4b72b040266d0
MD5 0fa8b2efa13d81a5f625151f8cae467d
BLAKE2b-256 38dfa2f1ace686024dcd4a930ed7eb5fe5577632fa5064f2877afcf6145a532e

See more details on using hashes here.

Provenance

The following attestation bundles were made for memory_foam-0.4.2.tar.gz:

Publisher: release.yml on mattseddon/memory-foam

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file memory_foam-0.4.2-py3-none-any.whl.

File metadata

  • Download URL: memory_foam-0.4.2-py3-none-any.whl
  • Upload date:
  • Size: 18.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for memory_foam-0.4.2-py3-none-any.whl
Algorithm Hash digest
SHA256 ff163473ae4ac0d7575d62112efacc3e4aecf8485460eb075f17f0353a1f50b4
MD5 fe9cd9f9de1ba593dafcf84a693ddcc4
BLAKE2b-256 05c8627d08baffd80e3f59b882536737c645095f7a1119c6aa68081918b316d2

See more details on using hashes here.

Provenance

The following attestation bundles were made for memory_foam-0.4.2-py3-none-any.whl:

Publisher: release.yml on mattseddon/memory-foam

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.4.2 This release

2 files

0.4.1

2 files

0.4.0

2 files

0.3.2

2 files

0.3.1

2 files

0.3.0

2 files

0.2.1

2 files

0.2.0

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

0.0.2

2 files

0.0.1

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page