Skip to main content

Unified multi-module DataFrames client for the Iguazio Data Science Platform

Project description

v3io_frames - Streaming Data Client for v3io

Build Status Documentation License

Streaming data from client nuclio handler to a pandas DataFrame.

You will need a framesd server running, see here.

import v3io_frames as v3f

client = v3f.Client(address='localhost:8081')
num_dfs = num_rows = 0
size = 1000
for df in client.read(backend='weather', table='table', max_in_message=size):
   print(df)
   num_dfs += 1
   num_rows += len(df)

print('\nnum_dfs = {}, num_rows = {}'.format(num_dfs, num_rows))

License

Apache License Version 2.0, see LICENSE.txt

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

v3io_frames-0.10.4.tar.gz (122.6 kB view details)

Uploaded Source

Built Distribution

v3io_frames-0.10.4-py3-none-any.whl (35.8 kB view details)

Uploaded Python 3

File details

Details for the file v3io_frames-0.10.4.tar.gz.

File metadata

  • Download URL: v3io_frames-0.10.4.tar.gz
  • Upload date:
  • Size: 122.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.9.6 requests/2.28.1 setuptools/65.4.0 requests-toolbelt/0.10.1 tqdm/4.64.1 CPython/3.9.14

File hashes

Hashes for v3io_frames-0.10.4.tar.gz
Algorithm Hash digest
SHA256 8eec9acd7711995f5fa2aba3938734dd51c8767ba6f85ef39cf55d08e08db6c7
MD5 879dbfcc493675b70b9ea62f43340c07
BLAKE2b-256 04ebb0839b507e448571f11badcb94f3e62ba850d857da39ff274a9c57bcf5fa

See more details on using hashes here.

File details

Details for the file v3io_frames-0.10.4-py3-none-any.whl.

File metadata

  • Download URL: v3io_frames-0.10.4-py3-none-any.whl
  • Upload date:
  • Size: 35.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.9.6 requests/2.28.1 setuptools/65.4.0 requests-toolbelt/0.10.1 tqdm/4.64.1 CPython/3.9.14

File hashes

Hashes for v3io_frames-0.10.4-py3-none-any.whl
Algorithm Hash digest
SHA256 0e44d57669985a9edcd4ca697b4f11ccfa13ee6e3e0893b9bfbb756f74bbfe39
MD5 5e2d496faf85bc3bdf4fa8b132dedf0b
BLAKE2b-256 b1febb9cf1149bc9bc28752ce350350cc76a1dde16477f11f2f27fc442e8977a

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page