Skip to main content

pyfilesystem2 interface to Azure Datalake

Installing

pip install fs-dlk

Opening FS Datalake

Authentication with username and password:

from fs_dlk import DLKFS
dlkfs = DLKFS("/path/to/the/remote/dir", username="username", password="password")

Authentication with tenant secret:

from fs_dlk import DLKFS
dlkfs = DLKFS("/path/to/the/remote/dir", tenant_id="tenant id", client_id="client id", client_secret="client_secret")

Specifying custom store name:

from fs_dlk import DLKFS
dlkfs = DLKFS("/path/to/the/remote/dir", store="store name", **auth_args_here)

Authentication with connection strings:

Username and password auth:

import fs
dlkfs = fs.open_fs("dlk://username:password@/store_name/path/to/remote")

Tenant secret auth:

import fs
dlkfs = fs.open_fs("dlk://username:password@tenant-id/store_name/path/to/remote")

Downloading files

with open("local_file", "wb") as local_file:
    dlkfs.download("path/to/remote/file", local_file)

Uploading files

with open("local_file", "wb") as local_file:
    dlkfs.upload("path/to/remote/file", local_file)

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fs-dlk-0.1.3.tar.gz (5.2 kB view details)

Uploaded Source

File details

Details for the file fs-dlk-0.1.3.tar.gz.

File metadata

  • Download URL: fs-dlk-0.1.3.tar.gz
  • Upload date:
  • Size: 5.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/45.2.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.6.10

File hashes

Hashes for fs-dlk-0.1.3.tar.gz
Algorithm Hash digest
SHA256 10791eaf2496c31e84847b6be91bac7e8b77a5694ae5b13c0900a85e624bad8e
MD5 80f20fb422d979b5a78373a2e2a66121
BLAKE2b-256 04c77b0b0907101c3bd69049b2bd344d8c24173a6507d493071c1f284d8944e9

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

0.1.3 This release

1 file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page