Skip to main content

transfer file using ftp, scp or sftp

Project description

transferfile

介绍

sftp、ftp、scp、rsync 传输文件的统一接口,无论哪一种传输方式,都可以适配。

程序适用于数据服务系统,如数据仓库对下游系统分发数据文件。

安装

pip install transferfile

使用说明

采用简单工厂模式,传入的 type 有:

  • ftp
  • sftp
  • scp
  • rsync
ftp

请注意原路径和目标路径都是带文件名的路径

传输 /path/to/src.txt 到 /path/to/dist.txt

from transferfile import TransferFactory
client = TransferFactory.create(type = "ftp",host = "172.17.0.2",username = "admin",password= "admin")
client.put("/path/to/src.txt","/path/to/dist.txt")

如果目标路径 /path/to/ 不存在,会递归创建。

如果程序运行在 linux 环境(utf8编码),而 ftp 服务器在 Windows 环境(GBK编码),为了文件名看起来不是乱码,可以指定服务端的编码方式为 GBK,指定特殊端口也是可以的,默认是 21

from transferfile import TransferFactory
client = TransferFactory.create(type = "ftp",host = "172.17.0.2",port = 21,username = "admin",password= "admin",encoding = 'gbk')
client.put("/path/to/src.txt","/path/to/dist.txt")

下载文件使用 get,下载远程 /path/to/remote.txt 到本地 /path/to/local.txt:

from transferfile import TransferFactory
client = TransferFactory.create(type = "ftp",host = "172.17.0.2",port = 21,username = "admin",password= "admin",encoding = 'gbk')
client.get("/path/to/local.txt","/path/to/remote.txt")
sftp,scp

请注意原路径和目标路径都是带文件名路径

用 scp 或 sftp 时只需要修改 type 参数为 scp 或 sftp 即可:

from transferfile import TransferFactory
client = TransferFactory.create(type = "sftp",host = "172.17.0.2",username = "admin",password= "admin")
client.put("/path/to/src.txt","/path/to/dist.txt")

也可以指定 rsa_私钥文件,从而不需要密码

from transferfile import TransferFactory
client = TransferFactory.create(type = "scp",host = "172.17.0.2",username = "admin", rsa_file = "/root/.ssh/id_rsa")
client.put("/path/to/src.txt","/path/to/dist.txt")

如果已经做好了 ssh 的授信,可以传入参数 load_system_host_keys = True,从而不需要密码

from transferfile import TransferFactory
client = TransferFactory.create(type = "scp",host = "172.17.0.2",username = "admin", load_system_host_keys = True )
client.put("/path/to/src.txt","/path/to/dist.txt")
rsync

请注意原路径和目标路径可以是文件名,也可以是目录

rsync 目前需要配置好授信才可以使用,暂时不支持用户名和密码登录。

from transferfile import TransferFactory
client = TransferFactory.create(type = "rsync",host = "172.17.0.2",username = "admin", load_system_host_keys = True)
client.put("/path/to/src.txt","/path/to/dist.txt")
扩展点

由于 ftp 不支持传输目录,这里就没有做出传输整个目录的接口,要实现也不复杂,如果要实现就是递归读取目录的文件,然后一个一个传输。也可以压缩成一个文件后上传。

目前工作中暂时没有这个需求,都是生成好一个文件就传输这个文件,不需要上传整个目录。因此就没有实现。

联系我

有问题,欢迎交流讨论。

公众号 「Python七号」,分享 Python 编程技能。

个人微信 「somenzz」

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

transferfile-0.4.tar.gz (7.5 kB view details)

Uploaded Source

Built Distribution

transferfile-0.4-py3-none-any.whl (7.6 kB view details)

Uploaded Python 3

File details

Details for the file transferfile-0.4.tar.gz.

File metadata

  • Download URL: transferfile-0.4.tar.gz
  • Upload date:
  • Size: 7.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.5

File hashes

Hashes for transferfile-0.4.tar.gz
Algorithm Hash digest
SHA256 6caeefa31eefd8f707d00e053848cd40163c5346f58e1ddfea6816e5c2535ec9
MD5 d1ce90a12367cc3c29d2e980bb72a20e
BLAKE2b-256 cfb1d324b7a66bffbc67df88f87fe5dae80befb926f3843a8ce5d53f00848f11

See more details on using hashes here.

File details

Details for the file transferfile-0.4-py3-none-any.whl.

File metadata

  • Download URL: transferfile-0.4-py3-none-any.whl
  • Upload date:
  • Size: 7.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.5

File hashes

Hashes for transferfile-0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 60dbf111d422b3278c9ddde088649ecd40ded5261a33c9074192085992e01252
MD5 2c1989482e86c33b68f9a5046ba4c7cc
BLAKE2b-256 48e0b701e8c22d740ffc894d983caf1fd08bbe0aed133af97f9ed8aa6d34fa55

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page