transfer file using ftp, scp or sftp
Project description
transferfile
介绍
sftp、ftp、scp、rsync 传输文件的统一接口,无论哪一种传输方式,都可以适配。
程序适用于数据服务系统,如数据仓库对下游系统分发数据文件。
安装
pip install transferfile
使用说明
采用简单工厂模式,传入的 type 有:
- ftp
- sftp
- scp
- rsync
ftp
请注意原路径和目标路径都是带文件名的路径
传输 /path/to/src.txt 到 /path/to/dist.txt
from transferfile import TransferFactory
client = TransferFactory.create(type = "ftp",host = "172.17.0.2",username = "admin",password= "admin")
client.put("/path/to/src.txt","/path/to/dist.txt")
如果目标路径 /path/to/
不存在,会递归创建。
如果程序运行在 linux 环境(utf8编码),而 ftp 服务器在 Windows 环境(GBK编码),为了文件名看起来不是乱码,可以指定服务端的编码方式为 GBK,指定特殊端口也是可以的,默认是 21
from transferfile import TransferFactory
client = TransferFactory.create(type = "ftp",host = "172.17.0.2",port = 21,username = "admin",password= "admin",encoding = 'gbk')
client.put("/path/to/src.txt","/path/to/dist.txt")
下载文件使用 get,下载远程 /path/to/remote.txt 到本地 /path/to/local.txt:
from transferfile import TransferFactory
client = TransferFactory.create(type = "ftp",host = "172.17.0.2",port = 21,username = "admin",password= "admin",encoding = 'gbk')
client.get("/path/to/local.txt","/path/to/remote.txt")
sftp,scp
请注意原路径和目标路径都是带文件名路径
用 scp 或 sftp 时只需要修改 type 参数为 scp 或 sftp 即可:
from transferfile import TransferFactory
client = TransferFactory.create(type = "sftp",host = "172.17.0.2",username = "admin",password= "admin")
client.put("/path/to/src.txt","/path/to/dist.txt")
也可以指定 rsa_私钥文件,从而不需要密码
from transferfile import TransferFactory
client = TransferFactory.create(type = "scp",host = "172.17.0.2",username = "admin", rsa_file = "/root/.ssh/id_rsa")
client.put("/path/to/src.txt","/path/to/dist.txt")
如果已经做好了 ssh 的授信,可以传入参数 load_system_host_keys = True,从而不需要密码
from transferfile import TransferFactory
client = TransferFactory.create(type = "scp",host = "172.17.0.2",username = "admin", load_system_host_keys = True )
client.put("/path/to/src.txt","/path/to/dist.txt")
rsync
请注意原路径和目标路径可以是文件名,也可以是目录
rsync 目前需要配置好授信才可以使用,暂时不支持用户名和密码登录。
from transferfile import TransferFactory
client = TransferFactory.create(type = "rsync",host = "172.17.0.2",username = "admin", load_system_host_keys = True)
client.put("/path/to/src.txt","/path/to/dist.txt")
扩展点
由于 ftp 不支持传输目录,这里就没有做出传输整个目录的接口,要实现也不复杂,如果要实现就是递归读取目录的文件,然后一个一个传输。也可以压缩成一个文件后上传。
目前工作中暂时没有这个需求,都是生成好一个文件就传输这个文件,不需要上传整个目录。因此就没有实现。
联系我
有问题,欢迎交流讨论。
公众号 「Python七号」,分享 Python 编程技能。
个人微信 「somenzz」
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file transferfile-0.4.tar.gz
.
File metadata
- Download URL: transferfile-0.4.tar.gz
- Upload date:
- Size: 7.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6caeefa31eefd8f707d00e053848cd40163c5346f58e1ddfea6816e5c2535ec9 |
|
MD5 | d1ce90a12367cc3c29d2e980bb72a20e |
|
BLAKE2b-256 | cfb1d324b7a66bffbc67df88f87fe5dae80befb926f3843a8ce5d53f00848f11 |
File details
Details for the file transferfile-0.4-py3-none-any.whl
.
File metadata
- Download URL: transferfile-0.4-py3-none-any.whl
- Upload date:
- Size: 7.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 60dbf111d422b3278c9ddde088649ecd40ded5261a33c9074192085992e01252 |
|
MD5 | 2c1989482e86c33b68f9a5046ba4c7cc |
|
BLAKE2b-256 | 48e0b701e8c22d740ffc894d983caf1fd08bbe0aed133af97f9ed8aa6d34fa55 |