phDagCommand
Pharbers Python 工具集合
打包和发布方式
# pipy 打包发布方式
1. 修改 phcli/define_value.py 中 CLI_CLIENT_VERSION 的版本号
2. 修改 file/ph_max_auto/phDagJob-*.tmp 中的 install_phcli 版本号
并将 file/ph_max_auto/phDagJob-*.tmp 上传到 s3://ph-platform/*/template/python/phcli/maxauto/ 下
3. 修改 phcli/ph_max_auto/define_value.py 中新的模板文件版本
4. 打包
$ rm -rf build/ dist/
$ python setup.py sdist bdist_egg bdist_wheel
5. 上传
发布 pypi
$ python -m twine upload dist/*
将生成的 dist/phcli-XXX-py3.8.egg 添加到 s3://ph-platform/*/jobs/python/phcli/common/ 下
清洗打包流程
# zip 打包方式(scala 调用方式)
$ python setup.py sdist --formats=zip
安装方式
$ pip install phcli
使用方法
> phcli -h
更新文档
2.2.1 2021/1/29
- 紧急修复 bug，在 .ipynb 中无法读取 ~/.profile 中的环境变量
2.2.0 2021/1/25
- 新增 recall 召回功能，可撤回 publish 的 dag。
phcli maxauto recall --name dag_name
2.1.0 2021/1/22
- Jupyter Spark Session 更语义化的 App Name
- 对 Jupyter R 的支持
- 修复了 phcli maxauto dag 后，无法取参的问题
2.0.4
- 修复 jupyter dag 时 timeout 参数的 bug
- 修复 preset.write_asset 的 bug
2.0.3
- phcli maxauto create 新增 option [--timeout]，指定 job 运行的超时时间（min），默认为 60 min。
2.0.0
- 之前的 phcli maxauto --cmd XXX --option 改为 phcli maxauto XXX --option
- phcli maxauto 新增两个 option，[--ide] 可选 c9(默认)，jupyter。[--runtime] 可选 python3(默认)，r。
- phcli maxauto create 新增 option [--command] 可选 submit(默认)，script。
- create/combine/dag 执行过程中出现目录已存在会提示是否覆盖。
- phcli maxauto combine 新增参数 [--owner]，[--tag]，[--jobs]。
- phcli maxauto submit 改为 phcli maxauto online_run
1.2.3
- dag airflow list 完成
- phcli 1.2.3 spark submit 中文乱码 bug 解决
- phcli 1.2.2 修复 submit jar 问题
4 maintainers
Metadata
4 maintainers
Release files for phcli 4.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| phcli-4.0.0.tar.gz | 8.2 MB | Details |
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| phcli-4.0.0-py3.8.egg | Legacy Egg format | - | - | Details |
| phcli-4.0.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 8.7 MB
Release files / phcli-4.0.0.tar.gz
| Download URL | phcli-4.0.0.tar.gz |
|---|---|
| Size | 8.2 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
5ac7a0462df120b717851444da09884d0be6aebbe9ee3b4235aa738a3cfad52c
|
|
BLAKE2b-256 checksum How to use checksums |
9e696bfefd18c5a256e2bbf7c973eb1b96c58bbaa017e181a528b08e7ff53d41
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.4.2 requests/2.25.1 setuptools/45.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.8.10
|
Release files / phcli-4.0.0-py3.8.egg
| Download URL | phcli-4.0.0-py3.8.egg |
|---|---|
| Size | 373.0 kB |
| Tags | Egg |
|
SHA-256 checksum How to use checksums |
5b13f693e3fad941421ccccff1ec39576cf9d7410b47d6b802031eed21dabf42
|
|
BLAKE2b-256 checksum How to use checksums |
70caa202f06283de3cd2b2109f8e85536faa1468da2fed52b333ac1dfc5aafa6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.4.2 requests/2.25.1 setuptools/45.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.8.10
|
Release files / phcli-4.0.0-py3-none-any.whl
| Download URL | phcli-4.0.0-py3-none-any.whl |
|---|---|
| Size | 158.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
72d42dbab4594db4341541731eb0a31f456a8592cf916c447f423fdb4a6dbe0d
|
|
BLAKE2b-256 checksum How to use checksums |
c51931dc418fc0763aa462e9042d601fc43e7dd52eb297719535084f5adedfc3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.4.2 requests/2.25.1 setuptools/45.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.8.10
|
