Baram
Python based AWS Framework which leverages boto3 and awswrangler.
Baram means "wind" in Korean which makes cloud move conveniently.
Features
- TBD
- Convenient S3 Usage(KMS setting, delete directory ...)
- Athena Iceberg
- Athena Performance Management(cache, ctas_approach control)
- Glue Job Management
Quick Start
> pip install awswrangler
For Beginner
S3 Usage
# import S3Manager
from baram.s3_manager import S3Manager
sm = S3Manager("my_bucket_name")
# Upload local file to S3
sm.upload_file(local_file_path="local_file_path",
s3_file_path="s3_file_path")
# Emphasize Directory Deletion
sm.download_dir(s3_dir_path="s3_directory_path",
local_dir_path="local_directory_path")
# Copy S3 object
sm.copy_object(from_key="from_s3_key",
to_key="to_s3_key")
For Data Scientist
S3 Usage
# Read csv from s3
# EDA
# Merging Datasets from S3(https://aws-sdk-pandas.readthedocs.io/en/stable/tutorials/013%20-%20Merging%20Datasets%20on%20S3.html)
# write dataframe to s3
Athena Usage
# Read rows from Athena
# EDA
# write dataframe to Another Athena Table without schema input.
# Batching(Good for restricted memory environments), https://aws-sdk-pandas.readthedocs.io/en/stable/tutorials/006%20-%20Amazon%20Athena.html
# big table dump to s3
For Data Engineer
Manage S3
# check_s3_object_exists
# count_csv_row_count
# rename_file
Read The Docs
1 maintainer
Metadata
1 maintainer
Release files for baram 0.5.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| baram-0.5.0.tar.gz | 26.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| baram-0.5.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 58.3 kB
Release files / baram-0.5.0.tar.gz
| Download URL | baram-0.5.0.tar.gz |
|---|---|
| Size | 26.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
8f93af4f6b29f2c8a2f045c91047dcd7793f79c0224fca9f7efcc8cbf34ef390
|
|
BLAKE2b-256 checksum How to use checksums |
9b57d7f16b940af9b25169b9ed307c0e566db093fb907db245c483020a7d29a6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.5.1 CPython/3.11.9 Darwin/23.6.0
|
Release files / baram-0.5.0-py3-none-any.whl
| Download URL | baram-0.5.0-py3-none-any.whl |
|---|---|
| Size | 31.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
7ed0a4c50eb6d2487518f887524eea424f6b1bb7d42b60fdf64013185faef29f
|
|
BLAKE2b-256 checksum How to use checksums |
de8159dcfcb3fcd36b50495124e7ea4fe9c9c66cc96ae105e97b117a0b4809b5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.5.1 CPython/3.11.9 Darwin/23.6.0
|
