TimeCoder
timecoder.py - is a pipeline for division uploaded subtitles to blocks based on threshold of cosinus similarity
Inside the script there are 2 approaches:
- first summarization of subtitles followed by calculation of cosinus similarity
- first calculation of cosinus similarity followed by division by blocks and then summarization of each block
parse_subs.py - is a parser of YouTube subtitles converting them to pd.DataFrame sentence_similarity.py - script for calculation of cosinus similarity gpt_shortening.py - script for summarization
Different models for summarization and Sentence Similarity were compared. For similarity now we are using "IlyaGusev/mbart_ru_sum_gazeta". For Sentence Similarity the model called 'symanto/sn-xlm-roberta-base-snli-mnli-anli-xnli'.
1 maintainer
Release files for blockdivision 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| blockdivision-0.1.0.tar.gz | 3.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| blockdivision-0.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 8.6 kB
Release files / blockdivision-0.1.0.tar.gz
| Download URL | blockdivision-0.1.0.tar.gz |
|---|---|
| Size | 3.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
035d66c53f645398386bfc71ddeadd4832d32b0e7b9c5dc0ae490daaaa3d6ec3
|
|
BLAKE2b-256 checksum How to use checksums |
7f022fe3b6f1c740650fce83d64dee4bc81bbebaa533d1349b91cf1527d690cb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.4.2 CPython/3.8.10 Linux/5.10.102.1-microsoft-standard-WSL2
|
Release files / blockdivision-0.1.0-py3-none-any.whl
| Download URL | blockdivision-0.1.0-py3-none-any.whl |
|---|---|
| Size | 5.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
3e6c468b1bc394659467226c35a09cb75f0c839974d96461086dc563c3ccb31f
|
|
BLAKE2b-256 checksum How to use checksums |
7bc139b1efa46c70539f3e38144bca580096fabca96ea26b4d41934e88d74465
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.4.2 CPython/3.8.10 Linux/5.10.102.1-microsoft-standard-WSL2
|
