president-speech 0.7.0

helper pip package module for analyzing presidential speech records (including basic data)

president-speech

• Presidents of the Republic of Korea Speeches
• Parquet, provided in the form of sqlite db file
• Comes with simple cli

SUMMARY OF PROVIDED DATA

• data per case can be checked in the following ways

• https://www.pa.go.kr/research/contents/speech/index.jsp?spMode=view&catid=c_pa02062&artid={division_number}

• some data show date values as empty columns or years only

  president	size	min(date)	max(date)
  이승만	998	1948.07.24	1959.03.10
  윤보선	3	1960.08.13	1960.09.15
  박정희	1270	1963.12.17	1979.10.26
  최규하	58	1979.10.27	1980.08.16
  전두환	602	1980.06.05	1987.02.16
  노태우	601	1988.02.25	1992.10.05
  김영삼	728	1993.01.09	1998.01.23
  김대중	822	1998.02.25	2003.02.17
  노무현	780	2003.02.25	2008.01.28
  이명박	1027	2008.02.25	2013.02.07
  박근혜	493	2013.02.24	2016.10.26
  문재인	1389	2017.05.10	2022.03.30

  >>> df.info()
  
  <class 'pandas.core.frame.DataFrame'>
  Index: 8771 entries, 5368 to 102591
  Data columns (total 7 columns):
   #   Column           Non-Null Count  Dtype 
  ---  ------           --------------  ----- 
   0   division_number  8771 non-null   int64 
   1   president        8771 non-null   object
   2   title            8771 non-null   object
   3   date             8771 non-null   object
   4   location         8771 non-null   object
   5   kind             8771 non-null   object
   6   speech_text      8771 non-null   object
  dtypes: int64(1), object(6)
  memory usage: 548.2+ KB
  

Use

$ pip install president-speech

$ ps-wordcount -h     
usage: ps-word-count [-h] [-t | -p] word

Word frequency output from previous presidential speeches

positional arguments:
  word         Search word

optional arguments:
  -h, --help   show this help message and exit
  -t, --table  Table Format Output
  -p, --plot   Format Output

$ ps-word-count -p 독립
문재인  [954]  ****************************************
이승만  [430]  ******************
박정희  [361]  ****************
이명박  [176]  ********
김대중  [171]  ********
전두환  [169]  ********
노무현  [167]  *******
노태우  [131]  ******
김영삼  [114]  *****
박근혜  [ 71]  ***
최규하  [  4]  *
윤보선  [  0]

$ ps-word-count -t 독립
|    | president   |   mention |
|---:|:------------|----------:|
|  0 | 문재인      |       954 |
|  1 | 이승만      |       430 |
|  2 | 박정희      |       361 |
|  3 | 이명박      |       176 |
|  4 | 김대중      |       171 |
|  5 | 전두환      |       169 |
|  6 | 노무현      |       167 |
|  7 | 노태우      |       131 |
|  8 | 김영삼      |       114 |
|  9 | 박근혜      |        71 |
| 10 | 최규하      |         4 |
| 11 | 윤보선      |         0 |

Ref

• 대통령기록관_행정안전부 대통령기록관_대통령연설기록 연설문
• https://stackoverflow.com/questions/45470964/python-extracting-text-from-webpage-pdf
• https://pypdf.readthedocs.io/en/latest/user/extract-text.html
• https://setuptools.pypa.io/en/latest/userguide/datafiles.html
• https://frhyme.github.io/python-basic/py_no_break_space/
• https://pypi.org/project/pandas-downcast/

Development environment setting

$ git clone ...
$ cd president-speech
$ pdm venv create
$ source .venv/bin/activate
$ pdm install

$ pdm add -dG test pytest pytest-cov
$ pdm test
$ pdm ptest

$ pdm ctest
---------- coverage: platform darwin, python 3.9.18-final-0 ----------
Name                                             Stmts   Miss  Cover
--------------------------------------------------------------------
src/president_speech/__init__.py                     0      0   100%
src/president_speech/db/__init__.py                  0      0   100%
src/president_speech/db/connection_manager.py       17      3    82%
src/president_speech/db/parquet_interpreter.py      25      1    96%
src/president_speech/db/search.py                   15      1    93%
tests/__init__.py                                    0      0   100%
tests/test_parquet_interpreter.py                   11      0   100%
tests/test_search.py                                 5      0   100%
--------------------------------------------------------------------
TOTAL                                               73      5    93%

Deploy to fly.io with Docker Technology

$ docker build -t president-speech-webapp .
$ docker run -it --rm -p 7942:8051 president-speech-webapp

$ fly deploy
Visit your newly deployed app at https://president-speech.fly.dev/