telegeo 0.1.2

This is a python package for scraping Telegram data based on geolocation.

telegeo

This is a python package for scraping Telegram:iphone: based on geolocation:earth_asia:.

:loudspeaker:Check this package on PyPI

Installing

pip install telegeo

Dependencies:

(If nothing odd happens, users will install all the following dependencies of telegeo automatically after running "pip install telegeo"):
pandas
geopy
plotly
tqdm
telethon

How to use

step1: import telegeo

from telegeo import telegeo

step2: generating all coordinates within the specified latitude and longitude range.
use the map_range() fucntion in telegeo to generate the coordinates you need.

users should provide the following parameters⬇
★lat_max: max latitude of the map range.
★lon_max: max longitude of the map range.
★lat_min: min latitude of the map range.
★lon_min: min longitude of the map range.
★distance: the distance between two coordinates on the map.
★save_path: the path and filename for saving a csv file, which records all the coordinates.
(see Figure 1 for the first 5 parameters)

Example:
Move every 500 meters to generate all coordinates covering Hong Kong. And, save as csv.

telegeo.map_range(lat_max = 22.560100,
                  lon_max = 114.404948,
                  lat_min = 22.155232,
                  lon_min = 113.835564,
                  distance = 0.5,
                  save_path = "geo_range_hk_r500.csv")

step3: generate a interactive map for displaying and checking the coordinates on a world map.
use the map_show() function in telegeo to create the map based on the above csv file.

telegeo.map_show(save_path = "geo_range_hk_r500.csv")

step4: some of the coordinates may not belong to your target city, choose a standard to filter the map

telegeo.map_center(lat_max = 22.560100,
                   lon_max = 114.404948,
                   lat_min = 22.155232,
                   lon_min = 113.835564)

the map_center() function will give you the geo information of the centroid on your target range, see the following results:

The centroid is →→(22.357914821609455, 114.12025600000001)
↓ Copy one standard to filter the coordinates generated from map_range() ↓ (e.g. 'state': '香港 Hong Kong') 
{'road': '荃灣路 Tsuen Wan Road', 'quarter': '葵盛圍 Kwai Shing Circuit', 'suburb': '下葵涌 Ha Kwai Chung', 'town': '葵涌 Kwai Chung', 'county': '葵青區 Kwai Tsing District', 'region': '新界 New Territories', 'state': '香港 Hong Kong', 'ISO3166-2-lvl3': 'CN-HK', 'country': '中国', 'country_code': 'cn'}

Then you could choose a item from the results to filter the map. For example, if you want to all the coordinates in Hong Kong, we could copy this string↓ 'state': '香港 Hong Kong' as a standard to filter the map through the next function: map_filter().

telegeo.map_filter(data_path = "geo_range_hk_r500.csv",
                   target = "'state': '香港 Hong Kong'")

This function will check all the coordinates in your original dataset "geo_range_hk_r500.csv", excluding all the coordinates you don't need based on your "standard" (target). This process will take some time if you have many coordinates to be filtered (due to the rate limit of "geopy"). You will get two csv files:
(1) geo_range_hk_r500_address.csv (contains the detailed geo information of all the coordinates in your original dataset);
(2) geo_range_hk_r500_filter.csv (a new dataset that includes all the coordinates you need, this dataset will be used for later data collection)

Before the data collection, we could map_show() again with our new dataset "geo_range_hk_r500_filter.csv" to check the filter process:

telegeo.map_show(save_path = "geo_range_hk_r500_filter.csv")

More tutorial: To Be Continued...