Wrapper to fetch data from marinetraffic
Project description
AISExplorer
AISExplorer can be used to locate vessels or to scrape all vessel in an specific AREA. Also free proxies can be used for scraping. Proxies will be scraped from https://www.sslproxies.org/, tested and used. Also Fallback are implemented
Installation
pip install aisexplorer
Usage
Find vessel by MMIS
from aisexplorer.AIS import AIS
AIS().get_location(211281610)
Find vessels in Area
maximum 500 vessels
from aisexplorer.AIS import AIS
AIS(return_df= True).get_area_data("EMED")
Output is limited to 500 rows. Areas can be found here
Get Table via URL
from aisexplorer.AIS import AIS
AIS(return_df = True).get_data_by_url("https://www.marinetraffic.com/en/data/?asset_type=vessels&columns=time_of_latest_position:desc,flag,shipname,photo,recognized_next_port,reported_eta,reported_destination,current_port,imo,ship_type,show_on_live_map,area,lat_of_latest_position,lon_of_latest_position,speed,length,width&area_in|in|West%20Mediterranean,East%20Mediterranean|area_in=WMED,EMED&time_of_latest_position_between|gte|time_of_latest_position_between=60,NaN")
Use Proxies
from aisexplorer.AIS import AIS
AIS(return_df = True, Proxy = True).get_data_by_url("https://www.marinetraffic.com/en/data/?asset_type=vessels&columns=time_of_latest_position:desc,flag,shipname,photo,recognized_next_port,reported_eta,reported_destination,current_port,imo,ship_type,show_on_live_map,area,lat_of_latest_position,lon_of_latest_position,speed,length,width&area_in|in|West%20Mediterranean,East%20Mediterranean|area_in=WMED,EMED&time_of_latest_position_between|gte|time_of_latest_position_between=60,NaN")
Next Steps
- Add more potential proxy lists
- Find a way to change the number of retrys
- Reset new filters
Changelog
2021-12-10
- Added Fallback if proxy has died
- Added get data by url
- Added Check if requests was filtered by cloudflare
2021-12-5
- Added Filters early stage
- Added Retry Options
- Added some new exceptions
2021-11-27
- Added Proxy Option
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
AISExplorer-0.0.12.tar.gz
(9.3 kB
view hashes)
Built Distribution
Close
Hashes for AISExplorer-0.0.12-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a9cf5bbf5839360f7757f33d9a8e0be25af607fb7b211a8e5564086851fd6811 |
|
MD5 | 0b5caedcb7eda77f902abb8ccb31c16e |
|
BLAKE2b-256 | 18ae2a095e00383ba3d9de23f721c345baa8f13d253480ca6711e6a75ad44921 |