A simple scrapper that uses coin360.com and coinmarketcap apis to populate an instant local database
Project description
Python : Simple Crypto currencies scrapper
This is a simple module that retrieve instant crypto currencies values in BTC and USD from coin360.com and coinmarketcap apis
How to use
First install the package
pip install cryptocurrencies_scraper
Basic usage
from cryptocurrencies_scraper.CurrencyService import Manager
manager = Manager() # Create a new instance of the Manager
manager.update() # Ask the manager to update all currencies values
manager.all_currencies() # returns a dict that contain the currency name and symbol as key and currency information as a list
manager.get_curency('btc') # return the list of currency values retrived for bitcoin using symbol
manager.get_curency('bitcoin') # return the list of currency values retrived for bitcoin using name
Add your own scraper
A scraper should extends the CurrentPriceInterface
.
Here is a basic scheme for a new scraper
class MySourceForCurrencies(CurrentPriceInterface):
instance = None
URL = 'https://api.mysource.com/v1/ticker/?limit=3000'
NAME = "mysource.com"
@classmethod
def get_instance(cls) -> 'CurrenciesFromCoinMarketCap':
if cls.instance is None:
cls.instance = MySourceForCurrencies()
return cls.instance
def __init__(self):
super().__init__()
def update_currency_list(self):
self.process_data(requests.get(self.URL).json())
def process_data(self, json_data: json) -> None:
# Manipulate the the json to be Currency "parsable"
c = Currency.parse_json(json_data, self.NAME)
#When parsed, add it to the index
NameIndexes.get_instance().add_to_index(c)
return None
In order for your scraper to be working you need to add it to the manager
from cryptocurrencies_scraper.CurrencyService import Manager
manager = Manager()
manager.add_source(MySourceForCurrencies.get_instance())
# you can also remove a source
manager.remove_source(MySourceForCurrencies.NAME)
Then on each manager.update()
call your scraper will be called and currencies added to the Index
NameIndex
This class is used internally to index all currencies. When a new currency is added, it will be grouped by the symbol and the name (symbol upper, name lower case)
The only useful method is NameIndexes.get_instance().add_to_index(currency)
. On each update, it get completlly cleared
from all old values.
Currency
This is the object that represent one currency here is the structure
{
"symbol" : "BTC",
"name" : "Bitcoin",
"valueUSD" : 5513,
"valueBTC": 1,
"lastUpdate" : 1566531513813,
"source" : "coin360.com",
"changes" : {
"7d": -1,
"24h": -5,
"1h": -10
}
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for cryptocurrencies_scraper-0.0.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | f671708191a1c83f82fb9c747f953264f3e045e280e566ac11100c3e62ae7912 |
|
MD5 | b8270bc1ed30633d0d0d55da4af9a440 |
|
BLAKE2b-256 | 68e2658b13dc1599869914cac95ef001ef865de14cc7097ee2e2ca94677485eb |
Hashes for cryptocurrencies_scraper-0.0.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | abd14b9636ee4904ee92be582ede21adfada6b8a08c1f4c74ca0ffeeb856ac91 |
|
MD5 | d0975374912224fdf93aad9f1422647a |
|
BLAKE2b-256 | aad9c22dc13b66cdf254bb85aa819104ad3b6c251753e95f736c09b037492530 |