Skip to main content

Financial Data Extraction from Investing.com with Python

Project description

Financial Data Extraction from Investing.com with Python

Based on package investpy. Information below is description of that package.

Changed file investpy/stocks.py

Added this code into function get_stock_company_profile after 770 line:

if "?cid" in tag:
    tag = tag.split("?cid")[0]

and after 795 line

header_path_ = root_.xpath("//div[@class=\"companyProfileHeader\"]")[0]
 
if path_:
    company_profile['desc'] = str(path_[0].text_content())
    company_profile['industry'] = header_path_[0].text_content().replace('Industry', '')
    company_profile['sector'] = header_path_[1].text_content().replace('Sector', '')
    company_profile['employees'] = header_path_[2].text_content().replace('Employees', '')
    company_profile['equity type'] = header_path_[3].text_content().replace('Equity Type', '')

investpy is a Python package to retrieve data from Investing.com, which provides data retrieval from up to 39952 stocks, 82221 funds, 11403 ETFs, 2029 currency crosses, 7797 indices, 688 bonds, 66 commodities, 250 certificates, and 4697 cryptocurrencies.

investpy allows the user to download both recent and historical data from all the financial products indexed at Investing.com. It includes data from all over the world, from countries such as United States, France, India, Spain, Russia, or Germany, amongst many others.

investpy seeks to be one of the most complete Python packages when it comes to financial data extraction to stop relying on public/private APIs since investpy is FREE and has NO LIMITATIONS. These are some of the features that currently lead investpy to be one of the most consistent packages when it comes to financial data retrieval.

Python Version PyPI Version Package Status Build Status Documentation Status Code Coverage

If you want to support the project, you can buy the developer a coffee. More information at: buy-me-a-coffee

Buy Me A Coffee


:hammer_and_wrench: Installation

To get this package working you will need to install it via pip (with a Python 3.6 version or higher) on the terminal by typing:

$ pip install investpy

Additionally, if you want to use the latest investpy version instead of the stable one, you can install it from source with the following command:

$ pip install git+https://github.com/alvarobartt/investpy.git@master

The master branch ensures the user that the most updated version will always be working and fully operative so as not to wait until the the stable release comes out (which eventually may take some time depending on the number of issues to solve).


:computer: Usage

Even though some investpy usage examples are presented on the docs, some basic functionality will be sorted out with sample Python code blocks. Additionally, more usage examples can be found under examples/ directory, which contains a collection of Jupyter Notebooks on how to use investpy and handle its data.

:pushpin: Note that investpy.search_quotes is the only function that ensures that the data is updated and aligned 1:1 with the data provided by Investing.com!

:chart_with_upwards_trend: Recent/Historical Data Retrieval

investpy allows the user to download both recent and historical data from any financial product indexed (stocks, funds, ETFs, currency crosses, certificates, bonds, commodities, indices, and cryptos). In the example presented below, the historical data from the past years of a stock is retrieved.

import investpy

df = investpy.get_stock_historical_data(stock='AAPL',
                                        country='United States',
                                        from_date='01/01/2010',
                                        to_date='01/01/2020')
print(df.head())
             Open   High    Low  Close     Volume Currency
Date                                                      
2010-01-04  30.49  30.64  30.34  30.57  123432176      USD
2010-01-05  30.66  30.80  30.46  30.63  150476160      USD
2010-01-06  30.63  30.75  30.11  30.14  138039728      USD
2010-01-07  30.25  30.29  29.86  30.08  119282440      USD
2010-01-08  30.04  30.29  29.87  30.28  111969192      USD

To get to know all the available recent and historical data extraction functions provided by investpy, and also, parameter tuning, please read the docs.

:mag: Search Live Data

Investing.com search engine is completely integrated with investpy, which means that any available financial product (quote) can be easily found. The search function allows the user to tune the parameters to adjust the search results to their needs, where both product types and countries from where the products are, can be specified. All the search functionality can be easily used, for example, as presented in the following piece of code:

import investpy

search_result = investpy.search_quotes(text='apple', products=['stocks'],
                                       countries=['united states'], n_results=1)
print(search_result)
{"id_": 6408, "name": "Apple Inc", "symbol": "AAPL", "country": "united states", "tag": "/equities/apple-computer-inc", "pair_type": "stocks", "exchange": "NASDAQ"}

Retrieved search results will be a list of investpy.utils.search_obj.SearchObj class instances, unless n_results is set to 1, when just a single investpy.utils.search_obj.SearchObj class instance will be returned. To get to know which are the available functions and attributes of the returned search results, please read the related documentation at Search Engine Documentation. So on, those search results let the user retrieve both recent and historical data, its information, the technical indicators, the default currency, etc., as presented in the piece of code below:

recent_data = search_result.retrieve_recent_data()
historical_data = search_result.retrieve_historical_data(from_date='01/01/2019', to_date='01/01/2020')
information = search_result.retrieve_information()
default_currency = search_result.retrieve_currency()
technical_indicators = search_result.retrieve_technical_indicators(interval='daily')

:money_with_wings: Crypto Currencies Data Retrieval

Cryptocurrencies support has recently been included, to let the user retrieve data and information from any available crypto at Investing.com. Please note that some cryptocurrencies do not have available data indexed at Investing.com so that it can not be retrieved using investpy either, even though they are just a few, consider it.

As already presented previously, historical data retrieval using investpy is really easy. The piece of code presented below shows how to retrieve the past years of historical data from Bitcoin (BTC).

import investpy

data = investpy.get_crypto_historical_data(crypto='bitcoin',
                                           from_date='01/01/2014',
                                           to_date='01/01/2019')

print(data.head())
             Open    High    Low   Close  Volume Currency
Date                                                     
2014-01-01  805.9   829.9  771.0   815.9   10757      USD
2014-01-02  815.9   886.2  810.5   856.9   12812      USD
2014-01-03  856.9   888.2  839.4   884.3    9709      USD
2014-01-04  884.3   932.2  848.3   924.7   14239      USD
2014-01-05  924.7  1029.9  911.4  1014.7   21374      USD

:open_book: Documentation

You can find the complete investpy documentation at Documentation.


:sparkles: Contribute

As this is an open-source project it is open to contributions, bug reports, bug fixes, documentation improvements, enhancements, and ideas. There is an open tab of issues where anyone can open new issues if needed or navigate through them to solve them or contribute to its solving. Remember that issues are not threads to describe multiple problems, this does not mean that issues can not be discussed, but so to keep structured project management, the same issue should not describe different problems, just the main one and some nested/related errors that may be found.


:question: Discussions (Q&A, AMA)

GitHub recently released a new feature named GitHub Discussions (still in beta). GitHub Discussions is a collaborative communication forum for the community around an open source project.

Check the investpy GitHub Discussions page at Discussions, and feel free to ask me (ar any developer) anything, share updates, have open-ended conversations, and follow along on decisions affecting the community's way of working.

:pushpin: Note. Usually I don't answer emails asking me questions about investpy, as we currently have the GitHub Discussions tab, and I encourage you to use it. GitHub Discussions is the easiest way to contact me about investpy, so that I don't answer the same stuff more than once via email, as anyone can see the opened/answered discussions.


:card_index_dividers: Related projects

Since investpy is intended to retrieve data from different financial products as indexed in Investing.com, the development of some support modules which implement an additional functionality based on investpy data, is presented. Note that anyone can contribute to this section by creating any package, module, or utility that uses investpy. So on, the ones already created are going to be presented, since they are intended to be used combined with investpy:

  • pyrtfolio: is a Python package to generate stock portfolios.
  • trendet: is a Python package for trend detection on stock time-series data.

If you developed an interesting/useful project based on investpy data, please open an issue to let me know to include it in this section.


:memo: Citation

When citing this repository on your scientific publications please use the following BibTeX citation:

@misc{investpy,
    author = {Alvaro Bartolome del Canto},
    title = {investpy - Financial Data Extraction from Investing.com with Python},
    year = {2018-2021},
    publisher = {GitHub},
    journal = {GitHub Repository},
    howpublished = {\url{https://github.com/alvarobartt/investpy}},
}

When citing this repository on any other social media, please use the following citation:

investpy - Financial Data Extraction from Investing.com with Python developed by Alvaro Bartolome del Canto

You should also mention the source from where the data is retrieved, Investing.com; even though it's already included in the package short description title.


:man_technologist: Contact Information

You can contact me at any of my social network profiles:

Or via email at alvarobartt@yahoo.com.


:warning: Disclaimer

This Python package has been made for research purposes to fit the needs that Investing.com does not cover, so this package works like an Application Programming Interface (API) of Investing.com developed in an altruistic way.

Conclude that investpy is not affiliated in any way to Investing.com or any dependant company, the only requirement specified by Investing.com to develop this package was to "mention the source where data is retrieved from".

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

investingpy-0.0.1.tar.gz (4.4 MB view details)

Uploaded Source

Built Distribution

investingpy-0.0.1-py3-none-any.whl (4.5 MB view details)

Uploaded Python 3

File details

Details for the file investingpy-0.0.1.tar.gz.

File metadata

  • Download URL: investingpy-0.0.1.tar.gz
  • Upload date:
  • Size: 4.4 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.10

File hashes

Hashes for investingpy-0.0.1.tar.gz
Algorithm Hash digest
SHA256 aea3bbd718c3c24ce94dcfba1b6df9cbcfb2cd2eb69af84657442b2c2d1de3b3
MD5 5f2a5651979ea144fdcd1f6c94ab48b5
BLAKE2b-256 d7815362068c23310bae4890ac5f6d43d00e1d8e207cce3c32a3ac5b8cfa103f

See more details on using hashes here.

File details

Details for the file investingpy-0.0.1-py3-none-any.whl.

File metadata

  • Download URL: investingpy-0.0.1-py3-none-any.whl
  • Upload date:
  • Size: 4.5 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.10

File hashes

Hashes for investingpy-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 70c2300c63114be810d3a94be767f34e46c6fd09e107c7198e116fee7d2dd921
MD5 e9d91bf160ae0f6db6b5d0cbf8cfbf00
BLAKE2b-256 be240dea2589e9aeb1958cdc99397f6a36d94dc99c42fe43d95e217810f02374

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page