One of the nicest looking EDGAR libraries out there
Project description
The world's easiest, most powerful edgar library
Features
- ๐ Access any SEC filing: You can access any SEC filing since 1994.
- ๐ฐ Company Financials: Comprehensive company financials from 10-K and 10-Q filings
- ๐ค Insider Transactions: Search for and get insider transactions
- ๐
List filings for any date range: List filings for year, quarter e.g. or date range
2024-02-29:2024-03-15
- ๐ Best looking edgar library: Uses rich library to display SEC Edgar data in a beautiful way.
- ๐ง Intuitive and easy to use: edgartools has a super simple API that is easy to use.
- ๏ฟฝ๏ฟฝ๏ธ Works as a library or a CLI: You can use edgartools as a library in your code or as a CLI tool.
- ๐ Page through filings: Use
filings.next()
andfilings.previous()
to page through filings - ๐๏ธ Build Data Pipelines: Build data pipelines by finding, filtering, transforming and saving filings
- โ Select a filing: You can select a filing from the list of filings.
- ๐ View the filing as HTML or text: Find a filing then get the content as HTML or text.
- ๐ข Chunk filing text: You can chunk the filing text into sections for vector embedding.
- ๐ Preview the filing: You can preview the filing in the terminal or a notebook.
- ๐ Search through a filing: You can search through a filing for a keyword.
- ๐ Parse XBRL: Extract XBRL data into intuitive data structures.
- ๐พ Data Objects: Automatically downloads and parses filings into data objects.
- ๐ฅ Download any attachment: You can download any attachment from the filing.
- ๐ Automatic throttling: Automatically throttles requests to Edgar to avoid being blocked.
- ๐ฅ Bulk downloads: Faster batch processing through bulk downloads of filings and facts
- ๐ข Get company by Ticker or Cik: Get a company by ticker
Company("SNOW")
or cikCompany(1640147)
- Get company filings: You can get all the company's historical filings using
company.get_filings()
- ๐ Get company facts: You can get company facts using
company.get_facts()
- ๐ Lookup Ticker by CUSIP: You can lookup a ticker by CUSIP
- ๐ Dataset of SEC entities: You can get a dataset of SEC companies and persons
- ๐ Fund Reports: Search for and get 13F-HR fund reports
- ๐ ๏ธ Works as a library or a CLI: You can use edgartools as a library in your code or as a CLI tool.
Getting started
Install using pip
pip install edgartools
Import and start using
from edgar import *
# Tell the SEC who you are
set_identity("Michael Mccallum mike.mccalum@indigo.com")
filings = get_filings()
Key Concepts
Getting financials
c = Company("AAPL")
filing = c.get_filings(form="10-Q").latest(1)
tenq = filing.obj()
financials = tenq.financials
Listing filings
filings = get_filings(form=['10-K', '10-Q'], year=2020)
filing = filings[0]
Finding things
filing = find("0001065280-23-000273")
For a deeper dive see Finding things with edgartools
How to use edgartools
Code | |
---|---|
Set your EDGAR identity in Linux/Mac | export EDGAR_IDENTITY="email@domain.com" |
Set your EDGAR identity in Windows | set EDGAR_IDENTITY="email@domain.com" |
Set identity in Windows Powershell | $env:EDGAR_IDENTITY="email@domain.com" |
Set identity in Python | set_identity("email@domain.com") |
Importing the library | from edgar import * |
Working with filings ๐
๐ Getting Filings
Code | |
---|---|
๐ Get filings for the year to date | filings = get_filings() |
๐ Get only XBRL filings | filings = get_filings(index="xbrl") |
๐ Get filings for a specific year | filings = get_filings(2020) |
๐๏ธ Get filings for a specific quarter | filings = get_filings(2020, 1) |
๐ Get filings for multiple years | filings = get_filings([2020, 2021]) |
๐ Get filings for a range of years | filings = get_filings(year=range(2010, 2020)) |
๐ Get filings released just now | filings = get_latest_filings() |
๐ Filtering Filings
Code | |
---|---|
๐ Filter by form type | filings.filter(form="10-K") |
๐ Filter by multiple forms | filings.filter(form=["10-K", "10-Q"]) |
๐ Include form amendments | filings.filter(form="10-K", amendments=True) |
๐ข Filter by CIK | filings.filter(cik="0000320193") |
๐๏ธ Filter by multiple CIKs | filings.filter(cik=["0000320193", "1018724"]) |
๐ท๏ธ Filter by ticker | filings.filter(ticker="AAPL") |
๐ท๏ธ๐ท๏ธ Filter by multiple tickers | filings.filter(ticker=["AAPL", "MSFT"]) |
๐ Filter on a specific date | filings.filter(date="2020-01-01") |
๐ โ๏ธ๐ Filter between dates | filings.filter(date="2020-01-01:2020-03-01") |
๐ โฌ ๏ธ Filter before a date | filings.filter(date=":2020-03-01") |
๐ โก๏ธ Filter after a date | filings.filter(date="2020-03-01:") |
๐ Combine multiple filters | filings.filter(form="10-K", date="2020-01-01:", ticker="AAPL") |
๐ Viewing and Manipulating Filings
Code | |
---|---|
โญ๏ธ Show the next page of filings | filings.next() |
โฎ๏ธ Show the previous page of filings | filings.prev() |
๐ Get the first n filings | filings.head(20) |
๐ Get the last n filings | filings.tail(20) |
๐ Get the latest n filings by date | filings.latest(20) |
๐ฒ Get a random sample of filings | filings.sample(20) |
๐ผ Get filings as a pandas dataframe | filings.to_pandas() |
Working with a filing ๐
๐ Accessing and viewing a Filing
Code | |
---|---|
๐ Get a single filing | filing = filings[3] |
๐ข Get a filing by accession number | filing = get_by_accession_number("0000320193-20-34576") |
๐ Get the filing homepage | filing.homepage |
๐ Open a filing in the browser | filing.open() |
๐ Open homepage in the browser | filing.homepage.open() |
๐ป View the filing in the terminal | filing.view() |
๐ Extracting Filing Content
Code | |
---|---|
๐ Get the HTML of the filing | filing.html() |
๐ Get the XBRL of the filing | filing.xbrl() |
๐ Get the filing as markdown | filing.markdown() |
๐ Get the full submission text | filing.full_text_submission() |
๐ข Get and parse filing data object | filing.obj() |
๐ Get filing header | filing.header |
๐ Searching inside a Filing
Code | |
---|---|
๐ Search within the filing | filing.search("query") |
๐ Search with regex | filing.search("pattern", regex=True) |
๐ Get filing sections | filing.sections() |
๐ Working with Attachments
Code | |
---|---|
๐ Get all filing attachments | filing.attachments |
๐ Get a single attachment | attachment = filing.attachments[0] |
๐ Open attachment in browser | attachment.open() |
โฌ๏ธ Download an attachment | content = attachment.download() |
Working with a company
Code | |
---|---|
Get a company by ticker | company = Company("AAPL") |
Get a company by CIK | company = Company("0000320193") |
Get company facts | company.get_facts() |
Get company facts as a pandas dataframe | company.get_facts().to_pandas() |
Get company filings | company.get_filings() |
Get company filings by form | company.get_filings(form="10-K") |
Get a company filing by accession_number | company.get_filing(accession_number="0000320193-21-000139") |
Get the company's financials | company.financials |
Get the company's balance sheet | company.financials.get_balance_sheet |
Get the company's income statement | company.financials.get_income_statement |
Get the company's cash flow statement | company.financials.get_cash_flow_statement |
Installation
pip install edgartools
Usage
Set your Edgar user identity
Before you can access the SEC Edgar API you need to set the identity that you will use to access Edgar. This is usually your name and email, or a company name and email but you can also just use an email.
Sample Company Name AdminContact@<sample company domain>.com
The user identity is sent in the User-Agent string and the Edgar API will refuse to respond to your request without it.
EdgarTools will look for an environment variable called EDGAR_IDENTITY
and use that in each request.
So, you need to set this environment variable before using it.
Setting EDGAR_IDENTITY in Linux/Mac
export EDGAR_IDENTITY="mcalum@gmail.com"
Setting EDGAR_IDENTITY in Windows Powershell
$Env:EDGAR_IDENTITY="mcalum@gmail.com"
Alternatively, you can call set_identity
which does the same thing.
from edgar import set_identity
set_identity("mcalum@gmail.com")
For more detail see https://www.sec.gov/os/accessing-edgar-data
Usage
Importing edgar
from edgar import *
Using the Filing API
Use the Filing API when you are not working with a specific company, but want to get a list of filings.
For details on how to use the Filing API see Using the Filing API
Using the Company API
With the Company API you can find a company by ticker or CIK, and get the company's filings, facts and financials.
Company("AAPL")
.get_filings(form="10-Q")
.latest(1)
.obj()
Viewing and downloading attachments
Every filing has a list of attachments. You can view the attachments using filing.attachments
# View the attachments
filing.attachments
You can access each attachment using the bracket operator []
and the index of the attachment.
# Get the first attachment
attachment = filing.attachments[0]
You can download the attachment using attachment.download()
. This will download the attachment to string or bytes in memory.
Data Objects
Now the reason you may want to download attachments is to get information contained in data files. For example, 13F-HR filings have attached infotable.xml files containing data from the holding report for that filing.
Fortunately, the library handles this for you. If you call filing.obj()
it will automatically download and parse the data files
into a data object, for several different form types. Currently, the following forms are supported:
Form | Data Object | Description |
---|---|---|
10-K | TenK |
Annual report |
10-Q | TenQ |
Quarterly report |
8-K | EightK |
Current report |
MA-I | MunicipalAdvisorForm |
Municipal advisor initial filing |
Form 144 | Form144 |
Notice of proposed sale of securities |
C, C-U, C-AR, C-TR | FormC |
Form C Crowdfunding Offering |
D | FormD |
Form D Offering |
3,4,5 | Ownership |
Ownership reports |
13F-HR | ThirteenF |
13F Holdings Report |
NPORT-P | FundReport |
Fund Report |
EFFECT | Effect |
Notice of Effectiveness |
And other filing with XBRL | XBRLData or XBRLInstance |
Container for XBRL data |
For example, to get the data object for a 13F-HR filing you can do the following:
filings = get_filings(form="13F-HR")
filing = filings[0]
thirteenf = filing.obj()
If you call obj()
on a filing that does not have a data file, then it will return None
.
Working with XBRL filings
Some filings are in XBRL (eXtensible Business Markup Language) format. These are mainly the newer filings, as the SEC has started requiring this for newer filings.
If a filing is in XBRL format then it opens up a lot more ways to get structured data about that specific filing and also about the company referred to in that filing.
The Filing
class has an xbrl
function that will download, parse and structure the filing's XBRL document if one exists.
If it does not exist, then filing.xbrl()
will return None
.
The function filing.xbrl()
returns an XBRLData
instance if the XBRL files contain presentation information or XBRLInstance
if it a simple instance document with just the facts.
For more details see Parsing XBRL
filing_xbrl = filing.xbrl()
Financials
Some filings, notably 10-K and 10-Q filings contain financial statements in XBRL format.
You can get the financials from the XBRL data using the Financials
class.
The Company object has a financials
property that will return the financials for the company.
from edgar.financials import Financials
company = Company("AAPL")
financials = company.financials
You can also get the financials through the Tenk
and TenQ
data objects.
Here is an example that gets the latest Apple financials
tenk = Company("AAPL").get_filings(form="10-K").latest(1).obj()
financials = tenk.financials
financials.get_balance_sheet() # or financials.balance_sheet
financials.get_income_statement() # or financials.income
financials.get_cash_flow_statement() # or financials.cashflow
financials.get_statement_of_changes_in_equity() # or financials.equity
financials.get_statement_of_comprehensive_income() # or financials.comprehensive_income
Get the financial data as a pandas dataframe
Each of the financial statements - BalanceSheet
, IncomeStatement
and CashFlowStatement
- have a get_dataframe()
method that will return the data as a pandas dataframe.
balance_sheet_df = financials.get_balance_sheet().get_dataframe()
TenK (10-K) Data Object
For 10-K filngs the 10-K Data Object allows you to access almost any data related to the filing - both text and financial data.
c = Company("ORCL")
filing = c.get_filings(form="10-K").latest()
tenk = filing.obj()
You can also get it directly using the property latest_tenk
on the Company
object.
c = Company("ORCL")
c.latest_tenk
Getting 10-K Items
You can get the text of individual sections of the 10-K filing using tge bracket []
operator.
tenk['Item 1']
There are also a few convenience methods to get the most common sections.
# Get Item 1 - Business
tenk.business
# Get Item 1A - Risk Factors
tenk.risk_factors
# Get Item 7 - Management's Discussion and Analysis
tenk.management_discussion
# Get Item 10 - Directors, Officers and Corporate Governance
tenk.directors_officers_and_governance
Downloading Edgar Data
The library is designed to make real time calls to EDGAR to get the latest data. However, you may want to download data for offline use or to build a dataset.
Download Bulk Company Data
You can download all the company filings and facts from Edgar using the download_edgar_data
function.
Note that this will store json files for each company of their facts and submissions, but it will not include the actual HTML or other attachments.
It will however dramatically speed up loading companies by cik or ticker.
The submissions and facts bulk data files are each over 1.GB in size, and take around a few minutes each.
The data is stored by default in the ~/.edgar
directory. You can change this by setting the EDGAR_LOCAL_DATA_DIR
environment variable.
def download_edgar_data(submissions: bool = True, facts: bool = True, reference: bool = True):
"""
Download all the company data from Edgar
:param submissions: Download all the company submissions
:param facts: Download all the company facts
:param reference: Download reference data
"""
download_edgar_data()
Using Bulk Data
If you want edgartools to use the bulk data files you can call use_local_storage()
before you start making calls using the library.
Alternatively, set EDGAR_USE_LOCAL_DATA
to True
in your environment.
Downsides of using bulk data
- The filings downloaded for each company is limited to the last 1000
- You will need to download the latest data every so often to keep it up to date.
Downloading Attachments
You can download attachments from a filing using the download
method on the attachments. This will download all the attached files to a folder of your choice.
class Attachments:
def download(self, path: Union[str, Path], archive: bool = False):
"""
Download all the attachments to a specified path.
If the path is a directory, the file is saved with its original name in that directory.
If the path is a file, the file is saved with the given path name.
If archive is True, the attachments are saved in a zip file.
path: str or Path - The path to save the attachments
archive: bool (default False) - If True, save the attachments in a zip file
"""
...
# Usage
filing.attachments.download(path)
Contributing
Contributions are welcome! We would love to hear your thoughts on how this library could be better at working with SEC Edgar.
Reporting Issues
We use GitHub issues to track public bugs. Report a bug by opening a new issue; it's that easy!
Making code changes
- Fork the repo and create your branch from master.
- If you've added code that should be tested, add tests.
- If you've changed APIs, update the documentation.
- Ensure the test suite passes.
- Make sure your code lints.
- Issue that pull request!
License
edgartools
is distributed under the terms of the MIT license.
Contact
Star History
Subscribe to Polar
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file edgartools-3.2.0.tar.gz
.
File metadata
- Download URL: edgartools-3.2.0.tar.gz
- Upload date:
- Size: 992.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.27.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 027551d5b35a4b67c9b389a44902f12e77aecff1bc2ac997a45400d82fa5449d |
|
MD5 | 4c9b79e58a487260f3369bb9abd4a471 |
|
BLAKE2b-256 | c4293dabbf1343dbf73b9052cccaf048b23befa1a34018a20c3fa6ae0db5c693 |
File details
Details for the file edgartools-3.2.0-py3-none-any.whl
.
File metadata
- Download URL: edgartools-3.2.0-py3-none-any.whl
- Upload date:
- Size: 1.0 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: python-httpx/0.27.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0463b8c6d9e79b428be2dbe609afe59efa9c8e22fe928e59e387bbaa90c0fb79 |
|
MD5 | ae5147686559445c015179987a879caa |
|
BLAKE2b-256 | 8823f17fe4e33a86d0aee0394336658c79ba04338d5cacf115122ade7ed128e3 |