Three minute ArcticDB demo from PyQuantNews
ArcticDB Website | 📘 ArcticDB Docs | 📰: ArcticDB Blog | Press Release | Press Release | Community
ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem. Launched in March 2023, it is the successor to Arctic.
Use of ArcticDB in production (including business or commercial environments) or for a Database Service requires a paid for license from ArcticDB Limited . Please contact info@arcticdb.io for further details.
ArcticDB offers an intuitive Python-centric API enabling you to read and write Pandas DataFrames to S3 or LMDB utilising a fast C++ data-processing and compression engine.
ArcticDB allows you to:
- Pandas in, Pandas out: Read and write Pandas DataFrames, NumPy arrays and native types to S3 and LMDB without leaving Python.
- Built for time-series data: Efficiently index and query time-series data across billions of rows
- Time travel: Travel back in time to see previous versions of your data and create customizable snapshots of the database
- Schemaless Database: Append, update and modify data without being constrained by the existing schema
- Optimised for streaming data: Built in support for efficient sparse data storage
- Powerful processing: Filter, aggregate and create new columns on-the-fly with a Pandas-like syntax
- C++ efficiency: Accelerate analytics though concurrency in the C++ data-processing engine
ArcticDB handles data that is big in both row count and column count, so a 20-year history of more than 400,000 unique securities can be stored in a single symbol. Each symbol is maintained as a separate entity with no shared data which means ArcticDB can scale horizontally across symbols, maximising the performance potential of your compute, storage and network.
ArcticDB is designed from the outset to be resilient; there is no single point of failure, and persistent data structures in the storage mean that once a version of a symbol has been written, it can never be corrupted by subsequent updates. Pulling compressed data directly from storage to the client means that there is no server to overload, so your data is always available when you need it.
Quickstart
Prebuilt binary availability (for the current version)
| PyPI (Python 3.9 - 3.14) | conda-forge (Python 3.10 - 3.14) | |
|---|---|---|
Linux x86_64 |
✔️ | ✔️ |
Linux arm64 |
➖ | ✔️ |
Windows x86_64 |
✔️ | ✔️ |
MacOS x86_64 |
➖ | ✔️ |
MacOS arm64 |
✔️ | ✔️ |
Storage compatibility
| Linux | Windows | Mac | |
|---|---|---|---|
| S3 | ✔️ | ✔️ | ✔️ |
| LMDB | ✔️ | ✔️ | ✔️ |
| Azure Blob Storage | ✔️ | ✔️ | ✔️ |
We have tested against the following S3 backends:
- AWS S3
- Ceph
- MinIO on Linux
- Pure Storage S3
- Scality S3
- VAST Data S3
Installation
Install ArcticDB:
$ pip install arcticdb
or using conda-forge
$ conda install -c conda-forge arcticdb
Import ArcticDB:
>>> import arcticdb as adb
Create an instance on your S3 storage (with or without explicit credentials):
# Leave AWS to derive credential information
>>> ac = adb.Arctic('s3://MY_ENDPOINT:MY_BUCKET?aws_auth=true')
# Manually specify creds
>>> ac = adb.Arctic('s3://MY_ENDPOINT:MY_BUCKET?region=YOUR_REGION&access=ABCD&secret=DCBA')
Or create an instance on your local disk:
>>> ac = adb.Arctic("lmdb:///<path>")
Create your first library and list the libraries in the instance:
>>> ac.create_library('travel_data')
>>> ac.list_libraries()
Create a test dataframe:
>>> import numpy as np
>>> import pandas as pd
>>> NUM_COLUMNS=10
>>> NUM_ROWS=100_000
>>> df = pd.DataFrame(np.random.randint(0,100,size=(NUM_ROWS, NUM_COLUMNS)), columns=[f"COL_{i}" for i in range(NUM_COLUMNS)], index=pd.date_range('2000', periods=NUM_ROWS, freq='h'))
Get the library, write some data to it, and read it back:
>>> lib = ac['travel_data']
>>> lib.write("my_data", df)
>>> data = lib.read("my_data")
To find out more about working with data, visit our docs
Documentation
The source code for the ArcticDB docs are located in the docs folder, and are hosted at docs.arcticdb.io.
License
ArcticDB is released under a Business Source License 1.1 (BSL)
BSL features are free to use and the source code is available, but users may not use ArcticDB for production use or for a Database Service, without agreement with Man Group Operations Limited.
Use of ArcticDB in production or for a Database Service requires a paid for license from ArcticDB Limited and is licensed under the ArcticDB Software License Agreement. For more information please contact info@arcticdb.io.
The BSL is not certified as an open-source license, but most of the Open Source Initiative (OSI) criteria are met. Please see version conversion dates in the below table:
| ArcticDB Version | License | Converts to Apache 2.0 |
|---|---|---|
| 1.0 | Business Source License 1.1 | Mar 16, 2025 |
| 1.2 | Business Source License 1.1 | May 22, 2025 |
| 1.3 | Business Source License 1.1 | Jun 9, 2025 |
| 1.4 | Business Source License 1.1 | Jun 23, 2025 |
| 1.5 | Business Source License 1.1 | Jul 11, 2025 |
| 1.6 | Business Source License 1.1 | Jul 25, 2025 |
| 2.0 | Business Source License 1.1 | Aug 29, 2025 |
| 3.0 | Business Source License 1.1 | Sep 13, 2025 |
| 4.0 | Business Source License 1.1 | Sep 27, 2025 |
| 4.1 | Business Source License 1.1 | Nov 1, 2025 |
| 4.2 | Business Source License 1.1 | Nov 12, 2025 |
| 4.3 | Business Source License 1.1 | Feb 7, 2026 |
| 4.4 | Business Source License 1.1 | Apr 5, 2026 |
| 4.5 | Business Source License 1.1 | Aug 14, 2026 |
| 5.0 | Business Source License 1.1 | Oct 31, 2026 |
| 5.1 | Business Source License 1.1 | Nov 15, 2026 |
| 5.2 | Business Source License 1.1 | Jan 27, 2027 |
| 5.3 | Business Source License 1.1 | Mar 24, 2027 |
| 5.4 | Business Source License 1.1 | Apr 28, 2027 |
| 5.5 | Business Source License 1.1 | May 13, 2027 |
| 5.6 | Business Source License 1.1 | May 26, 2027 |
| 5.7 | Business Source License 1.1 | Jun 2, 2027 |
| 5.8 | Business Source License 1.1 | Jun 9, 2027 |
| 5.9 | Business Source License 1.1 | Jul 7, 2027 |
| 5.10 | Business Source License 1.1 | Jul 29, 2027 |
| 6.1 | Business Source License 1.1 | Aug 20, 2027 |
| 6.2 | Business Source License 1.1 | Sep 8, 2027 |
| 6.3 | Business Source License 1.1 | Nov 3, 2027 |
| 6.5 | Business Source License 1.1 | Dec 11, 2027 |
| 6.6 | Business Source License 1.1 | Jan 6, 2028 |
| 6.7 | Business Source License 1.1 | Jan 12, 2028 |
| 6.8 | Business Source License 1.1 | Jan 28, 2028 |
| 6.9 | Business Source License 1.1 | Feb 2, 2028 |
| 6.10 | Business Source License 1.1 | Mar 2, 2028 |
| 6.11 | Business Source License 1.1 | Mar 23, 2028 |
| 6.12 | Business Source License 1.1 | Apr 15, 2028 |
| 6.13 | Business Source License 1.1 | Apr 21, 2028 |
| 6.14 | Business Source License 1.1 | Apr 29, 2028 |
| 6.15 | Business Source License 1.1 | May 4, 2028 |
| 6.16 | Business Source License 1.1 | May 11, 2028 |
| 6.17 | Business Source License 1.1 | May 18, 2028 |
| 6.18 | Business Source License 1.1 | Jun 1, 2028 |
| 6.19 | Business Source License 1.1 | Jul 21, 2028 |
| 6.20 | Business Source License 1.1 | Jul 27, 2028 |
| 6.21 | Business Source License 1.1 | Aug 4, 2028 |
Code of Conduct
This project has adopted a Code of Conduct. If you have any concerns about the Code, or behaviour that you have experienced in the project, please contact us at info@arcticdb.io.
Contributing/Building From Source
We welcome your contributions to help us improve and extend this project!
Please refer to the Contributing page and feel free to open issues on GitHub.
We are also always looking for feedback from our dedicated community! If you have used ArcticDB please let us know, we would love to hear about your experience!
Our release process is documented here.
Community
We would love to hear how your ArcticDB journey evolves, email us at info@arcticdb.io or come chat to us on Twitter!
Interested in learning more about ArcticDB? Head over to our blog!
Do you have any questions or issues? Chat to us and other users through our dedicated Slack Workspace - sign up for Slack access on our website.
5 maintainers
Release files for arcticdb 6.23.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
Total release size: 287.0 MB
Release files / arcticdb-6.23.0-cp314-cp314-win_amd64.whl
| Download URL | arcticdb-6.23.0-cp314-cp314-win_amd64.whl |
|---|---|
| Size | 9.9 MB |
| Tags | CPython 3.14 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
901445d150b5fa3a3296666e2c2e088936200c9598ac12206c2e053f08e72b00
|
|
BLAKE2b-256 checksum How to use checksums |
07f3ac397b8c831f0a95ca9d61018f171ff1b3d99df0ec902fc0dfe1dfcfc0cc
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp314-cp314-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
| Download URL | arcticdb-6.23.0-cp314-cp314-manylinux2014_x86_64.manylinux_2_17_x86_64.whl |
|---|---|
| Size | 21.2 MB |
| Tags | CPython 3.14 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
e948de0065705e94ca047eb28a3445785a36d0f3f7da32ca02bae72229085962
|
|
BLAKE2b-256 checksum How to use checksums |
1b1656e7b471a5a8f441f18ed12293aa12c87231213bc38e320b680e871323a0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp314-cp314-macosx_15_0_arm64.whl
| Download URL | arcticdb-6.23.0-cp314-cp314-macosx_15_0_arm64.whl |
|---|---|
| Size | 16.9 MB |
| Tags | CPython 3.14 macOS 15.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
c3bd1d60e5a4ff3dc1f36b1c0217c4088db54502f774983181692e3848007411
|
|
BLAKE2b-256 checksum How to use checksums |
61b36de55db6c8988d1f7a9d97e060b82cb987eb427d5e2754085874b8227a6e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp313-cp313-win_amd64.whl
| Download URL | arcticdb-6.23.0-cp313-cp313-win_amd64.whl |
|---|---|
| Size | 9.6 MB |
| Tags | CPython 3.13 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
371a12cc0e8c84f24429ce97db04e257ec2bea2a7725cc954183984dc16fae2c
|
|
BLAKE2b-256 checksum How to use checksums |
b64733e95ddd57cd2144fd17af6762699fb73276ee7a472e116e60763a2c2f84
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp313-cp313-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
| Download URL | arcticdb-6.23.0-cp313-cp313-manylinux2014_x86_64.manylinux_2_17_x86_64.whl |
|---|---|
| Size | 21.2 MB |
| Tags | CPython 3.13 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
62a5601f21edb7e093949e77156b7eff4fc97ee202e78bf1f114374618534f54
|
|
BLAKE2b-256 checksum How to use checksums |
7140dd004d515b30e6c7f978b0196d4d6a68062704e25cb1877e3d9e8aaf4068
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp313-cp313-macosx_15_0_arm64.whl
| Download URL | arcticdb-6.23.0-cp313-cp313-macosx_15_0_arm64.whl |
|---|---|
| Size | 16.9 MB |
| Tags | CPython 3.13 macOS 15.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
039171a4a648c49d930fc6cab7a690770befd7321c89b91a172f156e0c5855c2
|
|
BLAKE2b-256 checksum How to use checksums |
3fc183d0dffec6a1c999db3fa4fd1f50a77d73bf0d00a2baccab4fa216b5ab74
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp312-cp312-win_amd64.whl
| Download URL | arcticdb-6.23.0-cp312-cp312-win_amd64.whl |
|---|---|
| Size | 9.6 MB |
| Tags | CPython 3.12 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
6ab059f27b352bf66bd5c3d4d34b91bc5c9a07b227b7e66329da8949a22ab31f
|
|
BLAKE2b-256 checksum How to use checksums |
c0d3542052b4a80f715e04c6d7d8b5614a5b865eac894a35a682d1f29cf844fd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
| Download URL | arcticdb-6.23.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl |
|---|---|
| Size | 21.2 MB |
| Tags | CPython 3.12 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
27eb5547746bb018e88c0c276821c2ef7a449d07a7715de0766ee1afaaec6bf3
|
|
BLAKE2b-256 checksum How to use checksums |
d7845c82321a2be862215d4a18cc412f86be35ff433236c29104ff35c5e6068e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp312-cp312-macosx_15_0_arm64.whl
| Download URL | arcticdb-6.23.0-cp312-cp312-macosx_15_0_arm64.whl |
|---|---|
| Size | 17.0 MB |
| Tags | CPython 3.12 macOS 15.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
14884492b0bf8b0d312dd1ebcec514ba2514b53f7d47b71e10d4d622284ef9d8
|
|
BLAKE2b-256 checksum How to use checksums |
27f77fefb7a2151a29f9a975913141f2377682b0bd43d4115eaad1b3f78967c8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp311-cp311-win_amd64.whl
| Download URL | arcticdb-6.23.0-cp311-cp311-win_amd64.whl |
|---|---|
| Size | 9.6 MB |
| Tags | CPython 3.11 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
19013589641ffc1bc12aeac196e2593131b61a30b9f5dc8539aa80d0c1795452
|
|
BLAKE2b-256 checksum How to use checksums |
31290a977af2d7b6b7329c2fd8fdd8dd9db232e2ea6c5d9c628365eee8fc6a8b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
| Download URL | arcticdb-6.23.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl |
|---|---|
| Size | 21.2 MB |
| Tags | CPython 3.11 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
2d77641a2f38a84ba94276a4929e2349dbc296dc48e20171311c24e79933a9c2
|
|
BLAKE2b-256 checksum How to use checksums |
5ee80da2e7062963e0fb5c9572a69201469f0e69073b2f96c8cb05a9338d2e87
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp311-cp311-macosx_15_0_arm64.whl
| Download URL | arcticdb-6.23.0-cp311-cp311-macosx_15_0_arm64.whl |
|---|---|
| Size | 17.0 MB |
| Tags | CPython 3.11 macOS 15.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
df685d82ca02011730bf6814e37a565a1eca08e2f6b65264d25ffad448257577
|
|
BLAKE2b-256 checksum How to use checksums |
498c1db5893f6192e2b46d0d6d281f82259b2abfce51143e2db75eab5311ecce
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp310-cp310-win_amd64.whl
| Download URL | arcticdb-6.23.0-cp310-cp310-win_amd64.whl |
|---|---|
| Size | 9.7 MB |
| Tags | CPython 3.10 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
43d91867b041eb7eb91d380b2e4a18cc1e21e73bb1cb0bf133112190805b2a95
|
|
BLAKE2b-256 checksum How to use checksums |
d2fb009078a8bf08c12605c6dadfd3311db5ce84ec44a4af2394f96f57fda08b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
| Download URL | arcticdb-6.23.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl |
|---|---|
| Size | 21.2 MB |
| Tags | CPython 3.10 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
e365160328f743dd07485813f59a28fbe5113aa16b9c9960cdc1f0f83941707e
|
|
BLAKE2b-256 checksum How to use checksums |
2b234d06e5b3763a0b754a0f23f4aeb06f6ea19d9783fa0929ca4299d8086e21
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp310-cp310-macosx_15_0_arm64.whl
| Download URL | arcticdb-6.23.0-cp310-cp310-macosx_15_0_arm64.whl |
|---|---|
| Size | 17.0 MB |
| Tags | CPython 3.10 macOS 15.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
e7ec963d0eeab3d2e14bad404a1959b33dd9d01704f4a445e0971cfadd5b0d56
|
|
BLAKE2b-256 checksum How to use checksums |
c95ed29da2008b64e025a7c3991e629f0308a93adb6fa1d99d34611bd09fb289
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp39-cp39-win_amd64.whl
| Download URL | arcticdb-6.23.0-cp39-cp39-win_amd64.whl |
|---|---|
| Size | 9.6 MB |
| Tags | CPython 3.9 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
d8fe7b97dee7ad6e450b49f3238b5d9a767c148e60e34ee93b00526aeebc2e37
|
|
BLAKE2b-256 checksum How to use checksums |
efe6ccb72a730d57fb477736b5e6a14c7a2b1b64b7c7cc20fd0207bde24797df
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
| Download URL | arcticdb-6.23.0-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl |
|---|---|
| Size | 21.2 MB |
| Tags | CPython 3.9 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
7c58c2192ec923569e8ffde10ea038a73dabe8d6777f33477f8c38abb69e2249
|
|
BLAKE2b-256 checksum How to use checksums |
4d220e0f2bda462660c548038c4da9d37b2723c75dcc85fe6c1ae020b6c99743
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
Release files / arcticdb-6.23.0-cp39-cp39-macosx_15_0_arm64.whl
| Download URL | arcticdb-6.23.0-cp39-cp39-macosx_15_0_arm64.whl |
|---|---|
| Size | 17.0 MB |
| Tags | CPython 3.9 macOS 15.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
38b5a81e50edefa5c81f7f47a97507507bb06d025da2807415275a085ec6613e
|
|
BLAKE2b-256 checksum How to use checksums |
170f6bc0b6e7dded228b90f1803467ead29eb833902a14f9f910949ab176f735
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.12
|
