Skip to main content


Three minute ArcticDB demo from PyQuantNews

Options data in ArcticDB

ArcticDB Website | 📘 ArcticDB Docs | 📰: ArcticDB Blog | Press Release | Press Release | Community


ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem. Launched in March 2023, it is the successor to Arctic.

Use of ArcticDB in production (including business or commercial environments) or for a Database Service requires a paid for license from ArcticDB Limited . Please contact info@arcticdb.io for further details.

ArcticDB offers an intuitive Python-centric API enabling you to read and write Pandas DataFrames to S3 or LMDB utilising a fast C++ data-processing and compression engine.

ArcticDB allows you to:

  • Pandas in, Pandas out: Read and write Pandas DataFrames, NumPy arrays and native types to S3 and LMDB without leaving Python.
  • Built for time-series data: Efficiently index and query time-series data across billions of rows
  • Time travel: Travel back in time to see previous versions of your data and create customizable snapshots of the database
  • Schemaless Database: Append, update and modify data without being constrained by the existing schema
  • Optimised for streaming data: Built in support for efficient sparse data storage
  • Powerful processing: Filter, aggregate and create new columns on-the-fly with a Pandas-like syntax
  • C++ efficiency: Accelerate analytics though concurrency in the C++ data-processing engine

ArcticDB handles data that is big in both row count and column count, so a 20-year history of more than 400,000 unique securities can be stored in a single symbol. Each symbol is maintained as a separate entity with no shared data which means ArcticDB can scale horizontally across symbols, maximising the performance potential of your compute, storage and network.

ArcticDB is designed from the outset to be resilient; there is no single point of failure, and persistent data structures in the storage mean that once a version of a symbol has been written, it can never be corrupted by subsequent updates. Pulling compressed data directly from storage to the client means that there is no server to overload, so your data is always available when you need it.

Quickstart

Prebuilt binary availability (for the current version)

PyPI (Python 3.9 - 3.14) conda-forge (Python 3.10 - 3.14)
Linux x86_64 ✔️ ✔️
Linux arm64 ✔️
Windows x86_64 ✔️ ✔️
MacOS x86_64 ✔️
MacOS arm64 ✔️ ✔️

Storage compatibility

Linux Windows Mac
S3 ✔️ ✔️ ✔️
LMDB ✔️ ✔️ ✔️
Azure Blob Storage ✔️ ✔️ ✔️

We have tested against the following S3 backends:

  • AWS S3
  • Ceph
  • MinIO on Linux
  • Pure Storage S3
  • Scality S3
  • VAST Data S3

Installation

Install ArcticDB:

$ pip install arcticdb

or using conda-forge

$ conda install -c conda-forge arcticdb

Import ArcticDB:

>>> import arcticdb as adb

Create an instance on your S3 storage (with or without explicit credentials):

# Leave AWS to derive credential information
>>> ac = adb.Arctic('s3://MY_ENDPOINT:MY_BUCKET?aws_auth=true')

# Manually specify creds
>>> ac = adb.Arctic('s3://MY_ENDPOINT:MY_BUCKET?region=YOUR_REGION&access=ABCD&secret=DCBA')

Or create an instance on your local disk:

>>> ac = adb.Arctic("lmdb:///<path>")

Create your first library and list the libraries in the instance:

>>> ac.create_library('travel_data')
>>> ac.list_libraries()

Create a test dataframe:

>>> import numpy as np
>>> import pandas as pd
>>> NUM_COLUMNS=10
>>> NUM_ROWS=100_000
>>> df = pd.DataFrame(np.random.randint(0,100,size=(NUM_ROWS, NUM_COLUMNS)), columns=[f"COL_{i}" for i in range(NUM_COLUMNS)], index=pd.date_range('2000', periods=NUM_ROWS, freq='h'))

Get the library, write some data to it, and read it back:

>>> lib = ac['travel_data']
>>> lib.write("my_data", df)
>>> data = lib.read("my_data")

To find out more about working with data, visit our docs


Documentation

The source code for the ArcticDB docs are located in the docs folder, and are hosted at docs.arcticdb.io.

License

ArcticDB is released under a Business Source License 1.1 (BSL)

BSL features are free to use and the source code is available, but users may not use ArcticDB for production use or for a Database Service, without agreement with Man Group Operations Limited.

Use of ArcticDB in production or for a Database Service requires a paid for license from ArcticDB Limited and is licensed under the ArcticDB Software License Agreement. For more information please contact info@arcticdb.io.

The BSL is not certified as an open-source license, but most of the Open Source Initiative (OSI) criteria are met. Please see version conversion dates in the below table:

ArcticDB Version License Converts to Apache 2.0
1.0 Business Source License 1.1 Mar 16, 2025
1.2 Business Source License 1.1 May 22, 2025
1.3 Business Source License 1.1 Jun 9, 2025
1.4 Business Source License 1.1 Jun 23, 2025
1.5 Business Source License 1.1 Jul 11, 2025
1.6 Business Source License 1.1 Jul 25, 2025
2.0 Business Source License 1.1 Aug 29, 2025
3.0 Business Source License 1.1 Sep 13, 2025
4.0 Business Source License 1.1 Sep 27, 2025
4.1 Business Source License 1.1 Nov 1, 2025
4.2 Business Source License 1.1 Nov 12, 2025
4.3 Business Source License 1.1 Feb 7, 2026
4.4 Business Source License 1.1 Apr 5, 2026
4.5 Business Source License 1.1 Aug 14, 2026
5.0 Business Source License 1.1 Oct 31, 2026
5.1 Business Source License 1.1 Nov 15, 2026
5.2 Business Source License 1.1 Jan 27, 2027
5.3 Business Source License 1.1 Mar 24, 2027
5.4 Business Source License 1.1 Apr 28, 2027
5.5 Business Source License 1.1 May 13, 2027
5.6 Business Source License 1.1 May 26, 2027
5.7 Business Source License 1.1 Jun 2, 2027
5.8 Business Source License 1.1 Jun 9, 2027
5.9 Business Source License 1.1 Jul 7, 2027
5.10 Business Source License 1.1 Jul 29, 2027
6.1 Business Source License 1.1 Aug 20, 2027
6.2 Business Source License 1.1 Sep 8, 2027
6.3 Business Source License 1.1 Nov 3, 2027
6.5 Business Source License 1.1 Dec 11, 2027
6.6 Business Source License 1.1 Jan 6, 2028

Code of Conduct

Code of Conduct

This project has adopted a Code of Conduct. If you have any concerns about the Code, or behaviour that you have experienced in the project, please contact us at info@arcticdb.io.

Contributing/Building From Source

We welcome your contributions to help us improve and extend this project!

Please refer to the Contributing page and feel free to open issues on GitHub.

We are also always looking for feedback from our dedicated community! If you have used ArcticDB please let us know, we would love to hear about your experience!

Our release process is documented here.

Community

We would love to hear how your ArcticDB journey evolves, email us at info@arcticdb.io or come chat to us on Twitter!

Interested in learning more about ArcticDB? Head over to our blog!

Do you have any questions or issues? Chat to us and other users through our dedicated Slack Workspace - sign up for Slack access on our website.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

arcticdb-6.18.7-cp314-cp314-win_amd64.whl (9.8 MB view details)

Uploaded CPython 3.14Windows x86-64

arcticdb-6.18.7-cp314-cp314-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (21.1 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.17+ x86-64

arcticdb-6.18.7-cp314-cp314-macosx_15_0_arm64.whl (16.8 MB view details)

Uploaded CPython 3.14macOS 15.0+ ARM64

arcticdb-6.18.7-cp313-cp313-win_amd64.whl (9.5 MB view details)

Uploaded CPython 3.13Windows x86-64

arcticdb-6.18.7-cp313-cp313-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (21.1 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.17+ x86-64

arcticdb-6.18.7-cp313-cp313-macosx_15_0_arm64.whl (16.8 MB view details)

Uploaded CPython 3.13macOS 15.0+ ARM64

arcticdb-6.18.7-cp312-cp312-win_amd64.whl (9.6 MB view details)

Uploaded CPython 3.12Windows x86-64

arcticdb-6.18.7-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (21.1 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ x86-64

arcticdb-6.18.7-cp312-cp312-macosx_15_0_arm64.whl (16.8 MB view details)

Uploaded CPython 3.12macOS 15.0+ ARM64

arcticdb-6.18.7-cp311-cp311-win_amd64.whl (9.6 MB view details)

Uploaded CPython 3.11Windows x86-64

arcticdb-6.18.7-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (21.1 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

arcticdb-6.18.7-cp311-cp311-macosx_15_0_arm64.whl (16.8 MB view details)

Uploaded CPython 3.11macOS 15.0+ ARM64

arcticdb-6.18.7-cp310-cp310-win_amd64.whl (9.6 MB view details)

Uploaded CPython 3.10Windows x86-64

arcticdb-6.18.7-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (21.1 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

arcticdb-6.18.7-cp310-cp310-macosx_15_0_arm64.whl (16.9 MB view details)

Uploaded CPython 3.10macOS 15.0+ ARM64

arcticdb-6.18.7-cp39-cp39-win_amd64.whl (9.6 MB view details)

Uploaded CPython 3.9Windows x86-64

arcticdb-6.18.7-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (21.1 MB view details)

Uploaded CPython 3.9manylinux: glibc 2.17+ x86-64

arcticdb-6.18.7-cp39-cp39-macosx_15_0_arm64.whl (16.9 MB view details)

Uploaded CPython 3.9macOS 15.0+ ARM64

File details

Details for the file arcticdb-6.18.7-cp314-cp314-win_amd64.whl.

File metadata

  • Download URL: arcticdb-6.18.7-cp314-cp314-win_amd64.whl
  • Upload date:
  • Size: 9.8 MB
  • Tags: CPython 3.14, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for arcticdb-6.18.7-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 c5f9de854ad1245a4a7aae693234dc44688f0ea570f50bb8d4bedfa139de5928
MD5 275d42523f80f7c20b1975d2d531d0af
BLAKE2b-256 4171a01a8a1f8fc27c75fd6322a7f3c671a3b60a4574857df9eec778d18b5816

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp314-cp314-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for arcticdb-6.18.7-cp314-cp314-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 a005e65783b56f01b1609a99864305897a19a79f5f1345374240e05cf39d02b9
MD5 8fea079f446e651d0708663ebcd0b524
BLAKE2b-256 138ffd7b4e7368f2cb31e8624ecbf0a6081b78df666d73033acd3284157df402

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp314-cp314-macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for arcticdb-6.18.7-cp314-cp314-macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 a0e53787fc39d231d2a4e4c75c7042e047c999f765524590f93b26d324d5b5a7
MD5 ab7c8b46af68f586faa12b7737d6d881
BLAKE2b-256 fcfd83117865e5e2cdb6eceff7bf455025a59e478aa22ecd523ddfb9d22cb772

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp313-cp313-win_amd64.whl.

File metadata

  • Download URL: arcticdb-6.18.7-cp313-cp313-win_amd64.whl
  • Upload date:
  • Size: 9.5 MB
  • Tags: CPython 3.13, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for arcticdb-6.18.7-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 886cf72d62004c97c16e104109d9c0cb9097356acc5d1a481f8a2ddfb7504021
MD5 404dc8882b9b758c2b83b977e43e7d68
BLAKE2b-256 7d01a55b35aa20a233f87640765c12908667ad751fae179268a057ac4103c5e0

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp313-cp313-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for arcticdb-6.18.7-cp313-cp313-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 42ecaafef5d748cb8ee11287599b0b962f68732e27f3ee43a13f6d5965f30a67
MD5 d741d23e0487d971073a4fe9e42b1011
BLAKE2b-256 5f68cd65ed006ae194d32820c43812a0fd77c9b3224cd363414b617adfc7c6bd

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp313-cp313-macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for arcticdb-6.18.7-cp313-cp313-macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 15677bf7fbec422cb5afe02aba36c12ff3d6dd7f686911c6047ae81983cf5d6f
MD5 d0001087f143bea3dea82e571ea727fe
BLAKE2b-256 ccf184ea5f4d34591264aaffb94c4a0cd2f350417d8f0312d0dcc4cae16d7fd4

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp312-cp312-win_amd64.whl.

File metadata

  • Download URL: arcticdb-6.18.7-cp312-cp312-win_amd64.whl
  • Upload date:
  • Size: 9.6 MB
  • Tags: CPython 3.12, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for arcticdb-6.18.7-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 0432641751f57f6bd68a8eb73e2fc8e378f4e15bce2ffb0388ed9d573d1af697
MD5 0aec5582ca694448bf025c5ea43e460a
BLAKE2b-256 51c4c3726f6ce7497accc0b049d56ff0c83a24a9c67c681fe47e82d239284b9a

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for arcticdb-6.18.7-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 0fecc99140704a52bf6086dc9e6fb5e580bb5a3685dc292fecdf9ea02690b84b
MD5 61751593cbffe82b20b795882f58bd7d
BLAKE2b-256 084b50196f52ee8d89645a8dce24283a2dee18cba90ef4400d30580c02c78df3

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp312-cp312-macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for arcticdb-6.18.7-cp312-cp312-macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 a0bdfe2ea9fe320c2f2c1b1daeb6ef6f1a199e02872ac2039178fae5c4ae8576
MD5 3d0022abe28a19084f4188f64d264632
BLAKE2b-256 a2d174d4f5caba594b5c77218413f9bb487a262cc1829777e6141c5fe71ef768

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp311-cp311-win_amd64.whl.

File metadata

  • Download URL: arcticdb-6.18.7-cp311-cp311-win_amd64.whl
  • Upload date:
  • Size: 9.6 MB
  • Tags: CPython 3.11, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for arcticdb-6.18.7-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 727cfb1e87b29f8fde89241e25ef6188bc44af016cafc8705761a4b7ce33375e
MD5 0d5c58d63f5b750f2183ee502c720034
BLAKE2b-256 7ac1cc8ab1e780a8582a1a55902fc2ca34fc2e080a76a076c5da5ced0b67f02b

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for arcticdb-6.18.7-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 94b7bb7e5ef626c6fe493e299cd3376c0aed0b683e096e23f204e34934cc9004
MD5 645ab0c32bb29c03e3e4a2cde1680815
BLAKE2b-256 90cff1244a53118a42cbaa68565638cf45909086bc1a4cdbd8ece937ccb7468a

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp311-cp311-macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for arcticdb-6.18.7-cp311-cp311-macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 d4a3fa989069246c4680b4208b03ac77ed61c0e5e1c1af0e43992c7477847dfc
MD5 999af0779c404cc2ed702816aa3d29e7
BLAKE2b-256 b46c48efd91819cb40d355a2cf3185098b50c0282a4eb4c3aca2b3b4a55a5c7d

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp310-cp310-win_amd64.whl.

File metadata

  • Download URL: arcticdb-6.18.7-cp310-cp310-win_amd64.whl
  • Upload date:
  • Size: 9.6 MB
  • Tags: CPython 3.10, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for arcticdb-6.18.7-cp310-cp310-win_amd64.whl
Algorithm Hash digest
SHA256 3f524caaa66aca0021e0db9ead890b8424a0913cdd7a76ab657cdbb31d1508d0
MD5 7e42ee67a96a4483996692c78ad29af0
BLAKE2b-256 bc32fe8da8fdad3cbaf6fdc771fcdf495e7fb6a58da9123261ad3787beb12f08

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for arcticdb-6.18.7-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 542728a9694958967e44c55a858f55d66e0124e0af08ae2c1a22f0bf7578a0dd
MD5 91337719a5350d39926107d1dee781d0
BLAKE2b-256 1815bb54e76d6919948a4d33ae00e97d5b1c6d7d0a31d986f29286cd7fe12fe3

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp310-cp310-macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for arcticdb-6.18.7-cp310-cp310-macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 42b358a128e55fb7849003a6f274ee1db8c7adeb0d3d557fb72e1cd1677ac6e1
MD5 0db8795cdcaa28aa680e3d7e08276e8e
BLAKE2b-256 4b24015f0fa96fbfc087499703644fbd024b116c13e519782b2abee1f1e00a50

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp39-cp39-win_amd64.whl.

File metadata

  • Download URL: arcticdb-6.18.7-cp39-cp39-win_amd64.whl
  • Upload date:
  • Size: 9.6 MB
  • Tags: CPython 3.9, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for arcticdb-6.18.7-cp39-cp39-win_amd64.whl
Algorithm Hash digest
SHA256 a47982e20123d9aca24cf6af5e9d2835fd76612700d194cd895caf42a5161674
MD5 7f160827e89e9abf8580d7e802965032
BLAKE2b-256 14b640ef4360e2d6ae5c80971d24e0814dfef318ec2cc7a21ffbd846a8590269

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for arcticdb-6.18.7-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 89a3d0720f93eb998f82fd9887bd1c14b6c3423aaa5628f3f814b37a9b31f330
MD5 ecb3b9a839290b1adfa02e4cdc68f757
BLAKE2b-256 29fdb849c49905746f256fb1d9ab1cf2cdf5109b47905d206aa5cf694b3f5fc8

See more details on using hashes here.

File details

Details for the file arcticdb-6.18.7-cp39-cp39-macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for arcticdb-6.18.7-cp39-cp39-macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 979231aaff6fa5bb9b2e21211a3b26752bb13b4726afd8c0ea76bb0502461302
MD5 f15fe4b4437a27eae56ebad55e9f115f
BLAKE2b-256 8a431798d7c6d36842982eba6786dc2fea77963da3049b62112397ea4a304aa8

See more details on using hashes here.

Release history Release notifications | RSS feed

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page