Skip to main content


Three minute ArcticDB demo from PyQuantNews

Options data in ArcticDB

ArcticDB Website | 📘 ArcticDB Docs | 📰: ArcticDB Blog | Press Release | Press Release | Community


ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem. Launched in March 2023, it is the successor to Arctic.

Use of ArcticDB in production (including business or commercial environments) or for a Database Service requires a paid for license from ArcticDB Limited . Please contact info@arcticdb.io for further details.

ArcticDB offers an intuitive Python-centric API enabling you to read and write Pandas DataFrames to S3 or LMDB utilising a fast C++ data-processing and compression engine.

ArcticDB allows you to:

  • Pandas in, Pandas out: Read and write Pandas DataFrames, NumPy arrays and native types to S3 and LMDB without leaving Python.
  • Built for time-series data: Efficiently index and query time-series data across billions of rows
  • Time travel: Travel back in time to see previous versions of your data and create customizable snapshots of the database
  • Schemaless Database: Append, update and modify data without being constrained by the existing schema
  • Optimised for streaming data: Built in support for efficient sparse data storage
  • Powerful processing: Filter, aggregate and create new columns on-the-fly with a Pandas-like syntax
  • C++ efficiency: Accelerate analytics though concurrency in the C++ data-processing engine

ArcticDB handles data that is big in both row count and column count, so a 20-year history of more than 400,000 unique securities can be stored in a single symbol. Each symbol is maintained as a separate entity with no shared data which means ArcticDB can scale horizontally across symbols, maximising the performance potential of your compute, storage and network.

ArcticDB is designed from the outset to be resilient; there is no single point of failure, and persistent data structures in the storage mean that once a version of a symbol has been written, it can never be corrupted by subsequent updates. Pulling compressed data directly from storage to the client means that there is no server to overload, so your data is always available when you need it.

Quickstart

Prebuilt binary availability (for the current version)

PyPI (Python 3.9 - 3.14) conda-forge (Python 3.10 - 3.14)
Linux x86_64 ✔️ ✔️
Linux arm64 ✔️
Windows x86_64 ✔️ ✔️
MacOS x86_64 ✔️
MacOS arm64 ✔️ ✔️

Storage compatibility

Linux Windows Mac
S3 ✔️ ✔️ ✔️
LMDB ✔️ ✔️ ✔️
Azure Blob Storage ✔️ ✔️ ✔️

We have tested against the following S3 backends:

  • AWS S3
  • Ceph
  • MinIO on Linux
  • Pure Storage S3
  • Scality S3
  • VAST Data S3

Installation

Install ArcticDB:

$ pip install arcticdb

or using conda-forge

$ conda install -c conda-forge arcticdb

Import ArcticDB:

>>> import arcticdb as adb

Create an instance on your S3 storage (with or without explicit credentials):

# Leave AWS to derive credential information
>>> ac = adb.Arctic('s3://MY_ENDPOINT:MY_BUCKET?aws_auth=true')

# Manually specify creds
>>> ac = adb.Arctic('s3://MY_ENDPOINT:MY_BUCKET?region=YOUR_REGION&access=ABCD&secret=DCBA')

Or create an instance on your local disk:

>>> ac = adb.Arctic("lmdb:///<path>")

Create your first library and list the libraries in the instance:

>>> ac.create_library('travel_data')
>>> ac.list_libraries()

Create a test dataframe:

>>> import numpy as np
>>> import pandas as pd
>>> NUM_COLUMNS=10
>>> NUM_ROWS=100_000
>>> df = pd.DataFrame(np.random.randint(0,100,size=(NUM_ROWS, NUM_COLUMNS)), columns=[f"COL_{i}" for i in range(NUM_COLUMNS)], index=pd.date_range('2000', periods=NUM_ROWS, freq='h'))

Get the library, write some data to it, and read it back:

>>> lib = ac['travel_data']
>>> lib.write("my_data", df)
>>> data = lib.read("my_data")

To find out more about working with data, visit our docs


Documentation

The source code for the ArcticDB docs are located in the docs folder, and are hosted at docs.arcticdb.io.

License

ArcticDB is released under a Business Source License 1.1 (BSL)

BSL features are free to use and the source code is available, but users may not use ArcticDB for production use or for a Database Service, without agreement with Man Group Operations Limited.

Use of ArcticDB in production or for a Database Service requires a paid for license from ArcticDB Limited and is licensed under the ArcticDB Software License Agreement. For more information please contact info@arcticdb.io.

The BSL is not certified as an open-source license, but most of the Open Source Initiative (OSI) criteria are met. Please see version conversion dates in the below table:

ArcticDB Version License Converts to Apache 2.0
1.0 Business Source License 1.1 Mar 16, 2025
1.2 Business Source License 1.1 May 22, 2025
1.3 Business Source License 1.1 Jun 9, 2025
1.4 Business Source License 1.1 Jun 23, 2025
1.5 Business Source License 1.1 Jul 11, 2025
1.6 Business Source License 1.1 Jul 25, 2025
2.0 Business Source License 1.1 Aug 29, 2025
3.0 Business Source License 1.1 Sep 13, 2025
4.0 Business Source License 1.1 Sep 27, 2025
4.1 Business Source License 1.1 Nov 1, 2025
4.2 Business Source License 1.1 Nov 12, 2025
4.3 Business Source License 1.1 Feb 7, 2026
4.4 Business Source License 1.1 Apr 5, 2026
4.5 Business Source License 1.1 Aug 14, 2026
5.0 Business Source License 1.1 Oct 31, 2026
5.1 Business Source License 1.1 Nov 15, 2026
5.2 Business Source License 1.1 Jan 27, 2027
5.3 Business Source License 1.1 Mar 24, 2027
5.4 Business Source License 1.1 Apr 28, 2027
5.5 Business Source License 1.1 May 13, 2027
5.6 Business Source License 1.1 May 26, 2027
5.7 Business Source License 1.1 Jun 2, 2027
5.8 Business Source License 1.1 Jun 9, 2027
5.9 Business Source License 1.1 Jul 7, 2027
5.10 Business Source License 1.1 Jul 29, 2027
6.1 Business Source License 1.1 Aug 20, 2027
6.2 Business Source License 1.1 Sep 8, 2027
6.3 Business Source License 1.1 Nov 3, 2027
6.5 Business Source License 1.1 Dec 11, 2027
6.6 Business Source License 1.1 Jan 6, 2028

Code of Conduct

Code of Conduct

This project has adopted a Code of Conduct. If you have any concerns about the Code, or behaviour that you have experienced in the project, please contact us at info@arcticdb.io.

Contributing/Building From Source

We welcome your contributions to help us improve and extend this project!

Please refer to the Contributing page and feel free to open issues on GitHub.

We are also always looking for feedback from our dedicated community! If you have used ArcticDB please let us know, we would love to hear about your experience!

Our release process is documented here.

Community

We would love to hear how your ArcticDB journey evolves, email us at info@arcticdb.io or come chat to us on Twitter!

Interested in learning more about ArcticDB? Head over to our blog!

Do you have any questions or issues? Chat to us and other users through our dedicated Slack Workspace - sign up for Slack access on our website.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

arcticdb-6.20.0-cp314-cp314-win_amd64.whl (9.8 MB view details)

Uploaded CPython 3.14Windows x86-64

arcticdb-6.20.0-cp314-cp314-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (21.1 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.17+ x86-64

arcticdb-6.20.0-cp314-cp314-macosx_15_0_arm64.whl (16.8 MB view details)

Uploaded CPython 3.14macOS 15.0+ ARM64

arcticdb-6.20.0-cp313-cp313-win_amd64.whl (9.6 MB view details)

Uploaded CPython 3.13Windows x86-64

arcticdb-6.20.0-cp313-cp313-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (21.1 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.17+ x86-64

arcticdb-6.20.0-cp313-cp313-macosx_15_0_arm64.whl (16.9 MB view details)

Uploaded CPython 3.13macOS 15.0+ ARM64

arcticdb-6.20.0-cp312-cp312-win_amd64.whl (9.6 MB view details)

Uploaded CPython 3.12Windows x86-64

arcticdb-6.20.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (21.1 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ x86-64

arcticdb-6.20.0-cp312-cp312-macosx_15_0_arm64.whl (16.9 MB view details)

Uploaded CPython 3.12macOS 15.0+ ARM64

arcticdb-6.20.0-cp311-cp311-win_amd64.whl (9.6 MB view details)

Uploaded CPython 3.11Windows x86-64

arcticdb-6.20.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (21.1 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

arcticdb-6.20.0-cp311-cp311-macosx_15_0_arm64.whl (16.9 MB view details)

Uploaded CPython 3.11macOS 15.0+ ARM64

arcticdb-6.20.0-cp310-cp310-win_amd64.whl (9.6 MB view details)

Uploaded CPython 3.10Windows x86-64

arcticdb-6.20.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (21.1 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

arcticdb-6.20.0-cp310-cp310-macosx_15_0_arm64.whl (16.9 MB view details)

Uploaded CPython 3.10macOS 15.0+ ARM64

arcticdb-6.20.0-cp39-cp39-win_amd64.whl (9.6 MB view details)

Uploaded CPython 3.9Windows x86-64

arcticdb-6.20.0-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (21.1 MB view details)

Uploaded CPython 3.9manylinux: glibc 2.17+ x86-64

arcticdb-6.20.0-cp39-cp39-macosx_15_0_arm64.whl (16.9 MB view details)

Uploaded CPython 3.9macOS 15.0+ ARM64

File details

Details for the file arcticdb-6.20.0-cp314-cp314-win_amd64.whl.

File metadata

  • Download URL: arcticdb-6.20.0-cp314-cp314-win_amd64.whl
  • Upload date:
  • Size: 9.8 MB
  • Tags: CPython 3.14, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.10.12

File hashes

Hashes for arcticdb-6.20.0-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 e425213881671be21defa128b83ca5bce35674297f51f2b25c194bd85fb15db1
MD5 f8204d92da278e5f7339cd4b2556c331
BLAKE2b-256 ab13300f7a2ee9295777b5a36ae9e5ab3c70f95a439a505cc3f7d04f3d1b9a17

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp314-cp314-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for arcticdb-6.20.0-cp314-cp314-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 0d2d15279520ad547bbc056e3e678a2da8b44636582e8f039e284667a73ed803
MD5 7bf8f3fa37c5e4f99dd96153da27692e
BLAKE2b-256 6072bdd59c5b1f2cf4a3251c461d59e3789192f505b8476ecf56c486a55b7f1b

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp314-cp314-macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for arcticdb-6.20.0-cp314-cp314-macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 685d3e9699356c08d4df95ad0e348754903e8028e6246f242be1a22a9ff9dc17
MD5 a40df5416c3cda7fa75f4ca9104b7be9
BLAKE2b-256 63f1cbe739a3179b77c01edd6fe1814cb5ec0b8fb2f114e031a3414fce346cce

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp313-cp313-win_amd64.whl.

File metadata

  • Download URL: arcticdb-6.20.0-cp313-cp313-win_amd64.whl
  • Upload date:
  • Size: 9.6 MB
  • Tags: CPython 3.13, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.10.12

File hashes

Hashes for arcticdb-6.20.0-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 c343acb3d0ee51ce2adb68d05a3959b2cb468d1508d94e99b258ce90b58c0c4a
MD5 de377496cda2ef9be0cb6666ef63ce6e
BLAKE2b-256 d3ebcf7650eaf84667167341e99abf1e37a7f44d8105dd41a8aca3065cb85a54

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp313-cp313-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for arcticdb-6.20.0-cp313-cp313-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 a568fc2a5aca3fa07fa14793c3e8983a2fef5b296a0e3c74b899fd5bf9082906
MD5 c2c20eafce689da4c608d14869bbb3d6
BLAKE2b-256 2af5277785213ccfb9ae478c9008bf25de5b2766418b4505522c3cb891d5eef3

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp313-cp313-macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for arcticdb-6.20.0-cp313-cp313-macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 74481776f65702b981a7a058661881b94ca64facaad3ee8a02840eb27e57d2c7
MD5 11943b510fddd09108cf454762a014d3
BLAKE2b-256 8548400a7e82c3130a720bb1ceed1f53ea56a942ee69e9134654240ecc6ee569

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp312-cp312-win_amd64.whl.

File metadata

  • Download URL: arcticdb-6.20.0-cp312-cp312-win_amd64.whl
  • Upload date:
  • Size: 9.6 MB
  • Tags: CPython 3.12, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.10.12

File hashes

Hashes for arcticdb-6.20.0-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 dbe59040d46a50c7a580f8d65bdef72005af5afbe12e3045ab5a4112de927e4b
MD5 8ed5f906d37c25716a5ca796ce35b6e9
BLAKE2b-256 dc700025708c6f0242d1d2ed14f10a5712614330ef2475e50b42bc1b3c058c3c

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for arcticdb-6.20.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 8f794628a55b986b269b796987a71769786a314cbf62a26edde13423b08aaf79
MD5 dd32f322d52abfca12bbe8e9ab0027ee
BLAKE2b-256 8eb22db46189a6a0fe01452e96a8c04291e4fb7e4b5a84171c185e18ff736688

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp312-cp312-macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for arcticdb-6.20.0-cp312-cp312-macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 564e33a0393d3fd409007bfe96aa6cb54f5b9ff224b9c57c72d20973bf7a9c60
MD5 0191a445c5e4e05dbde502a08139b6ab
BLAKE2b-256 3dac1be397070d5223e803d2371a12c1dd52ef86e7e44b4ab6bb52f36baf5dc4

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp311-cp311-win_amd64.whl.

File metadata

  • Download URL: arcticdb-6.20.0-cp311-cp311-win_amd64.whl
  • Upload date:
  • Size: 9.6 MB
  • Tags: CPython 3.11, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for arcticdb-6.20.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 70c765104194ba51df533f89eb867147e530adc1d47396f9f97b773370b1cae2
MD5 d93adfefbf33e7d89c85a301a841a24e
BLAKE2b-256 59c4860bfe0760db058d228094521e95cb43b823a2cde6453a433ad400b41132

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for arcticdb-6.20.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 39537ea20daeac6cad8ae0ef5de3f6f13e27a11a7fe5f3345b954a2cc04d403a
MD5 8a6a70e7d9f5f8a2c3977880e473f066
BLAKE2b-256 f0c22f80a4540f56385f4d5e203c526bb4b2be0b947d70b30c41a5c179da1c7f

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp311-cp311-macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for arcticdb-6.20.0-cp311-cp311-macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 a435396c6fc055f6d2231b2c64f887900adbdf1cea488a0719b3bdff7790047e
MD5 5d59233cf681226e3cb71b2f20867250
BLAKE2b-256 72a5fa74cc41424efe4802aba917e6b7e25bda2d93b15511fbae8c982903d442

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp310-cp310-win_amd64.whl.

File metadata

  • Download URL: arcticdb-6.20.0-cp310-cp310-win_amd64.whl
  • Upload date:
  • Size: 9.6 MB
  • Tags: CPython 3.10, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.12

File hashes

Hashes for arcticdb-6.20.0-cp310-cp310-win_amd64.whl
Algorithm Hash digest
SHA256 b6127fd70ec3bb0dd0a9b577626d157251ca224f2870ace6310198dc55cf567a
MD5 44f0f295f0e2e4529111e573fd9c453f
BLAKE2b-256 405cd83d949b3570e49d0010f5fe26aa4fe16234fc8ea10541f7fdd35dc75f98

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for arcticdb-6.20.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 d7428cf47d6ad9dc4c70e0ba649a64fd00ff97a2c84136a7bf9e4798c0c01fd4
MD5 3dc765b082b90b4b3cc9ef797d79e04f
BLAKE2b-256 cc5bfa50b3f4ae4f8070b188ae39121b584c51d5ffb8031b98d3fb415122c53e

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp310-cp310-macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for arcticdb-6.20.0-cp310-cp310-macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 713abe24b301de11af5fc4af889db7617cda9c55451a19840a4c1812b3b3274c
MD5 7e966dd6e8aac1efe16aede82684040f
BLAKE2b-256 12ca087b77374f9aa7a987252766c11b7338e89dd322ff31d77e7cd6d405d6f5

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp39-cp39-win_amd64.whl.

File metadata

  • Download URL: arcticdb-6.20.0-cp39-cp39-win_amd64.whl
  • Upload date:
  • Size: 9.6 MB
  • Tags: CPython 3.9, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.10.12

File hashes

Hashes for arcticdb-6.20.0-cp39-cp39-win_amd64.whl
Algorithm Hash digest
SHA256 413a2397f6341d25373c67aa3673f4e86759a7b52f4f5ded58bdd5374e57a1bf
MD5 7105f54df3f3c37c34cb0d0345d9fd73
BLAKE2b-256 fe4f5f4db9cf1eaf6b6012dcec23047bf4e20115b0eacde840a1fd0d7d8e870b

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for arcticdb-6.20.0-cp39-cp39-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 b779a67234d6818eec06ec64b8dd7516b2a64de122a83526b36b561b6629cac5
MD5 4791c619d49ca3736a5790f83dbe5fec
BLAKE2b-256 326b24f195d0c5dcb433be7fb381227109695cfc5f14ddb2da162f4d8ff90163

See more details on using hashes here.

File details

Details for the file arcticdb-6.20.0-cp39-cp39-macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for arcticdb-6.20.0-cp39-cp39-macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 62b5aa6fd01dda4f40b1a71ce542aab5330daef32e1d69df02cfede30467fb0f
MD5 3d42b2c1598b54124eac9bcdb375a733
BLAKE2b-256 6d810bdaa5d5e85c2bcda16206f5608cb1a8d6fed53f8879180b69305aaa1bf3

See more details on using hashes here.

Release history Release notifications | RSS feed

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page