Skip to main content

A lightweight key-value database using SQLite and APSW.

Project description

FlashSQL

FlashSQL is a high-performance key-value store built on SQLite with support for optional expiration. It offers a simple and efficient interface for storing, retrieving, and managing key-value pairs with additional features like pagination and database optimization.

PyPI Version Python Version License

Features

  • SQLite-based: Utilizes SQLite for persistent storage.
  • In-memory Option: Supports in-memory databases for transient data.
  • Expiration Support: Allows setting an expiration time (TTL) for keys.
  • Efficient Storage: Optimized with PRAGMA settings for performance.
  • Flexible Key Management: Supports basic CRUD operations (Create, Read, Update, Delete) for keys.
  • Pattern Matching: Allows retrieval of keys based on patterns using SQL LIKE queries.
  • Pagination: Supports paginated retrieval of keys.
  • Database Optimization: Includes methods to clean up expired keys and optimize database file size.
  • Fast Access Times: Provides quick access to stored values with efficient querying and indexing.

Installation

You can install FlashSQL using pip:

pip install FlashSQL

Usage

Initialization

To initialize a new instance of FlashSQL Client, provide the file path to the SQLite database. Use ":memory:" for an in-memory database.

from FlashSQL import Client

# For a file-based database
db = Client('database.db')

# For an in-memory database
db = Client(':memory:')

Storing Values

Use the set method to store a value under a specific key. You can specify an expiration time (TTL) in seconds or leave it out for no expiration.

Without Expiration:

db.set('name', 'hexa')

With Expiration:

db.set('session', {'user': 'hexa'}, ttl=3600)  # Expires in 1 hour

Retrieving Values

Use the get method to retrieve the value associated with a key. If the key does not exist or has expired, None is returned.

value = db.get('name')
print(value)  # Output: 'hexa'

Deleting Values

Use the delete method to remove a key-value pair from the database.

db.delete('name')

Checking Key Existence

Use the exists method to check if a key is present and not expired.

exists = db.exists('name')
print(exists)  # Output: False (if the key was deleted)

Renaming Keys

Use the rename method to rename an existing key.

db.rename('old_key', 'new_key')

Retrieving Expiration Date

Use the get_expire method to get the expiration date of a key.

expire_date = db.get_expire('session')
print(expire_date)  # Output: ISO 8601 formatted expiration date or None

Setting Expiration Date

Use the set_expire method to set a new expiration time (TTL) for an existing key.

db.set_expire('session', ttl=7200)  # Expires in 2 hours

Retrieving Keys

Use the keys method to retrieve a list of keys matching a specified pattern.

keys = db.keys('%')
print(keys)  # Output: List of all keys

Pagination

Use the paginate method to retrieve a paginated list of keys matching a pattern.

paged_keys = db.paginate(pattern='key%', page=1, page_size=2)
print(paged_keys)  # Output: List of keys for the specified page

Counting Keys

Use the count method to count the total number of keys in the database.

total_keys = db.count()
print(total_keys)  # Output: Total number of keys

Counting Expired Keys

Use the count_expired method to count the number of expired keys.

expired_keys_count = db.count_expired()
print(expired_keys_count)  # Output: Number of expired keys

Cleaning Up Expired Keys

Use the cleanup method to remove expired key-value pairs from the database. This is called automatically before any retrieval or key-checking operation.

db.cleanup()

Optimizing Database File

Use the vacuum method to optimize the database file and reduce its size.

db.vacuum()

Ensuring Changes Are Written to Disk

Use the flush method to ensure all changes are written to disk by performing a full checkpoint of the WAL (Write-Ahead Log).

db.flush()

Executing Raw SQL

Use the execute method to execute a raw SQL statement and return the result.

Example:

results = db.execute("SELECT key FROM FlashDB WHERE key LIKE ?", ('key%',))
print(results)  # Output: Results of the raw SQL query

Closing the Database

Use the close method to close the database connection.

db.close()

Full Example

from FlashSQL import Client

# Initialize the database
db = Client(':memory:')

# Store values
db.set('name', 'hexa', ttl=3600)  # Expires in 1 hour
db.set('age', 30)

# Retrieve values
print(db.get('name'))  # Output: 'hexa' if within TTL
print(db.get('age'))   # Output: 30

# Check existence
print(db.exists('name'))  # Output: True if within TTL
print(db.exists('address'))  # Output: False (if the key does not exist)

# Retrieve keys with a pattern
print(db.keys('na%'))  # Output: ['name']

# Delete a key
db.delete('name')

# Close the database
db.close()

License

This project is licensed under the MIT License. See the LICENSE file for details.

Contributing

Contributions are welcome! Please submit pull requests or open issues to improve the functionality and performance of FlashSQL.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

flashsql-0.3.3.tar.gz (13.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

FlashSQL-0.3.3-py3-none-any.whl (7.2 kB view details)

Uploaded Python 3

File details

Details for the file flashsql-0.3.3.tar.gz.

File metadata

  • Download URL: flashsql-0.3.3.tar.gz
  • Upload date:
  • Size: 13.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.5

File hashes

Hashes for flashsql-0.3.3.tar.gz
Algorithm Hash digest
SHA256 a3bf2dda3a515688c243b0a5daa52d3abe77faf6bb0d1931a7fc658f4590e8aa
MD5 8f0c7bca833c5b73aae96ff26cb1161d
BLAKE2b-256 0f836e43940e4d9817bd07e6b5c9820254a2d00e8f30e4f92563a32d2a962681

See more details on using hashes here.

File details

Details for the file FlashSQL-0.3.3-py3-none-any.whl.

File metadata

  • Download URL: FlashSQL-0.3.3-py3-none-any.whl
  • Upload date:
  • Size: 7.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.5

File hashes

Hashes for FlashSQL-0.3.3-py3-none-any.whl
Algorithm Hash digest
SHA256 8be9c54188c62cb521c143b372cfd40b39833dae97da9e7a1db2739ce77ba75c
MD5 7d0c6172273478818125b124d1345731
BLAKE2b-256 215aa446c243fade03cfde223d64e9ecb58ffe4d01ead77a31fd00114a15165f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page