Skip to main content

A Python library for various big data structures including graphs, trees, and more.

Project description

BigDataLib

BigDataLib is a Python library that provides direct implementations of various big data structures, allowing you to work with these structures efficiently using simple functions. This library includes support for graphs, trees, and more.

Features

  • Adjacency Matrix: Efficient representation and manipulation of graph edges.
  • Adjacency List: Lightweight representation of graph edges with fast access.
  • Trie (Prefix Tree): Fast prefix-based search and insertion for strings.
  • Segment Tree: Efficient range queries and updates.
  • Fenwick Tree (Binary Indexed Tree): Fast updates and prefix sum queries.
  • Red-Black Tree: Self-balancing binary search tree with efficient insertions and deletions.
  • AVL Tree: Self-balancing binary search tree maintaining height balance.
  • Skip List: Probabilistic data structure for fast search, insertion, and deletion.
  • B-Tree: Balanced tree used for efficient data retrieval in databases.
  • B+ Tree: Similar to B-Tree but with all values stored in leaf nodes.

Installation

You can install the library using pip:

pip install bigdata_lib

Usage

1.Adjacency Matrix

The adjacency matrix is a 2D array used to represent graph edges. It is memory-intensive but straightforward.

from bigdata_lib.adjacency_matrix import create_adjacency_matrix, add_edge_matrix, display_matrix

matrix = create_adjacency_matrix(5)
add_edge_matrix(matrix, 1, 2)
display_matrix(matrix)

2.Adjacency List

The adjacency list is a dictionary where keys are nodes and values are lists of adjacent nodes.

from bigdata_lib.adjacency_list import add_edge_list, display_list

graph = {}
add_edge_list(graph, 1, 2)
display_list(graph)

3.Trie (Prefix Tree)

A trie is a tree used for storing strings in a way that allows for fast retrieval of prefixes.

from bigdata_lib.trie_structure import Trie, TrieNode

trie = Trie()
trie.insert("example")
print(trie.search("example"))  # Output: True
print(trie.search("test"))     # Output: False

4.Segment Tree

A segment tree is used for storing intervals or segments, allowing efficient querying and updating.

from bigdata_lib.segment_tree import SegmentTree

arr = [1, 3, 5, 7, 9, 11]
segment_tree = SegmentTree(arr)
print(segment_tree.query(1, 3))  # Output: 15
segment_tree.update(1, 10)
print(segment_tree.query(1, 3))  # Output: 22

5.Fenwick Tree (Binary Indexed Tree)

A Fenwick Tree is used for efficient range queries and updates.

from bigdata_lib.fenwick_tree import FenwickTree

arr = [1, 3, 5, 7, 9, 11]
fenwick_tree = FenwickTree(arr)
print(fenwick_tree.query(3))  # Output: 16
fenwick_tree.update(1, 10)
print(fenwick_tree.query(3))  # Output: 26

6.Red-Black Tree

A Red-Black Tree is a self-balancing binary search tree with specific rules to ensure balanced height.

from bigdata_lib.red_black_tree import RedBlackTree

rb_tree = RedBlackTree()
rb_tree.insert(10)
rb_tree.insert(20)
rb_tree.insert(15)
# Implement traversal or other operations as needed

7.AVL Tree

An AVL Tree is a self-balancing binary search tree where the height difference between left and right subtrees is maintained.

from bigdata_lib.avl_tree import AVLTree

avl_tree = AVLTree()
root = None
root = avl_tree.insert(root, 10)
root = avl_tree.insert(root, 20)
root = avl_tree.insert(root, 15)
# Implement traversal or other operations as needed

8.Skip List

A Skip List is a probabilistic data structure that allows fast search, insertion, and deletion operations.

from bigdata_lib.skip_list import SkipList

skip_list = SkipList(max_level=3, p=0.5)
skip_list.insert(3)
skip_list.insert(6)
skip_list.insert(7)
print(skip_list.search(6))  # Output: True
print(skip_list.search(4))  # Output: False

9.B-Tree

A B-Tree is a balanced tree used for efficient data retrieval and insertion, often used in database systems.

from bigdata_lib.b_tree import BTree

b_tree = BTree(t=2)
b_tree.insert(10)
b_tree.insert(20)
b_tree.insert(5)
# Implement traversal or other operations as needed

10.B+ Tree

A B+ Tree is similar to a B-Tree but with all values stored in leaf nodes, allowing efficient range queries.

from bigdata_lib.bplus_tree import BPlusTree

bplus_tree = BPlusTree(t=2)
bplus_tree.insert(10)
bplus_tree.insert(20)
bplus_tree.insert(5)
# Implement traversal or other operations as needed

Contributing

Contributions are welcome! Please submit a pull request or open an issue to suggest improvements.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bigdata_lib-0.2.tar.gz (7.5 kB view details)

Uploaded Source

Built Distribution

bigdata_lib-0.2-py3-none-any.whl (8.4 kB view details)

Uploaded Python 3

File details

Details for the file bigdata_lib-0.2.tar.gz.

File metadata

  • Download URL: bigdata_lib-0.2.tar.gz
  • Upload date:
  • Size: 7.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.4

File hashes

Hashes for bigdata_lib-0.2.tar.gz
Algorithm Hash digest
SHA256 163d31655985f4e5286cc026ec6e9b9669249a02f3a4ef1db22176a8397d1831
MD5 af1b97f4622fb7874151840a8b366908
BLAKE2b-256 ad8ae06ef09888880fd8bf36e66893bdc13920708fa0846bb2b45340636da18f

See more details on using hashes here.

File details

Details for the file bigdata_lib-0.2-py3-none-any.whl.

File metadata

  • Download URL: bigdata_lib-0.2-py3-none-any.whl
  • Upload date:
  • Size: 8.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.4

File hashes

Hashes for bigdata_lib-0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 7bc1cc031a32c34b73349c152f4d0564e5f0502a09a53c78673464119f998495
MD5 f4d4b1c64ebb6e2ece8a9a62a1ad23d8
BLAKE2b-256 35494ba1fea2b93cadfbb4f0a9f4e73c40f23e4642bed3be63d3af5967004650

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page