Skip to main content

Mixpeek Python SDK

Project description

Mixpeek Python SDK

This SDK provides easy access to the Mixpeek API for Python developers.

Installation

pip install mixpeek

Usage

First, import and initialize the Mixpeek client:

from mixpeek import Mixpeek

client = Mixpeek(api_key="your_api_key_here")

Embed

The embed module provides methods for embedding various types of data.

Video Embedding

response = client.embed.video(model_id="model_id", input="video_data", input_type="base64")
  • model_id (str): The ID of the model to use for embedding.
  • input (str): The video data or URL.
  • input_type (str): Either "base64" or "url".

Text Embedding

response = client.embed.text(model_id="model_id", input="text_to_embed", input_type="text")
  • model_id (str): The ID of the model to use for embedding.
  • input (str): The text to embed.
  • input_type (str): Should be "text".

Image Embedding

response = client.embed.image(model_id="model_id", input="image_data", input_type="base64")
  • model_id (str): The ID of the model to use for embedding.
  • input (str): The image data or URL.
  • input_type (str): Either "base64" or "url".

Audio Embedding

response = client.embed.audio(model_id="model_id", input="audio_data", input_type="base64")
  • model_id (str): The ID of the model to use for embedding.
  • input (str): The audio data or URL.
  • input_type (str): Either "base64" or "url".

Index

The index module provides methods for indexing various types of content.

Upload File

with open("file.txt", "rb") as file:
    response = client.index.upload(file=file, collection_id="collection_id", metadata={"key": "value"}, settings={"video": {"transcribe": True}})
  • file (file object): The file to upload.
  • collection_id (str): The ID of the collection to add the file to.
  • metadata (dict, optional): Additional metadata for the file.
  • settings (dict, optional): Processing settings for the file.

Index URL

response = client.index.url(url="https://example.com", collection_id="collection_id", metadata={"key": "value"}, settings={"image": {"caption_model_id": "model_id"}})
  • url (str): The URL to index.
  • collection_id (str): The ID of the collection to add the content to.
  • metadata (dict, optional): Additional metadata for the content.
  • settings (dict, optional): Processing settings for the content.

Index YouTube Video

response = client.index.youtube(youtube_video_id="video_id", collection_id="collection_id", metadata={"key": "value"}, settings={"video": {"transcribe": True}})
  • youtube_video_id (str): The ID of the YouTube video to index.
  • collection_id (str): The ID of the collection to add the video to.
  • metadata (dict, optional): Additional metadata for the video.
  • settings (dict, optional): Processing settings for the video.

Search YouTube

response = client.index.youtube_search(query="search query", collection_id="collection_id", max_results=20, metadata={"key": "value"}, shorts_only=False)
  • query (str): The search query for YouTube videos.
  • collection_id (str): The ID of the collection to add the search results to.
  • max_results (int, optional): Maximum number of results to return (default: 10, max: 500).
  • metadata (dict, optional): Additional metadata for the search results.
  • shorts_only (bool, optional): Whether to search for YouTube Shorts only (default: False).

Search

The search module provides methods for searching indexed content.

Text Search

response = client.search.text(input="search query", modality="text", input_type="text", filters={"key": "value"}, group_by_file=True, page=1, page_size=10)
  • input (str): The search query or input data.
  • modality (str): The modality of the search (e.g., "text", "image", "video", "audio").
  • input_type (str, optional): The type of input (default: "text").
  • filters (dict, optional): Additional filters for the search.
  • group_by_file (bool, optional): Whether to group results by file (default: True).
  • page (int, optional): The page number for pagination (default: 1).
  • page_size (int, optional): The number of results per page (default: 10).

Upload Search

with open("query_image.jpg", "rb") as file:
    response = client.search.upload(file=file, filters={"key": "value"}, page=1, page_size=10)
  • file (file object): The file to use as a search query.
  • filters (dict, optional): Additional filters for the search.
  • page (int, optional): The page number for pagination (default: 1).
  • page_size (int, optional): The number of results per page (default: 10).

URL Search

response = client.search.url(url="https://example.com/image.jpg", input_type="file", filters={"key": "value"}, modality="image", page=1, page_size=10)
  • url (str): The URL of the file to use as a search query.
  • input_type (str, optional): The type of input (default: "file").
  • filters (dict, optional): Additional filters for the search.
  • modality (str, optional): The modality of the search (default: "text").
  • page (int, optional): The page number for pagination (default: 1).
  • page_size (int, optional): The number of results per page (default: 10).

Collections

The collections module provides methods for managing collections and files.

List Files

response = client.collections.list_files(collection_id="collection_id", randomize=False, page=1, page_size=10, filters={"key": "value"}, sort_by="created_at", sort_order="desc")
  • collection_id (str): The ID of the collection to list files from.
  • randomize (bool, optional): Whether to randomize the results (default: False).
  • page (int, optional): The page number for pagination (default: 1).
  • page_size (int, optional): The number of results per page (default: 10).
  • filters (dict, optional): Additional filters for the file list.
  • sort_by (str, optional): The field to sort by.
  • sort_order (str, optional): The sort order, either "asc" or "desc" (default: "asc").

List Collections

response = client.collections.list_collections()

Search Files

response = client.collections.search_files(query="search query", collection_id="collection_id", page=1, page_size=10, sort_by="relevance", sort_order="desc")
  • query (str): The search query for files within the collection.
  • collection_id (str): The ID of the collection to search in.
  • page (int, optional): The page number for pagination (default: 1).
  • page_size (int, optional): The number of results per page (default: 10).
  • sort_by (str, optional): The field to sort by.
  • sort_order (str, optional): The sort order, either "asc" or "desc" (default: "asc").

Get File by ID

response = client.collections.get_file_by_id(file_id="file_id")
  • file_id (str): The ID of the file to retrieve.

Delete File by ID

response = client.collections.delete_file_by_id(file_id="file_id")
  • file_id (str): The ID of the file to delete.

Delete Collection

response = client.collections.delete_collection(collection_id="collection_id")
  • collection_id (str): The ID of the collection to delete.

Tools

The tools module provides utility functions for processing various types of data before embedding or indexing.

Video Processing

The video tool allows you to process video files or URLs into chunks for easier embedding.

from mixpeek import Mixpeek

mixpeek = Mixpeek('your_api_key_here')

video_url = "https://example.com/video.mp4"

# Process video chunks, this runs locally
processed_chunks = mixpeek.tools.video.process(
    video_source=video_url,
    chunk_interval=1,
    resolution=[720, 1280]
)

# Embed each chunk
results = []
for index, chunk in enumerate(processed_chunks):
    print(f"Processing video chunk: {index}")

    embedding = mixpeek.embed.video(
        model_id="vuse-generic-v1",
        input=chunk['base64_chunk'],
        input_type="base64"
    )['embedding']

    result = {
        "start_time": chunk["start_time"],
        "end_time": chunk["end_time"],
        "embedding": embedding
    }
    results.append(result)
    print(f"  Embedding preview: {embedding[:5] + ['...'] + embedding[-5:]}")
    print("Insert into DB here")

print(f"Processed {len(results)} chunks")

Parameters for mixpeek.tools.video.process:

  • video_source (str): URL or file path of the video to process.
  • chunk_interval (float): Duration of each video chunk in seconds.
  • resolution (list): Desired resolution of the video chunks as [height, width].

The process method returns a list of dictionaries, each containing:

  • start_time (float): Start time of the chunk in seconds.
  • end_time (float): End time of the chunk in seconds.
  • base64_chunk (str): Base64-encoded video chunk.

This tool is particularly useful when you need to embed long videos, as it allows you to process the video in smaller chunks and embed each chunk separately.

Register

The register module provides methods for registering various types of data, such as faces for facial recognition.

Face Registration

from mixpeek import Mixpeek

# Initialize the Mixpeek client
mixpeek = Mixpeek(api_key="your_api_key_here")

# Path to the local image file containing faces
face_image_path = "/path/to/your/face_image.jpg"

# Start the face registration task
task = mixpeek.register.faces(
    file_path=face_image_path,
    collection_id="face-recognition-collection",
    metadata={"name": "John Doe", "age": 30},
    settings={"detection_threshold": 0.8}
)

# Define a callback function (optional)
def on_task_update(status):
    print(f"Current task status: {status}")

# Wait for the task to complete
status = task.wait_for_done(
    sleep_interval=1,
    callback=on_task_update
)

print(f"Face registration completed with status: {status}")

# If you want to do something with the final result
if status.get("status") == "DONE":
    result = status.get("result")
    print("Face registration result:", result)
else:
    print("Face registration failed or was interrupted")

Parameters for mixpeek.register.faces:

  • file_path (str): Path to the local image file containing faces to register.
  • collection_id (str): The ID of the collection to add the registered faces to.
  • metadata (dict, optional): Additional metadata for the registered faces.
  • settings (dict, optional): Processing settings for face registration.

The faces method returns a Task object that allows you to monitor the progress of the face registration process.

Response Format

All methods return a JSON response. In case of an error, the response will contain an "error" key with a description of the error.

Error Handling

The SDK handles HTTP errors and returns them in the response. You should always check for the presence of an "error" key in the response before processing the results.

response = client.embed.text(model_id="model_id", input="text_to_embed", input_type="text")
if "error" in response:
    print(f"An error occurred: {response['error']}")
else:
    # Process the successful response
    print(response)

Rate Limiting

The Mixpeek API may have rate limits. If you encounter rate limiting errors, you should implement appropriate backoff and retry logic in your application.

Support

For any issues or questions, please contact Mixpeek support or refer to the official API documentation.


Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mixpeek-0.8.42.tar.gz (11.2 kB view details)

Uploaded Source

Built Distribution

mixpeek-0.8.42-py3-none-any.whl (10.8 kB view details)

Uploaded Python 3

File details

Details for the file mixpeek-0.8.42.tar.gz.

File metadata

  • Download URL: mixpeek-0.8.42.tar.gz
  • Upload date:
  • Size: 11.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.20

File hashes

Hashes for mixpeek-0.8.42.tar.gz
Algorithm Hash digest
SHA256 36df9de6eae27f543d3fa245e9807a2a4d3a5642951969e7b6eea3a3a3d18339
MD5 0766c4fcc9e48cb0591d42f5c4926947
BLAKE2b-256 6554aed1a7416f2a952e3b36a424e80dca5094910b4dd8c3c4c52bedf0deb65b

See more details on using hashes here.

File details

Details for the file mixpeek-0.8.42-py3-none-any.whl.

File metadata

  • Download URL: mixpeek-0.8.42-py3-none-any.whl
  • Upload date:
  • Size: 10.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.20

File hashes

Hashes for mixpeek-0.8.42-py3-none-any.whl
Algorithm Hash digest
SHA256 24dc25ad8343707a5b55eb41fd5075e8115ff567aeadab40e39c7e85de4a5581
MD5 404fd32604d40bfec09f17e3ba74e696
BLAKE2b-256 b64c3ab86a41cf2b251fe191894d69c84b943dd47de72f9d2529e329936e1091

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page