Skip to main content

speedy, performant and small tool calling agents

Project description

tiny-agent-α

Installation

To install the package run: (Best for CPU inference)

pip install dria_agent

To use MLX as backend for macOS.

pip install 'dria_agent[mlx]'

For HuggingFace backend for GPU.

pip install 'dria_agent[huggingface]'

In order to use extra tooling select a backend (e.g. mlx) and run:

pip install 'dria_agent[mlx, tools]'

Models

Model Description HF Download Link Ollama Tag Size
Tiny-Agent-a-3B (8bit) High performance and reasoning Download driaforall/tiny-agent-a:3B-q8_0 3.3 GB
Tiny-Agent-a-3B (4bit) Tradeoff 3B quality for memory Download driaforall/tiny-agent-a:3B-q4_K_M 1.9 GB
Tiny-Agent-a-1.5B (8bit) Balanced performance and speed Download driaforall/tiny-agent-a:1.5B-q8_0 1.6 GB
Tiny-Agent-a-1.5B (4bit) Faster CPU inference, performance tradeoff Download driaforall/tiny-agent-a:1.5B-q4_K_M 986 MB
Tiny-Agent-a-0.5B (8bit) Ultra-light Download driaforall/tiny-agent-a:0.5B-q8_0 531 MB

a fast and powerful tool calling model designed to run on edge devices.

3B 8bit high performance and quality download

3B 4bit balanced performance and speed download

1.5B 8bit fast CPU inference download

1.5B 4bit faster CPU inference download

0.5B 8bit ultra-light download

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dria_agent-0.1.53.tar.gz (80.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dria_agent-0.1.53-py3-none-any.whl (39.0 kB view details)

Uploaded Python 3

File details

Details for the file dria_agent-0.1.53.tar.gz.

File metadata

  • Download URL: dria_agent-0.1.53.tar.gz
  • Upload date:
  • Size: 80.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.12.5 Darwin/23.6.0

File hashes

Hashes for dria_agent-0.1.53.tar.gz
Algorithm Hash digest
SHA256 394f1b08a4be6dd3247b4883f16d165805f71934d908cf8a2f68e1179cc5ce00
MD5 ac779906ee84d1f14a722311fe695f6a
BLAKE2b-256 30e62695e0085901c35f6ce571ebcb3fc0a585eb5647c486ec24fae05d16837a

See more details on using hashes here.

File details

Details for the file dria_agent-0.1.53-py3-none-any.whl.

File metadata

  • Download URL: dria_agent-0.1.53-py3-none-any.whl
  • Upload date:
  • Size: 39.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.12.5 Darwin/23.6.0

File hashes

Hashes for dria_agent-0.1.53-py3-none-any.whl
Algorithm Hash digest
SHA256 3af0ea85045dfb2ead47fee436f1465499349e2a54053b0d1ac6c35123f57adc
MD5 d120a74ea1472c7fc8666ae8b03323df
BLAKE2b-256 ee7791c94561e1fe7db385370d95f92aaed5e3f21b4465f64737bdc0eac5dcef

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page