Skip to main content

Chaiverse

Project description

Chaiverse Banner

PyPI version first-timers-only Friendly Pull Requests Welcome

$1M LLM Prize Hosted By

Chai Logo Chai Logo

Chaiverse is part of the Chai Prize Competition, accelerating community AGI.

It's the world's first open community challenge with real-user evaluations. You models will be directly deployed on the Chai App where our over 500K daily active users will be providing live feedback. Get to top of the leaderboard and share the $1 million cash prize!

🚀 Quick Start with Colab

  1. Join the Chaiverse Discord, our bot will greet you and give you a developer key 🥳
  2. Submit a model in < 10 minutes with Chaiverse Jupyter Notebook Quickstart
  3. Run through our Chaiverse Prompt Engineering Guide to submit models with custom prompts
  4. Run through our Chaiverse: Reward Model Guide to submit reward models! ❤️
  5. Run through our Chaiverse: Blend Model Guide to submit blended models!
  6. Take a look at our #new-joiners #dataset-sharing and #ai-discussions channels for easter eggs

📼 Local Installation

  1. Run pip install chaiverse
  2. Read through examples shown in the "Quick Start with Colab" section

:keyboard: Chaiverse CLI

You can also interact with Chaiverse directly from your terminal using Chaiverse CLI. Read through our user guide for instructions.

🧠 How Does It Work?

  • The chaiverse pip package provides a way to easily submit your language model, all you need to do is ensure it is on HuggingFace 🤗
  • We will automatically Tritonize your model for fast inference and host it in our internal GPU cluster 🚀
  • Once deployed, Chai users on our platform who enter the arena mode will be rating your model directly, providing you with both quantatitive and verbal feedback 📈
  • Both the public leaderboard and user feedback for your model can be directly downloaded via the chaiverse package 🧠
  • Cash prizes will be allocated according to your position in the leaderboard 💰

Chai Pipeline

Resources

🤗 Chai Huggingface Tons of models / datasets for you to finetune on! Including past winner solutions
📒 Fine tuning guide Guide on language model finetuning
💾 Datasets Curated list of open-sourced datasets to get started with finetuning
💖 Chaiverse Discord Our Chaiverse Competition discord
🚀 Deepspeed Guide Guide for training with Deepspeed (faster training without GPU bottleneck)
💬 Example Conversations Here you can find 100 example conversations from the Chai Platform
⚒️ Build with us If you think what we are building is cool, join us!
Competition EULA Covers terms of use and competition agreements

CHAI RESEARCH CORP. COMPETITION END USER LICENSE AGREEMENT (EULA)

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

chaiverse-1.15.45.tar.gz (48.6 kB view details)

Uploaded Source

File details

Details for the file chaiverse-1.15.45.tar.gz.

File metadata

  • Download URL: chaiverse-1.15.45.tar.gz
  • Upload date:
  • Size: 48.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.8.18

File hashes

Hashes for chaiverse-1.15.45.tar.gz
Algorithm Hash digest
SHA256 a835fba682f7d43e657b21c0077ce87ac7243f6fefaf421e6ba6d49c24e13383
MD5 f8f88bfb923fb998950c99ed145e9d1f
BLAKE2b-256 50e1a3b2e58677f1857006c90b1a5ff778be1d3c5b95339e5b6b79fd7c242856

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page