Jina is the cloud-native neural search solution powered by the state-of-the-art AI and deep learning
Project description
Cloud-Native Neural Search Framework for Any Kind of Data
👋 Click here to see quick demo!
|
|
|
Image search | QA chatbot | Multi-media search |
---|
Jina is geared towards building search systems for any kind of data, including text, images, audio, video and many more. With the modular design & multi-layer abstraction, you can leverage the efficient patterns to build the system by parts, or chaining them into a Flow for an end-to-end experience.
🌌 Search anything - Large-scale indexing and querying of unstructured data: video, image, long/short text, music, source code, etc.
⏱️ Save time - The design pattern of neural search systems, from zero to a production-ready system in minutes.
🍱 Own your stack - Keep an end-to-end stack ownership of your solution, avoid the integration pitfalls with fragmented, multi-vendor, generic legacy tools.
🧠 First-class AI models - First-class support for state-of-the-art AI models, easily usable and extendable with a Pythonic interface.
🌩️ Fast & cloud-ready - Decentralized architecture from day one. Scalable & cloud-native by design: enjoy containerizing, distributing, sharding, async, REST/gRPC/WebSocket.
Installation
pip install -U jina
via Docker
docker run jinaai/jina:latest
📦 More installation options
x86/64,arm/v6,v7,v8 (Apple M1) |
On Linux/macOS & Python 3.7/3.8/3.9 | Docker Users |
---|---|---|
Standard | pip install -U jina |
docker run jinaai/jina:latest |
Daemon | pip install -U "jina[daemon]" |
docker run --network=host jinaai/jina:latest-daemon |
With Extras | pip install -U "jina[devel]" |
docker run jinaai/jina:latest-devel |
Dev/Pre-Release | pip install --pre jina |
docker run jinaai/jina:master |
Version identifiers are explained here. To install Jina with extra dependencies please refer to the docs. Jina can run on Windows Subsystem for Linux. We welcome the community to help us with native Windows support.
💡 YAML Completion in PyCharm & VSCode
Developing Jina app often means writing YAML configs. We provide a JSON Schema for your IDE to enable code completion, syntax validation, members listing and displaying help text. Here is a video tutorial to walk you through the setup.
Get Started
Cookbook
Bits, pieces and examples of Jina code
Run Quick Demo
- 👗 Fashion image search:
jina hello fashion
- 🤖 QA chatbot:
pip install "jina[chatbot]" && jina hello chatbot
- 📰 Multimedia search:
pip install "jina[multimodal]" && jina hello multimodal
The Basics
- What is neural search, and how is it different to symbolic search?
- Jina 101: Learn Jina's key components
- Jina 102: Learn how Jina's components fit together
- My First Jina App: Build your first simple app
Video Tutorials
|
|
|
Examples (View all)
📄 NLP Semantic Wikipedia Search with Transformers and DistilBERT
Brand new to neural search? See a simple text-search example to understand how Jina works
📄 Add Incremental Indexing to Wikipedia Search
Index more effectively by adding incremental indexing to your Wikipedia search
📄 Search Lyrics with Transformers and PyTorch
Get a better understanding of chunks by searching a lyrics database. Now with shiny front-end!
🖼️ Google's Big Transfer Model in (Poké-)Production
Use SOTA visual representation for searching Pokémon!
🎧 Search YouTube audio data with Vggish
A demo of neural search for audio data based Vggish model.
🎞️ Search Tumblr GIFs with KerasEncoder
Use prefetching and sharding to improve the performance of your index and query Flow when searching animated GIFs.
Check our examples repo for advanced and community-submitted examples.
Documentation & Support
- Docs: https://docs.jina.ai
- Join our Slack community to chat to our engineers about your use cases, questions, and support queries.
- Join our Engineering All Hands meet-up to discuss your use case and learn Jina's new features.
- When? The second Tuesday of every month
- Where? Zoom (calendar link/.ics) and live stream on YouTube
- Subscribe to the latest video tutorials on our YouTube channel.
Contributing
We welcome all kinds of contributions from the open-source community, individuals and partners. We owe our success to your active involvement.
- Contributing guidelines
- Code of conduct - play nicely with the Jina community
- Good first issues
- Release cycles and development stages
- Upcoming features - what's being planned, what we're thinking about.
<a href="https://git
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.