langchain-commoncompute 0.1.0

LangChain provider for Common Compute — plug Apple-Silicon-powered LLMs and embeddings into your LangChain app.

langchain-commoncompute

LangChain provider for Common Compute.

pip install langchain-commoncompute

from langchain_commoncompute import CommonComputeChat, CommonComputeEmbeddings
from langchain_core.prompts import ChatPromptTemplate

llm = CommonComputeChat(model="qwen-2.5-7b")
emb = CommonComputeEmbeddings(model="bge-small")

prompt = ChatPromptTemplate.from_messages([("user", "Summarize: {doc}")])
chain = prompt | llm
print(chain.invoke({"doc": "Common Compute runs AI on idle Macs."}).content)

Streaming is supported natively:

for chunk in llm.stream("Write a haiku about Apple Silicon."):
    print(chunk.content, end="", flush=True)

Set CC_API_KEY in your environment (or pass api_key=... to either class).