Skip to main content
Open In ColabOpen on GitHub

Together AI

caution

您当前所在的页面记录了Together AI模型作为文本完成模型的使用。许多流行的Together AI模型是聊天完成模型。

你可能在寻找这个页面。

Together AI 提供了一个API，可以用几行代码查询50多个领先的开源模型。

本示例介绍了如何使用LangChain与Together AI模型进行交互。

安装​

%pip install --upgrade langchain-together

环境​

要使用Together AI，您需要一个API密钥，您可以在这里找到： https://api.together.ai/settings/api-keys。这可以作为初始化参数 together_api_key传递，或者设置为环境变量TOGETHER_API_KEY。

示例​

# Querying chat models with Together AI

from langchain_together import ChatTogether

# choose from our 50+ models here: https://docs.together.ai/docs/inference-models
chat = ChatTogether(
    # together_api_key="YOUR_API_KEY",
    model="meta-llama/Llama-3-70b-chat-hf",
)

# stream the response back from the model
for m in chat.stream("Tell me fun things to do in NYC"):
    print(m.content, end="", flush=True)

# if you don't want to do streaming, you can use the invoke method
# chat.invoke("Tell me fun things to do in NYC")
API Reference:ChatTogether
# Querying code and language models with Together AI

from langchain_together import Together

llm = Together(
    model="codellama/CodeLlama-70b-Python-hf",
    # together_api_key="..."
)

print(llm.invoke("def bubble_sort(): "))
API Reference:Together

这个页面有帮助吗？