OctoAI¶
OctoAI是一个强大的人工智能工具,可以用于处理各种任务和项目。它提供了许多功能和工具,可以帮助用户更高效地完成工作。 OctoAI支持自然语言处理、机器学习、数据分析和其他人工智能领域的功能。
如果您在Colab上打开这个笔记本,您可能需要安装LlamaIndex 🦙。
In [ ]:
Copied!
%pip install llama-index-llms-octoai
%pip install llama-index
%pip install octoai-sdk
%pip install llama-index-llms-octoai
%pip install llama-index
%pip install octoai-sdk
In [ ]:
Copied!
OCTOAI_API_KEY = ""
OCTOAI_API_KEY = ""
初始化与默认模型的集成¶
In [ ]:
Copied!
from llama_index.llms.octoai import OctoAI
octoai = OctoAI(token=OCTOAI_API_KEY)
from llama_index.llms.octoai import OctoAI
octoai = OctoAI(token=OCTOAI_API_KEY)
使用提示调用complete
¶
In [ ]:
Copied!
response = octoai.complete("Paul Graham is ")
print(response)
response = octoai.complete("Paul Graham is ")
print(response)
使用消息列表调用chat
¶
In [ ]:
Copied!
from llama_index.core.llms import ChatMessage
messages = [
ChatMessage(
role="system",
content="Below is an instruction that describes a task. Write a response that appropriately completes the request.",
),
ChatMessage(role="user", content="Write a blog about Seattle"),
]
response = octoai.chat(messages)
print(response)
from llama_index.core.llms import ChatMessage
messages = [
ChatMessage(
role="system",
content="Below is an instruction that describes a task. Write a response that appropriately completes the request.",
),
ChatMessage(role="user", content="Write a blog about Seattle"),
]
response = octoai.chat(messages)
print(response)
流式处理¶
使用 stream_complete
终端点
In [ ]:
Copied!
response = octoai.stream_complete("Paul Graham is ")
for r in response:
print(r.delta, end="")
response = octoai.stream_complete("Paul Graham is ")
for r in response:
print(r.delta, end="")
使用stream_chat
与消息列表
In [ ]:
Copied!
from llama_index.core.llms import ChatMessage
messages = [
ChatMessage(
role="system",
content="Below is an instruction that describes a task. Write a response that appropriately completes the request.",
),
ChatMessage(role="user", content="Write a blog about Seattle"),
]
response = octoai.stream_chat(messages)
for r in response:
print(r.delta, end="")
from llama_index.core.llms import ChatMessage
messages = [
ChatMessage(
role="system",
content="Below is an instruction that describes a task. Write a response that appropriately completes the request.",
),
ChatMessage(role="user", content="Write a blog about Seattle"),
]
response = octoai.stream_chat(messages)
for r in response:
print(r.delta, end="")
配置模型¶
In [ ]:
Copied!
# 自定义您的API令牌,可以这样做
# 否则它将查找您环境变量中的OCTOAI_TOKEN
octoai = OctoAI(
model="mistral-7b-instruct", max_tokens=128, token=OCTOAI_API_KEY
)
response = octoai.complete("Paul Graham is ")
print(response)
# 自定义您的API令牌,可以这样做
# 否则它将查找您环境变量中的OCTOAI_TOKEN
octoai = OctoAI(
model="mistral-7b-instruct", max_tokens=128, token=OCTOAI_API_KEY
)
response = octoai.complete("Paul Graham is ")
print(response)