ChatKonko
Konko
Konko API 是一个完全托管的 Web API，旨在帮助应用程序开发者：
- 选择适合其应用的开源或专有LLMs
- 构建应用程序更快，通过集成领先的应用程序框架和完全托管的API
- 微调 较小的开源LLMs，以极低的成本实现行业领先的性能
- 部署生产规模的API，使用Konko AI符合SOC 2标准的多云基础设施，无需设置或管理基础设施，即可满足安全、隐私、吞吐量和延迟的SLA要求
本示例介绍了如何使用LangChain与Konko ChatCompletion 模型进行交互
要运行此笔记本，您需要Konko API密钥。登录我们的网络应用程序以创建API密钥来访问模型
from langchain_community.chat_models import ChatKonko
from langchain_core.messages import HumanMessage, SystemMessage
设置环境变量
- 您可以设置环境变量
- KONKO_API_KEY (必填)
- OPENAI_API_KEY (可选)
- 在当前的 shell 会话中，使用 export 命令：
export KONKO_API_KEY={your_KONKO_API_KEY_here}
export OPENAI_API_KEY={your_OPENAI_API_KEY_here} #Optional
调用模型
在Konko概览页面上找到一个模型
另一种查找在Konko实例上运行的模型列表的方法是通过这个endpoint。
从这里，我们可以初始化我们的模型：
chat = ChatKonko(max_tokens=400, model="meta-llama/llama-2-13b-chat")
messages = [
SystemMessage(content="You are a helpful assistant."),
HumanMessage(content="Explain Big Bang Theory briefly"),
]
chat(messages)
AIMessage(content=" Sure thing! The Big Bang Theory is a scientific theory that explains the origins of the universe. In short, it suggests that the universe began as an infinitely hot and dense point around 13.8 billion years ago and expanded rapidly. This expansion continues to this day, and it's what makes the universe look the way it does.\n\nHere's a brief overview of the key points:\n\n1. The universe started as a singularity, a point of infinite density and temperature.\n2. The singularity expanded rapidly, causing the universe to cool and expand.\n3. As the universe expanded, particles began to form, including protons, neutrons, and electrons.\n4. These particles eventually came together to form atoms, and later, stars and galaxies.\n5. The universe is still expanding today, and the rate of this expansion is accelerating.\n\nThat's the Big Bang Theory in a nutshell! It's a pretty mind-blowing idea when you think about it, and it's supported by a lot of scientific evidence. Do you have any other questions about it?")