OpenLM
OpenLM 是一个零依赖的 OpenAI 兼容的 LLM 提供者，可以直接通过 HTTP 调用不同的推理端点。
它实现了OpenAI的Completion类，因此可以作为OpenAI API的直接替代品使用。此更改集利用BaseOpenAI以最小化添加的代码。
本示例介绍了如何使用LangChain与OpenAI和HuggingFace进行交互。您需要两者的API密钥。
设置
安装依赖项并设置API密钥。
# Uncomment to install openlm and openai if you haven't already
%pip install --upgrade --quiet openlm
%pip install --upgrade --quiet langchain-openai
import os
from getpass import getpass
# Check if OPENAI_API_KEY environment variable is set
if "OPENAI_API_KEY" not in os.environ:
print("Enter your OpenAI API key:")
os.environ["OPENAI_API_KEY"] = getpass()
# Check if HF_API_TOKEN environment variable is set
if "HF_API_TOKEN" not in os.environ:
print("Enter your HuggingFace Hub API key:")
os.environ["HF_API_TOKEN"] = getpass()
使用 LangChain 与 OpenLM
在这里，我们将在LLMChain中调用两个模型，分别是来自OpenAI的text-davinci-003和HuggingFace上的gpt2。
from langchain.chains import LLMChain
from langchain_community.llms import OpenLM
from langchain_core.prompts import PromptTemplate
question = "What is the capital of France?"
template = """Question: {question}
Answer: Let's think step by step."""
prompt = PromptTemplate.from_template(template)
for model in ["text-davinci-003", "huggingface.co/gpt2"]:
llm = OpenLM(model=model)
llm_chain = LLMChain(prompt=prompt, llm=llm)
result = llm_chain.run(question)
print(
"""Model: {}
Result: {}""".format(model, result)
)
Model: text-davinci-003
Result: France is a country in Europe. The capital of France is Paris.
Model: huggingface.co/gpt2
Result: Question: What is the capital of France?
Answer: Let's think step by step. I am not going to lie, this is a complicated issue, and I don't see any solutions to all this, but it is still far more