Deepinfra
DeepInfra¶
通过这个集成,你可以使用DeepInfra嵌入模型为你的文本数据获取嵌入。这是嵌入模型的链接。
首先,你需要在DeepInfra网站上注册并获取API令牌。你可以从模型卡中复制model_ids
并开始在你的代码中使用它们。
安装说明¶
In [ ]:
Copied!
!pip install llama-index llama-index-embeddings-deepinfra
!pip install llama-index llama-index-embeddings-deepinfra
初始化¶
In [ ]:
Copied!
from dotenv import load_dotenv, find_dotenv
from llama_index.embeddings.deepinfra import DeepInfraEmbeddingModel
_ = load_dotenv(find_dotenv())
model = DeepInfraEmbeddingModel(
model_id="BAAI/bge-large-en-v1.5", # 使用自定义模型ID
api_token="YOUR_API_TOKEN", # 可选择在此处提供令牌
normalize=True, # 可选的规范化
text_prefix="text: ", # 可选的文本前缀
query_prefix="query: ", # 可选的查询前缀
)
from dotenv import load_dotenv, find_dotenv
from llama_index.embeddings.deepinfra import DeepInfraEmbeddingModel
_ = load_dotenv(find_dotenv())
model = DeepInfraEmbeddingModel(
model_id="BAAI/bge-large-en-v1.5", # 使用自定义模型ID
api_token="YOUR_API_TOKEN", # 可选择在此处提供令牌
normalize=True, # 可选的规范化
text_prefix="text: ", # 可选的文本前缀
query_prefix="query: ", # 可选的查询前缀
)
同步请求¶
def get_text_embedding(text):
"""
Get the embedding for a given text.
Args:
text (str): The input text.
Returns:
embedding (np.array): The text embedding.
"""
# Implementation goes here
pass
In [ ]:
Copied!
response = model.get_text_embedding("hello world")
print(response)
response = model.get_text_embedding("hello world")
print(response)
批量请求
In [ ]:
Copied!
texts = ["hello world", "goodbye world"]
response_batch = model.get_text_embedding_batch(texts)
print(response_batch)
texts = ["hello world", "goodbye world"]
response_batch = model.get_text_embedding_batch(texts)
print(response_batch)
查询请求¶
In [ ]:
Copied!
query_response = model.get_query_embedding("hello world")
print(query_response)
query_response = model.get_query_embedding("hello world")
print(query_response)
异步请求¶
获取文本嵌入¶
In [ ]:
Copied!
async def main():
text = "hello world"
async_response = await model.aget_text_embedding(text)
print(async_response)
if __name__ == "__main__":
import asyncio
asyncio.run(main())
async def main():
text = "hello world"
async_response = await model.aget_text_embedding(text)
print(async_response)
if __name__ == "__main__":
import asyncio
asyncio.run(main())
如有任何问题或反馈,请通过feedback@deepinfra.com与我们联系。