阿里云PAI EAS

阿里云的人工智能机器学习平台是一个面向企业和开发者的机器学习或深度学习工程平台。它提供了易于使用、成本效益高、性能优越且易于扩展的插件，适用于各种行业场景。内置超过140种优化算法，Machine Learning Platform for AI提供了全流程的人工智能工程能力，包括数据标注（PAI-iTAG）、模型构建（PAI-Designer 和 PAI-DSW）、模型训练（PAI-DLC）、编译优化和推理部署（PAI-EAS）。PAI-EAS支持不同类型的硬件资源，包括CPU和GPU，具有高吞吐量和低延迟的特点。它允许您通过几次点击部署大规模复杂模型，并实时进行弹性扩展和缩减。它还提供了全面的运维和监控系统。

##Installing the langchain packages needed to use the integration
%pip install -qU langchain-community

from langchain.chains import LLMChain
from langchain_community.llms.pai_eas_endpoint import PaiEasEndpoint
from langchain_core.prompts import PromptTemplate

template = """Question: {question}

Answer: Let's think step by step."""

prompt = PromptTemplate.from_template(template)

API Reference:LLMChain | PaiEasEndpoint | PromptTemplate

想要使用EAS LLMs的人必须先设置EAS服务。当EAS服务启动时，可以获取EAS_SERVICE_URL和EAS_SERVICE_TOKEN。用户可以参考https://www.alibabacloud.com/help/en/pai/user-guide/service-deployment/获取更多信息，

import os

os.environ["EAS_SERVICE_URL"] = "Your_EAS_Service_URL"
os.environ["EAS_SERVICE_TOKEN"] = "Your_EAS_Service_Token"
llm = PaiEasEndpoint(
    eas_service_url=os.environ["EAS_SERVICE_URL"],
    eas_service_token=os.environ["EAS_SERVICE_TOKEN"],
)

llm_chain = prompt | llm

question = "What NFL team won the Super Bowl in the year Justin Beiber was born?"
llm_chain.invoke({"question": question})

'  Thank you for asking! However, I must respectfully point out that the question contains an error. Justin Bieber was born in 1994, and the Super Bowl was first played in 1967. Therefore, it is not possible for any NFL team to have won the Super Bowl in the year Justin Bieber was born.\n\nI hope this clarifies things! If you have any other questions, please feel free to ask.'

LLM 概念指南
LLM how-to guides

相关​

这个页面有帮助吗？

相关