EverlyAI¶

如果您在colab上打开这个笔记本，您可能需要安装LlamaIndex 🦙。

In [ ]:

%pip install llama-index-llms-everlyai

%pip install llama-index-llms-everlyai

In [ ]:

!pip install llama-index

!pip install llama-index

In [ ]:

from llama_index.llms.everlyai import EverlyAI
from llama_index.core.llms import ChatMessage

from llama_index.llms.everlyai import EverlyAI from llama_index.core.llms import ChatMessage

使用chat函数与ChatMessage列表交互¶

您需要设置环境变量EVERLYAI_API_KEY或在类构造函数中设置api_key

In [ ]:

# 导入 os 模块# 设置环境变量 EVERLYAI_API_KEY 为 '<your-api-key>'llm = EverlyAI(api_key="your-api-key")

# 导入 os 模块# 设置环境变量 EVERLYAI_API_KEY 为 ''llm = EverlyAI(api_key="your-api-key")

In [ ]:

message = ChatMessage(role="user", content="Tell me a joke")
resp = llm.chat([message])
print(resp)

message = ChatMessage(role="user", content="Tell me a joke") resp = llm.chat([message]) print(resp)

assistant:  Sure! Here's a classic one:

Why don't scientists trust atoms?

Because they make up everything!

I hope that brought a smile to your face!

流式处理¶

In [ ]:

message = ChatMessage(role="user", content="Tell me a story in 250 words")
resp = llm.stream_chat([message])
for r in resp:
    print(r.delta, end="")

message = ChatMessage(role="user", content="Tell me a story in 250 words") resp = llm.stream_chat([message]) for r in resp: print(r.delta, end="")

 Sure, here is a story in 250 words:

As the sun set over the horizon, a young girl named Lily sat on the beach, watching the waves roll in. She had always loved the ocean, and today was no different. The water was a deep blue, almost purple, and the waves were gentle and soothing. Lily closed her eyes and let the sound of the waves wash over her, feeling the stress of her daily life melt away.
Suddenly, a seagull landed nearby, chirping and flapping its wings. Lily opened her eyes and saw the bird was holding something in its beak. Curious, she leaned forward and saw that the bird was carrying a small, shimmering shell. The bird dropped the shell at Lily's feet, and she picked it up, feeling its smooth surface and admiring its beauty.
As she held the shell, Lily felt a strange sensation wash over her. She felt connected to the ocean and the bird, and she knew that this moment was special. She looked out at the water and saw a school of fish swimming in the distance, their scales shimmering in the sun

使用Prompt调用complete¶

In [ ]:

resp = llm.complete("Tell me a joke")
print(resp)

resp = llm.complete("Tell me a joke") print(resp)

 Sure, here's a classic one:

Why don't scientists trust atoms?

Because they make up everything!

I hope that brought a smile to your face!

In [ ]:

resp = llm.stream_complete("Tell me a story in 250 words")
for r in resp:
    print(r.delta, end="")

resp = llm.stream_complete("Tell me a story in 250 words") for r in resp: print(r.delta, end="")

 Sure, here is a story in 250 words:

As the sun set over the horizon, a young girl named Maria sat on the beach, watching the waves roll in. She had always loved the ocean, and today was no different. The water was a deep blue, almost purple, and the waves were gentle and soothing.
Maria closed her eyes and let the sound of the waves wash over her. She could feel the sand beneath her feet, warm and soft. She felt at peace, like she was a part of something bigger than herself.
Suddenly, a seagull landed nearby, chirping and flapping its wings. Maria opened her eyes and saw the bird, and she felt a smile spread across her face. She loved the sound of the seagulls, and the way they seemed to know exactly when to appear.
As the sun dipped lower in the sky, Maria stood up and walked closer to the water. She felt the cool water wash over her feet, and she let out a contented sigh. This was her happy place, where she could escape the stresses of everyday life and just be.
Maria stayed there for a while