langchain_community.callbacks.infino_callback.get_num_tokens¶

langchain_community.callbacks.infino_callback.get_num_tokens(string: str, openai_model_name: str) int[source]¶

使用tiktoken包为OpenAI计算num tokens。

官方文档:https://github.com/openai/openai-cookbook/blob/main

/examples/How_to_count_tokens_with_tiktoken.ipynb

Parameters
  • string (str) –

  • openai_model_name (str) –

Return type

int