OpenAIHandler Class

Internal class for calls to OpenAI API's.

Create a new model by parsing and validating input data from keyword arguments.

Raises [ValidationError][pydantic_core.ValidationError] if the input data cannot be validated to form a valid model.

self is explicitly positional-only to allow self as a field name.

Constructor

OpenAIHandler(*, client: AsyncOpenAI, ai_model_type: OpenAIModelTypes = OpenAIModelTypes.CHAT, prompt_tokens: int = 0, completion_tokens: int = 0, total_tokens: int = 0)

Keyword-Only Parameters

Name	Description
client Required
ai_model_type	Default value: OpenAIModelTypes.CHAT
prompt_tokens Required
completion_tokens Required
total_tokens Required

Methods

store_usage

Store the usage information from the response.

store_usage

Store the usage information from the response.

store_usage(response: ChatCompletion | Completion | AsyncStream[ChatCompletionChunk] | AsyncStream[Completion] | CreateEmbeddingResponse)

Parameters

Name	Description
response Required

Attributes

ai_model_type

ai_model_type: OpenAIModelTypes

client

client: AsyncOpenAI

completion_tokens

completion_tokens: int

prompt_tokens

prompt_tokens: int

total_tokens

total_tokens: int