CompletionsUsageOutput interface

Package:

@azure-rest/ai-inference

Representation of the token counts processed for a completions request. Counts consider all tokens across prompts, choices, choice alternates, best_of generations, and other consumers.

Properties

completion_tokens	The number of tokens generated across all completions emissions.
prompt_tokens	The number of tokens in the provided prompts for the completions request.
total_tokens	The total number of tokens processed for the completions request and response.

Property Details

completion_tokens

The number of tokens generated across all completions emissions.

completion_tokens: number

Property Value

number

prompt_tokens

The number of tokens in the provided prompts for the completions request.

prompt_tokens: number

Property Value

number

total_tokens

The total number of tokens processed for the completions request and response.

total_tokens: number

Property Value

number