Starting from October 17, 2024, the consumption of Processed Inference Tokens has increased significantly

xieshiwei 0 信誉分
2024-10-28T10:26:41.5666667+00:00

Starting from October 17, 2024, the consumption of Processed Inference Tokens has increased significantly, and is much higher than Prompt Tokens + Generated Completion Tokens. In theory, the input + output tokens should be doubled. Prompt Tokens * 2 + Generated Completion Tokens are basically equal to Processed Inference Tokens.

Microsoft Q&A
Microsoft Q&A
使用此标记与 Microsoft 问答团队共享建议、功能请求和 bug。 Microsoft 问答团队将定期评估你的反馈,并在此过程中提供更新。
157 个问题
0 个注释 无注释
{count} 票

你的答案

问题作者可以将答案标记为“接受的答案”,这有助于用户了解已解决作者问题的答案。