Azure API Management
An Azure service that provides a hybrid, multi-cloud management platform for APIs.
2,060 questions
Issue of APIM's azure-openai-emit-token-metric policy on gpt4o stream
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 27%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
김세형
85
Reputation points
Key Point
'azure-openai-emit-token-metric' policy on GPT4o stream.
Situation
I use gpt4o stream and need token usage metrics.
Problem
I received a response that Azure doesn't have plan to provided 'stream_options: {"include_usage": true}`'.
So, I tried to use 'azure-openai-emit-token-metric' policy of APIM for estimated token usage, But, estimated token usage is not measured when using gpt4o stream.### Required Action
Action
It hasn't been long since GA of 'azure-openai-emit-token-metric' policy.
So, if this is known issue, Could you tell me when it will be resolved?
1 answer
Sort by: Most helpful
-
Deleted
This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
Comments have been turned off. Learn more