I believe this will still cost; it's under Streaming.
"Please note that Azure Media Player only supports media streams from Azure Media Services."
https://azure.microsoft.com/en-us/pricing/details/media-services/#faq
https://video2.skills-academy.com/en-us/legal/azure-media-player/azure-media-player-license
The license has "Installation and Use. You may use the software with your programs that deliver, receive, playback or otherwise handle video or audio content in the delivery chain with Microsoft Azure Media Services."
There is no indication of it needing to be used on specific or other endpoints.