The definition of the "local public connection point" of a Site-To-Site connection is in the Local Network Gateway configuration.
There you can define an IP or a FQDN. You have to make sure with a "Dynamic DNS Service" the FQDN could be resolved to the dynamic IP.
Config of the the Azure Local Network Gateway:
----------
(If the reply was helpful please don't forget to upvote and/or accept as answer, thank you)
Regards
Andreas Baumgarten