@Jeremy Pope In the past we have come across a similar case and it was discovered that this SQL VM Resource relies on the SQL IAAS Extension being installed.
As you may know, the failover operation doesn’t failover the VM Extensions, so you will need to reinstall that after failover.
https://video2.skills-academy.com/en-us/azure/site-recovery/azure-to-azure-support-matrix
After reinstalling the extension you may see this getting recreated at that time.
----------------------------------------------------------------------------------------------------------------------
If the response helped, do "Accept Answer" and up-vote it