Managed HSM didn't deploy successfully. Can't delete it and it's maxing out my monthly subscription allowance

Hey there. I tried to add a Managed HSM to my subscription and it didn't deploy properly. Now I can't delete it yet it seems to be running and using up my monthly subscription allowance. I can't even log a service/bug request with Microsoft as it's asking for me to purchase a support plan. Any help?

Also, I started deleting my tenant (to create a new one) to see if that would fix the issue, however it's telling me I have to cancel my Azure subscription. I'm hesistant to do that if it means cancelling my Visual Studio subscription as well.