Hello @Shane E Kim ,
I see this related feature request already raised in Uservoice on feedback forum. So I would recommend you to upvote it and other features that are of interest.
As a workaround, your account Administrator can temporary disable your Azure Subscription.
Depending on the subscription type, a subscription may remain disabled between 1 - 90 days. After which, it's permanently deleted.
Recommended Documents:
If you still have questions or need help, please create a support request. Billing and subscription management support tickets are free of charges for all users in the Azure.
-------
(If the reply was helpful please don't forget to upvote and/or accept as answer, thank you)
Sincerely,
Olga