@Darin , To delete a directory, you can follow the steps mentioned here. But in case you face issues getting the directory deleted, you can contact our support team by creating a case from the Azure Portal so that they can help you further.
Hope this helps.
Do let us know if this helps and if there are any more queries around this, please do let us know so that we can help you further. Also, please do not forget to accept the response as Answer; if the above response helped in answering your query.