@Jonas vR By raising a support case, our engineer helped resolve your issue. I am glad that you are now able to delete the Azure Database for PostgreSQL flexible server that was stuck in a restart state.
Thanks for visiting Microsoft Q&A, have a great day.
Regards
Geetha