@JarzynowskiMatthew566-6633, Bastion starts charging when the resource gets created. To stop the charge, you will need to delete the resource. Besides the normal rental, the inbound traffic is also charged.
az network bastion delete --name MyBastionHost --resource-group MyResourceGroup
----------
Please do not forget to "Accept the answer" wherever the information provided helps you to help others in the community.