@Usama Wahab Khan , You can connect to Bastion only from Portal as of now. You cannot just click a link to access the VM as you need to pass on credentials to RDP/SSH to the VM.
The only way to RDP/SSH to VM using Azure Bastion would be to navigate to the VM and connect to the VM by passing credentials.