The instance name is ignored when you connect using a port number. It is irrelevant since you have pointed to which instance to connect to using the port number. Never specify an instance name when you connect using a port number, it is only confusing - as you just have experienced.
I would have preferred if MS decided to catch this as an error and gave us an error message when it detects a backslash and a comma (i.e., when we try to use both).