Hi @Peter Hyde ,
Apologies for the late reply. I was looking into your ask and there isn't any message delivery queue in either SignalR or Web PubSub service offerings. These are real-time communication so there isn't any queueing of the sort.
If you want to do reliable messaging, it's going to have to be something handled by your application. One option you have the client send ack message upstream to the publisher/service. When you client fails to send the acknowledgement, then you can do something on the server side to start retaining messages and resend them to the disconnected client.
Web PubSub can retain messages for a 1-minute period. Now this isn't a message queue like you're looking but it may be another option you can look into rather than doing acknowledge message.