Welcome to the Microsoft Q&A Platform. Thank you for reaching out & I hope you are doing well.
Comparing Load Balancer and Application Gateway latencies is not a right approach.
- As Load Balancer is L4 and does not require much processing of incoming request
- However, with App gateway, there is a lot of processing required
Have a look at : Application Gateway timing metric
- Backend connect time - refers to the time taken by App gateway for TCP + TLS Handshake
- Backend last byte response time - App gateway + Backend processing time
You can cross reference this with App gateway Access log
- serverResponseLatency = Backend last byte response time
- Use this to find out how long did the backend take to process the request and send it back
- clientResponseTime
- Time difference (in seconds) between the first byte and the last byte application gateway sent to the client. Helpful in gauging Application Gateway's processing time for responses or slow clients.
This should give you an idea on how various latencies are introduced.
- Can you share an entire row of App gateway Access log
- So we can see how long did the backend take to respond?
Cheers,
Kapil