Would it be possible to use a load balancer for multiple Form Recognizers?

gdasani 0 Reputation points
2023-10-20T13:49:32.4233333+00:00

Hello all,

I am trying to solve a problem without much luck. I have created two Form Recognizers and want to be able to route traffic to both of them. I was going to attempt this with the containerized FR, but neural models are not available for them. I want to have a single endpoint so that I do not have to worry about switching between keys and just let the load balancer dictate which FR the traffic should go to. I am new to Azure and am a bit lost surfing through the docs. Would the AI Service resource work for multiple FRs or should I use RBACs?

Azure Load Balancer
Azure Load Balancer
An Azure service that delivers high availability and network performance to applications.
416 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. KapilAnanth-MSFT 39,211 Reputation points Microsoft Employee
    2023-10-23T05:22:23.9033333+00:00

    @gdasani

    Welcome to the Microsoft Q&A Platform. Thank you for reaching out & I hope you are doing well.

    I understand that you would like to use two Form Recognizers behind an Azure Load Balancer.

    Please note that Azure Load Balancer's backend can only be a VM or VMSS in a Virtual Network.

    For a public facing endpoint, you should consider

    • Azure App gateway (if both the FRs are in same region)
    • Azure Front Door (if you want global availability)
    • Azure Traffic Manager (only routing, no load balancing traffic)

    I would recommend the latter two as they have less management overhead.

    Now, if the two FRs are two individual workloads and if one FR cannot compliment the workload of the other FR, then you must consider using Session Persistence.

    For App Gateway : Enable Cookie-based Affinity

    • User's image

    For Front Door : Session affinity

    • Cookie-based session affinity allows Front Door to identify different users even if behind the same IP address, which in turn allows a more even distribution of traffic between your different origins.
    • The lifetime of the cookie is the same as the user's session, as Front Door currently only supports session cookie.

    For Traffic Manager : Geographic traffic-routing method

    • You can use Geographic traffic-routing method so that users from a particular region/location are always redirected to the same FR instance (closer to their region)

    Hope this helps.

    Cheers,

    Kapil.

    1 person found this answer helpful.
    0 comments