OnlineRequestSettings Class

Request Settings entity.

Inheritance
azure.ai.ml.entities._mixins.RestTranslatableMixin
OnlineRequestSettings

Constructor

OnlineRequestSettings(max_concurrent_requests_per_instance: int | None = None, request_timeout_ms: int | None = None, max_queue_wait_ms: int | None = None)

Parameters

Name Description
request_timeout_ms
int

defaults to 5000

Default value: None
max_concurrent_requests_per_instance
int

defaults to 1

Default value: None
max_queue_wait_ms
int

defaults to 500

Default value: None