Items - Update Spark Job Definition Definition

  • Reference
Service:
SparkJobDefinition
API Version:
v1

Overrides the definition for the specified spark job definition.
This API supports long running operations (LRO).

Updating the spark job definition's definition, does not affect its sensitivity label.

Permissions

The API caller must have contributor or higher workspace role.

Required Delegated Scopes

SparkJobDefinition.ReadWrite.All or Item.ReadWrite.All

Microsoft Entra supported identities

This API supports the Microsoft identities listed in this section.

Identity Support
User Yes
Service principal Yes
Managed identities Yes

Interface

POST https://api.fabric.microsoft.com/v1/workspaces/{workspaceId}/sparkJobDefinitions/{sparkJobDefinitionId}/updateDefinition
With optional parameters: 
POST https://api.fabric.microsoft.com/v1/workspaces/{workspaceId}/sparkJobDefinitions/{sparkJobDefinitionId}/updateDefinition?updateMetadata={updateMetadata}

URI Parameters

Name In Required Type Description
sparkJobDefinitionId
 path True

string

uuid

The spark job definition ID.
workspaceId
 path True

string

uuid

The workspace ID.
updateMetadata
 query

boolean

When set to true and the .platform file is provided as part of the definition, the item's metadata is updated using the metadata in the .platform file

Request Body

Name Required Type Description
definition True

SparkJobDefinitionPublicDefinition

Spark job definition public definition object. Refer to this article for more details on how to craft a spark job definition public definition.

Responses

Name Type Description
200 OK

Request completed successfully.
202 Accepted

Request accepted. Update definition is in progress.

Headers

  • Location: string
  • x-ms-operation-id: string
  • Retry-After: integer
Other Status Codes

ErrorResponse

Common error codes:

  • OperationNotSupportedForItem - Operation not supported for requested item.

  • CorruptedPayload - The provided payload is corrupted.

Examples

Update a spark job definition public definition example

Sample request

POST https://api.fabric.microsoft.com/v1/workspaces/cfafbeb1-8037-4d0c-896e-a46fb27ff229/sparkJobDefinitions/5b218778-e7a5-4d73-8187-f10824047715/updateDefinition?updateMetadata=True

{
  "definition": {
    "parts": [
      {
        "path": "SparkJobDefinitionV1.json",
        "payload": "ew0KICAiZXhlY3V0YW..OWRmNDhhY2ZmZTgifQ==",
        "payloadType": "InlineBase64"
      },
      {
        "path": ".platform",
        "payload": "ZG90UGxhdGZvcm1CYXNlNjRTdHJpbmc=",
        "payloadType": "InlineBase64"
      }
    ]
  }
}

Sample response

Status code:
200
Status code:
202 
Location: https://api.fabric.microsoft.com/v1/operations/427f6c34-b64e-4ee4-8ea5-b533c0e203ef
x-ms-operation-id: 427f6c34-b64e-4ee4-8ea5-b533c0e203ef
Retry-After: 30

Definitions

Name Description
ErrorRelatedResource

The error related resource details object.
ErrorResponse

The error response.
ErrorResponseDetails

The error response details.
PayloadType

The type of the definition part payload. Additional payload types may be added over time.
SparkJobDefinitionPublicDefinition

Spark job definition public definition object. Refer to this article for more details on how to craft a spark job definition public definition.
SparkJobDefinitionPublicDefinitionPart

Spark job definition definition part object.
UpdateSparkJobDefinitionDefinitionRequest

Update spark job definition public definition request payload.

ErrorRelatedResource

The error related resource details object.

Name Type Description
resourceId

string

The resource ID that's involved in the error.
resourceType

string

The type of the resource that's involved in the error.

ErrorResponse

The error response.

Name Type Description
errorCode

string

A specific identifier that provides information about an error condition, allowing for standardized communication between our service and its users.
message

string

A human readable representation of the error.
moreDetails

ErrorResponseDetails[]

List of additional error details.
relatedResource

ErrorRelatedResource

The error related resource details.
requestId

string

ID of the request associated with the error.

ErrorResponseDetails

The error response details.

Name Type Description
errorCode

string

A specific identifier that provides information about an error condition, allowing for standardized communication between our service and its users.
message

string

A human readable representation of the error.
relatedResource

ErrorRelatedResource

The error related resource details.

PayloadType

The type of the definition part payload. Additional payload types may be added over time.

Name Type Description
InlineBase64

string

Inline Base 64.

SparkJobDefinitionPublicDefinition

Spark job definition public definition object. Refer to this article for more details on how to craft a spark job definition public definition.

Name Type Description
format

string

The format of the item definition. Supported format: SparkJobDefinitionV1.
parts

SparkJobDefinitionPublicDefinitionPart[]

A list of definition parts.

SparkJobDefinitionPublicDefinitionPart

Spark job definition definition part object.

Name Type Description
path

string

The spark job definition public definition part path.
payload

string

The spark job definition public definition part payload.
payloadType

PayloadType

The payload type.

UpdateSparkJobDefinitionDefinitionRequest

Update spark job definition public definition request payload.

Name Type Description
definition

SparkJobDefinitionPublicDefinition

Spark job definition public definition object. Refer to this article for more details on how to craft a spark job definition public definition.