SparkJob Class

Reference

Definition

Namespace:: Azure.ResourceManager.MachineLearning.Models

Assembly:: Azure.ResourceManager.MachineLearning.dll

Package:: Azure.ResourceManager.MachineLearning v1.2.1

Package:: Azure.ResourceManager.MachineLearning v1.2.0-beta.3

Source:: SparkJob.cs

Source:: SparkJob.cs

Important

Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.

Spark job definition.

public class SparkJob : Azure.ResourceManager.MachineLearning.Models.MachineLearningJobProperties, System.ClientModel.Primitives.IJsonModel<Azure.ResourceManager.MachineLearning.Models.SparkJob>, System.ClientModel.Primitives.IPersistableModel<Azure.ResourceManager.MachineLearning.Models.SparkJob>

public class SparkJob : Azure.ResourceManager.MachineLearning.Models.MachineLearningJobProperties

type SparkJob = class
    inherit MachineLearningJobProperties
    interface IJsonModel<SparkJob>
    interface IPersistableModel<SparkJob>

type SparkJob = class
    inherit MachineLearningJobProperties

Public Class SparkJob
Inherits MachineLearningJobProperties
Implements IJsonModel(Of SparkJob), IPersistableModel(Of SparkJob)

Public Class SparkJob
Inherits MachineLearningJobProperties

Inheritance: Object

MachineLearningResourceBase

MachineLearningJobProperties
SparkJob

Implements: IJsonModel<SparkJob> IPersistableModel<SparkJob> IPersistableModel<T>

Constructors

SparkJob(ResourceIdentifier, SparkJobEntry)	Initializes a new instance of SparkJob.
SparkJob(String, SparkJobEntry)	Initializes a new instance of SparkJob.

Properties

Archives	Archive files used in the job.
Args	Arguments for the job.
CodeId	[Required] arm-id of the code asset.
ComponentId	ARM resource ID of the component resource. (Inherited from MachineLearningJobProperties)
ComputeId	ARM resource ID of the compute resource. (Inherited from MachineLearningJobProperties)
Conf	Spark configured properties.
Description	The asset description text. (Inherited from MachineLearningResourceBase)
DisplayName	Display name of job. (Inherited from MachineLearningJobProperties)
Entry	[Required] The entry to execute on startup of the job. Please note SparkJobEntry is the base class. According to the scenario, a derived class of the base class might need to be assigned here, or this property needs to be casted to one of the possible derived classes. The available derived classes include SparkJobPythonEntry and SparkJobScalaEntry.
EnvironmentId	The ARM resource ID of the Environment specification for the job.
EnvironmentVariables	Environment variables included in the job.
ExperimentName	The name of the experiment the job belongs to. If not set, the job is placed in the "Default" experiment. (Inherited from MachineLearningJobProperties)
Files	Files used in the job.
Identity	Identity configuration. If set, this should be one of AmlToken, ManagedIdentity, UserIdentity or null. Defaults to AmlToken if null. Please note MachineLearningIdentityConfiguration is the base class. According to the scenario, a derived class of the base class might need to be assigned here, or this property needs to be casted to one of the possible derived classes. The available derived classes include AmlToken, MachineLearningManagedIdentity and MachineLearningUserIdentity. (Inherited from MachineLearningJobProperties)
Inputs	Mapping of input data bindings used in the job. Please note MachineLearningJobInput is the base class. According to the scenario, a derived class of the base class might need to be assigned here, or this property needs to be casted to one of the possible derived classes. The available derived classes include MachineLearningCustomModelJobInput, MachineLearningLiteralJobInput, MachineLearningFlowModelJobInput, MachineLearningTableJobInput, MachineLearningTritonModelJobInput, MachineLearningUriFileJobInput and MachineLearningUriFolderJobInput.
IsArchived	Is the asset archived?. (Inherited from MachineLearningJobProperties)
Jars	Jar files used in the job.
NotificationSetting	Notification setting for the job. (Inherited from MachineLearningJobProperties)
Outputs	Mapping of output data bindings used in the job. Please note MachineLearningJobOutput is the base class. According to the scenario, a derived class of the base class might need to be assigned here, or this property needs to be casted to one of the possible derived classes. The available derived classes include MachineLearningCustomModelJobOutput, MachineLearningFlowModelJobOutput, MachineLearningTableJobOutput, MachineLearningTritonModelJobOutput, MachineLearningUriFileJobOutput and MachineLearningUriFolderJobOutput.
Properties	The asset property dictionary. (Inherited from MachineLearningResourceBase)
PyFiles	Python files used in the job.
QueueJobTier	Controls the compute job tier.
QueueSettings	Queue settings for the job.
Resources	Compute Resource configuration for the job.
SecretsConfiguration	Configuration for secrets to be made available during runtime. (Inherited from MachineLearningJobProperties)
Services	List of JobEndpoints. For local jobs, a job endpoint will have an endpoint value of FileStreamObject. (Inherited from MachineLearningJobProperties)
Status	Status of the job. (Inherited from MachineLearningJobProperties)
Tags	Tag dictionary. Tags can be added, removed, and updated. (Inherited from MachineLearningResourceBase)

Explicit Interface Implementations

IJsonModel<MachineLearningJobProperties>.Create(Utf8JsonReader, ModelReaderWriterOptions)	Reads one JSON value (including objects or arrays) from the provided reader and converts it to a model. (Inherited from MachineLearningJobProperties)
IJsonModel<MachineLearningJobProperties>.Write(Utf8JsonWriter, ModelReaderWriterOptions)	Writes the model to the provided Utf8JsonWriter. (Inherited from MachineLearningJobProperties)
IJsonModel<MachineLearningResourceBase>.Create(Utf8JsonReader, ModelReaderWriterOptions)	Reads one JSON value (including objects or arrays) from the provided reader and converts it to a model. (Inherited from MachineLearningResourceBase)
IJsonModel<MachineLearningResourceBase>.Write(Utf8JsonWriter, ModelReaderWriterOptions)	Writes the model to the provided Utf8JsonWriter. (Inherited from MachineLearningResourceBase)
IJsonModel<SparkJob>.Create(Utf8JsonReader, ModelReaderWriterOptions)	Reads one JSON value (including objects or arrays) from the provided reader and converts it to a model.
IJsonModel<SparkJob>.Write(Utf8JsonWriter, ModelReaderWriterOptions)	Writes the model to the provided Utf8JsonWriter.
IPersistableModel<MachineLearningJobProperties>.Create(BinaryData, ModelReaderWriterOptions)	Converts the provided BinaryData into a model. (Inherited from MachineLearningJobProperties)
IPersistableModel<MachineLearningJobProperties>.GetFormatFromOptions(ModelReaderWriterOptions)	Gets the data interchange format (JSON, Xml, etc) that the model uses when communicating with the service. (Inherited from MachineLearningJobProperties)
IPersistableModel<MachineLearningJobProperties>.Write(ModelReaderWriterOptions)	Writes the model into a BinaryData. (Inherited from MachineLearningJobProperties)
IPersistableModel<MachineLearningResourceBase>.Create(BinaryData, ModelReaderWriterOptions)	Converts the provided BinaryData into a model. (Inherited from MachineLearningResourceBase)
IPersistableModel<MachineLearningResourceBase>.GetFormatFromOptions(ModelReaderWriterOptions)	Gets the data interchange format (JSON, Xml, etc) that the model uses when communicating with the service. (Inherited from MachineLearningResourceBase)
IPersistableModel<MachineLearningResourceBase>.Write(ModelReaderWriterOptions)	Writes the model into a BinaryData. (Inherited from MachineLearningResourceBase)
IPersistableModel<SparkJob>.Create(BinaryData, ModelReaderWriterOptions)	Converts the provided BinaryData into a model.
IPersistableModel<SparkJob>.GetFormatFromOptions(ModelReaderWriterOptions)	Gets the data interchange format (JSON, Xml, etc) that the model uses when communicating with the service.
IPersistableModel<SparkJob>.Write(ModelReaderWriterOptions)	Writes the model into a BinaryData.

Applies to

Share via