January 2023

These features and Azure Databricks platform improvements were released in January 2023.

Enable private connectivity with Azure Private Link (GA)

January 31, 2023

Azure Databricks supports enabling Azure Private Link connections for private connectivity between users and their Azure Databricks workspaces, and also between clusters on the compute plane and the core services on the control plane within the Azure Databricks workspace infrastructure. This feature is now generally available. See Enable Azure Private Link back-end and front-end connections.

Account SCIM is now GA

January 31, 2023

The Account SCIM API is now generally available.

Account SCIM lets you use an identity provider (IdP) to create users in an Azure Databricks account, give users the proper level of access, and remove access (deprovision users) when they leave your organization or no longer need access to Azure Databricks.

You can use a SCIM provisioning connector in your IdP or invoke the SCIM APIs to manage provisioning. For more information, see Sync users and groups from Microsoft Entra ID.

Easier creation and editing of Azure Databricks jobs in the UI

January 30, 2023

The Azure Databricks Jobs user interface now shows a view of your entire job when you add or make changes to job tasks. This unified view simplifies job creation and editing by allowing you to see the full details of your job as you make changes. See Schedule and orchestrate workflows.

Improvements to the Azure Databricks Jobs UI when viewing job runs

January 30, 2023

The Azure Databricks Jobs user interface now shows the job runs matrix and the job runs list in a single panel, improving your visibility into the status and details of your job runs. Previously, viewing the runs matrix or the runs list required switching between the two views. See View runs for a job.

New account console home screen provides better account management experience

January 26, 2023

Admins can use the new account console home screen to better navigate between Databricks products.

Databricks Terraform provider updated to version 1.9.1

January 25, 2023

Version 1.9.1 adds max_clusters_per_user to databricks_cluster_policy, support for cluster_mount_infos in databricks_cluster, a parent attribute to databricks_sql_query and databricks_sql_dashboard, and more. For more details, see the changelog for version 1.9.1.

Account users can update email preferences in the account console

January 23, 2023

You can now update instructional product and feature email preferences in your Azure Databricks account console. For more information, see Manage email preferences.

Region support consolidated onto one page

January 20, 2023

A new supported regions article consolidates all information about supported regions, including:

• Region-specific feature support
• IP addresses, domains, and endpoints for allow lists and custom network configurations

Databricks Runtime 12.1 and Databricks Runtime 12.1 ML are GA

January 19, 2023

Databricks Runtime 12.1 and Databricks Runtime 12.1 ML are now generally available.

See Databricks Runtime 12.1 (EoS) and Databricks Runtime 12.1 for Machine Learning (EoS).

Cluster policies now support limiting the max number of clusters per user

January 18, 2023

You can now use cluster policies to restrict the number of clusters a user can create. For more information, see restrict the number of clusters per user.

Databricks Terraform provider updated to version 1.9.0

January 17, 2023

Version 1.9.0 includes fixes to the databricks_sql_endpoint and databricks_sql_permissions resources, makes several documentation improvements, and more. For more details, see the changelog for version 1.9.0.

serverless SQL warehouses are available in Central US and North Europe regions

January 13-17, 2023

Serverless SQL endpoints are now available in Central US and North Europe regions.

Partner Connect supports connecting to Privacera

January 12-19, 2023

You can now easily create a connection between Privacera and your Azure Databricks workspace using Partner Connect. For more information, see Connect to Privacera using Partner Connect.

Databricks Terraform provider updated to version 1.8.0

January 10, 2023

Version 1.8.0 includes new resources such as databricks_instance_pool, databricks_provider for Delta Sharing, and databricks_permission_assignment. Several existing resources are improved. For more details, see the changelog for version 1.8.0.

Databricks Runtime 12.1 (Beta)

January 9, 2023

Databricks Runtime 12.1 and Databricks Runtime 12.1 ML are now available as Beta releases.

See Databricks Runtime 12.1 (EoS) and Databricks Runtime 12.1 for Machine Learning (EoS).

Partner Connect supports Sigma

January 9-17, 2022

You can now easily create a connection between Sigma and your Azure Databricks workspace using Partner Connect. For more information, see Connect to Sigma using Partner Connect.

New left and right sidebars in Databricks notebooks

January 5-12, 2023

We have added left and right sidebars to the Databricks notebook. You can now find the notebook’s table of contents in the left-hand sidebar, and you can find comments, MLflow experiments, and the notebook version history in the right-hand sidebar.