Skip to content

Databricks for Azure Guide

Screenshot

Learn more about the benefits of Satori for Databricks and Schedule a demo

Satori streamlines and simplifies the process of controlling access to data in Databricks. Satori reduces the risk of data leakage caused by misconfiguring users or permissions.

Databricks Unity Catalog is designed for centralized data governance. Satori integrates with several of its features such as user management, access controls and audit logs.

It only takes a few minutes to get started with Satori. Ensure that you have the following prepared in advance:

  • Access to the Satori Management Console.
  • The hostname of your Databricks Workspace.

Configuring your Databricks Account

To grant Satori access to Databricks on Azure, go to your Databricks account and get the following configuration details:

Extract the Account Information from Databricks

To extract the relevant Account information from Databricks, perform the following steps:

  1. Get your Databricks Instance - Login to your Databricks account and follow the instructions to obtain your databricks-instance from the Databricks instructions. Databricks instructions (Copy the Databricks instance)
  2. Get your Account ID - Go to the Databricks Admin console and click on your username located in the right hand corner of the interface and extract Account ID. (Copy the Databricks Acount ID)
  3. Get your SQL Warehouses ID - In the Workspace console select the SQL Warehouse tab. (Copy the ID from Name input field)

Note: Satori recommends provisioning a dedicated SQL warehouse for the Satori workload, a minimal SQL Classic instance is sufficient.

Creating a New Satori Service Principal in Databricks

  1. Create a new Satori Service Principal to manage your Databricks instance. Go to the User Management view, select the Service Principals tab, add a new Satori Service Principal.
  2. Provision a Service Principal: Learn how to get an Azure AD token from the following link Get Azure AD tokens for service principals.
  3. Click the Azure Subscription Service where the databricks has installed the Access Control (IAM).
  4. Select the Access Control (IAM) item located in the navigation menu.
  5. Add a Role Assignment with the role: Reader and then select it and connect it to your Service Principal.
  6. In the Databricks Account go to User Management and select Service Principals section and add the Service Principal using the clientID (UUID).
  7. In the Databricks User Management view, select the Satori Service Principle and then go to the Roles tab and assign the Satori Service Principle as the Account Admin role.
  8. In the Databricks User Management view, select the Groups tab and then select the Admin Group that manages the metastore.
  9. Verify the group that manages the metastore. This configuration is located in the Metastore Configuration section in the Data view.
  10. Go to the Workspace view and select your workspace and click the Permissions Tab and select the Satori service principle. Then, set the Permission Role to user.
  11. Go to the Databicks Workspace and click on the SQL Warehouses view. Now locate the Satori Warehouse and grant Satori Service Principle permission to Use the warehouse.

Databrick Information Configuration Checklist

Ensure that you have obtained the following details:

  • Databricks Instance
  • Account ID
  • SQL Warehouse ID
  • Application (client) ID (Satori service principal).
  • Client Secret Value (Satori service principal).

Enabling the Audit Log on your Account

To take advantage of the Azure Databricks system tables and the associated resources, refer to the Microsoft documentation Monitor usage with system tables and enable the Audit logs module on your account using the Enable a system schema API.

Adding a Databricks Unity Catalog to Satori

Screenshot

  1. Login to the Satori Management Console.
  2. In the Data Stores view, click the plus button to Add a New Data Store.
  3. Select the Databricks option.
  4. Now, provide an informative name for the data store, for example: Sales Data Warehouse.
  5. Enter the Databricks Instance of your Databricks account.
  6. Enter your databricks Account ID.
  7. Enter your databricks SQL Warehouse ID.
  8. Select the Authentication type to Azure Service Principal
  9. Enter your Application (client) ID
  10. Enter your Directory (tenant) ID
  11. Enter your Client Secret’s value
  12. Select your Satori Data Access Controller cloud provider
  13. Select your Satori Data Access Controller region
  14. Click Create.
  15. Finally, you will be redirected to the Data Stores list view

Testing your Databricks Integration

  1. Go to your newly created Databricks instance and select the Integartion Tab.
  2. Click the Test Connection button.

Screenshot