Skip to main content

Getting Started with Databricks

Connect your OpenMetadata instance to Databricks by registering it as an MCP Service in Unity Catalog. Once registered, Databricks agents and AI assistants (including Databricks Assistant and Mosaic AI Agent Framework agents) can discover and call OpenMetadata’s MCP tools as a governed, auditable Unity Catalog resource. Unlike client-side integrations such as Claude or Cursor, Databricks doesn’t connect directly to the OpenMetadata MCP endpoint from a local config file. Instead, an admin registers the server once as a Unity Catalog securable, and Databricks proxies and governs every call through its Unity AI Gateway.

Prerequisites

Before you begin, ensure you have:
  • OpenMetadata v1.8.0+ running.
  • MCP Server application installed in OpenMetadata.
    1. Navigate to Settings > Application and click Add Apps.
    2. Install MCP Server application if not already installed.
  • An OpenMetadata Personal Access Token, or an OpenMetadata user account to sign in with if you want per-user OAuth authentication instead.
  • A Databricks workspace with Unity Catalog enabled, in a region that supports Model Serving.
  • Sufficient Unity Catalog privileges to create connections and MCP Services in the target catalog and schema.

Configure the MCP Service

Step 1: Create a Unity Catalog HTTP Connection

To create a Unity Catalog HTTP connection in Databricks, follow these steps:
  1. Navigate to Catalog > Connections.
  2. Click Create connection.
  3. Set Connection type to HTTP.
  4. Set Host / MCP server URL to https://<YOUR-OpenMetadata-SERVER>/mcp.
  5. Set Authentication to Bearer token, and paste your OpenMetadata Personal Access Token.
  6. Enable the Is MCP connection checkbox so Databricks treats the endpoint as an MCP server rather than a generic HTTP API.
  7. Click Create to save the connection.
If your OpenMetadata deployment authenticates with OAuth 2.0 instead of a PAT, use OAuth U2M (per-user login) as the authentication type instead of Bearer token. OpenMetadata’s MCP OAuth server only issues authorization_code and refresh_token grants. It doesn’t support client_credentials (OAuth M2M), so that option isn’t available here. For a shared, non-interactive credential, use a Personal Access Token instead. See OAuth 2.0 Authentication for the values OpenMetadata expects.
If you selected OAuth U2M, each user must authenticate individually before they can call the service:
  1. Open the connection’s detail page in Catalog Explorer.
  2. Click Login.
  3. Complete the OAuth consent flow against your OpenMetadata instance.
Bearer token skips this step: it uses a single shared credential set once, at connection creation, so no per-user login is required.

Step 2: Register the MCP Service

Register the MCP Service through the Databricks UI or the REST API.

Using the Databricks UI

To register the MCP service in Databricks, follow these steps:
  1. In the left sidebar, select AI Gateway > MCPs > Register MCP Server. Alternatively, go to Catalog, open the target schema, and select Create > MCP Service, which opens the same form.
  2. Set Catalog and Schema to where the MCP Service will live as a Unity Catalog securable.
  3. Set MCP Service name, for example openmetadata (this can’t be changed after creation).
  4. Set Connection to the HTTP connection you created in Step 1.
  5. Optional: Set Tools to the OpenMetadata MCP tools you want to expose. Leave unrestricted to expose all of them. See the MCP Tools Reference for the full list.
  6. Click Create to register the service.

Using the REST API

Register the service directly with a POST request:

Step 3: Grant EXECUTE Permission

On the MCP Service’s Permissions tab, grant EXECUTE to the users, groups, or service principals that should be able to call OpenMetadata’s tools:
Grant EXECUTE on the MCP Service itself. Never grant USE CONNECTION on the underlying HTTP connection to end users. That would let them bypass tool selection and call the OpenMetadata MCP endpoint directly with the shared credential.

Step 4: Connect an Agent or Client

After getting registered, the MCP Service is reachable at:
Mosaic AI Agent Framework agents can add it as a tool source directly. To verify the connection manually, authenticate with a Databricks token and list the available tools:
You should see OpenMetadata’s MCP tools (search_metadata, get_entity_details, and others) in the response. See the MCP Tools Reference for the complete list.

Try It Out

Once your agent has the OpenMetadata MCP Service attached as a tool source, try prompting it:
“What tables do you have access to in OpenMetadata?”
“Find the tables that track customer transactions, engagement metrics, and churn indicators.”

Troubleshooting

If you run into connection issues:
  1. Verify OpenMetadata is running: curl <YOUR-OpenMetadata-SERVER>/api/health.
  2. Check the MCP endpoint: curl <YOUR-OpenMetadata-SERVER>/mcp (should return 401).
  3. Verify MCP Application is installed: Visit <YOUR-OpenMetadata-SERVER>/marketplace/apps/McpApplication.
  4. Confirm the connection is marked as an MCP connection: Open the HTTP connection in Catalog Explorer and check that Is MCP connection is enabled.
  5. Confirm EXECUTE is granted: Check the MCP Service’s Permissions tab for the calling user, group, or service principal.
  6. Token expired: Generate a new PAT and update the HTTP connection’s credentials.

Additional Resources