This guide will help you connect your Databricks workspace to using Databricks Partner Connect. Once connected, you can design and run data pipelines in that interact with your Databricks workspace.Documentation Index
Fetch the complete documentation index at: https://docs.maia.ai/llms.txt
Use this file to discover all available pages before exploring further.
Start in Databricks Partner Connect
This section describes the steps you need to take in your Databricks workspace to connect to .Choose Maia listing
- Log in to your Databricks workspace.
- In the left-hand navigation pane, click Partner Connect.
- Search for “Matillion” and select the "" listing.
- Click Connect.
Select a compute resource
You will need to choose a compute resource that can use to execute your data pipelines. This compute resource can be an existing Databricks cluster or a new cluster.Select a Unity Catalog and schema
You will need to select a Unity Catalog and schema that can use to create and manage your data. If you do not have a Unity Catalog or schema, you will need to create one.Review and confirm setup
At this stage, review your selections and accept the terms and conditions. Then, click Connect to launch .Complete the setup in Maia
This section describes the steps you need to take in to complete the connection to your Databricks workspace.Register or log in
- If you’re new to Matillion, read Registration to get started with a new account.
- For existing users, log in to and select your account.
Resource provisioning
If you’re signing up for the first time, a short introductory video will play, giving you an overview of . During this time, Matillion is creating the necessary infrastructure for your account and securely connecting to your Databricks workspace. This will take a couple of minutes.Get started with Maia
Once setup is finished, your page will refresh and you will see , Matillion’s UI for building data pipelines. Read UI basics to learn more about and its capabilities. You will see a default project with the Databricks logo in the top left of the project bar, confirming you’re connected to your Databricks workspace. The project will precede a/ and then the name of the environment, which is using your chosen Unity Catalog and schema.
Click Schemas in the project bar to open the Schemas panel. If this panel displays a list of existing Databricks schemas, your connection is working correctly. If the panel is empty, try clicking the refresh icon to reload the list of schemas.
Next steps
You’re now ready to build your first data pipeline in .- Use orchestration pipelines to move data into Databricks from your source databases.
- Use transformation pipelines to shape, clean, and prepare data that is already in Databricks.
Many components let you sample the data output from that component, giving you the option to observe the state of data at various stages in your pipeline. Sampling also helps you to confirm that a component is set up correctly before you use it in a production pipeline.