Add a pipeline
To create a new pipeline:- In Designer, click Files at the top of the canvas.
- Click the + icon in the top right of the Files panel, and select Orchestration pipeline or Transformation pipeline. To create a test pipeline, select Test. Read Test pipelines.
- In Name, enter a name for the pipeline. The name may include alphanumerics, underscores, single spaces, parentheses, and hyphens. The name must be unique within each folder.
- Optionally, in Description, enter a description for the pipeline. This is useful if you want to share or export this pipeline, as it provides context for other users. Max 1000 characters.
- Click Add.
Create pipelines with Maia Team
Instead of adding a pipeline and its components yourself, you can describe what you want in the Maia Team chat panel. Maia Team creates the pipeline, adds and configures the components, and connects them for you. For example, you could prompt Maia Team: “Get sales data from the orders table, calculate revenue by region, and store the results in a new table calledregional_revenue.”
For more information, read Building pipelines.
Manage pipelines
In Designer, click Files to view the pipelines on your current branch. You can use folders to organize your pipelines in a hierarchical structure. Hover over a pipeline in the Files panel and click the three dots … next to its name to open a list of actions you can perform on the selected pipeline.Copying pipelines
To copy and paste a pipeline:- Click Copy in the actions list, or click the pipeline and press
ctrl + c(Windows) orcmd + c(Mac). - Paste the copy into a folder using one of the following options:
- Hover over the folder, click the three dots … next to its name, and click Paste.
- Click the name of the folder in the Files panel, then press
ctrl + v(Windows) orcmd + v(Mac) to paste it.
If you make a copy of a pipeline in the same folder as the original, the new pipeline will be called
_copy_your-pipeline-name. Any additional copies will be called _copy_your-pipeline-name_2, ..._3, and so on.Renaming pipelines
To edit a pipeline’s name or description:- Click Edit details in the actions list.
- In the Pipeline name and Pipeline description fields, change the pipeline’s name and/or description as required.
- Choose how to update references to this pipeline in other pipelines:
- Update references automatically: Maia will find and update any references to this pipeline in other pipelines in your project, such as Run Orchestration or Run Transformation components.
- Rename this pipeline only: Do not update references to this pipeline in other pipelines. You’ll need to update any references to this pipeline yourself.
- Click Update.
Deleting pipelines
To delete a pipeline:- Click Delete in the actions list.
- In the Delete pipeline dialog, click Delete to confirm.
Cancelling a running pipeline
To cancel a pipeline that is running in Designer:- Click the Task history tab.
- On the far right of the running task, click Cancel. This is a “soft” cancellation, and will allow the current task to complete. After that, no other pipeline tasks will run.
- To force the pipeline to stop, click Force cancel, which replaces Cancel after you click it. In the dialog, click Yes, force cancel to confirm. This is a “hard” cancellation, and will interrupt and terminate the current task, set the pipeline status to “Stopped”, and prevent the pipeline from receiving further information from the Maia runner.