Skip to main content
This page explains how to add a pipeline to your project and how to copy, rename, delete, and cancel pipelines in Designer. For an introduction to the types of pipeline, read Pipelines.

Add a pipeline

To create a new pipeline:
  1. In Designer, click Files at the top of the canvas.
  2. Click the + icon in the top right of the Files panel, and select Orchestration pipeline or Transformation pipeline. To create a test pipeline, select Test. Read Test pipelines.
  3. In Name, enter a name for the pipeline. The name may include alphanumerics, underscores, single spaces, parentheses, and hyphens. The name must be unique within each folder.
  4. Optionally, in Description, enter a description for the pipeline. This is useful if you want to share or export this pipeline, as it provides context for other users. Max 1000 characters.
  5. Click Add.
The new pipeline opens in a new tab on the canvas and is placed at the top level of your pipeline folder tree. To create a pipeline within a folder, read Pipeline folders. The new pipeline is blank. Add components to construct a workflow that performs your data extraction and transformation tasks.

Create pipelines with Maia Team

Instead of adding a pipeline and its components yourself, you can describe what you want in the Maia Team chat panel. Maia Team creates the pipeline, adds and configures the components, and connects them for you. For example, you could prompt Maia Team: “Get sales data from the orders table, calculate revenue by region, and store the results in a new table called regional_revenue.” For more information, read Building pipelines.

Manage pipelines

In Designer, click Files to view the pipelines on your current branch. You can use folders to organize your pipelines in a hierarchical structure. Hover over a pipeline in the Files panel and click the three dots … next to its name to open a list of actions you can perform on the selected pipeline.

Copying pipelines

To copy and paste a pipeline:
  1. Click Copy in the actions list, or click the pipeline and press ctrl + c (Windows) or cmd + c (Mac).
  2. Paste the copy into a folder using one of the following options:
    • Hover over the folder, click the three dots … next to its name, and click Paste.
    • Click the name of the folder in the Files panel, then press ctrl + v (Windows) or cmd + v (Mac) to paste it.
If you make a copy of a pipeline in the same folder as the original, the new pipeline will be called _copy_your-pipeline-name. Any additional copies will be called _copy_your-pipeline-name_2, ..._3, and so on.

Renaming pipelines

Renaming a pipeline will break any schedules, API calls, and stored variables that reference the renamed pipeline’s previous name.Maia can only update references to this pipeline in other pipelines in your project. You’ll need to update all other references yourself.Renaming a pipeline can take several minutes. During this time, all pipelines are unavailable to edit and you can’t perform other actions.
To edit a pipeline’s name or description:
  1. Click Edit details in the actions list.
  2. In the Pipeline name and Pipeline description fields, change the pipeline’s name and/or description as required.
  3. Choose how to update references to this pipeline in other pipelines:
    • Update references automatically: Maia will find and update any references to this pipeline in other pipelines in your project, such as Run Orchestration or Run Transformation components.
    • Rename this pipeline only: Do not update references to this pipeline in other pipelines. You’ll need to update any references to this pipeline yourself.
  4. Click Update.
The Edit pipeline details dialog also shows the pipeline’s scalar and grid variables, which you can reorder.

Deleting pipelines

Deleted pipelines cannot be recovered.Deleting a pipeline will break any pipelines that contain Run Orchestration or Run Transformation components that run the deleted pipeline.
To delete a pipeline:
  1. Click Delete in the actions list.
  2. In the Delete pipeline dialog, click Delete to confirm.

Cancelling a running pipeline

To cancel a pipeline that is running in Designer:
  1. Click the Task history tab.
  2. On the far right of the running task, click Cancel. This is a “soft” cancellation, and will allow the current task to complete. After that, no other pipeline tasks will run.
  3. To force the pipeline to stop, click Force cancel, which replaces Cancel after you click it. In the dialog, click Yes, force cancel to confirm. This is a “hard” cancellation, and will interrupt and terminate the current task, set the pipeline status to “Stopped”, and prevent the pipeline from receiving further information from the Maia runner.
You can also cancel pipeline runs from Your activity.