Reviewing a pipeline
Before using the Review feature for the first time, you need to add and configure a rules file, which contains the standards that will use to assess your pipeline quality. To do this:-
In the top right of the canvas, click the drop-down icon next to the Review button, then select Manage rules.
The Review button will be grayed out if you haven’t configured a rules file yet.
- In the rules file, edit the rules to suit your requirements. For more information, read Configuring pipeline quality rules below.
- Close the rules file and return to your pipeline.
- Click Review.
Reviewing all pipelines in a branch
You can review all orchestration and transformation pipelines within the current branch in a single action. To review all pipelines:- In the top right of the canvas, click the drop-down icon next to the Review button.
- Select Review all pipelines.
Fixing rule violations with Maia
From the Review results panel, you can use Maia to automatically fix selected rule violations. To fix rule violations using Maia:- In the Review results panel, review the list of rule violations identified across the pipelines in the branch.
- Use the checkboxes next to each rule violation to select the issues you want Maia to fix. The maximum selection is 50 rule violations.
- Optionally, use the checkbox in the table header to select or deselect all rule violations on the current page.
- Click Fix with Maia in the top-right corner of the panel. This will open the Maia chat with a pre-sent message asking Maia to fix the violations.
Pre-commit pipeline quality review
You can choose to run a pipeline quality review as part of the commit process. When committing changes, the Commit changes dialog includes a checkbox to enable pipeline quality review. If the checkbox is selected, runs the pipeline quality review before completing the commit.- If the review identifies rule violations with an error enforcement level, the commit is blocked.
- If the review passes or only identifies rule violations with a warn enforcement level, the commit proceeds successfully.
Configuring pipeline quality rules
The rules that uses to review your pipeline quality are stored in a YAML file calledpipeline_quality_rules. This file is automatically added to the .matillion/config folder in your project when you click Manage rules for the first time. Do not move the pipeline_quality_rules file out of this folder.
Each rule contains one fixed parameter (id) and two or three editable parameters (enabled, enforcementLevel and config). The table below explains what each of these parameters represents.
You can download a copy of the default rules file here.
Individual rules
The table below explains what each rule checks. If a rule has aconfig parameter, the Configuration details column explains how to define the value to check for.
