Video example
Prerequisites
Before you begin, ensure the following requirements are met:- Export project files from the source platform and store them locally or in an accessible Git repository (such as GitHub or GitLab). For more information on integrating your Git account with , read Connect your own Git repo.
- An active account is available.
- Maia is enabled and accessible in your environment. Read Edit account details to learn how to enable Maia if it isn’t enabled for your account.
-
Your role includes the required permissions to create and deploy pipelines in the target project and environment. For more information on account roles, read Role based Access Control overview.
- Maia supports a growing set of data workload conversions from major data platforms, with support for additional platforms such as Ab Initio coming soon.
- If you need to convert from a platform that isn’t currently supported, contact your account team to discuss your requirements.
Supported file types for data workload conversions
Convert workloads with Maia
- Log in to and select the project you want to use.
- Click the Files icon, select Add (+) from the dropdown menu, and then select Convert workloads.
- In the Convert workloads with Maia dialog , select a workload type. All supported platforms are listed under Workload type.
-
Choose a file loading method: Git repository files or Upload files.
- If you choose Git repository files, make sure all workload files are already available in your Git repository, use the search feature to select the files you want Maia to convert, and ensure that each file is 10 MB or smaller.
- If you choose Upload files, you can upload up to 10 files at a time, provided the combined size of all selected files does not exceed 20 MB.
-
(Optional) Conversions are often more successful when additional context is provided. For guidance on what to include, read Best practices for workload conversion. To add context, edit the conversion-specific context file
(conversions/user-guidance.md)displayed on screen. This file can include pipeline design standards, schema information, or any other details relevant to the conversion. Maia will also use any other context files that have already been created. - Click Submit to begin the analysis. Maia analyzes the workload files. The analysis time varies based on file size.
-
After the analysis is complete, choose how you want to proceed:
- Plan conversion with Maia: Work with Maia to create and refine a conversion plan. Once you’re happy, Maia will execute the agreed plan.
- Begin conversion without planning: Maia will begin building pipeline(s) immediately without further planning and without asking for approval. Choose this option when you have high confidence that Maia will deliver the expected outcome without additional guidance.
- Click Submit.
Validate Maia pipeline outputs
When you use Maia to create data pipelines in a environment, validation helps ensure that the output from the newly created pipelines is consistent and comparable with the output from the source platform workloads.Load source outputs into the cloud data warehouse
If the output from the source platform workloads is not already in the same cloud data warehouse used by , load it into that cloud data warehouse to simplify comparison. Load the output into a different schema within the same database as the output. Files such as.txt, .csv, or .xlsx can be saved to cloud storage and loaded using a orchestration pipeline. Using fixed input data makes side-by-side validation easier.
You can choose not to load the output into the cloud data warehouse; however, this approach requires more manual validation and is generally less efficient.
Compare pipeline outputs
Follow these steps to compare the output of a pipeline with the output from another product.- Ensure that the output from both and the other product is available in the same cloud data warehouse.
- Create a new transformation pipeline in and add the Table Input component.
- Use the Table Input component to load the output tables from both and the other product.
- Add components such as Detect Changes, Assert View, or Aggregate to compare the results.
You can also ask Maia to compare the two tables and review the results.
