- Create custom connectors.
- Import custom connectors from other Maia projects or from Matillion ETL API Extract profiles.
- Give Maia Team a link to an external OpenAPI documentation specification so that Maia Team can create your custom connector.
- View and manage the existing custom connectors available in your project.
- Browse the Flex connector library, which lists the pre-built Flex connectors that you can use to connect to external data sources.
Creating custom connectors
To create a custom connector, click Add connector in the top right of the Custom connectors dashboard. In the custom connector editor, add and configure the endpoints you want to use as described in Creating custom connectors.Managing custom connectors
From the Custom connectors dashboard, you can edit, delete, export, and download any of your existing custom connectors as described below:-
Edit: Click the name of the custom connector in the list to open the custom connector editor. Make your changes, then click Save. For more information about editing custom connectors, read Creating custom connectors.
Your changes will be reflected in any pipelines that use this custom connector. As a result, you may need to edit these pipelines—for example, if you make a change that requires a different authentication method, you will need to update this authentication method in all pipelines using this custom connector.
- Delete: Click the Delete connector icon in its row, then click Yes, delete in the confirmation dialog.
- Export for use in Matillion ETL: Click Use connector, then select Matillion ETL and click Continue. The JSON file created using this option can be imported into Matillion ETL and used to fetch data as described in Using custom connectors in Matillion ETL.
- Download: Click Use connector, then select Download and click Continue. The JSON file created using this option is a complete representation of your custom connector, which can be used for troubleshooting.
Flex connector library
The Flex connector library lists the pre-built connectors that let you fetch data from commonly used APIs. You can use Flex connectors as the basis for your own custom connectors, saving you time adding and configuring frequently used endpoints. To use a Flex connector, click its tile in the library to open it in the custom connector editor. You can then rename your new Flex connector, and add, configure, and remove endpoints as described in Creating custom connectors. After you’re finished, click Save in the top right. This connector will appear in your list of available custom connectors in the Custom connectors dashboard, where you can edit and manage it. For more information about Flex connectors, read Flex connector overview.Importing custom connectors into Maia
You can import custom connectors into Maia from two sources:- Custom connectors that have been exported from Maia. This is useful if you have a custom connector in one project and want to use it in another without recreating the custom connector.
- API Extract profiles that have been exported from Matillion ETL for use in Maia. For more information, read Upgrade: API Extract.
- Click Import in the top left of the Custom connectors dashboard.
- In the Import connector dialog, upload a JSON file up to 50 MB.
- Click Import.
Using custom connectors in Matillion ETL
After exporting a custom connector from Maia, follow these steps to import it into Matillion ETL:- In your Matillion ETL instance, click Project, then Manage API Profiles, then Manage Extract Profiles.
- In the Manage Extract Profiles dialog, click the upload button in the lower left.
- Select the JSON file containing the exported custom connector. If the import is successful, you’ll see the message “API Extract File was uploaded successfully”.
- Click OK.
- The new profile is now listed in the Manage Extract Profiles dialog, and is ready for you to use in orchestration jobs. The profile will have the same name as the exported custom connector. You can add and edit endpoints here, but this shouldn’t be necessary if the connector was correctly configured in Maia.
- Click OK.
- To use the connector in an orchestration job, add an API Extract component to the job canvas and configure the following properties for it:
- Profile: Select the profile you imported.
- Data Source: Select from the list of available endpoints. This list will include all the endpoints you created for the custom connector in Maia, as well as any you added when importing the profile.
