> ## Documentation Index
> Fetch the complete documentation index at: https://docs.maia.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# 2025

export const metl = "Matillion ETL";

export const cdc_runner = "CDC agent";

export const m_runner = "Maia runner";

export const s_runner = "Streaming runner";

export const designer = "Designer";

export const maia = "Maia";

Here you'll find the 2025 changelog for {maia}. Just want to read about new features? Read our [New Features](https://roadmap.matillion.com/changelog) blog.

<Update label="December 18, 2025" description={designer}>
  ## Designer - New features

  * A new **Contributor** role has been added for Environments. This is part of a set of [changes to roles and permissions](/docs/administration/important-changes-to-roles-and-permissions) over the next few months. For more information, read [Environment roles](/docs/administration/environment-roles).
</Update>

<Update label="December 17, 2025" description={designer}>
  ## Designer - New features

  * You can now create unlimited API credentials and assign each credential a specific role at the account level. This update enables safer integrations and a cleaner separation of duties for your automation. For more information, read [Account roles for API credentials](/docs/administration/api-credentials).

  Components:

  * Added a new ORC Load component for Snowflake that loads data directly into a Snowflake table from one or more ORC files stored in Snowflake Managed Storage, Amazon S3, Google Cloud Storage, or Azure Blob Storage. For more information, read [ORC Load](/docs/components/orc-load).
  * Added a new AVRO Load component for Snowflake that loads data directly into a Snowflake table from one or more AVRO files stored in Snowflake Managed Storage, Amazon S3, Google Cloud Storage, or Azure Blob Storage. For more information, read [AVRO Load](/docs/components/avro-load).
  * Added a new Parquet Load component for Snowflake that loads data directly into a Snowflake table from one or more Parquet files stored in Snowflake Managed Storage, Amazon S3, Google Cloud Storage, or Azure Blob Storage. For more information, read [Parquet Load](/docs/components/parquet-load).
</Update>

<Update label="December 9, 2025" description={designer + ", Billing"}>
  ## Designer - New features

  * You can now quickly locate any file and folder in your project using the new search bar in the Files Panel.

  Components:

  * Added a new [Show to Grid](/docs/components/show-to-grid) component for Snowflake, which allows you to save the results of a Snowflake SHOW command into a grid variable for further processing within your orchestration pipeline.

  ## Billing - New features

  * A new **Same as billing** checkbox is now available in the **Shipping Address** section of the credit card [payment method](/docs/administration/marketplace-subscriptions#choosing-a-payment-method), allowing you to automatically populate shipping details using your billing address.
</Update>

<Update label="December 8, 2025" description={designer}>
  ## Designer - New features

  * You can now set [default session parameters](/docs/guides/environments#select-defaults) for Snowflake connections when you create an environment. Session parameters can be used to modify the behavior of your Snowflake connection.
</Update>

<Update label="December 4, 2025" description="Streaming">
  ## Streaming - Improvements

  * Fixed a bug to ensure that a pipeline failure email will be sent if a pipeline fails to restart when scheduled, and the pipeline is opted in to receive error emails.
</Update>

<Update label="December 2, 2025" description={designer}>
  ## Connectors - New features

  * Added a new [Snowflake Load](/docs/components/snowflake-load) connector, which enables you to fetch data from a Snowflake database. This new connector offers full and incremental load options, allowing you to only fetch new and updated rows of data.
</Update>

<Update label="November 27, 2025" description={designer}>
  ## Designer - New features

  Matillion MCP server:

  * The [Matillion MCP server](/docs/api-reference/mcp-server) is now publicly available. The MCP server offers a secure, standardized way for Large Language Models (LLMs) to interact with your {maia} resources. By configuring the MCP server, you can enable AI assistants to help with tasks such as monitoring pipeline executions, analyzing credit consumption, and triggering pipeline runs

  Maia:

  * You can now [rename and delete](/docs/guides/maia-sessions-and-tools#renaming-and-deleting-conversations) previous conversations with Maia to make it easier to find useful previous chats, or clear conversations that you no longer need.
</Update>

<Update label="November 26, 2025" description={designer}>
  ## Designer - New features

  {m_runner}s:

  * You can now restrict which {m_runner}s are available to a specific project or environment, and ensure that only specific environments are allowed to use {m_runner}s. For more information, read [Restricting {m_runner}s](/docs/guides/restrict-a-runner).

  API:

  * The following endpoints have been added to the [{maia} REST API](/docs/api-reference/maia-api-overview):

  **{m_runner}s**

  | Method     | Endpoint                         | Description                                                    |
  | ---------- | -------------------------------- | -------------------------------------------------------------- |
  | **DELETE** | `/v1/agents/{agentId}/allowlist` | Remove project from {m_runner} allow list.                     |
  | **GET**    | `/v1/agents/{agentId}/allowlist` | Get the {m_runner}'s allow list.                               |
  | **PATCH**  | `/v1/agents/{agentId}/allowlist` | Add projects and/or environments to a {m_runner}'s allow list. |
  | **PUT**    | `/v1/agents/{agentId}/allowlist` | Set a {m_runner}'s allow list.                                 |
</Update>

<Update label="November 21, 2025" description={designer}>
  ## Designer - New features

  * You can now use [slash commands](/docs/guides/maia-sessions-and-tools#slash-commands) when interacting with Maia. These commands simplify complex prompts into single-word commands that instruct Maia to document, explain, fix, optimize and annotate files in your project.
</Update>

<Update label="November 14, 2025" description={designer}>
  ## Designer - New features

  Maia:

  * Maia now offers [plan mode](/docs/guides/maia-sessions-and-tools#plan-mode), which allows you to chat to Maia about your pipelines without making any changes to their configuration. In plan mode, Maia will suggest a multi-step plan to achieve your goal, but will not make any changes until you approve the plan.
  * Maia can now move, copy and rename files in your project. For example, you can now tell Maia to "Make a copy of my 'customer\_data' pipeline, rename it to 'customers', and move it into my 'customer\_data' folder".
  * Maia now supports grid variables. As a result, it can create grid variables with defined columns and default values, build pipelines that use grid variables, and help to configure components such as [Grid Iterator](/docs/components/grid-iterator) and [Append to Grid](/docs/components/append-to-grid).
</Update>

<Update label="November 13, 2025" description={m_runner + "s, " + designer}>
  ## Maia runners - New features

  * Added the ability to upload [external database drivers](/docs/guides/uploading-external-drivers) to the {m_runner} for Snowflake.

  ## Connectors - New features

  * Added a new JSON Load component for Snowflake that loads data directly into a Snowflake table from one or more JSON files stored in Snowflake Managed Storage, Amazon S3, Google Cloud Storage, or Azure Blob Storage. For more information, read [JSON Load](/docs/components/json-load).
</Update>

<Update label="November 10, 2025" description="Streaming">
  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.113.69` to `2.113.75`.
  * Improve error messages shown in the pipeline event log if the Streaming pipeline stops with an error.
  * Library updates and security fixes.
</Update>

<Update label="November 7, 2025" description={designer}>
  ## Connectors - New features

  * Added an authentication guide to connect to a Fabric Lakehouse SQL analytics endpoint using the [Microsoft SQL Server Load](/docs/components/microsoft-sql-server-load) component. For more information, read [Microsoft Fabric Lakehouse authentication guide](/docs/guides/microsoft-fabric-lakehouse-authentication-guide).
</Update>

<Update label="November 6, 2025" description={designer}>
  ## Designer - New features

  Maia:

  We have added two new Maia features. You can now ask Maia to:

  * Visualize a sample of your data directly in the chat panel, so you can spot trends at a glance. To use this feature, ask Maia to create a chart visualizing the data in a component in your pipeline. For more details, read [Visualizing data](/docs/guides/maia-sessions-and-tools#visualizing-data).
  * Search files in your project and provide information about the content of your files. For example, you can ask Maia to tell you how you have configured specific components, or which pipelines contain data from a specific table. For more information, read [File exploration](/docs/guides/maia-sessions-and-tools#file-exploration).
  * When creating a custom connector with Maia, you can now upload a PDF, JSON, or YAML file, including Postman collections and OpenAPI specifications.

  Pipeline quality review:

  * Added a new **Review** button to the {designer} canvas. The **Review** feature lets you check whether your pipelines meet a defined set of rules, so you can be sure that your pipelines align with your organization's standards. For more information, read [Reviewing pipeline quality](/docs/guides/pipeline-quality).
</Update>

<Update label="October 30, 2025" description={designer}>
  ## Connectors - New features

  * Added the [Open Exchange Rates](/docs/components/open-exchange-rates) Flex connector for developing pipelines.
</Update>

<Update label="October 28, 2025" description={designer}>
  ## Connectors - New features

  * Added a new CSV Load component for Snowflake that loads data directly into a Snowflake table from one or more CSV files stored in Snowflake Managed Storage, Amazon S3, Google Cloud Storage, or Azure Blob Storage. For more information, read [CSV Load](/docs/components/csv-load).
</Update>

<Update label="October 23, 2025" description={designer + ", " + m_runner + "s, Streaming"}>
  ## Connectors - New features

  * Added three new Oracle Fusion Cloud connectors for Snowflake projects. All three connectors offer full and incremental load options, allowing you to only fetch new and updated rows of data. For more information, read:
    * [Oracle Fusion Cloud Financials Load](/docs/components/oracle-fcf-load)
    * [Oracle Fusion Cloud Procurement Load](/docs/components/oracle-fcp-load)
    * [Oracle Fusion Cloud Project Management Load](/docs/components/oracle-fcpm-load)
  * Added support for Oracle Wallet in the [JDBC Load](/docs/components/jdbc-load) connector, enabling secure mutual TLS connections to Oracle Autonomous Databases. For more information, read [Oracle Autonomous Database authentication guide](/docs/guides/oracle-autonomous-database-authentication-guide).

  ## Maia runners - Improvements

  * You can now include `.sso` (Oracle Wallet) files when uploading external drivers to the {m_runner}. For more information, read [Uploading external drivers to the {m_runner}](/docs/guides/uploading-external-drivers#valid-external-driver-file-types)

  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.113.23` to `2.113.69`.
  * Library updates and security fixes.
</Update>

<Update label="October 22, 2025" description={designer}>
  ## Designer - Improvements

  * Maia now saves your recent conversations, making it easy to continue where you left off or revisit previous work. To resume a previous conversation with Maia, either click the conversation in the **Branch conversations** section of the Maia interface, or click **Chat history** in the top right to view a list of recent conversations. For more information, read [Sessions and tools in Maia](/docs/guides/maia-sessions-and-tools).
</Update>

<Update label="October 21, 2025" description={designer}>
  ## Connectors - New features

  * Added a new [NetSuite SuiteAnalytics Load](/docs/components/netsuite-suiteanalytics-load) connector, which offers full and incremental load options. This component is currently only available for Snowflake projects.
</Update>

<Update label="October 16, 2025" description={designer}>
  ## Designer - Improvements

  * Added the ability to include descriptions with pipelines, to improve collaboration and clarity when sharing pipelines. You can now add a description to your pipelines during creation, and at the point of sharing. Descriptions can be a maximum of 1000 characters.
  * We have recently addressed an inconsistency where nested variables (i.e. a variable specified as the value of another variable) were not always being resolved. To ensure predictable and reliable pipeline execution, all nested variables will now be consistently resolved to their final value, up to one level of nesting. We understand that some pipelines may have been built to rely on the previous behavior. While we never intend to disrupt your workflows, this update was necessary to guarantee a consistent experience for all users and pipelines. For more information, read [Using variables](/docs/guides/variables#using-variables).
</Update>

<Update label="October 14, 2025" description={designer}>
  ## Designer - Improvements

  * Added a new **Passphrase parameter** *(optional)* to the [Database Query](/docs/components/database-query#connect) component. Use the drop-down menu to select the secret definition storing your passphrase. If your private key is passphrase protected, you will also need to add a secret to store the passphrase. For more information, read [Using Snowflake key-pair authentication](/docs/administration/snowflake-key-pair-authentication).
</Update>

<Update label="October 9, 2025" description="API">
  ## API - New endpoints

  The following endpoints have been added to the [{maia} REST API](/docs/api-reference/maia-api-overview). You can use them to create a project within {maia}. For more information, read [Project Provisioning API](/docs/api-reference/provisioning-a-project) and [Generating a Personal Access Token](/docs/api-reference/generating-a-pat).

  **Project provisioning**

  | Method   | Endpoint                                             | Description                           |
  | -------- | ---------------------------------------------------- | ------------------------------------- |
  | **POST** | `/v1/projects`                                       | Create a project                      |
  | **POST** | `/v1/projects/{projectId}/data-platform-connections` | Create a default warehouse connection |
  | **POST** | `/v1/projects/{projectId}/environments`              | Create an environment                 |
  | **POST** | `/v1/projects/{projectId}/repositories`              | Initialize a repository               |
</Update>

<Update label="October 7, 2025" description={designer}>
  ## Designer - New features

  * Added a new [IBM Db2 for i Load](/docs/components/ibm-db2-load) connector. This connector offers a new Incremental Load option, which allows you to only load new or updated records each time your pipeline runs.
</Update>

<Update label="October 6, 2025" description="Audit service API">
  ## Audit service API - New features

  * The [Audit service API](/api-reference/audit-events/query-audit-events-in-a-time-range) now includes event types for [accounts](/docs/guides/audit-service#account).
</Update>

<Update label="October 2, 2025" description={designer}>
  ## Designer - New features

  {designer}:

  * When sampling data, you can now use an SQL query to filter the rows displayed in the table in the **Sample data** tab. You can filter for string, number, and date values, as well as using `AND` and `OR` operators to combine different filter criteria. For more information, read [Filtering sampled data](/docs/guides/sampling-output#filtering-sampled-data).

  Connectors:

  * Added a new [Workday Load](/docs/components/workday-load) connector, which offers full and incremental load options.
</Update>

<Update label="September 29, 2025" description={maia}>
  ## Maia - New features

  Custom Connector:

  * You can now add multiple OAuth providers to a single Custom Connector endpoint.
</Update>

<Update label="September 24, 2025" description={designer}>
  ## Designer - New features

  Git actions:

  Added a new [Revert changes](/docs/guides/git-revert) action to the branch menu. You can now revert your branch to a previous commit, which will undo all the changes that have been made to your branch after the selected commit. This new feature ensures that your commit history stays intact, and allows you to track all the changes made to your branch.
</Update>

<Update label="September 22, 2025" description={designer}>
  ## Designer - New features

  Schedules:

  You can now run schedules on demand using the **Run now** option in the **Schedules** tab of your project. For more details, read [Run now](/docs/guides/schedules#run-now).
</Update>

<Update label="September 18, 2025" description={designer}>
  ## Connectors - New features

  Added a new [Jira Load](/docs/components/jira-load) connector, which offers full and incremental load options.
</Update>

<Update label="September 17, 2025" description={designer}>
  ## Connectors - New features

  A new endpoint for accessing OpenLineage events has been added to the [{maia} Flex connector](/docs/components/maia-flex-connector).
</Update>

<Update label="September 11, 2025" description={designer}>
  ## Designer - Improvements

  Maia:

  * Maia is now faster at completing a range of tasks, especially when adding multiple instances of the same component to the {designer} canvas.
  * Maia can now make multiple instances of the same type of change at the same time. For example, when adding or updating table prefixes for multiple Table Output components in a pipeline.
  * Maia can now interact with scalar variables.
  * Maia can now use iterators on components.

  {designer} UI:

  * You can now add a component between two existing, connected components. Click on the connector line and then click **+** and choose the component you wish to add into the middle.
</Update>

<Update label="September 10, 2025" description={designer}>
  ## Designer - Improvements

  Schedules:

  * Upgraded the maximum number of [schedules](/docs/guides/schedules) that can be created per account from 500 to 1000.
</Update>

<Update label="September 8, 2025" description="Streaming">
  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.113.15` to `2.113.23`.
  * Fixed an issue where a failed snapshot would cause the pipeline to lose any streaming events that were created during the snapshot window.
  * Library updates and security fixes.
</Update>

<Update label="September 5, 2025" description={designer}>
  ## Connectors - New features

  * Added a [Shopify Load](/docs/components/shopify-load) connector, which offers full and incremental load options.

  ## Designer - Improvements

  * Added the **dbt Core Version** property to the [dbt Core](/docs/components/dbt-core) component. This property allows you to select which version of dbt Core to use.
</Update>

<Update label="September 1, 2025" description="Streaming">
  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.113.6` to `2.113.15`.
  * Library updates and security fixes.
</Update>

<Update label="August 28, 2025" description={m_runner + "s"}>
  ## Maia runners - New features

  * You can now [test the outbound connection](/docs/guides/manage-runners#test-connectivity) from a Hybrid SaaS {m_runner} to a specified host and port.
</Update>

<Update label="August 27, 2025" description={designer + ", API"}>
  ## Designer - New features

  Two new connectors are available, both offering full and incremental load options:

  * [Marketo Load](/docs/components/marketo-load)
  * [SugarCRM Load](/docs/components/sugarcrm-load)

  ## API - New endpoints

  The following endpoints have been added to the [{maia} REST API](/docs/api-reference/executing-and-managing-a-pipeline?fullpage=true#/):

  **Environments**

  | Method     | Endpoint                                                  | Description                    |
  | ---------- | --------------------------------------------------------- | ------------------------------ |
  | **DELETE** | `/v1/projects/{projectId}/environments/{environmentName}` | Delete an environment by name. |

  **Lineage**

  | Method  | Endpoint             | Description                                                                         |
  | ------- | -------------------- | ----------------------------------------------------------------------------------- |
  | **GET** | `/v1/lineage/events` | Retrieve OpenLineage-formatted lineage events within a time range, with pagination. |

  **{m_runner} allow list**

  | Method     | Endpoint                         | Description                                                         |
  | ---------- | -------------------------------- | ------------------------------------------------------------------- |
  | **GET**    | `/v1/agents/{agentId}/allowlist` | Get the current allow list for a {m_runner}.                        |
  | **PATCH**  | `/v1/agents/{agentId}/allowlist` | Add projects and/or environments to a {m_runner}'s allow list.      |
  | **PUT**    | `/v1/agents/{agentId}/allowlist` | Replace the allow list for a {m_runner} (overwrites existing).      |
  | **DELETE** | `/v1/agents/{agentId}/allowlist` | Remove a project and/or environment from a {m_runner}'s allow list. |
</Update>

<Update label="August 26, 2025" description={designer}>
  ## Designer - New features

  * The **Files** panel now displays indicators next to the name of a pipeline if it has uncommitted changes, to help you quickly identify changes that you have made but not yet committed. The indicators are **N** for new pipelines, **M** for modified pipelines, and **R** for renamed pipelines.
</Update>

<Update label="August 22, 2025" description={designer + ", Streaming"}>
  ## Designer - New features

  * Added new endpoints to the [{maia} connector](/docs/components/maia-flex-connector). These include endpoints for {m_runner}s, schedules, and audit events.

  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.113.5` to `2.113.6`.
  * Fixed an issue in the Db2 connector when processing columns with datatype NCHAR or NVARCHAR.
</Update>

<Update label="August 21, 2025" description="Streaming">
  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.112.12` to `2.113.5`.
  * Library updates and security fixes.
</Update>

<Update label="August 20, 2025" description="Maia">
  ## Maia - Improvements

  * Maia has been updated with the following new features:
    * **Automatic to-do lists:** Maia now creates and displays a to-do list for the tasks you give it, helping you to track Maia's progress, and helping Maia to stay focused on the task at hand.
    * **File mentions:** You can now direct Maia to specific files in your project by mentioning them in your prompt. To do this, use `@` followed by the file name, for example `@myfile.md`. Maia will then read the file and use it to inform its responses. You can also use `@` to direct Maia to files you want it to update, or to provide specific context for the task at hand.
    * **Textual file support:** Maia can now read from and write to a range of textual files, including Markdown `.md`, SQL `.sql`, and Python `.py` files. This allows Maia to work directly with your code, create documentation, and edit other text-based files.
</Update>

<Update label="August 14, 2025" description={maia}>
  ## Maia - Improvements

  * You can now specify a [Policy ID](/docs/guides/databricks-jobs-compute) when using Databricks Jobs Compute to execute Databricks transformation pipelines. This allows you to enforce governed compute usage in Databricks projects.
</Update>

<Update label="August 8, 2025" description="Streaming">
  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.112.9` to `2.112.12`.
  * Library updates and security fixes.
</Update>

<Update label="August 6, 2025" description={designer}>
  ## Connectors - New features

  You can now use the following new connectors in Snowflake projects. Both new connectors offer Incremental Load options.

  * [JDBC Load](/docs/components/jdbc-load)
  * [MariaDB Load](/docs/components/mariadb-load)
    * We recommend using this connector instead of using the Database Query component to connect to MariaDB.

  ## Designer - Improvements

  Sampling data:

  * You can now export the data displayed in the **Sample data** tab in {designer} as a CSV file. For more information, read [Sampling output](/docs/guides/sampling-output).
</Update>

<Update label="August 1, 2025" description={designer}>
  ## Maia - New features

  You can now enable and disable Maia features in your account settings. For more information, read [Edit account settings](/docs/administration/manage-accounts#edit-account-details).
</Update>

<Update label="July 31, 2025" description="API">
  ## API - New endpoints

  * New endpoints for creating and managing Streaming pipeline definitions have been added to the [{maia} REST API](/docs/api-reference/maia-api-overview). You can find a how-to guide for common tasks involving these endpoints [here](/docs/api-reference/streaming-pipeline).
</Update>

<Update label="July 30, 2025" description={"Streaming, " + designer}>
  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.112.8` to `2.112.9`.
  * Db2 for IBM i: add support for processing journal entries where a date is an empty string.

  ## Designer - Improvements

  For Databricks projects, once a Jobs Compute configuration is created, the dialog named after your configuration now displays key details at a glance, rather than just the Compute ID. Additionally, if an environment is associated with a Jobs Compute, its configuration is now shown directly in the environment list when selected. For more information, read [Databricks Jobs Compute](/docs/guides/databricks-jobs-compute).
</Update>

<Update label="July 29, 2025" description="Streaming">
  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.111.76` to `2.112.8`.
  * Library updates and security fixes.
  * Fixed an issue where a {s_runner} out-of-memory (OOM) error would not be reported as a pipeline event correctly.
</Update>

<Update label="July 25, 2025" description={designer + ", API"}>
  ## Designer - New features

  AI components:

  * A new [Amazon OpenSearch Upsert](/docs/components/amazon-opensearch-upsert) component is now available. This component lets you upsert data converted into vector embeddings into an Amazon OpenSearch Service index using the Amazon OpenSearch Service API. Currently, this component only supports provisioned OpenSearch services, not serverless. Supported embedding providers include Amazon Bedrock and OpenAI.

  ## API - New endpoints

  * A new endpoint for accessing comprehensive audit logs over a period of time has been added to the [{maia} REST API](/api-reference/audit-events/query-audit-events-in-a-time-range):

  | Method  | Endpoint     | Description                                   |
  | ------- | ------------ | --------------------------------------------- |
  | **GET** | `/v1/events` | Retrieves audit events in a given time range. |
</Update>

<Update label="July 24, 2025" description={designer}>
  ## Connectors - New features

  Added the following connectors, which offer Incremental Load:

  * [Microsoft SQL Server Load](/docs/components/microsoft-sql-server-load)
  * [PostgreSQL Load](/docs/components/postgresql-load)
</Update>

<Update label="July 22, 2025" description={designer}>
  ## Designer - New features

  Metadata sampling:

  * You can now use the **Metadata** tab to view the name, data type, and size of each column in a component's output. For more information, read [Metadata](/docs/guides/sampling-output#metadata).

  Connectors:

  Added the following Flex connectors for developing data pipelines:

  * [Dropbox](/docs/components/dropbox)
  * [Dynamics 365 Business Central](/docs/components/dynamics-365-business-central)
  * [Microsoft Dataverse](/docs/components/microsoft-dataverse)
  * [Salesforce Pardot](/docs/components/salesforce-pardot)
  * [Zuora](/docs/components/zuora)
</Update>

<Update label="July 18, 2025" description={designer}>
  ## Components - New features

  * The [X Ads Load](/docs/components/x-ads-load) component, which supersedes the [X Ads](/docs/components/x-ads) component, is now available for Snowflake projects. This component lets you fetch data using the X Ads API.
</Update>

<Update label="July 11, 2025" description={designer}>
  ## Components - New features

  * The [Intersect](/docs/components/intersect) component is now available for Databricks projects. This component lets you compare two datasets, and then return any rows that are identical in both datasets.
</Update>

<Update label="July 8, 2025" description={designer + ", " + maia}>
  ## Designer - New features

  Git actions:

  * When committing changes in {designer}, you can now choose which files to include in each commit. For more information, read [How to commit](/docs/guides/git-commit#how-to-commit).

  ## Maia - New features

  Amazon Redshift environments:

  * When creating an Amazon Redshift environment, you can now choose whether to use the credentials associated with the {m_runner} you selected when creating your project, or to override these credentials by entering new credentials. For more information, read [Specify cloud data warehouse credentials](/docs/guides/environments#amazon-redshift).
</Update>

<Update label="July 2, 2025" description={designer}>
  ## Components - New features

  * [Databricks Jobs Compute](/docs/guides/databricks-jobs-compute) lets you run and/or schedule transformation pipelines using a Databricks Jobs Compute cluster.
</Update>

<Update label="June 27, 2025" description="Maia">
  ## Maia - New features

  [Maia](/docs/guides/maia-ai-agents-overview) is now generally available in {maia}.

  * All [Maia](/docs/guides/maia-ai-agents-overview) features in {designer}, including [support for both transformation and orchestration pipelines](/docs/guides/maia-pipelines), multi-pipeline workflows, interactive [tools](/docs/guides/maia-sessions-and-tools), and natural language prompting, are now generally available (GA) in {maia}.
</Update>

<Update label="June 26, 2025" description={designer}>
  ## Designer - Improvements

  Components:

  * [Grid Variables](/docs/guides/grid-variables) are now supported in the [Calculator](/docs/components/calculator) component.
</Update>

<Update label="June 24, 2025" description={designer + ", API"}>
  ## Designer - New features

  Git:

  * You can now [search your commit history](/docs/guides/git-commit#view-commit-history) by commit message, timestamp, author, and hash to stay informed about all changes made in your branch.

  ## API - New endpoints

  * A new endpoint for a {m_runner} creation has been added to the [{maia} REST API](/api-reference/agents/create-a-new-agent):

  | Method   | Endpoint     | Description                                                            |
  | -------- | ------------ | ---------------------------------------------------------------------- |
  | **POST** | `/v1/agents` | Creates a new {m_runner} using the specified configuration parameters. |
</Update>

<Update label="June 23, 2025" description={designer}>
  ## Designer - New features

  * Added a new auto-complete feature to some component properties, which makes it easier to include variables and warehouse functions in various fields, such as [Calculator](/docs/components/calculator) expressions or [Send Email](/docs/components/send-email) messages.
</Update>

<Update label="June 19, 2025" description={"Maia, " + designer}>
  ## Maia - New features

  [Maia](/docs/guides/maia-ai-agents-overview) is now live in {maia}.

  Maia in {designer}:

  * [Maia](/docs/guides/maia-ai-agents-overview) is your always-on agentic data team, enabled via natural language prompting. You can collaborate with Maia directly in {designer} to deliver data faster and to automate repetitive tasks.
  * [Maia supports both transformation and orchestration pipelines](/docs/guides/maia-pipelines). Support for orchestration pipelines is currently in public preview.
  * Maia can build, run, and update data pipelines for you, all via your natural language prompts.
  * Maia can advise you about designing optimal data pipelines in {designer}. Maia can recommend next steps in your pipeline flow and even clarify any queries you have about your pipelines and the components therein.
  * Maia can explore the cloud data warehouse that you have connected to the environment in your {maia} project, examining data structures and relationships to help you create the pipelines that lead to the most value.
  * Maia will suggest actions, including version control operations such as committing your branch's current state and pushing those commits to your remote repository.
  * Maia uses [tools](/docs/guides/maia-sessions-and-tools) to perform tasks in your {designer} workspace based on your prompts. These tools let Maia go beyond chat and perform real, interactive actions.
  * Maia works across multiple pipelines.

  Connectors:

  * [Maia can create custom connectors](/docs/guides/create-a-custom-connector-with-maia) for you. Maia works with any API that has publicly viewable documentation pages (ideally static HTML) that list and define available endpoints, methods, and parameters.

  Observability dashboard:

  * Maia can perform root cause analysis on a failed pipeline and will suggest steps you can take to get your pipeline working again.
  * Maia can detect anomalies in your scheduled pipeline runs, such as sudden spikes in execution time. Maia does this by analyzing past scheduled pipelines, and will provide visual indicators for significant behavioral deviations.

  ## Designer - New features

  New connector:

  * Added a new [Salesforce Load](/docs/components/salesforce-load) connector, which offers Incremental Load options.

  ## Designer - Improvements

  Components:

  * The [JDBC Table Metadata to Grid](/docs/components/jdbc-table-metadata-to-grid) component now supports an additional authentication method when the database type is set to **Snowflake**. Users can now choose **Key Pair Authentication**.

  <Note>
    Key pair authentication is the recommended authentication method, as [Snowflake plans to block single-factor password authentication by November 2025](/docs/tech-notes/tech-note-snowflake-to-block-single-factor-password-authentication).
  </Note>
</Update>

<Update label="June 18, 2025" description={maia}>
  ## Maia - New features

  New connector:

  * Added a new [Oracle Unload from Snowflake](/docs/components/oracle-unload-snowflake) connector, which enables you to unload data from your Snowflake data warehouse to an Oracle database.
</Update>

<Update label="June 16, 2025" description="Streaming">
  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.111.64` to `2.111.76`.
  * Library updates and security fixes.
  * Oracle pipelines will now always include BLOB and CLOB data in change events emitted during the snapshot period, regardless of the `lob.enabled` advanced setting.
  * Fixed an issue where an Oracle connection could pass validation but fail to retrieve source information.
  * Fixed an issue for SQL Server pipelines where the {s_runner} would incorrectly emit a snapshot error event during a snapshot.
</Update>

<Update label="June 11, 2025" description={designer}>
  ## Components - New features

  * [Create External Table](/docs/components/create-external-table) is now available for Snowflake.
</Update>

<Update label="June 10, 2025" description={maia}>
  ## Maia - New features

  * All automatic and export variables in {metl} are now automatically migrated as system variables in {maia}. For more information, read [Migration: Export variables](https://docs.matillion.com/metl/docs/migration-export-variables/), and [Migration: Automatic variables](https://docs.matillion.com/metl/docs/migration-automatic-variables/).

  Components:

  * [Convert Type](/docs/components/convert-type#__tabbed_1_3) is now available for Amazon Redshift.

  ## Maia - Improvements

  * New and improved [filters](/docs/guides/pipeline-run-history#filter-pipeline-runs) on the pipeline runs of the Pipeline run history page. Users can now filter by **Status**, **Project**, and **Environment**.
</Update>

<Update label="May 29, 2025" description={designer + ", " + m_runner + "s"}>
  ## Designer - New features

  * Monitor the health of your data pipelines with real-time **Pipeline notifications**. These notifications keep users informed about pipeline failures in projects and environments they can access. Alerts are sent via email for scheduled and API-triggered runs, but not for manual executions.
  * The new **View commit history** Git action allows you to see the previous commits you have made in your branch. For more details, read [View commit history](/docs/guides/git-commit#view-commit-history).

  ## Maia runners - New features

  {maia} is now available for [running in your Snowflake account](/docs/guides/snowflake-runner-install) using Snowpark Container Services.
</Update>

<Update label="May 28, 2025" description={maia}>
  ## Maia - New features

  {maia} has released a new navigation and {designer} user experience, including the following improvements:

  * **New left navigation** enables you to move between key areas of {maia} from anywhere in the platform.
  * **Profile & Account icon in the left navigation** provides quick access to user and account settings.
  * **Expanded {designer} canvas** reduces visual clutter, providing more space for pipeline creation.
  * **Resizable Files and Schemas panels** can be docked or positioned anywhere on the canvas.
  * **Shorter load times** in {designer} ensure faster navigation and reduced latency.
</Update>

<Update label="May 23, 2025" description={maia + ", Streaming"}>
  ## Maia - New features

  Schedules:

  * When viewing schedules in the **Your projects** list, you can now filter the displayed schedules by their environment.

  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.111.47` to `2.111.64`.
  * Reverted Snowflake JDBC driver version to `3.21.0`.
  * Library updates and security fixes.
</Update>

<Update label="May 22, 2025" description={designer}>
  ## Designer - New features

  Secret definitions:

  * You can now create secret definitions in {designer} when configuring components, without needing to leave the canvas. For information about creating secret definitions, read [Secrets and secret definitions](/docs/guides/secrets-and-secret-definitions).

  Environments:

  * You can now delete environments, provided that there are no active schedules running pipelines in the environment, and it is not the default environment for any branches. For more information, read [Delete an environment](/docs/guides/environments#delete-an-environment).

  Components:

  * You can now set an optional **Message** field as part of the post-processor for any component. This means you can add a custom, descriptive message that clearly communicates what's happening at each step of your pipeline, tailored to your specific requirements.
</Update>

<Update label="May 19, 2025" description={designer}>
  ## Designer - New features

  Secret definitions:

  * If you use a Full SaaS deployment model, you can now update the value of secret definitions, for example if a password changes. For more information, read [Update a secret definition](/docs/guides/secrets-and-secret-definitions#update-a-secret-definition).
</Update>

<Update label="May 16, 2025" description="Streaming">
  ## Streaming - New features

  * A [{s_runner} for Google Cloud](/docs/streaming/gcp-streaming-agent-install) is now available. This {s_runner} can be installed in Google Cloud and used to run Streaming pipelines in {maia}.
</Update>

<Update label="May 15, 2025" description={"Streaming, " + designer}>
  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.111.40` to `2.111.47`.
  * Improved the pipeline activity reporting to ensure consistent consumption reporting, especially during times when the source database has limited changes going through.
  * Library updates and security fixes.

  ## Designer - Improvements

  * The [Unstructured](/docs/components/unstructured) Flex connector has been renamed to **Unstructured.io**. Two new POST endpoints have been added: **Cancel Job** and **Run Workflow**.
</Update>

<Update label="May 13, 2025" description={designer}>
  ## Designer - New features

  AI components:

  * Added a [Cortex Finetune](/docs/components/cortex-finetune) component, which enables users to fine-tune large language models (LLMs) using Snowflake Cortex.

  Components:

  * [Extract Nested Data](/docs/components/extract-nested-data) is now available for Databricks.

  ## Designer - Improvements

  * A new data type called **Variant** has been added for Databricks in the [Create Table](/docs/components/create-table) component. This data type is supported in Databricks Runtime version 15.4 and above.
</Update>

<Update label="May 8, 2025" description={designer}>
  ## Designer - New features

  New connector:

  * Added a new [Google Sheets](/docs/components/google-sheets) connector, which lets you query the Google Sheets API to retrieve data and load it into a table. You can then use transformation components to enrich and manage the data in permanent tables.
    * The Google Sheets Query connector is no longer available for creating data pipelines, as it has been replaced by the new Google Sheets connector.
</Update>

<Update label="May 6, 2025" description="Streaming">
  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.111.26` to `2.111.40`.
  * Db2 for IBM i: Improve management of JDBC connections.
  * Library updates and security fixes.
</Update>

<Update label="May 2, 2025" description={m_runner + "s"}>
  ## Maia runners - New features

  * {m_runner}s can now be put into a [Paused state](/docs/guides/pause-runner), which gracefully puts the {m_runner} into a safe state when you need to perform maintenance work such as upgrading the version or updating the configuration to add new drivers.
  * We have introduced {m_runner} [version tracks](/docs/guides/runner-overview#maia-foundation-runner-version-tracks), with different release cadences. You can choose a version track based on how the {m_runner} update cadence fits with your operational practices, and how eager you are to take advantage of new features.
  * {m_runner}s can be [updated](/docs/guides/runner-updates) either automatically, as soon as a new release is available, or manually, at a time of your choosing. Read our [support policy](/docs/security/software-updates-and-patch-management#maia-foundation-runner-version-support-policy) for details.
  * A new [{m_runner}s public API](/docs/api-reference/maia-api-overview) lets you list {m_runner} details and also send commands such as `restart` to the {m_runner}.
</Update>

<Update label="April 28, 2025" description={designer}>
  ## Designer - New features

  New connector:

  * Added a new Flex connector for developing data pipelines with data from [Unstructured.io](/docs/components/unstructured)
</Update>

<Update label="April 24, 2025" description={designer}>
  ## Designer - New features

  New connector:

  * Added a new connector for [SAP NetWeaver](/docs/components/sap-netweaver) that lets you connect to SAP to access available data sources. You can then use transformation components to enrich and manage the data in permanent tables.

  Git actions

  * Added a new **View pull requests** action that allows you to view the pull requests in your external Git repository if your team uses a pull request approval workflow. For more information, read [View pull requests](/docs/guides/git-pull-requests#view-pull-requests).
  * After pushing changes to the remote branch, you can click the link in the success notification to create a pull request in your external Git repository.

  Components:

  * A new data type called **Variant** has been added for Databricks in the [Convert Type](/docs/components/convert-type) transformation component. This data type is supported in Databricks Runtime version 15.4 and above.

  ## Designer - Improvements

  Components:

  * The `S3 Attachment` parameter for the [Send Email](/docs/components/send-email) component has now been updated from a `string` to a `file editor`.
</Update>

<Update label="April 17, 2025" description={designer}>
  ## Designer - New features

  AI components:

  * The [Google Vertex AI Prompt](/docs/components/vertex-ai-prompt) component is now available. This component uses a Google Gemini large language model (LLM) to provide responses to user-composed prompts. The component takes one or more inputs in the form of text, image, audio, or video, combines the inputs with user prompts, and sends this data to the LLM for processing.
</Update>

<Update label="April 16, 2025" description="API">
  ## API - New endpoints

  The following endpoint has been added to the [{maia} REST API](/docs/api-reference/maia-api-overview):

  **Secret references**

  | Method     | Endpoint                                                           | Description               |
  | ---------- | ------------------------------------------------------------------ | ------------------------- |
  | **DELETE** | `/v1/projects/{projectId}/secret-references/{secretReferenceName}` | Delete a secret reference |
</Update>

<Update label="April 11, 2025" description={designer + ", Streaming"}>
  ## Designer - New features and improvements

  * You can now view and resolve merge conflicts using the **Merge from branch** Git action. For more information, read [Resolving merge conflicts](/docs/guides/git-merge#resolving-merge-conflicts).
  * The `S3 Location` parameter in [Send Email](/docs/components/send-email) has been updated to `S3 Attachment`.

  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.111.18` to `2.111.26`.
  * Db2 for IBM i: Add option to disable use of unique indexes.
  * Db2 for IBM i: Default connection `date time` property to `iso`.
  * Added periodic diagnostic logging.
  * Library updates and security fixes.
</Update>

<Update label="April 4, 2025" description="Streaming">
  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.111.6` to `2.111.18`.
  * Db2 for IBM i: Set the default batch size value to 512, and fixed an issue where an incorrect journal receiver library could be used.
  * Library updates and security fixes.
</Update>

<Update label="April 2, 2025" description={designer}>
  ## Designer - New features

  Components:

  * **Copy Grants:** In Snowflake, the COPY GRANTS clause transfers privileges from the original object such as a table, view, schema, or database, to a new object when replacing or cloning, ensuring consistent access control and eliminating manual reassignment. The COPY GRANT clause information has been added to the following documentation:
    * [Create Table](/docs/components/create-table)
    * [Rewrite Table](/docs/components/rewrite-table)
    * [Amazon Bedrock Prompt](/docs/components/amazon-bedrock-prompt)
    * [Azure OpenAI Prompt](/docs/components/azure-openai-prompt)
    * [OpenAI Prompt](/docs/components/openai-prompt)
    * [Snowpark Container Prompt](/docs/components/snowpark-container-prompt)
    * [Pinecone Vector Query](/docs/components/pinecone-vector-query)

  * Transient table type: The [Create Table](/docs/components/create-table) component for Snowflake now supports the new table type, **Transient**. This table type holds data indefinitely but can't be restored.

  * Attach a file using the [Send Email](/docs/components/send-email) component. The attachment must be a single file located in an S3 bucket.
</Update>

<Update label="March 27, 2025" description={designer}>
  ## Designer - New features

  Schedules:

  * Added a new **Allow concurrent schedule runs** option when [creating a schedule](/docs/guides/schedules#create-a-new-schedule) that lets you choose whether a scheduled pipeline run is skipped if the previous scheduled run is still in progress.
</Update>

<Update label="March 25, 2025" description={designer + ", Streaming"}>
  ## Connectors - New features

  * Added a [Coalesce](/docs/components/coalesce) Flex connector for developing pipelines.

  ## Streaming - Improvements

  * Updated the [{s_runner} version](/docs/streaming/agent-versions) from `2.110.4` to `2.111.6`. This is the minimum {s_runner} version required for the new snapshot feature.
  * New [snapshot](/docs/streaming/streaming-pipelines/#overview-of-snapshots) feature introduces recoverability and flexibility. This replaces initial and on-demand snapshot options.
  * New dashboard layout makes it easier to navigate to relevant information.
  * Upgrade of the IBMi Db2 JDBC driver in the {s_runner}.
  * Library updates and security fixes.
</Update>

<Update label="March 21, 2025" description={designer}>
  ## Connectors - New features

  * Added a [Zoom](/docs/components/zoom) Flex connector for developing pipelines.
</Update>

<Update label="March 20, 2025" description={designer}>
  ## Designer - New features

  AI:

  * Added an [ML Classification](/docs/components/ml-classification-sf) component, which uses the Snowflake [Classification](https://docs.snowflake.com/en/user-guide/ml-functions/classification) machine learning (ML) function to sort data into different classes using patterns detected in training data. This component is available in public preview.
</Update>

<Update label="March 14, 2025" description={designer}>
  ## Designer - New features

  * New and updated roles and permissions for projects and environments have been introduced: `Owner`, `Contributor`, `Viewer`, and `None`, replacing `Admin`, `User`, `Read Only`, and `No Access`, respectively. Additionally, a new environment role, `Runner`, has been introduced. All roles and permissions are documented in the following.
    * [Environment roles](/docs/administration/environment-roles)
    * [Project roles](/docs/administration/project-roles)
    * [Networks](/docs/guides/networks#role-permissions)

  New connector:

  * [X Ads](/docs/components/x-ads), which lets you query the X Ads (formerly Twitter Ads) API to retrieve data and load it into a table. You can then use transformation components to enrich and manage the data in permanent tables.

  Maia (formerly Copilot):

  * Maia can now write your Git [Commit](/docs/guides/git-commit) messages for you using the [Conventional Commits](https://www.conventionalcommits.org/en/v1.0.0/) format.
</Update>

<Update label="March 13, 2025" description={designer + ", CDC"}>
  ## Designer - New features

  AI components:

  * Add a [Cortex Multi Prompt](/docs/components/cortex-multi-prompt) component, which uses [Snowflake Cortex](https://www.snowflake.com/en/data-cloud/cortex/) to receive a prompt and then generate multiple responses (completions) using your chosen supported language model. This component is available in public preview.

  ## CDC - Improvements

  * Updates to the [{cdc_runner} version](/docs/streaming/agent-versions).
    * From `2.108.1` to `2.110.3`.
    * From `2.110.3` to `2.110.4`.
  * Reverted the Snowflake JDBC driver to `3.22.0` to mitigate an issue where the first Snowflake request on a {cdc_runner} could fail.
  * When using a storage target or Snowflake with the "Source Database & Schema" prefix, setting the database value is now `Root` where previously the Db2 system name would have been used.
  * Library updates and security fixes.
</Update>

<Update label="March 5, 2025" description={designer}>
  ## Designer - Improvements

  * System variables and post-processing are now generally available:
    * [System Variables](/docs/guides/system-variables) can now be used in component parameters, Python, Bash, and SQL scripts, in addition to [post-processing](/docs/guides/post-processing).
    * Users can access shared and public scalar variables from a child pipeline using the post-processing **Update Scalar** property in [Run Transformation](/docs/components/run-transformation), [Run Orchestration](/docs/components/run-orchestration), and [Run Shared Pipeline](/docs/components/run-shared-pipeline) components.
    * System variables are read-only and cannot be modified manually. Instead, system variable values are updated automatically during component executions.
    * System variables can be directly used in [Python Pushdown](/docs/components/python-pushdown), manually assigned in [Bash Pushdown](/docs/components/bash-pushdown), and used inline in [SQL script (orchestration)](/docs/components/sql-script) and [SQL (transformation) components](/docs/components/sql), with mapping required for external SQL.
    * New child pipeline system variable syntax is `${sysvar.childPipeline.vars.<varname>}` and allows referencing variables from child pipelines, e.g., `${sysvar.childPipeline.vars.var1}`.

  * [Lineage](/docs/guides/data-lineage) now includes orchestration pipelines, providing a comprehensive view of data origins. This expansion introduces support for additional connectors and offers key benefits such as audit and compliance, impact analysis, and faster debugging.
</Update>

<Update label="February 28, 2025" description={designer}>
  ## Designer - Improvements

  * Added support for Snowflake "Named" stages to third-party connectors (Asana, GitHub, Mailchimp, etc.).
  * Added support for Snowflake storage integration stage access strategies when using AWS or Azure as the staging cloud platform with third-party connectors (Asana, GitHub, Mailchimp, etc.).
</Update>

<Update label="February 26, 2025" description="CDC">
  ## CDC - Improvements

  * Updated the [{cdc_runner} version](/docs/streaming/agent-versions) from `2.107.4` to `2.108.1`.
  * Library updates and security fixes.
  * Fixed an issue where the {cdc_runner} could not compact legacy history.dat files.
</Update>

<Update label="February 25, 2025" description={maia}>
  ## Maia - Improvements

  * Updated account admin privileges so that account admins can enable and disable the ability for each user to create projects within an account.
</Update>

<Update label="February 20, 2025" description={designer}>
  ## Designer - Improvements

  * Updated the [SQL Script](/docs/components/sql-script) component for Snowflake and Databricks projects. You can now choose whether to specify which project and pipeline variables to declare as SQL variables upon component execution, or to declare all as SQL variables. By default, no project or pipeline variables are declared as SQL variables prior to an SQL Script component execution.
  * Updated the [OpenAI Prompt](/docs/components/openai-prompt), [Azure OpenAI Prompt](/docs/components/azure-openai-prompt), and [Amazon Bedrock Prompt](/docs/components/amazon-bedrock-prompt) components to add an **Append** setting to the **Create Table Options** property.
</Update>

<Update label="February 18, 2025" description="Streaming">
  ## Streaming - New features and improvements

  * Updates to [Pre-built pipelines](/docs/streaming/sync-all-tables/). Amazon Redshift now supports these types of pipelines.
</Update>

<Update label="February 17, 2025" description="CDC">
  ## CDC - Improvements

  * Updated the [{cdc_runner} version](/docs/streaming/agent-versions) from `2.102.27` to `2.107.4`.
  * Updated the matillion.compact-history default value to `true`.
  * Library updates and security fixes.
</Update>

<Update label="February 13, 2025" description={m_runner + "s"}>
  ## Maia runners - New features

  * Hybrid SaaS {m_runner}s running on AWS can now be [connected via AWS PrivateLink](/docs/guides/connecting-via-privatelink), an AWS service that allows you to connect via a secure, private connection. Using AWS PrivateLink, no traffic is exposed to the public Internet when it travels between {maia} and your own AWS virtual private cloud.
</Update>

<Update label="February 11, 2025" description="API">
  ## API - New endpoints

  The following new endpoints have been added to the [{maia}](/docs/components/maia-flex-connector) Flex connector:

  * List All Schedules
  * Create Schedule
  * Get Schedule
  * List Artifacts
  * Get Artifact
  * Promote Artifact
  * Pipeline Executions
  * List Custom Connectors
  * List Flex Connectors
  * List All Secret References
  * Create Secret Reference
</Update>

<Update label="February 7, 2025" description={designer}>
  ## Designer - Improvements

  * [Workday](/docs/components/workday) and [Workday Custom Reports](/docs/components/workday-custom-reports) now support OAuth 2.0 Authorization Code Grant authentication. For more information about creating an OAuth connection for these components, read the [Workday authentication guide](/docs/guides/workday-authentication-guide).
</Update>

<Update label="February 6, 2025" description={designer}>
  ## Designer - New features and improvements

  {m_runner}s:

  * Added the ability to [restart a Hybrid SaaS {m_runner}](/docs/guides/restart-runner) from within {maia}.

  New orchestration components:

  Database [transactions](/docs/guides/transactions) for Snowflake and Amazon Redshift allow multiple database changes to be executed as a single, logical unit of work. With the introduction of database transactions in {maia}, the following orchestration components have been added:

  * The [Begin](/docs/components/begin) component starts a new [transaction](/docs/guides/transactions) in the database.
  * The [Commit](/docs/components/commit) component completes a [transaction](/docs/guides/transactions), making all changes since the most recent Begin component visible to other users.
  * The [Rollback](/docs/components/rollback) component cancels a [transaction](/docs/guides/transactions), undoing all changes made since the most recent Begin component. These changes remain invisible to other users.

  New connector:

  * Added the [LinkedIn Ads](/docs/components/linkedin-ads) Flex connector for developing data pipelines.
</Update>

<Update label="February 4, 2025" description={designer}>
  ## Designer - Improvements

  Components:

  * Improved the [dbt Core](/docs/components/dbt-core) component by adding two new properties:
    * **dbt Project Location:** Use this property to clarify whether the dbt project is located in an external Git repository that is not connected to your {maia} project, *or* the dbt project is already hosted in the Git repository connected to your {maia} project.
    * **dbt Project:** This property will list any dbt projects that reside in the Git repository connected to your {maia} project. A directory is a dbt project when it includes a `dbt_project.yml` file.
</Update>

<Update label="February 3, 2025" description="API">
  ## API - New endpoints

  The following endpoints have been added to the [{maia} REST API](/docs/api-reference/maia-api-overview):

  **Schedules**

  | Method     | Endpoint                                          | Description                                                       |
  | ---------- | ------------------------------------------------- | ----------------------------------------------------------------- |
  | **GET**    | `/v1/projects/{projectId}/schedules`              | List all schedules for a project                                  |
  | **POST**   | `/v1/projects/{projectId}/schedules`              | Create a new schedule                                             |
  | **DELETE** | `/v1/projects/{projectId}/schedules/{scheduleId}` | Deletes the schedule by the given schedule ID                     |
  | **GET**    | `/v1/projects/{projectId}/schedules/{scheduleId}` | Get a schedule summary for a given schedule ID                    |
  | **PATCH**  | `/v1/projects/{projectId}/schedules/{scheduleId}` | Update the schedule by the given schedule ID and schedule request |

  **Artifacts**

  | Method    | Endpoint                                        | Description                                   |
  | --------- | ----------------------------------------------- | --------------------------------------------- |
  | **GET**   | `/v1/projects/{projectId}/artifacts`            | Get a list of artifacts                       |
  | **PATCH** | `/v1/projects/{projectId}/artifacts`            | Enable or disable an artifact                 |
  | **POST**  | `/v1/projects/{projectId}/artifacts`            | Create an artifact                            |
  | **GET**   | `/v1/projects/{projectId}/artifacts/details`    | Get an artifact by a given version name       |
  | **POST**  | `/v1/projects/{projectId}/artifacts/promotions` | Promote an artifact to a specific environment |

  **Connectors**

  | Method  | Endpoint                | Description                                                |
  | ------- | ----------------------- | ---------------------------------------------------------- |
  | **GET** | `/v1/custom-connectors` | Lists custom connector profiles for the requesting account |
  | **GET** | `/v1/flex-connectors`   | Lists Flex connector profiles                              |

  **Secret References**

  | Method   | Endpoint                                                           | Description                |
  | -------- | ------------------------------------------------------------------ | -------------------------- |
  | **GET**  | `/v1/projects/{projectId}/secret-references`                       | List all secret references |
  | **POST** | `/v1/projects/{projectId}/secret-references/{secretReferenceName}` | Create a secret reference  |
</Update>

<Update label="January 29, 2025" description={designer + ", CDC"}>
  ## Designer - Improvements

  Orchestration:

  * The [S3 Unload](/docs/components/s3-unload) component is now available for Databricks projects.
  * The [Azure Blob Storage Unload](/docs/components/azure-blob-storage-unload) component is now available for Databricks projects.

  Transformation:

  * The [Generate Sequence](/docs/components/generate-sequence) component is now available for Databricks projects.

  ## CDC - Improvements

  * Updated the [{cdc_runner} version](/docs/streaming/agent-versions) from `2.102.1` to `2.102.27`.
  * Library updates and security fixes.
</Update>

<Update label="January 27, 2025" description={designer}>
  ## Designer - Improvements

  Components:

  * Updated Flex and custom connectors to include a `Load Selected Data` parameter. This setting lets you choose whether to return the entire payload (default) or only selected data objects in your API response.
  * Updated the [Python Pushdown](/docs/components/python-pushdown) component. When you set a Python version, the `Packages` parameter is updated to show packages supported by that Python version. Currently the Python Pushdown component supports Python versions 3.9, 3.10 (default), 3.11, and 3.12.
</Update>

<Update label="January 23, 2025" description={designer}>
  ## Designer - Improvements

  {designer} UI:

  * Updated the command palette to include the following action commands, all of which can be activated by typing `SHIFT` + `>`:
    * Run Pipeline
    * Validate Pipeline
    * Canvas: Add component
    * Canvas: Zoom in
    * Canvas: Zoom out
    * Canvas: Zoom to fit

  To access the command palette, type `CMD` + `k` or `CTRL` + `k` or click the magnifying glass button in the upper-right of the UI. Type `CMD` + `SHIFT` + `k` or `CTRL` + `SHIFT` + `k` to open the action commands list directly.

  Components:

  * Updated the [Database Query](/docs/components/database-query) component to include a `Fetch Size` parameter, which lets you specify the batch size of rows to fetch at a time, for example, 500.
</Update>

<Update label="January 22, 2025" description={designer}>
  ## Designer - New features

  DataOps:

  * Artifacts can now be created to ensure that the version of a pipeline that you are releasing to production is the same version that you have tested in your environments. An artifact is an immutable collection of resources (such as pipelines and script files) that is deployed to your chosen environment when you publish. The following guides contain more information about artifacts and how they relate to schedules:
    * [Artifacts](/docs/guides/artifacts) explains how to create, view, and manage artifacts in {maia}.
    * [Schedules](/docs/guides/schedules) explains how artifacts fit into the process of publishing your changes and scheduling pipelines.
  * The process of pushing and publishing local changes using **Git push** has been changed. For more details about how to push and publish your local changes to create a schedule, read [Git push](/docs/guides/git-push).
  * For more information on how {maia} can help you to take an innovative approach to DataOps, read [DataOps in {maia}](/docs/guides/dataops-overview).

  Networks:

  * Customers using a Full SaaS {maia} solution can use the [Database Query](/docs/components/database-query) and [RDS Query](/docs/components/rds-query) components to access data sources within their infrastructure using a configured SSH tunnel. This is accessed via the new Networks tab. Read our [Networks](/docs/guides/networks) guide to get started.
</Update>

<Update label="January 20, 2025" description={designer}>
  ## Designer - New features

  {designer}:

  * [System variables](/docs/guides/system-variables) are now available in public preview. System variables provide component execution metadata, such as row count, execution duration, and more.
  * [Post-processing](/docs/guides/post-processing) is now available in public preview. Each orchestration pipeline component now includes a **Post-processing** tab, where you can update scalar variables and map your existing user-defined pipeline variables and project variables to system variables.
</Update>

<Update label="January 16, 2025" description={designer + ", " + maia + ", CDC"}>
  ## Designer - New features

  Migration tool:

  * The migration tool for any current {metl} users who wish to migrate their data pipelines to {maia} is now generally available. Migrating from {metl} to {maia} is a complex process, and we urge you to read all of the documentation listed here:
    * [Migration considerations](https://docs.matillion.com/metl/docs/migration-considerations/) focuses on what a migration will involve and the steps required before getting started.
    * [Migration feature parity](https://docs.matillion.com/metl/docs/migration-feature-parity/) details the current differences between {metl} and {maia} that you should consider.
    * [Migration process](https://docs.matillion.com/metl/docs/migration-process/) explains how to export your jobs from {metl} and import them to {maia}.
    * [Migration mappings](https://docs.matillion.com/metl/docs/migration-mappings/) explains how you can resolve issues when migrating shared jobs in {metl} to the shared pipelines feature in {maia}.

  ## Maia - New features

  * [Lineage filtering](/docs/guides/data-lineage#filtering-lineage) is now available for customers who want to enhance the clarity of data flows in their {maia} pipelines.

  ## CDC - Improvements

  * Updated the [{cdc_runner} version](/docs/streaming/agent-versions) from `2.101.2` to `2.102.1`.
  * Improved logging around the compaction of a pipeline's schema history.
  * Library updates and security fixes.
</Update>

<Update label="January 14, 2025" description={designer + ", " + maia + ", CDC"}>
  ## Designer - New features

  Orchestration:

  * The [JDBC Table Metadata to Grid](/docs/components/jdbc-table-metadata-to-grid) component is now available for Databricks projects.

  ## Maia - New features

  * The [Super Admin](/docs/administration/account-roles#roles) role is now available in {maia} for new and existing accounts. This new role gives users with the role access to everything in that account—including all users, projects, environments, and more. For all new accounts, this is applied automatically. For more information, read [Registration](/docs/administration/registration#registering-for-a-hub-account). For existing accounts, submit a [support ticket](/docs/guides/getting-support) with the account number and the user's email address to request the role assignment.

  ## CDC - Improvements

  * Updated the [{cdc_runner} version](/docs/streaming/agent-versions) from `2.101.2` to `2.102.1`.
  * Improved logging around the compaction of a pipeline's schema history.
  * Library updates and security fixes.
</Update>

<Update label="January 8, 2025" description={designer}>
  ## Designer - New features

  Code Editor:

  * Added a new feature, [Code Editor](/docs/guides/code-editor), to {designer}. Code Editor introduces an improved high code experience to {maia}. Code Editor is powered by the [Monaco Editor](https://microsoft.github.io/monaco-editor/), which also powers Visual Studio Code and other editors across the web.
  * Added the ability to create .sql and .py files in {designer}.
  * Added the ability to [edit files](/docs/guides/code-editor#edit-files) in Code Editor.
  * Improved the [SQL Script](/docs/components/sql-script) and [Python Pushdown](/docs/components/python-pushdown) components by adding a **Script Location** property. With this property, you can decide whether to run an SQL or Python script from directly within the component (current behaviour) or choose to run an existing .sql or .py file in your project instead. Any .sql and .py files in the repository you have connected to your project can be edited using Code Editor and run within SQL Script or Python Pushdown components.

  <Note>
    Python Pushdown is currently only available for Snowflake projects.
  </Note>
</Update>