2025

​

- New features

• A new Contributor role has been added for Environments. This is part of a set of changes to roles and permissions over the next few months. For more information, read Environment roles.

​

- New features

• You can now create unlimited API credentials and assign each credential a specific role at the account level. This update enables safer integrations and a cleaner separation of duties for your automation. For more information, read Account roles for API credentials.

• Added a new ORC Load component for Snowflake that loads data directly into a Snowflake table from one or more ORC files stored in Snowflake Managed Storage, Amazon S3, Google Cloud Storage, or Azure Blob Storage. For more information, read ORC Load.
• Added a new AVRO Load component for Snowflake that loads data directly into a Snowflake table from one or more AVRO files stored in Snowflake Managed Storage, Amazon S3, Google Cloud Storage, or Azure Blob Storage. For more information, read AVRO Load.
• Added a new Parquet Load component for Snowflake that loads data directly into a Snowflake table from one or more Parquet files stored in Snowflake Managed Storage, Amazon S3, Google Cloud Storage, or Azure Blob Storage. For more information, read Parquet Load.

​

- New features

• You can now quickly locate any file and folder in your project using the new search bar in the Files Panel.

• Added a new Show to Grid component for Snowflake, which allows you to save the results of a Snowflake SHOW command into a grid variable for further processing within your orchestration pipeline.

​

Billing - New features

• A new Same as billing checkbox is now available in the Shipping Address section of the credit card payment method, allowing you to automatically populate shipping details using your billing address.

​

- New features

• You can now set default session parameters for Snowflake connections when you create an environment. Session parameters can be used to modify the behavior of your Snowflake connection.

​

Streaming - Improvements

• Fixed a bug to ensure that a pipeline failure email will be sent if a pipeline fails to restart when scheduled, and the pipeline is opted in to receive error emails.

​

Connectors - New features

• Added a new Snowflake Load connector, which enables you to fetch data from a Snowflake database. This new connector offers full and incremental load options, allowing you to only fetch new and updated rows of data.

​

- New features

• The Matillion MCP server is now publicly available. The MCP server offers a secure, standardized way for Large Language Models (LLMs) to interact with your resources. By configuring the MCP server, you can enable AI assistants to help with tasks such as monitoring pipeline executions, analyzing credit consumption, and triggering pipeline runs

• You can now rename and delete previous conversations with Maia to make it easier to find useful previous chats, or clear conversations that you no longer need.

​

- New features

• You can now restrict which agents are available to a specific project or environment, and ensure that only specific environments are allowed to use agents. For more information, read Restricting agents.

• The following endpoints have been added to the REST API:

​

- New features

• You can now use slash commands when interacting with Maia. These commands simplify complex prompts into single-word commands that instruct Maia to document, explain, fix, optimize and annotate files in your project.

​

- New features

• Maia now offers plan mode, which allows you to chat to Maia about your pipelines without making any changes to their configuration. In plan mode, Maia will suggest a multi-step plan to achieve your goal, but will not make any changes until you approve the plan.
• Maia can now move, copy and rename files in your project. For example, you can now tell Maia to “Make a copy of my ‘customer_data’ pipeline, rename it to ‘customers’, and move it into my ‘customer_data’ folder”.
• Maia now supports grid variables. As a result, it can create grid variables with defined columns and default values, build pipelines that use grid variables, and help to configure components such as Grid Iterator and Append to Grid.

​

Agents - New features

• Added the ability to upload external database drivers to the Matillion agent for Snowflake.

​

Connectors - New features

• Added a new JSON Load component for Snowflake that loads data directly into a Snowflake table from one or more JSON files stored in Snowflake Managed Storage, Amazon S3, Google Cloud Storage, or Azure Blob Storage. For more information, read JSON Load.

​

Streaming - Improvements

• Updated the Streaming agent version from 2.113.69 to 2.113.75.
• Improve error messages shown in the pipeline event log if the Streaming pipeline stops with an error.
• Library updates and security fixes.

​

Connectors - New features

• Added an authentication guide to connect to a Fabric Lakehouse SQL analytics endpoint using the Microsoft SQL Server Load component. For more information, read Microsoft Fabric Lakehouse authentication guide.

​

- New features

• Visualize a sample of your data directly in the chat interface, so you can spot trends at a glance. To use this feature, ask Maia to create a chart visualizing the data in a component in your pipeline. For more details, read Visualizing data.
• Search files in your project and provide information about the content of your files. For example, you can ask Maia to tell you how you have configured specific components, or which pipelines contain data from a specific table. For more information, read File exploration.
• When creating a custom connector with Maia, you can now upload a PDF, JSON, or YAML file, including Postman collections and OpenAPI specifications.

• Added a new Review button to the canvas. The Review feature lets you check whether your pipelines meet a defined set of rules, so you can be sure that your pipelines align with your organization’s standards. For more information, read Reviewing pipeline quality.

​

Connectors - New features

• Added the Open Exchange Rates Flex connector for developing pipelines.

​

Connectors - New features

• Added a new CSV Load component for Snowflake that loads data directly into a Snowflake table from one or more CSV files stored in Snowflake Managed Storage, Amazon S3, Google Cloud Storage, or Azure Blob Storage. For more information, read CSV Load.

​

Connectors - New features

• Added three new Oracle Fusion Cloud connectors for Snowflake projects. All three connectors offer full and incremental load options, allowing you to only fetch new and updated rows of data. For more information, read:
  • Oracle Fusion Cloud Financials Load
  • Oracle Fusion Cloud Procurement Load
  • Oracle Fusion Cloud Project Management Load
• Added support for Oracle Wallet in the JDBC Load connector, enabling secure mutual TLS connections to Oracle Autonomous Databases. For more information, read Oracle Autonomous Database authentication guide.

​

Agents - Improvements

• You can now include .sso (Oracle Wallet) files when uploading external drivers to the agent. For more information, read Uploading external drivers to the agent

​

Streaming - Improvements

• Updated the Streaming agent version from 2.113.23 to 2.113.69.
• Library updates and security fixes.

​

- Improvements

• Maia now saves your recent conversations, making it easy to continue where you left off or revisit previous work. To resume a previous conversation with Maia, either click the conversation in the Branch conversations section of the Maia interface, or click Chat history in the top right to view a list of recent conversations. For more information, read Sessions and tools in Maia.

​

Connectors - New features

• Added a new NetSuite SuiteAnalytics Load connector, which offers full and incremental load options. This component is currently only available for Snowflake projects.

​

- Improvements

• Added the ability to include descriptions with pipelines, to improve collaboration and clarity when sharing pipelines. You can now add a description to your pipelines during creation, and at the point of sharing. Descriptions can be a maximum of 1000 characters.
• We have recently addressed an inconsistency where nested variables (i.e. a variable specified as the value of another variable) were not always being resolved. To ensure predictable and reliable pipeline execution, all nested variables will now be consistently resolved to their final value, up to one level of nesting. We understand that some pipelines may have been built to rely on the previous behavior. While we never intend to disrupt your workflows, this update was necessary to guarantee a consistent experience for all users and pipelines. For more information, read Using variables.

​

- Improvements

• Added a new Passphrase parameter (optional) to the Database Query component. Use the drop-down menu to select the secret definition storing your passphrase. If your private key is passphrase protected, you will also need to add a secret to store the passphrase. For more information, read Using Snowflake key-pair authentication.

​

API - New endpoints

​

- New features

• Added a new IBM DB2 for i Load connector. This connector offers a new Incremental Load option, which allows you to only load new or updated records each time your pipeline runs.

​

Audit service API - New features

• The Audit service API now includes event types for accounts.

​

- New features

• When sampling data, you can now use an SQL query to filter the rows displayed in the table in the Sample data tab. You can filter for string, number, and date values, as well as using AND and OR operators to combine different filter criteria. For more information, read Filtering sampled data.

• Added a new Workday Load connector, which offers full and incremental load options.

​

- New features

• You can now add multiple OAuth providers to a single Custom Connector endpoint.

​

- New features

​

- New features

​

Connectors - New features

​

Connectors - New features

​

- Improvements

• Maia is now faster at completing a range of tasks, especially when adding multiple instances of the same component to the canvas.
• Maia can now make multiple instances of the same type of change at the same time. For example, when adding or updating table prefixes for multiple Table Output components in a pipeline.
• Maia can now interact with scalar variables.
• Maia can now use iterators on components.

• You can now add a component between two existing, connected components. Click on the connector line and then click + and choose the component you wish to add into the middle.

​

- Improvements

• Upgraded the maximum number of schedules that can be created per account from 500 to 1000.

​

Streaming - Improvements

• Updated the Streaming agent version from 2.113.15 to 2.113.23.
• Fixed an issue where a failed snapshot would cause the pipeline to lose any streaming events that were created during the snapshot window.
• Library updates and security fixes.

​

Connectors - New features

• Added a Shopify Load connector, which offers full and incremental load options.

​

- Improvements

• Added the dbt Core Version property to the dbt Core component. This property allows you to select which version of dbt Core to use.

​

Streaming - Improvements

• Updated the Streaming agent version from 2.113.6 to 2.113.15.
• Library updates and security fixes.

​

Agents - New features

• You can now test the outbound connection from a Hybrid SaaS agent to a specified host and port.

​

- New features

• Marketo Load
• SugarCRM Load

​

API - New endpoints

​

- New features

• The Files panel now displays indicators next to the name of a pipeline if it has uncommitted changes, to help you quickly identify changes that you have made but not yet committed. The indicators are N for new pipelines, M for modified pipelines, and R for renamed pipelines.

​

- New features

• Added new endpoints to the connector. These include endpoints for agents, schedules, and audit events.

​

Streaming - Improvements

• Updated the Streaming agent version from 2.113.5 to 2.113.6.
• Fixed an issue in the DB2 connector when processing columns with datatype NCHAR or NVARCHAR.

​

Streaming - Improvements

• Updated the Streaming agent version from 2.112.12 to 2.113.5.
• Library updates and security fixes.

​

Maia - Improvements

• Maia has been updated with the following new features:
  • Automatic to-do lists: Maia now creates and displays a to-do list for the tasks you give it, helping you to track Maia’s progress, and helping Maia to stay focused on the task at hand.
  • File mentions: You can now direct Maia to specific files in your project by mentioning them in your prompt. To do this, use @ followed by the file name, for example @myfile.md. Maia will then read the file and use it to inform its responses. You can also use @ to direct Maia to files you want it to update, or to provide specific context for the task at hand.
  • Textual file support: Maia can now read from and write to a range of textual files, including Markdown .md, SQL .sql, and Python .py files. This allows Maia to work directly with your code, create documentation, and edit other text-based files.

​

- Improvements

• You can now specify a Policy ID when using Databricks Jobs Compute to execute Databricks transformation pipelines. This allows you to enforce governed compute usage in Databricks projects.

​

Streaming - Improvements

• Updated the Streaming agent version from 2.112.9 to 2.112.12.
• Library updates and security fixes.

​

Connectors - New features

• JDBC Load
• MariaDB Load
  • We recommend using this connector instead of using the Database Query component to connect to MariaDB.

​

- Improvements

• You can now export the data displayed in the Sample data tab in as a CSV file. For more information, read Sampling output.

​

Maia - New features

​

API - New endpoints

• New endpoints for creating and managing Streaming pipeline definitions have been added to the REST API. You can find a how-to guide for common tasks involving these endpoints here.

​

Streaming - Improvements

• Updated the Streaming agent version from 2.112.8 to 2.112.9.
• Db2 for IBM i: add support for processing journal entries where a date is an empty string.

​

- Improvements

​

Streaming - Improvements

• Updated the Streaming agent version from 2.111.76 to 2.112.8.
• Library updates and security fixes.
• Fixed an issue where a out-of-memory (OOM) error would not be reported as a pipeline event correctly.

​

- New features

• A new Amazon OpenSearch Upsert component is now available. This component lets you upsert data converted into vector embeddings into an Amazon OpenSearch Service index using the Amazon OpenSearch Service API. Currently, this component only supports provisioned OpenSearch services, not serverless. Supported embedding providers include Amazon Bedrock and OpenAI.

​

API - New endpoints

• A new endpoint for accessing comprehensive audit logs over a period of time has been added to the REST API:

​

Connectors - New features

• Microsoft SQL Server Load
• PostgreSQL Load

​

- New features

• You can now use the Metadata tab to view the name, data type, and size of each column in a component’s output. For more information, read Metadata.

• Dropbox
• Dynamics 365 Business Central
• Microsoft Dataverse
• Salesforce Pardot
• Zuora

​

Components - New features

• The X Ads Load component, which supersedes the X Ads component, is now available for Snowflake projects. This component lets you fetch data using the X Ads API.

​

Components - New features

• The Intersect component is now available for Databricks projects. This component lets you compare two datasets, and then return any rows that are identical in both datasets.

​

- New features

• When committing changes in , you can now choose which files to include in each commit. For more information, read How to commit.

​

- New features

• When creating an Amazon Redshift environment, you can now choose whether to use the credentials associated with the agent you selected when creating your project, or to override these credentials by entering new credentials. For more information, read Specify cloud data warehouse credentials.

​

Components - New features

• Databricks Jobs Compute lets you run and/or schedule transformation pipelines using a Databricks Jobs Compute cluster.

​

Maia - New features

• All Maia features in , including support for both transformation and orchestration pipelines, multi-pipeline workflows, interactive tools, and natural language prompting, are now generally available (GA) in .

​

- Improvements

• Grid Variables are now supported in the Calculator component.

​

- New features

• You can now search your commit history by commit message, timestamp, author, and hash to stay informed about all changes made in your branch.

​

API - New endpoints

• A new endpoint for an agent creation has been added to the REST API:

​

- New features

• Added a new auto-complete feature to some component properties, which makes it easier to include variables and warehouse functions in various fields, such as Calculator expressions or Send Email messages.

​

Maia - New features

• Maia is your always-on agentic data team, enabled via natural language prompting. You can collaborate with Maia directly in to deliver data faster and to automate repetitive tasks.
• Maia supports both transformation and orchestration pipelines. Support for orchestration pipelines is currently in public preview.
• Maia can build, run, and update data pipelines for you, all via your natural language prompts.
• Maia can advise you about designing optimal data pipelines in . Maia can recommend next steps in your pipeline flow and even clarify any queries you have about your pipelines and the components therein.
• Maia can explore the cloud data warehouse that you have connected to the environment in your project, examining data structures and relationships to help you create the pipelines that lead to the most value.
• Maia will suggest actions, including version control operations such as committing your branch’s current state and pushing those commits to your remote repository.
• Maia uses tools to perform tasks in your workspace based on your prompts. These tools let Maia go beyond chat and perform real, interactive actions.
• Maia works across multiple pipelines.

• Maia can create custom connectors for you. Maia works with any API that has publicly viewable documentation pages (ideally static HTML) that list and define available endpoints, methods, and parameters.

• Maia can perform root cause analysis on a failed pipeline and will suggest steps you can take to get your pipeline working again.
• Maia can detect anomalies in your scheduled pipeline runs, such as sudden spikes in execution time. Maia does this by analyzing past scheduled pipelines, and will provide visual indicators for significant behavioral deviations.

​

- New features

• Added a new Salesforce Load connector, which offers Incremental Load options.

​

- Improvements

• The JDBC Table Metadata to Grid component now supports an additional authentication method when the database type is set to Snowflake. Users can now choose Key Pair Authentication.

​

- New features

• Added a new Oracle Unload from Snowflake connector, which enables you to unload data from your Snowflake data warehouse to an Oracle database.

​

Streaming - Improvements

• Updated the Streaming agent version from 2.111.64 to 2.111.76.
• Library updates and security fixes.
• Oracle pipelines will now always include BLOB and CLOB data in change events emitted during the snapshot period, regardless of the lob.enabled advanced setting.
• Fixed an issue where an Oracle connection could pass validation but fail to retrieve source information.
• Fixed an issue for SQL Server pipelines where the agent would incorrectly emit a snapshot error event during a snapshot.

​

Components - New features

• Create External Table is now available for Snowflake.

​

- New features

• All automatic and export variables in Matillion ETL are now automatically migrated as system variables in . For more information, read Migration: Export variables, and Migration: Automatic variables.

• Convert Type is now available for Amazon Redshift.

​

- Improvements

• New and improved filters on the pipeline runs of the pipeline observability dashboard. Users can now filter by Status, Project, and Environment.

​

- New features

• Monitor the health of your data pipelines with real-time Pipeline notifications. These notifications keep users informed about pipeline failures in projects and environments they can access. Alerts are sent via email for scheduled and API-triggered runs, but not for manual executions.
• The new View commit history Git action allows you to see the previous commits you have made in your branch. For more details, read View commit history.

​

Agents - New features

​

- New features

• New left navigation enables you to move between key areas of from anywhere in the platform.
• Profile & Account icon in the left navigation provides quick access to user and account settings.
• Expanded canvas reduces visual clutter, providing more space for pipeline creation.
• Resizable Files and Schemas panels can be docked or positioned anywhere on the canvas.
• Shorter load times in ensure faster navigation and reduced latency.

​

- New features

• When viewing schedules in the Your projects list, you can now filter the displayed schedules by their environment.

​

Streaming - Improvements

• Updated the Streaming agent version from 2.111.47 to 2.111.64.
• Reverted Snowflake JDBC driver version to 3.21.0.
• Library updates and security fixes.

​

- New features

• You can now create secret definitions in when configuring components, without needing to leave the canvas. For information about creating secret definitions, read Secrets and secret definitions.

• You can now delete environments, provided that there are no active schedules running pipelines in the environment, and it is not the default environment for any branches. For more information, read Delete an environment.

• You can now set an optional Message field as part of the post-processor for any component. This means you can add a custom, descriptive message that clearly communicates what’s happening at each step of your pipeline, tailored to your specific requirements.

​

- New features

• If you use a Full SaaS deployment model, you can now update the value of secret definitions, for example if a password changes. For more information, read Update a secret definition.

​

Streaming - New features

• A for Google Cloud Platform (GCP) is now available. This agent can be installed in GCP and used to run Streaming pipelines in .

​

Streaming - Improvements

• Updated the Streaming agent version from 2.111.40 to 2.111.47.
• Improved the pipeline activity reporting to ensure consistent consumption reporting, especially during times when the source database has limited changes going through.
• Library updates and security fixes.

​

- Improvements

• The Unstructured Flex connector has been renamed to Unstructured.io. Two new POST endpoints have been added: Cancel Job and Run Workflow.

​

- New features

• Added a Cortex Finetune component, which enables users to fine-tune large language models (LLMs) using Snowflake Cortex.

• Extract Nested Data is now available for Databricks.

​

- Improvements

• A new data type called Variant has been added for Databricks in the Create Table component. This data type is supported in Databricks Runtime version 15.4 and above.

​

- New features

• Added a new Google Sheets connector, which lets you query the Google Sheets API to retrieve data and load it into a table. You can then use transformation components to enrich and manage the data in permanent tables.
  • The Google Sheets Query connector is no longer available for creating data pipelines, as it has been replaced by the new Google Sheets connector.

​

Streaming - Improvements

• Updated the Streaming agent version from 2.111.26 to 2.111.40.
• Db2 for IBM i: Improve management of JDBC connections.
• Library updates and security fixes.

​

Agents - New features

• Agents can now be put into a Paused state, which gracefully puts the agent into a safe state when you need to perform maintenance work such as upgrading the version or updating the configuration to add new drivers.
• We have introduced agent version tracks, with different release cadences. You can choose a version track based on how the agent update cadence fits with your operational practices, and how eager you are to take advantage of new features.
• Agents can be updated either automatically, as soon as a new release is available, or manually, at a time of your choosing. Read our support policy for details.
• A new agents public API lets you list agent details and also send commands such as restart to the agent.

​

- New features

• Added a new Flex connector for developing data pipelines with data from Unstructured.io

​

- New features

• Added a new connector for SAP NetWeaver that lets you connect to SAP to access available data sources. You can then use transformation components to enrich and manage the data in permanent tables.

• Added a new View pull requests action that allows you to view the pull requests in your external Git repository if your team uses a pull request approval workflow. For more information, read View pull requests.
• After pushing changes to the remote branch, you can click the link in the success notification to create a pull request in your external Git repository.

• A new data type called Variant has been added for Databricks in the Convert Type transformation component. This data type is supported in Databricks Runtime version 15.4 and above.

​

- Improvements

• The S3 Attachment parameter for the Send Email component has now been updated from a string to a file editor.

​

- New features

• The Google Vertex AI Prompt component is now available. This component uses a Google Gemini large language model (LLM) to provide responses to user-composed prompts. The component takes one or more inputs in the form of text, image, audio, or video, combines the inputs with user prompts, and sends this data to the LLM for processing.

​

API - New endpoints

​

- New features and improvements

• You can now view and resolve merge conflicts using the Merge from branch Git action. For more information, read Resolving merge conflicts.
• The S3 Location parameter in Send Email has been updated to S3 Attachment.

​

Streaming - Improvements

• Updated the Streaming agent version from 2.111.18 to 2.111.26.
• Db2 for IBM i: Add option to disable use of unique indexes.
• Db2 for IBM i: Default connection date time property to iso.
• Added periodic diagnostic logging.
• Library updates and security fixes.

​

Streaming - Improvements

• Updated the Streaming agent version from 2.111.6 to 2.111.18.
• Db2 for IBM i: Set the default batch size value to 512, and fixed an issue where an incorrect journal receiver library could be used.
• Library updates and security fixes.

​

- New features

• Copy Grants: In Snowflake, the COPY GRANTS clause transfers privileges from the original object such as a table, view, schema, or database, to a new object when replacing or cloning, ensuring consistent access control and eliminating manual reassignment. The COPY GRANT clause information has been added to the following documentation:
  • Create Table
  • Rewrite Table
  • Amazon Bedrock Prompt
  • Azure OpenAI Prompt
  • OpenAI Prompt
  • Snowpark Container Prompt
  • Pinecone Vector Query
• Transient table type: The Create Table component for Snowflake now supports the new table type, Transient. This table type holds data indefinitely but can’t be restored.
• Attach a file using the Send Email component. The attachment must be a single file located in an S3 bucket.

​

- New features

• Added a new Allow concurrent schedule runs option when creating a schedule that lets you choose whether a scheduled pipeline run is skipped if the previous scheduled run is still in progress.

​

Connectors - New features

• Added a Coalesce Flex connector for developing pipelines.

​

Streaming - Improvements

• Updated the Streaming agent version from 2.110.4 to 2.111.6. This is the minimum agent version required for the new snapshot feature.
• New snapshot feature introduces recoverability and flexibility. This replaces initial and on-demand snapshot options.
• New dashboard layout makes it easier to navigate to relevant information.
• Upgrade of the IBMi DB2 JDBC driver in the Agent.
• Library updates and security fixes.

​

Connectors - New features

• Added a Zoom Flex connector for developing pipelines.

​

- New features

• Added an ML Classification component, which uses the Snowflake Classification machine learning (ML) function to sort data into different classes using patterns detected in training data. This component is available in public preview.

​

- New features

• New and updated roles and permissions for projects and environments have been introduced: Owner, Contributor, Viewer, and None, replacing Admin, User, Read Only, and No Access, respectively. Additionally, a new environment role, Runner, has been introduced. All roles and permissions are documented in the following.
  • Environment roles
  • Project roles
  • Networks

• X Ads, which lets you query the X Ads (formerly Twitter Ads) API to retrieve data and load it into a table. You can then use transformation components to enrich and manage the data in permanent tables.

• Maia can now write your Git Commit messages for you using the Conventional Commits format.

​

- New features

• Add a Cortex Multi Prompt component, which uses Snowflake Cortex to receive a prompt and then generate multiple responses (completions) using your chosen supported language model. This component is available in public preview.

​

CDC - Improvements

• Updates to the CDC agent version.
  • From 2.108.1 to 2.110.3.
  • From 2.110.3 to 2.110.4.
• Reverted the Snowflake JDBC driver to 3.22.0 to mitigate an issue where the first Snowflake request on an agent could fail.
• When using a storage target or Snowflake with the “Source Database & Schema” prefix, setting the database value is now Root where previously the Db2 system name would have been used.
• Library updates and security fixes.

​

- Improvements

• System variables and post-processing are now generally available:
  • System Variables can now be used in component parameters, Python, Bash, and SQL scripts, in addition to post-processing.
  • Users can access shared and public scalar variables from a child pipeline using the post-processing Update Scalar property in Run Transformation, Run Orchestration, and Run Shared Pipeline components.
  • System variables are read-only and cannot be modified manually. Instead, system variable values are updated automatically during component executions.
  • System variables can be directly used in Python Pushdown, manually assigned in Bash Pushdown, and used inline in SQL script (orchestration) and SQL (transformation) components, with mapping required for external SQL.
  • New child pipeline system variable syntax is ${sysvar.childPipeline.vars.<varname>} and allows referencing variables from child pipelines, e.g., ${sysvar.childPipeline.vars.var1}.
• Lineage now includes orchestration pipelines, providing a comprehensive view of data origins. This expansion introduces support for additional connectors and offers key benefits such as audit and compliance, impact analysis, and faster debugging.

​

- Improvements

• Added support for Snowflake “Named” stages to third-party connectors (Asana, GitHub, Mailchimp, etc.).
• Added support for Snowflake storage integration stage access strategies when using AWS or Azure as the staging cloud platform with third-party connectors (Asana, GitHub, Mailchimp, etc.).

​

CDC - Improvements

• Updated the CDC agent version from 2.107.4 to 2.108.1.
• Library updates and security fixes.
• Fixed an issue where the agent could not compact legacy history.dat files.

​

- Improvements

• Updated account admin privileges so that account admins can enable and disable the ability for each user to create projects within an account.

​

- Improvements

• Updated the SQL Script component for Snowflake and Databricks projects. You can now choose whether to specify which project and pipeline variables to declare as SQL variables upon component execution, or to declare all as SQL variables. By default, no project or pipeline variables are declared as SQL variables prior to an SQL Script component execution.
• Updated the OpenAI Prompt, Azure OpenAI Prompt, and Amazon Bedrock Prompt components to add an Append setting to the Create Table Options property.

​

Streaming - New features and improvements

• Updates to Pre-built pipelines. Amazon Redshift now supports these types of pipelines.

​

CDC - Improvements

• Updated the CDC agent version from 2.102.27 to 2.107.4.
• Updated the matillion.compact-history default value to true.
• Library updates and security fixes.

​

Agents - New features

• Hydrid SaaS agents running on AWS can now be connected via AWS PrivateLink, an AWS service that allows you to connect via a secure, private connection. Using AWS PrivateLink, no traffic is exposed to the public Internet when it travels between and your own AWS virtual private cloud.

​

API - New endpoints

• List All Schedules
• Create Schedule
• Get Schedule
• List Artifacts
• Get Artifact
• Promote Artifact
• Pipeline Executions
• List Custom Connectors
• List Flex Connectors
• List All Secret References
• Create Secret Reference

​

- Improvements

• Workday and Workday Custom Reports now support OAuth 2.0 Authorization Code Grant authentication. For more information about creating an OAuth connection for these components, read the Workday authentication guide.

​

- New features and improvements

• Added the ability to restart a Hybrid SaaS agent from within .

• The Begin component starts a new transaction in the database.
• The Commit component completes a transaction, making all changes since the most recent Begin component visible to other users.
• The Rollback component cancels a transaction, undoing all changes made since the most recent Begin component. These changes remain invisible to other users.

• Added the LinkedIn Ads Flex connector for developing data pipelines.

​

- Improvements

• Improved the dbt Core component by adding two new properties:
  • dbt Project Location: Use this property to clarify whether the dbt project is located in an external Git repository that is not connected to your project, or the dbt project is already hosted in the Git repository connected to your project.
  • dbt Project: This property will list any dbt projects that reside in the Git repository connected to your project. A directory is a dbt project when it includes a dbt_project.yml file.

​

API - New endpoints

​

- Improvements

• The S3 Unload component is now available for Databricks projects.
• The Azure Blob Storage Unload component is now available for Databricks projects.

• The Generate Sequence component is now available for Databricks projects.

​

CDC - Improvements

• Updated the CDC agent version from 2.102.1 to 2.102.27.
• Library updates and security fixes.

​

- Improvements

• Updated Flex and custom connectors to include a Load Selected Data parameter. This setting lets you choose whether to return the entire payload (default) or only selected data objects in your API response.
• Updated the Python Pushdown component. When you set a Python version, the Packages parameter is updated to show packages supported by that Python version. Currently the Python Pushdown component supports Python versions 3.9, 3.10 (default), 3.11, and 3.12.

​

- Improvements

• Updated the command palette to include the following action commands, all of which can be activated by typing SHIFT + >:
  • Run Pipeline
  • Validate Pipeline
  • Canvas: Add component
  • Canvas: Zoom in
  • Canvas: Zoom out
  • Canvas: Zoom to fit

• Updated the Database Query component to include a Fetch Size parameter, which lets you specify the batch size of rows to fetch at a time, for example, 500.

​

- New features

• Artifacts can now be created to ensure that the version of a pipeline that you are releasing to production is the same version that you have tested in your environments. An artifact is an immutable collection of resources (such as pipelines and script files) that is deployed to your chosen environment when you publish. The following guides contain more information about artifacts and how they relate to schedules:
  • Artifacts explains how to create, view, and manage artifacts in .
  • Schedules explains how artifacts fit into the process of publishing your changes and scheduling pipelines.
• The process of pushing and publishing local changes using Git push has been changed. For more details about how to push and publish your local changes to create a schedule, read Git push.
• For more information on how can help you to take an innovative approach to DataOps, read DataOps in .

• Customers using a Full SaaS solution can use the Database Query and RDS Query components to access data sources within their infrastructure using a configured SSH tunnel. This is accessed via the new Networks tab. Read our Networks guide to get started.

​

- New features

• System variables are now available in public preview. System variables provide component execution metadata, such as row count, execution duration, and more.
• Post-processing is now available in public preview. Each orchestration pipeline component now includes a Post-processing tab, where you can update scalar variables and map your existing user-defined pipeline variables and project variables to system variables.

​

- New features

• The migration tool for any current Matillion ETL users who wish to migrate their data pipelines to is now generally available. Migrating from Matillion ETL to is a complex process, and we urge you to read all of the documentation listed here:
  • Migration considerations focuses on what a migration will involve and the steps required before getting started.
  • Migration feature parity details the current differences between Matillion ETL and that you should consider.
  • Migration process explains how to export your jobs from Matillion ETL and import them to .
  • Migration mappings explains how you can resolve issues when migrating shared jobs in Matillion ETL to the shared pipelines feature in .

​

- New features

• Lineage filtering is now available for customers who want to enhance the clarity of data flows in their pipelines.

​

CDC - Improvements

• Updated the CDC agent version from 2.101.2 to 2.102.1.
• Improved logging around the compaction of a pipeline’s schema history.
• Library updates and security fixes.

​

- New features

• The JDBC Table Metadata to Grid component is now available for Databricks projects.

​

- New features

• The Super Admin role is now available in for new and existing accounts. This new role gives users with the role access to everything in that account—including all users, projects, environments, and more. For all new accounts, this is applied automatically. For more information, read Registration. For existing accounts, submit a support ticket with the account number and the user’s email address to request the role assignment.

​

CDC - Improvements

• Updated the CDC agent version from 2.101.2 to 2.102.1.
• Improved logging around the compaction of a pipeline’s schema history.
• Library updates and security fixes.

​

- New features

• Added a new feature, Code Editor, to . Code Editor introduces an improved high code experience to . Code Editor is powered by the Monaco Editor, which also powers Visual Studio Code and other editors across the web.
• Added the ability to create .sql and .py files in .
• Added the ability to edit files in Code Editor.
• Improved the SQL Script and Python Pushdown components by adding a Script Location property. With this property, you can decide whether to run an SQL or Python script from directly within the component (current behaviour) or choose to run an existing .sql or .py file in your project instead. Any .sql and .py files in the repository you have connected to your project can be edited using Code Editor and run within SQL Script or Python Pushdown components.