- If using Matillion Full SaaS: The component will use the cloud credentials associated with your environment to access resources.
- If using Hybrid SaaS: By default the component will inherit the agent’s execution role (service account role). However, if there are cloud credentials associated with your environment, these will overwrite the role.
Properties
Reference material is provided below for the Source and Destination properties.string
required
A human-readable name for the component.
Source
- Snowflake
- Databricks
- Amazon Redshift
- Google BigQuery
drop-down
required
The Snowflake database. The special value
[Environment Default] uses the database defined in the environment. Read Databases, Tables and Views - Overview to learn more.drop-down
required
The Snowflake schema. The special value
[Environment Default] uses the schema defined in the environment. Read Database, Schema, and Share DDL to learn more.drop-down
required
Select the table to unload to the target PostgreSQL database. The tables available for selection depend on the chosen schema.
object selector
Select columns to return from the table.Leave this blank to unload all columns.
object selector
Select one or more columns to use as the table’s primary key. The component uses the primary key to identify matching rows in the target table when determining the update strategy.If you select multiple columns, the component creates a composite primary key using the combination of the selected columns.Leave this blank to load all rows without duplicate checking.
integer
Set a numeric value to limit the number of rows that are unloaded. The default is an empty field, which unloads all rows.
column editor
Define one or more filter conditions that each row of data must meet to be unloaded.
- Input Column: Select an input column. The available input columns vary depending upon the selected table.
- Qualifier:
- Is: Compares the column to the value using the comparator.
- Not: Reverses the effect of the comparison, so “Equals” becomes “Not equals”, “Less than” becomes “Greater than or equal to”, etc.
- Comparator: Choose a method of comparing the column to the value. Possible comparators include: “Equal to”, “Greater than”, “Less than”, “Greater than or equal to”, “Less than or equal to”, “Like”, “Null”. Not all column types support all comparators.
- Value: The value to be compared.
drop-down
The filter conditions you have defined can be combined using either And or Or logic. If And, then all filter conditions must be satisfied to unload the data row. If Or, then only a single filter condition must be satisfied. The default is And.If you have only one filter condition, or no filter conditions, this parameter is essentially ignored.
Destination
drop-down
required
Select a Connection. This connection defines all credentials needed to connect to the service.If the required connection doesn’t yet exist, you can create it here by selecting Add Connection in the drop-down. Read Add a connection for further details, following that process from step 4 onwards. A connection created here is visible in the Connections tab and available for other connectors to use.
string
required
The name of the PostgreSQL schema to write the target table into.
string
required
The name of the table to create or write to in the target PostgreSQL database.
drop-down
required
Define what happens when the component writes to the target table.
- Replace: If the specified table already exists, it will be dropped and recreated with the new data. If the table doesn’t exist, a new table is created.
- Truncate and insert: If the specified table already exists, all existing rows are removed before new rows are inserted. If the table doesn’t exist, a new table is created.
- Append: New rows are added to the existing table. If the table doesn’t exist, a new table is created. When Primary Keys are specified, the Update Strategy property determines how duplicate rows are handled.
drop-down
required
When Write Mode is set to Append and Primary Keys have been specified, this property determines how existing rows with matching primary key values are handled.
- Ignore: Rows in the destination with the same primary key values as incoming rows are kept unchanged. This is the default behavior.
- Replace: Rows in the destination with the same primary key values as incoming rows are replaced with the incoming data.
column editor
- Parameter: A JDBC parameter supported by the database driver. The available parameters are explained in the data model. Manual setup is not usually required, since sensible defaults are assumed.
- Value: A value for the given parameter.
