Skip to main content
The Multi Table Input transformation component lets you select columns from across multiple tables in your cloud data warehouse, and combines them into a single dataset. The component:
  1. Examines all tables in the specified database schema and selects those whose names match a user-specified pattern. For example, tables called “Budgets_2012”, “Budget_2013”, and so on, would be selected with a pattern of Budget%_20%.
  2. Selects user-specified columns from each of the selected tables. The matching tables need to have common column names, so that the same columns can be selected from each table and combined into a single dataset.
  3. Outputs the dataset for use by the pipeline’s downstream components.
Multi Table Input is similar to Table Input, but operates over a range of similar tables rather than a single specified table.

​
Use case

The Multi Table Input component is used to consolidate data from multiple similar tables. Some common uses for this include:
  • Consolidating historical data from multiple yearly tables. Combine multiple identical tables that are partitioned by year into a single dataset for analysis and reporting.
  • Comparing or joining data across multiple similar tables. Load similar data from multiple tables, allowing further transformations such as aggregations to be performed.

​
Properties

​
Name
string
required
A human-readable name for the component.
​
Database
drop-down
required
The Snowflake database. The special value [Environment Default] uses the database defined in the environment. Read Databases, Tables and Views - Overview to learn more.
​
Schema
drop-down
required
The Snowflake schema. The special value [Environment Default] uses the schema defined in the environment. Read Database, Schema, and Share DDL to learn more.
​
Pattern Type
drop-down
required
​
Pattern
string
required
The pattern to match available tables to. The pattern syntax depends upon the chosen Pattern Type.
​
Cast Types
boolean
required
  • True: If the same-named column from multiple tables has a different data type, attempt to cast to a common type.
  • False: If the same-named column from multiple tables has a different data type, it is reported as an error. This is the default setting.
​
Add Source Table
boolean
required
When True, Matillion adds a column, “source_table”, containing the input table name that was matched to provide this row.
​
Columns
dual listbox
required
The available columns are generated by first scanning the available tables, and then providing all columns from any of the inputs. It is expected that the tables matching the pattern are fairly similar and share many columns. Move columns from left to right to include in the input.