The Assert Table orchestration component empowers users to confirm that a target table has been created with the correct metadata. This component asserts a row count using various methods such as “Equal to”, “Greater than”, “Less than”, and “Range”; these comparator options allow users to set the upper and lower values of row counts.
The Snowflake database. The special value [Environment Default] uses the database defined in the environment. Read Databases, Tables and Views - Overview to learn more.
The Snowflake schema. The special value [Environment Default] uses the schema defined in the environment. Read Database, Schema, and Share DDL to learn more.
Enter the following details for each table column.
Column Name: The name of the new column.
Data Type: Select one of:
Varchar: This type is suitable for numbers and letters. A varchar or Variable Character Field is a set of character data of indeterminate length.
Number: This type is suitable for numeric types, with or without decimals.
Float: This type of values are approximate numeric values with fractional components.
Boolean: This type is suitable for data that is either “true” or “false”.
Date: This type is suitable for dates without times.
Time: This type is suitable for time, independent of a specific date and timezone.
Timestamp: This type is a timestamp left unformatted (exists as Unix/Epoch Time).
Variant: Variant is a tagged universal type that can hold up to 16 MB of any data type supported by Snowflake.
Size: For Text types, this is the maximum length. This is a limit on the number of bytes, not characters. For Numeric types, this is the total number of digits allowed, whether before or after the decimal point.
Precision: The precision of the data in the column. Will be 0 (zero) for non-applicable types.
You can specify table metadata using text mode.This property is only available when Exists is set to “Yes”.Toggle Text mode on at the bottom of the dialog to open a multi-line editor that lets you add items in a single block. For more information, read Text mode.To use grid variables, toggle Use Grid Variable on. For more information, read Grid variables.
Select how row count values are compared. Possible comparison operators include:
Equal To: The value in the Input Column must be equal to that specified in the Value Column. This is the default comparison operator.
Greater Than or Equal To: The value in the Input Column must be greater than or equal to the value in the Value Column.
Less Than or Equal To: The value in the Input Column must be less than or equal to the value in the Value Column.
Range: This allows users to specify the range for the value of the row counts.
Not all data sources support all comparison operators; thus, it is likely that only a subset of the above comparison operators will be available to choose from.This property is only available when Exists is set to “Yes”.
Select a Databricks Unity Catalog. The special value [Environment Default] uses the catalog defined in the environment. Selecting a catalog will determine which databases are available in the next parameter.
The Databricks schema. The special value [Environment Default] uses the schema defined in the environment. Read Create and manage schemas to learn more.
TIMESTAMP: Represents values comprising values of fields year, month, day, hour, minute, and second, with the session local time-zone. The timestamp value represents an absolute point in time.
DATE: Represents values comprising values of fields year, month and day, without a time-zone.
BOOLEAN: Represents data that is either “true” or “false”.
Size: For Text types, this is the maximum length. This is a limit on the number of bytes, not characters. For Number types, this is the total number of digits allowed, whether before or after the decimal point.
Scale: Scale is the number of digits to the right of the decimal point in a float. For example, the number 123.45 has a scale of 2.
You can specify table metadata using text mode.This property is only available when Exists is set to “Yes”.Toggle Text mode on at the bottom of the dialog to open a multi-line editor that lets you add items in a single block. For more information, read Text mode.To use grid variables, toggle Use Grid Variable on. For more information, read Grid variables.
Select how row count values are compared. Possible comparison operators include:
Equal To: The value in the Input Column must be equal to that specified in the Value Column. This is the default comparison operator.
Greater Than or Equal To: The value in the Input Column must be greater than or equal to the value in the Value Column.
Less Than or Equal To: The value in the Input Column must be less than or equal to the value in the Value Column.
Range: This allows users to specify the range for the value of the row counts.
Not all data sources support all comparison operators; thus, it is likely that only a subset of the above comparison operators will be available to choose from.This property is only available when Exists is set to “Yes”.
Select the table schema. The special value [Environment Default] uses the schema defined in the environment. For more information on using multiple schemas, read Schemas.
Enter the following details for each table column.
Column Name: The name of the column.
Data Type: Select the data type.
Text: A string can hold any kind of data, subject to a maximum size.
Integer: An integer data type is suitable for whole numbers (no decimals).
Numeric: The numeric data type accepts numbers, with or without decimals.
Real: This type is suitable for data of a single precision floating-point number.
Double Precision: This type is suitable for data of a double precision floating-point number.
Boolean: Data with a Boolean data type can be either “true” or “false”.
Date: This type is suitable for dates without times.
DateTime: This type is suitable for dates, times, or timestamps (both date and time).
SUPER: Use the SUPER data type to store semi-structured data or documents as values.
Size: For text types, this is the maximum length. This is a limit on the number of bytes, not characters. For Redshift, since all data is stored using UTF-8, any non-ASCII character will count as 2 or more bytes. For Numeric types, this is the total number of digits allowed, whether before or after the decimal point.
Decimal Places: Relevant only for “Numeric” data, it is the maximum number of digits that may appear to the right of the decimal point.
You can specify table metadata using text mode.This property is only available when Exists is set to “Yes”.Toggle Text mode on at the bottom of the dialog to open a multi-line editor that lets you add items in a single block. For more information, read Text mode.To use grid variables, toggle Use Grid Variable on. For more information, read Grid variables.
Select how row count values are compared. Possible comparison operators include:
Equal To: The value in the Input Column must be equal to that specified in the Value Column. This is the default comparison operator.
Greater Than or Equal To: The value in the Input Column must be greater than or equal to the value in the Value Column.
Less Than or Equal To: The value in the Input Column must be less than or equal to the value in the Value Column.
Range: This allows users to specify the range for the value of the row counts.
Selecting “Range” makes the Upper value and Lower value properties available.Not all data sources support all comparison operators; thus, it is likely that only a subset of the above comparison operators will be available to choose from.This property is only available when Exists is set to “Yes”.
The Google Cloud project that owns the BigQuery dataset. The special value [Environment Default] uses the Google Cloud project defined in the environment. For more information, read Creating projects.
Toggle Text mode on at the bottom of the dialog to open a multi-line editor that lets you add items in a single block. For more information, read Text mode.To use grid variables, toggle Use Grid Variable on. For more information, read Grid variables.This property is only available when Exists is set to “Yes”.
Select how row count values are compared. Possible comparison operators include:
Equal To: The value in the Input Column must be equal to that specified in the Value Column. This is the default comparison operator.
Greater Than or Equal To: The value in the Input Column must be greater than or equal to the value in the Value Column.
Less Than or Equal To: The value in the Input Column must be less than or equal to the value in the Value Column.
Range: This allows users to specify the range for the value of the row counts.
Not all data sources support all comparison operators; thus, it is likely that only a subset of the above comparison operators will be available to choose from.This property is only available when Exists is set to “Yes”.