Skip to main content
The Stream Input transformation component reads selected columns from a Snowflake stream, and makes those columns available to the pipeline. The stream must already exist in Snowflake. If necessary, you can create a new stream in Snowflake using the Create Stream component. For more information on Snowflake streams, read Introduction to Streams in the Snowflake documentation.

Use case

A Snowflake stream object records row-level changes made to tables, including inserts, updates, and deletes, as well as metadata about each change. Using Stream Input, you can ingest these change records into your pipeline and take further actions based on the change data.

Properties

Name
string
required
A human-readable name for the component.
Database
drop-down
required
The Snowflake database. The special value [Environment Default] uses the database defined in the environment. Read Databases, Tables and Views - Overview to learn more.
Schema
drop-down
required
The Snowflake schema. The special value [Environment Default] uses the schema defined in the environment. Read Database, Schema, and Share DDL to learn more.
Target Stream
string
required
Enter the name of the stream that you want to take data from.
Column Names
dual listbox
required
Once the Target Stream is set, the columns become available to choose from. Use the dual listbox to select which columns to pass along.