Skip to main content
Metadata components retrieve information about the structure of your data warehouse, such as tables, columns, and data types, and load it into pipeline variables for use elsewhere in an orchestration pipeline.

Use cases

Metadata components are useful when a pipeline needs to react to the current structure of a table or database, rather than assuming it stays fixed. Use metadata components to:
  • Discover the columns and data types of a table at runtime, rather than hardcoding them.
  • Build pipelines that adapt automatically when the structure of a source or target table changes.
  • Populate a grid variable with table or column metadata to drive an iterator.
  • Audit or inspect the structure of warehouse objects as part of a larger workflow.