Add a knowledge graph
To add a new knowledge graph, you need an account role with the Create knowledge graph permission. Adding a knowledge graph includes crawling data to add information to the knowledge graph, so that it contains relevant business logic and information when it is created.- On the Context Engine dashboard, click Add knowledge graph.
-
Select Build a graph to create a new knowledge graph.
If the information you’re adding relates to an existing knowledge graph, we recommend clicking Add to a graph to add more context to this knowledge graph. This will help Maia Team to understand your business logic by keeping related content in one place.
-
Select the type of crawl you want to perform for the new knowledge graph, and then follow the steps in the corresponding tab below:
- Data warehouse: Harvest your warehouse and structured sources supported via connectors to populate the graphs.
- Pipeline executions: Harvest your pipeline executions for your chosen project and environment to build an operational understanding of how data flows through your organization and workflow.
- Data warehouse
- Pipeline executions
- Select the type of cloud data warehouse you want to harvest data from.
- In Project, select a project that is connected to the warehouse you want to harvest data from.
- In Environment, select the environment you want to use to harvest data.
- (Optional) Click Manage next to the list of users in the selected project to view and edit the users who will be collaborators on this knowledge graph. To remove a collaborator, click the trash can icon next to their name.
- (Optional) In the Invite individual to collaborate drop-down, search for and click a Maia user to add them as a collaborator on this knowledge graph.
- Click Next.
- In the Select data step, select the data to crawl:
- If you’re crawling a Snowflake warehouse, select the database and schemas to crawl.
- If you’re crawling a Databricks warehouse, select the catalog and schemas to crawl.
- If you’re crawling an Amazon Redshift warehouse, select the schemas to crawl.
- If you’re crawling a Google BigQuery warehouse, select the datasets to crawl.
- (Optional) Select or deselect the Include data from pipeline executions checkbox to include or exclude pipeline executions in the selected project and environment in the crawl.
- Click Next.
- In the Schedule crawl step, choose how often this crawl should run. The crawl will run immediately after you create this knowledge graph, then follow this schedule.
- Select Standard or Advanced schedule settings.
- In Timezone, select the timezone for the crawl schedule.
- If you selected Standard settings, use the repeat drop-downs to set how often the crawler runs.
- If you selected Advanced settings, enter a cron expression to set how often the crawler runs.
- Click Run.
