Snowflake Integration Docs

Summary

Snowflake’s Data Cloud is powered by an advanced data platform provided as a self-managed service. Snowflake enables data storage, processing, and analytic solutions that are faster, easier to use, and far more flexible than traditional offerings. Metarouter allows clients to pass event and identity to their chosen cloud storage account in real time. By ensuring that compliant and correctly configured event data goes into the cloud data storage and then to the data warehouse MetaRouter can reduce processing time and improve quality. Metarouter can also offer enterprise level client access to additional vendor ID’s that might be used for attribution, identity graphing or 2nd party data sales.

How Does It Work?

The MetaRouter integration requires a cloud data storage as the main event feed. Events will be sent to the cloud data storage in “real-time”. Clients will need to pick their desired cloud storage account, connect their events data via the MetaRouter cloud storage account and then within the cloud storage account connect Snowflake. Using these steps clients can quick enabled their eventing data into SnowFlake for processing. Or the client can chose to define their desired file and once the desired file size has been completed the data storage will “respond” with the URL. Difference being we send a request and the response immediately comes back with the URL to the file, like a webhook. This notified us to push the file to Snowflake via the Snowpipe API.

Integration Setup

Step 1:

Chose and Setup Cloud Storage Account

Setup Amazon’s S3 - https://aws.amazon.com/pm/serv-s3/
Setup Google Cloud Storage - https://support.google.com/cloud/answer/6250993?hl=en
Setup Microsoft Azure - https://learn.microsoft.com/en-us/azure/cloud-adoption-framework/ready/azure-setup-guide/

Step 2:

Once the clients desired cloud storage account is chosen and setup. Use the MetaRouter Integration to pipe data to the cloud storage account.

Setup the MetaRouter Amazon’s S3 integrations - https://docs.metarouter.io/docs/amazon-s3
Setup the MetaRouter Google Cloud Storage integration - https://docs.metarouter.io/docs/google-cloud-storage
Setup the MetaRouter Microsoft Azure Blob integration - https://docs.metarouter.io/docs/blob

Step 3:

Configure Snowflake to read and consume via the chosen cloud storage account

Configure Snowflake to Consume Amazon’s S3 - https://docs.snowflake.com/en/user-guide/data-load-s3
Configure Snowflake to Consume Google Cloud Storage - https://docs.snowflake.com/en/user-guide/data-load-gcs
Configure Snowflake to Consume Microsoft Azure - https://docs.snowflake.com/en/user-guide/data-load-azure

And you’re done! This will allow data to flow from your digital property, process through MetaRouter’s cloud storage integration, and ultimately be consumed (on a schedule of your choosing within Snowflake’ UI) into your Snowflake warehouse.