Data loading in Snowflake (https://docs.snowflake.net/manuals/user-guide/data-load-overview.html) is performed in two, separate steps. The first step is to load the files into a staging area, and the second step is to trigger the upload with a COPY INTO step. This plugin will allow files to be written to the staging area for further processing.
Use case(s)
As a financial services company, I would like to build an analytics pipeline to push data into the Snowflake. I would leverage Hydrator, and use this plugin as a sink to create files in the staging area. Finally, there would be an action plugin to trigger the loading of the data.
User Storie(s)
I would like to load processed data to the correct Snowflake staging area in the proper format.
Plugin Type
Batch Sink
Real-time Sink
Configurables
This section defines properties that are configurable for this plugin.