Data loading in Snowflake (https://docs.snowflake.net/manuals/user-guide/data-load-overview.html) is performed in two, separate steps. The first step is to load the files into a staging area, and the second step is to trigger the upload with a COPY INTO step. This action plugin will execute both steps using Snowflake JDBC.
Use case(s)
As a financial services company, I would like to build an analytics pipeline to push data into the Snowflake. I would leverage Hydrator, and use this plugin as action to create files in the staging area and trigger the loading of the data.
User Storie(s)
I would like to create files in the staging area and trigger loading of the data.
I would like to have capability to load files from internal and external(s3) location.
Plugin Type
Action
Configurables
This section defines properties that are configurable for this plugin.