...
Thus, the suggestion is to create a Snowflake Copy Data Loading Action Plugin that will utilize COPY INTO <table> command to load data files into Snowflake and Snowflake and Snowflake Data Unloading Action Plugin COPY INTO <location> command to unload data from a table (or query) into one or more files.
...
User Configuration Label | Label Description | Options | Default | Variable | User Widget | |
---|---|---|---|---|---|---|
General | Label | Label for UI | textbox | |||
Account Name | Full name of Snowflake account. | |||||
Database | Database name to connect to connect to. | |||||
Query | SQL query to run. | query | textarea | |||
Credentials | Username | User identity for connecting to the specified database. | username | textbox | ||
Password | Password to use to connect to the specified database. | password | password | |||
Key Pair Authentication | Key Pair Authentication Enabled | If true, plugin will perform Key Pair authentication. |
| False | keyPairEnabled | toggle |
Key File Path | Path to the private key file. | path | textbox | |||
User | Snowflake login name. | user | textbox | |||
OAuth2 | OAuth2 Enabled | If true, plugin will perform OAuth2 authentication. |
| False | oauth2Enabled | toggle |
Auth URL | Endpoint for the authorization server used to retrieve the authorization code. | authUrl | textbox | |||
Token URL | Endpoint for the resource server, which exchanges the authorization code for an access token. | tokenUrl | textbox | |||
Client ID | Client identifier obtained during the Application registration process. | clientId | textbox | |||
Client Secret | Client secret obtained during the Application registration process. | clientSecret | password | |||
Scopes | Scope of the access request, which might have multiple space-separated values. | scopes | textbox | |||
Refresh Token | Token used to receive accessToken, which is end product of OAuth2. | refreshToken | textbox | |||
Advanced | Bounding Query | Bounding Query should return the min and max of the values of the 'splitBy' field. For example, 'SELECT MIN(id),MAX(id) FROM table'. Not required if numSplits is set to one. | boundingQuery | textarea | ||
Split-By Field Name | Field Name which will be used to generate splits. Not required if numSplits is set to one. | splitBy | textbox | |||
Number of Splits to Generate | Number of splits to generate. | numSplits | textbox | |||
Connection Arguments | A list of arbitrary string tag/value pairs as connection arguments. See: https://docs.snowflake.net/manuals/user-guide/jdbc-configure.html#jdbc-driver-connection-string | connectionArguments | keyvalue |
...
Snowflake Data Loading Action Plugin Properties
User Configuration Label | Label Description | Options | Default | Variable | User Widget | |
---|---|---|---|---|---|---|
General | Label | Label for UI | textbox |
Snowflake Data Unloading Action Plugin Properties
User Configuration Label | Label Description | Options | Default | Variable | User Widget | |
---|---|---|---|---|---|---|
General | Label | Label for UI | textbox |
...