...
- Please, refer Plugin OAuth2 Common Module for OAuth2 common module design information
Option 2
TODO
Option 3
TODO
Source Data Types Mapping
| Snowflake Data Types | CDAP Schema Data Type | Comment |
|---|---|---|
| NUMBER | decimal | Default precision and scale are (38,0). |
| DECIMAL | decimal | Synonymous with NUMBER. |
| NUMERIC | decimal | Synonymous with NUMBER. |
| INT, INTEGER, BIGINT, SMALLINT | decimal | Synonymous with NUMBER, except that precision and scale cannot be specified (i.e. always defaults to NUMBER(38, 0)). |
| FLOAT, FLOAT4, FLOAT8 | double | Snowflake uses double-precision (64 bit) IEEE 754 floating point numbers. |
| DOUBLE | double | Synonymous with FLOAT. |
| DOUBLE PRECISION | double | Synonymous with FLOAT. |
| REAL | double | Synonymous with FLOAT. |
| VARCHAR | string | Default (and maximum) is 16,777,216 bytes. |
| CHAR, CHARACTER | string | Synonymous with VARCHAR except default length is VARCHAR(1). |
| STRING | string | Synonymous with VARCHAR. |
| TEXT | string | Synonymous with VARCHAR. |
| BINARY | bytes | |
| VARBINARY | bytes | Synonymous with BINARY. |
| BOOLEAN | boolean | |
| DATE | date | |
| DATETIME | timestamp | Alias for TIMESTAMP_NTZ |
| TIME | time | |
| TIMESTAMP | timestamp/string | Alias for one of the TIMESTAMP variations (TIMESTAMP_NTZ by default). |
| TIMESTAMP_LTZ | timestamp | TIMESTAMP with local time zone; time zone, if provided, is not stored. |
| TIMESTAMP_NTZ | timestamp | TIMESTAMP with no time zone; time zone, if provided, is not stored. |
| TIMESTAMP_TZ | string | TIMESTAMP with time zone. |
| VARIANT | string | A tagged universal type, which can store values of any other type, including OBJECT and ARRAY, up to a maximum size of 16 MB compressed. |
| OBJECT | record | |
| ARRAY | array |
...
| Section | User Configuration Label | Label Description | Options | Default | Variable | User Widget |
|---|---|---|---|---|---|---|
| General | Label | Label for UI. | textbox | |||
| Reference Name | Uniquely identified name for lineage. | referenceName | textbox | |||
| Account Name | Full name of Snowflake account. | |||||
| Database | Database name to connect to connect to. | |||||
| Table Name | Name of a database table to write to. | |||||
| Credentials | Username | User identity for connecting to the specified database. | username | textbox | ||
| Password | Password to use to connect to the specified database. | password | password | |||
| Key Pair Authentication | Key Pair Authentication Enabled | If true, plugin will perform Key Pair authentication. |
| False | keyPairEnabled | toggle |
| Key File Path | Path to the private key file. | path | textbox | |||
| User | Snowflake login name. | user | textbox | |||
| OAuth2 | OAuth2 Enabled | If true, plugin will perform OAuth2 authentication. |
| False | oauth2Enabled | toggle |
| Auth URL | Endpoint for the authorization server used to retrieve the authorization code. | authUrl | textbox | |||
| Token URL | Endpoint for the resource server, which exchanges the authorization code for an access token. | tokenUrl | textbox | |||
| Client ID | Client identifier obtained during the Application registration process. | clientId | textbox | |||
| Client Secret | Client secret obtained during the Application registration process. | clientSecret | password | |||
| Scopes | Scope of the access request, which might have multiple space-separated values. | scopes | textbox | |||
| Refresh Token | Token used to receive accessToken, which is end product of OAuth2. | refreshToken | textbox | |||
| Advanced | Connection Arguments | A list of arbitrary string tag/value pairs as connection arguments. See: https://docs.snowflake.net/manuals/user-guide/jdbc-configure.html#jdbc-driver-connection-string | connectionArguments | keyvalue |
Option 2
TODO
...
TODO
Sink Data Types Mapping
| CDAP Schema Data Type | Snowflake Data Types | Comment |
|---|---|---|
| boolean | BOOLEAN | |
| bytes | BINARY | |
| date | DATE | |
| double | FLOAT | Snowflake uses double-precision (64 bit) IEEE 754 floating point numbers. |
| decimal | NUMBER(s, p) | |
| float | FLOAT | |
| int | NUMBER(s, p) | Where p >= 10. It's safe to write primitives as values of decimal logical type in the case of valid precision. |
| long | NUMBER(s, p) | Where p >= 19. It's safe to write primitives as values of decimal logical type in the case of valid precision. |
| string | VARCHAR | |
| time | TIME | |
| timestamp | TIMESTAMP_NTZ | |
| array | ARRAY | |
| record | OBJECT | |
| enum | VARCHAR | |
| map | OBJECT | |
| union | VARIANT |
...