...
- It is suggested to place plugin code under database-plugin repository to reuse existing database capabilities.
Source Properties
User Facing Name | Type | Description | Constraints |
---|---|---|---|
Label | String | Label for UI | |
Reference Name | String | Uniquely identified name for lineage | Required |
Driver Name | String | Name of JDBC driver to use | Required (defaults to postgres) |
Cluster endpoint | String | URL of the current master instance of PostgreSQL cluster | Required |
Port | Number | Port of PostgreSQL cluster's master instance | Optional (defaults to 5432) |
Database | String | Database name to connect | Required |
Import Query | String | Query for import data | Valid SQL query |
Username | String | DB username | Required |
Password | String | User password | Required |
Bounding Query | String | Returns max and min of split-By Filed | Valid SQL query |
Split-By Field Name | String | Field name which will be used to generate splits | |
Number of Splits to Generate | Number | Number of splits to generate | |
Connection Arguments | Keyvalue | A list of arbitrary string tag/value pairs as connection arguments, list of properties https://jdbc.postgresql.org/documentation/head/connect.html#connection-parameters |
Sink Properties
User Facing Name | Type | Description | Constraints |
---|---|---|---|
Label | String | Label for UI | |
Reference Name | String | Uniquely identified name for lineage | Required |
Driver Name | String | Name of JDBC driver to use | Required (defaults to postgres) |
Host | String | URL of the current master instance of PostgreSQL cluster | Required |
Port | Number | Port of PostgreSQL cluster's master instance | Optional (defaults to 5432) |
Database | String | Database name to connect | Required |
Username | String | DB username | Required |
Password | Password | User password | Required |
Connection Arguments | Keyvalue | A list of arbitrary string tag/value pairs as connection arguments, list of properties https://jdbc.postgresql.org/documentation/head/connect.html#connection-parameters | |
Table Name | String | Name of a database table to write to | Requried |
...
Test Case(s)
- Test case #1
- Test case #2
...