Batch source to use Google Cloud Platforms's Bigtable as a Source.
...
Section | User Configuration Label | Label Description | Mandatory | Macro-enabled | Options | Default | Variable | User Widget |
---|---|---|---|---|---|---|---|---|
Standard | Reference Name | This will be used to uniquely identify this source for lineage, annotating metadata, etc | + | + | referenceName | Text Box | ||
Table Name | Database table name | + | + | tableNametable | Text Box | |||
Instance ID | Bigtable instance ID | + | + | instanceIdinstance | Text Box | |||
Project ID | The ID of the project in Google Cloud If not specified, will be automatically read from the cluster environment | + | projectIdproject | Text Box | ||||
Service Account File Path | Path on the local file system of the service account key used for If the plugin is run on a Google Cloud Dataproc cluster, the service account key does not need to be provided and can be set to 'auto-detect'. When running on other clusters, the file must be present on every node in the cluster. See Google's documentation on Service account credentials for details. | + | serviceFilePath | Text Box | ||||
Key Alias | Name of the field to set as the key fieldfor row key. | __key__ | keyAlias | Text Box | ||||
Scan Row Start | Scan start row. | + | scanRowStart | Text Box | ||||
Scan Row Stop | Scan stop row. | + | scanRowStop | Text Box | ||||
Scan Time Range Start | The starting timestamp used to filter columns with a specific range of versions. | + | scanTimeRangeStart | Text Box | ||||
Scan Time Range Stop | The ending timestamp used to filter columns with a specific range of versions. | + | scanTimeRangeStop | Text Box | ||||
Schema | Specifies the schema that has to be output. If not specified, then by default each item will be emitted as a JSON string. Only columns defined in schema will be included into output record. Field name should be in form "<family>:__<column>". | + | schema | schema | ||||
Error Handling | On Record Error | How to handle error in record processing. Error will be thrown if failed to parse value according to provided schema. | + |
| Skip error | on-error | Radio Button (layout: block) |
...