Batch source to use Google Cloud Platforms's Bigtable as a Source.
...
| Section | User Configuration Label | Label Description | Mandatory | Macro-enabled | Options | Default | Variable | User Widget |
|---|---|---|---|---|---|---|---|---|
| Standard | Reference Name | This will be used to uniquely identify this source for lineage, annotating metadata, etc | + | + | referenceName | Text Box | ||
| Table Name | Database table name | + | + | tableName | Text Box | |||
| Instance ID | Bigtable instance ID | + | + | instanceId | Text Box | |||
| Project ID | The ID of the project in Google Cloud If not specified, will be automatically read from the cluster environment | + | projectId | Text Box | ||||
| Service Account File Path | Path on the local file system of the service account key used for If the plugin is run on a Google Cloud Dataproc cluster, the service account key does not need to be provided and can be set to 'auto-detect'. When running on other clusters, the file must be present on every node in the cluster. See Google's documentation on Service account credentials for details. | + | serviceFilePath | Text Box | ||||
| Key Alias | Name of the field to set as the key field. | __key__ | keyAlias | Text Box | ||||
| Scan Row Start | Scan start row. | + | scanRowStart | Text Box | ||||
| Scan Row Stop | Scan stop row. | + | scanRowStop | Text Box | ||||
| Scan Time Range Start | The starting timestamp used to filter columns with a specific range of versions. | + | scanRowStartscanTimeRangeStart | Text Box | ||||
| Scan Time Range Stop | The ending timestamp used to filter columns with a specific range of versions. | + | scanRowStopscanTimeRangeStop | Text Box | ||||
| Schema | Specifies the schema that has to be output. If not specified, then by default each item will be emitted as a JSON string. Only columns defined in schema will be included into output record. Field name should be in form "<family>:<column>". | + | schema | schema | ||||
| Error Handling | On Record Error | How to handle error in record processing. Error will be thrown if failed to parse value according to provided schema. | + |
| Skip error | on-error | Radio Button (layout: block) |
...