...
- What authorization roles are required by this plugin?
- An application default credential is required. Here is where to get such a credential.
- I see a few additional config options on the query API. Are those configurable by the user?
Design
...
- Now what the user need to configure are project Id, credential path to the local private key, query string, time limit.
- Create a simple batch source inside hydrator plugin with all dependencies needed.
- Add an endpoint to run query against datasets in BigQuery.
Design
| Inputs | type | required | default |
|---|---|---|---|
| ProjectId | String | Yes |
|
| Credentials | String | Yes | |
| Query | String | Yes | |
| Limit Time | Integer (min) | No | 10 |
| Limit Size | Integer (GB) | No | 50 |
...