...
As a user, I would like to run arbitrary queries synchronously against my datasets in BigQuery and pull those records in BigQuery and pull those records in a hydrator pipeline.
Requirements
- User should provide the correct project id which he has access to.
- User should provide the SQL query against a dataset inside his project.
- User should provide the Json Key File of the project.
- User should specify the limit time for the queryingprovide the temporary google cloud storage bucket to store the intermediate query result.
- User should specify the limit time for the queryingprovide the fully qualified input table in BigQuery.
Example
Following is a simple example showing how BigQuery Source would work.
...