Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

As a user, I would like to run arbitrary queries synchronously against my datasets in BigQuery and pull those records in BigQuery and pull those records in a hydrator pipeline.

 

Requirements

  1. User should provide the correct project id which he has access to. 
  2. User should provide the SQL query against a dataset inside his project.
  3. User should provide the Json Key File of the project.
  4. User should specify the limit time for the queryingprovide the temporary google cloud storage bucket to store the intermediate query result
  5. User should specify the limit time for the queryingprovide the fully qualified input table in BigQuery

Example

Following is a simple example showing how BigQuery Source would work.

...