...

Users want to integrate CDAP with their already stored dataset in Google BigQuery. 

User Stories

  1. User is able to query their datasets stored in Google BigQuery.  2. As a user, I would like to run arbitrary queries synchronously against my datasets in BigQuery and pull those records in BigQuery and pull those records in a hydrator pipeline.

  2. As a user, i would like to store data from a Hydrator pipeline into a table (dataset) in BigQuery. If the table doesn't exist, it should be created.

Requirements

  1. User should specify the limit time for the querying. 

  32. User is able to specify the limit size of the dataset to query. 

  4. User is able to poll for the result.

  5. User can list the query result history for a duration of time. 

  6. 3. The schema is automatically pulled from the table. 

  74. User can pull the field names from the query.

...