...
Following are the possible configuration parameters for the hydrator application:
- endStages(Optional): List of stages(inclusive) till which preview need to be executed. If not given, preview will be executed till the sink.
- realLookups: List of datasets to be used from the real space for the lookup purpose only. This is required field, since if it is not given the datasets from the preview space will be used which will be empty.
- realExternalWrites(Optional): List of EXTERNAL datasets to which the actual writes need to happen. If user does not want to write to the external dataset, we can replace the sink with the /dev/null sink in the pipeline configurations. Note that this is only required for the external datasets. The CDAP internal datasets will be created in the preview space only, so even if we write to them, those writes will not be visible in the real space.
- numRecords(Optional): Number of records to be read from the source for the preview. If not given we will read ALL the records from the source.
- outputs(Optional): User can provide test data to preview using outputs configurations.
...