...
- Type of dataset
- Schema
- RecordScannable/BatchWritable/RecordWritable/BatchReadable
- Other properties
Streams
- Format
Views
- Format
Schema as Metadata
Design Considerations
Storage
...
- The REST APIs for adding/updating/deleting system metadata will not be documented, and will not be exposed via the Router
- The SystemMetadataUpdater will use service discovery to discover the Metadata Service and make REST calls.
Schema as Metadata
Schema as metadata is meant to add the capability in CDAP for users to be able to retrieve datasets/streams with a field X optionally of type Y.
...