...
| Id | Description | Comments |
|---|---|---|
| U1 | As a user, I should be able to search Datasets containing the specified fields | List the kinds of queries that will be supported |
| U2 | As a CDAP system, I should be able to annotate CDAP entities with system metadata automatically | System metadata for each entity is listed below |
| U3 | As a user, I should be able to access and update CDAP metadata using the CDAP CLI | |
| U4 | As a developer, I should be able to access and update CDAP metadata using the CDAP Test Framework | |
| U5 | As a user, I should be able to search CDAP entities based on metadata using the CDAP UI | |
| U6 | As a user, I should be able to view the lineage of a CDAP dataset/stream in a specified time window using the CDAP UI |
New Metadata Search:
Key-Value - Author: Rohit Sinha
Tags: Tag1, Tag2
Schema: {field1: fieldtype1, field2: fieldtype2}
Storage:
Real Table
| Key | Value |
|---|---|
| <Entity-Id><Author> | Rohit Sinha |
| <Entity-Id><Tags> | {Tag1, Tag2} |
| <Entity-Id><Schema-Id> | {field1: fieldtype1, field2: fieldtype2} |
Index Table:
| Indexes | Entity |
|---|---|
| Author: Rohit Sinha | <Entity-Id> |
| Author: Rohit | <Entity-Id> |
| Author: Sinha | <Entity-Id> |
| Rohit | <Entity-Id> |
| Sinha | <Entity-Id> |
| Tag1 | <Entity-Id> |
| Schema | <Entity-Id> |
| field1:fieldtype1 | <Entity-Id> |
| field1 | <Entity-Id> |
| field2:fieldtype2 | <Entity-Id> |
| field2 | <Entity-Id> |
System Metadata
Kinds of system metadata:
...