...
- Key-Value Metadata:
- Codename: Alpha Tango Charlie
Supported searches:Use case: User should be able to search with- Whole Key-Value (complete or partial) - Codename: Alpha Tango Charlie or Codename: Alpha Tang*
- Key with Part of Value (complete or partial) - Codename: Alpha or Codename: Tango or Codename: Charlie or Codename: Alp*
- Whole Value (complete or partial): Alpha Tango Charlie or Alpha* or Alpha Tan*
- Parts of value (complete or partial): Alpha or Tango or Charlie or Alph* or Tan* or Ch*
- Whole Key-Value (complete or partial) - Codename: Alpha Tango Charlie or Codename: Alpha Tang*
- Codename: Alpha Tango Charlie
- Tags Metadata:
- Tags: Tag1, Tag22
Supported searches:Use case: User should be able to search with- With tags key and a tag value (complete or partial): Tags: Tag1 or Tags: Tag*
- With tag value complete or partial: Tag22 or Tag2*
- Tags: Tag1, Tag22
- Schema Metadata: This is just key-value where key is schema and value schema fields but needs special indexing to support searches with fieldName and fieldName:fieldType.(we don't plan to support schema searches with fieldTypes)
- Schema: {EmpName: String, EmpContact: {EmpTel: Integer, EmpAddr: String}} (Note: This is a nested schema)
Supported searches:- FieldName with FieldType: EmpName: String or EmpTel:Integer or EmpAddr: String
- FieldName: EmpName, EmpTel, EmpAddr
- Schema: {EmpName: String, EmpContact: {EmpTel: Integer, EmpAddr: String}} (Note: This is a nested schema)
- Use case: User should be able to search with
- FieldName scoped to schema (complete or partial): Schema: EmpName or Schema: EmpContact or Schema: EmpTel or Schema: EmpAddr or Schema: Emp*
- FieldName (complete or partial): EmpName or EmpContact or EmpTel or EmpAddr or Emp*
- Use case: User should be able to search with
Storage:
Main Table: This table stores stores the metadata for the entity. It will be used when an user wants to get metadata of an entity. This table is not for searching.
...
Key: Entity with index | Value: Index |
---|---|
<Entity-Id><CodeName: Alpha Tango Charlie> | CodeName: Alpha Tango Charlie |
<Entity-Id><Codename: Alpha> | Codename: Alpha |
<Entity-Id><Codename: Tango> | Codename: Tango |
<Entity-Id><Codename: Charlie> | Codename: Charlie |
<Entity-Id><Alpha Tango Charlie> | Alpha Tango Charlie |
<Entity-Id><Alpha> | Alpha |
<Entity-Id><Tango> | Tango |
<Entity-Id><Charlie> | Charlie |
<Entity-Id><Tags: Tag1> | Tags: Tag1 |
<Entity-Id><Tags: Tag22> | Tags: Tag22 |
<Entity-Id><Tag1> | Tag1 |
<Entity-Id><Tag22> | Tag22 |
<Entity-Id><EmpName> | EmpName |
<Entity-Id><EmpContact> | EmpContact |
<Entity-Id><EmpTel> | EmpTel |
<Entity-Id><EmpAddr> | EmpAddr |
...
Search Result:
Metadata search will return Entities with the following details depending upon the type of the Entity.
Entity Type | Search Details | Special Case |
---|---|---|
Application | Type | |
Name | ||
Metadata: Tags and Properties | ||
App Description | ||
Program | Type | Type=Workflow |
Name | All program under the workflow | |
Metadata: Tags and Properties | Schedule for this workflow | |
App it belongs to | ||
Artifact | Type | |
Name | ||
? | ||
Dataset | Type | |
Name | ||
Programs which uses this Dataset | ||
Stream | Name | |
Type | ||
Programs which uses this Stream | ||
View | Name | |
Type | ||
Stream Name | ||
Programs which uses this View. |
System Metadata
Kinds of system metadata:
...