Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Key-Value Metadata:
    1. Codename: Alpha Tango Charlie
      Supported searches:Use case: User should be able to search with
      1. Whole Key-Value (complete or partial) - Codename: Alpha Tango Charlie or Codename: Alpha Tang*
      2. Key with Part of Value (complete or partial) - Codename: Alpha or Codename: Tango or Codename: Charlie or Codename: Alp*
      3. Whole Value (complete or partial): Alpha Tango Charlie or Alpha* or Alpha Tan*
      4. Parts of value (complete or partial): Alpha or Tango or Charlie or Alph* or Tan* or Ch*

  2. Tags Metadata:
    1. Tags: Tag1, Tag22
      Supported searches:Use case: User should be able to search with
      1. With tags key and a tag value (complete or partial): Tags: Tag1 or Tags: Tag*
      2. With tag value complete or partial: Tag22 or  Tag2*

  3. Schema Metadata: This is just key-value where key is schema and value schema fields but needs special indexing to support searches with fieldName and fieldName:fieldType.(we don't plan to support schema searches with fieldTypes)
    1. Schema: {EmpName: String, EmpContact: {EmpTel: Integer, EmpAddr: String}} (Note: This is a nested schema)
      Supported searches:
      1. FieldName with FieldType: EmpName: String or EmpTel:Integer or EmpAddr: String
      2. FieldName: EmpName, EmpTel, EmpAddr

 

 

    1. Use case: User should be able to search with
      1. FieldName scoped to schema (complete or partial): Schema: EmpName or Schema: EmpContact or Schema: EmpTel or Schema: EmpAddr or Schema: Emp*
      2. FieldName (complete or partial): EmpName or EmpContact or EmpTel or EmpAddr or Emp*

Storage:

Main Table: This table stores stores the metadata for the entity. It will be used when an user wants to get metadata of an entity. This table is not for searching. 

...

Key: Entity with indexValue: Index
<Entity-Id><CodeName: Alpha Tango Charlie>CodeName: Alpha Tango Charlie
<Entity-Id><Codename: Alpha>Codename: Alpha
<Entity-Id><Codename: Tango>Codename: Tango
<Entity-Id><Codename: Charlie>Codename: Charlie
<Entity-Id><Alpha Tango Charlie>Alpha Tango Charlie
<Entity-Id><Alpha>Alpha
<Entity-Id><Tango>Tango
<Entity-Id><Charlie>Charlie
<Entity-Id><Tags: Tag1>Tags: Tag1
<Entity-Id><Tags: Tag22>Tags: Tag22
<Entity-Id><Tag1>Tag1
<Entity-Id><Tag22>Tag22 
<Entity-Id><EmpName>EmpName
<Entity-Id><EmpContact>EmpContact
<Entity-Id><EmpTel>EmpTel
<Entity-Id><EmpAddr>EmpAddr

 

...

Search Result:

Metadata search will return Entities with the following details depending upon the type of the Entity.

Entity TypeSearch DetailsSpecial Case
Application

Type

 
 Name 
 Metadata: Tags and Properties 
 App Description 
ProgramTypeType=Workflow
 NameAll program under the workflow
 Metadata: Tags and PropertiesSchedule for this workflow
 App it belongs to 
ArtifactType 
 Name 
 ? 
DatasetType 
 Name 
 Programs which uses this Dataset 
StreamName 
 Type 
 Programs which uses this Stream 
ViewName 



Type 
Stream Name 

Programs which uses this View.

 

 

System Metadata

Kinds of system metadata:

...