Page Comparison

The goal of this page is to document the design of the Tracker Audit Metrics.

...

1. As a user of Tracker, I would like to see total number of audit messages by type/subtype in the past T timeframe.
   1. "Show me the total number of reads in the system in the past 1 hour."
2. As a user of Tracker, I would like to see the top N datasets/streams by audit message type/subtype activity in the past T timeframe.
   1. "Show me the 5 datasets with the most writes in the past 24 hours."
   2. "Show me the 5 streams with the most metadata_changes in the past 7 days."
3. As a user of Tracker, I would like to see the top N namespaces with the most type/subtype activity in the past T timeframe.
   1. "Show me the 5 namespaces witht with he most reads in the past 1 hour."

...

• Add an additional Cube table to the AuditLog custom dataset to hold metrics.
• The properties of the cube will be as follows
  • Resolutions: 1h, 1d, 7d, 30d
  • Aggs: 
    • access_type (access create update truncate delete metadata_change)
    • access_type,subtype (access,read access,write access,unknown)
    • namespace (default ns1 ns2)
    • namespace,entity_type,entity_name (default,stream,stream1 default,dataset,dataset1)
  • Measurements: 
    • accesses
    • access_reads
    • access_writes
    • access_unknowns
    • creates
    • updates
    • truncates
    • deletes
    • metadata_changes
• Queries to OLAP cube
  • "Show me the total number of reads in the system in the past 1 hour."

    • {
          "aggregation": "agg2",
          "resolution": 3600,
          "startTs": now,
          "endTs":   now-1h,
          "measurements": {"access_reads": "SUM"},
          "limit": 1
      }