Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Operations
    1. Perform single + batch read on single + multiple dataset from script transform
    2. Perform single + batch read on DistributedCache from script transform
  2. Supported datasets for lookup
    1. Key-value table
    2. ObjectMappedTable
  3. Optional caching with time-based expiration

Proposed changes

...

  1. Rename TransformContext to StageContext (since it is used as the base context in BatchRuntimeContext, not only transform contexts).
  2. Create TransformContext which extends StageContext
    1. Has a single method: Lookup getLookup()

...

Design

  1. LookupKV interface
    1. Object read(String key);
  2. ScriptTransform
    1. New configuration property for declaring lookup tables to use
    2. At configure(), verify datasets / tables exist