Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 5 Next »

Requirements

  1. Operations
    1. Perform single + batch read on single + multiple dataset from script transform
    2. Perform single + batch read on DistributedCache from script transform
  2. Supported datasets for lookup
    1. Key-value table
    2. ObjectMappedTable
  3. Optional caching with time-based expiration

Proposed changes

  1. TransformContext changes
    1. Rename TransformContext to StageContext (since it is used as the base context in BatchRuntimeContext, not only transform contexts.
    2. Create TransformContext which extends StageContext
  2. Transform changes
    1. Lookup interface with lookup methods that perform read operations on datasets
    2. DefaultLookup: implementation that uses Transactional to implement Lookup, used in ETLWorker
    3. Add Lookup field to ScriptContext, so Lookup is accessible via transforms that interpret JavaScript
      1. Sample usage: ctx.lookup.lookupKVString('purchases', 'key')

 

  • No labels