Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Extends Action Class
  2. Config Properties:
    1. sourcePath: Path of file/directory
    2. destPath: Path of desired destination
    3. fileRegex: wildcard used to identify types of files to run
  3. Run Method:
    1. Pull all files in given path and filter them if `fileRegex` is set using a `WildCardFileFilter`
    2. For each file, execute a `FileSystem.rename(src, dest)` call to move it to the desired location. Would require getting the hdfs fileSystem first.

     To-do:

  • Allow moving of files from FTP to HDFS.
    • Proposal: parse source path config to see if it is in FTP or HDFS

 

File Action:

  • Moves files between remote machines

...