This video walks you through the use of FlowFile Concurrency at Process Group level. This feature is very useful to replace the Wait/Notify processors (that are not always easy to use properly) in some scenarios. A very common use case is to deal with a FlowFile (let's say a ZIP file) that is going to generate a bunch of child FlowFiles (unpacking the ZIP file into the individual files of the archive), have processing on the individual FlowFiles (say running an antivirus scan on the files), and have specific handling of the original FlowFile (the ZIP file) based on the results of the processing of the child FlowFiles (virus detected or not).
As a note, I did write this blog post about Wait/Notify pattern. It was 4 years ago but it still gives an overview of this option:
https://pierrevillard.com/2018/06/27/nifi-workflow-monitoring-wait-notify-pattern-with-split-and-merge/
Download
0 formats
No download links available.
FlowFile Concurrency at Process Group level | NatokHD