Speaker
Mr
Ivan Gankevich
(Saint Petersburg State University)
Description
Processing of large amounts of data often consists of several steps, e.g. pre- and postprocessing stages, which are executed sequentially with data written to disk after each step, however, when preprocessing stage for each task is different the more efficient way of processing data is to construct a pipeline which streams data from one stage to another. In a more general case some processing stages can be factored into several parallel subordinate stages thus forming a distributed pipeline where each stage can have multiple inputs and multiple outputs. Such processing pattern emerges in a problem of classification of wave energy spectra based on analytic approximations which can extract different wave systems and their parameters (e.g. system type, mean wave direction) from spectrum. Distributed pipeline approach achieves good performance compared to conventional “sequential-stage” processing.
Primary authors
Prof.
Alexander Degtyarev
(Saint Petersburg State University)
Mr
Ivan Gankevich
(Saint Petersburg State University)
