Synchronous and Asynchronous Processing
The synchronous nature of a transformation refers to its row-processing behavior and whether it must first receive all rows from the input before it is able to process and begin returning rows in its output. A truly synchronous transformation processes a row as it flows through its input, performs the transformation, and immediately outputs the row. Synchronous transformations manipulate data that already exists in a buffer faster than a transformation that must copy records into a new buffer.
An asynchronous transformation must wait for all rows or a group of them before it can perform the transformation. This requires management of data in buffer space and blocks the flow of rows to subsequent components in the data flow pipeline. Some transformations must process only groups of rows (for example, all rows matching a value or having a sorted column value) and might exhibit partially synchronous behavior by releasing a group of processed rows for output after transforming the row group.
No comments:
Post a Comment