“Pipelines” section is used for editing standard chains of operations on data used by Unidata system. By editing it becomes available:
Changing the order of of the chain of actions when working with data.
Temporarily disabling certain parts of the chain of actions.
Integrating additional chains of actions necessary for the customer.
Go to the “Pipelines” section.
As a result, a list of starting segments will open, from which you need to select one.
Required. If the segment was not selected immediately, then set the segment in the Start area: click the “Select Segment” button and select a segment from the list.
Enter the name of the subject in the “Subject” field located above the block of starting segments.
Set the segment of the Point type, in which the basic pipeline logic will be executed. To do this, click on the “Add Segment” button under the Start area and select the required segment.
If necessary, specify the segment of the Connector type through which a new pipeline will be connected. To do this, click on the “Add Segment” button under the “Start” area and select the required segment.
The availability of Point and Connector segments depends on the selected Start segment.
There can be more than one segment of the Point and Connector types.
The order in which these segments start can be configured.
If necessary, set the segment that will handle a pipeline execution error. To do this, in the “Fallback” area, click the “Select Segment” button and select the required segment from the list.
The availability of this segment depends on the selected Start segment.
Required. Set the segment with which the pipeline will end. To do this, in the Finish area, click the “Select Segment” button and select the required segment.
Click “Save” in the upper right corner of the screen.
Select the required pipeline from the list.
Change or delete required segments. For a description of segment selection, see above.
Click “Save” in the upper-right corner of the screen.
To delete a pipeline, click “Delete” in the upper-right corner of the screen.
Search for Pipeline segments¶
The search field is located in the upper left part of the list of segments. Case-independent search, searches for execution thread segments by their Id and Description.
“Filter” button activates filtering options:
Start segments. Search only among the start segments (marked with the Start label).
All segments. Search among segments of all types.
If the “Filter” button is inactive, then the search is performed by the starting segment.
Figure 1. Search field with a option of filtering options
Pipeline Segment Types¶
Start. A segment from which a pipeline will start. All subsequent segments are offered contextually, depending on the selected start segment.
Point. A segment of the main logic execution of the pipeline. The pipeline can contain several Point segments at once. The order in which the segments are run depends on the order in which they are arranged.
Connector. A segment to connect new pipelines. It is used when one pipeline needs to use another one in its work (for example, to use the pipeline for getting relations in the pipeline for getting records).
Selector. A segment of a standard pipeline branching into several other pipelines.
Fallback. Segment of pipeline execution error handling. Launched if the main pipeline logic (Start, Point and Connector) ended with an error.
Finish. A segment with which the pipeline will end.