Record Capturer¶
This stage captures the data that passes through this stage and store the data in Redis in the key:field:value
format. The format of the Redis key is pipelineId::commonRedisStage::assetId
, in which commonRedisStage
is a fixed field.
Configuration¶
The configuration tabs for this stage are General, Basic, and Input/Output.
General¶
Name | Required? | Description |
---|---|---|
Name | Yes | The name of the stage. |
Description | No | The description of the stage. |
Stage Library | Yes | The streaming calculator library to which the stage belongs. |
Required Fields | No | The fields that the data records must contain. If the specified fields are not included, the record will be filtered out. |
Preconditions | No | The conditions that must be satisfied by the data records. Records that do not meet the conditions will be filtered out. |
On Record Error | Yes | The processing method for error data.
|
Basic¶
Name | Required? | Description |
---|---|---|
Quality Filter | No | Filter the data according to the data quality. Only records that meet the quality conditions will be processed by this stage. |
Input/Output¶
Name | Required? | Description |
---|---|---|
Input Point | Yes | Specify the input point of the records, using the format {modelId}::{pointId}. |