Record Capturer*¶
This stage captures the data that passes through this stage and store the data in Redis in the key:field:value
format. The calculation logic of this stage is as follows:
- The format of the Redis key is
pipelineId::commonRedisStage::assetId
, in whichcommonRedisStage
is a fixed field. - This stage cannot guarantee idempotence of the calculation results due to failure retries caused by any reasons, such as cluster node exceptions.
- Incompatible with old data formats, i.e. cannot filter data by
ModelId::PointId
.
Configuration¶
The configuration tabs for this stage are General, Basic, Input/Output, and CacheConfig.
General¶
Name | Required? | Description |
---|---|---|
Name | Yes | The name of the stage. |
Description | No | The description of the stage. |
Stage Library | Yes | The streaming operator library to which the stage belongs. |
Required Fields | No | The fields that the data records must contain. If the specified fields are not included, the record will be filtered out. |
Preconditions | No | The conditions that must be satisfied by the data records. Records that do not meet the conditions will be filtered out. For example, ${record:value('/value') > 0} . For the syntax of EL expressions, see Expression Language. |
On Record Error | Yes | The processing method for error data.
|
Basic¶
Name | Required? | Description |
---|---|---|
Quality Filter | No | Filter the data according to the data quality. Only records that meet the quality conditions will be processed by this stage. |
Input/Output¶
Name | Required? | Description |
---|---|---|
Input Measurement | Yes | Data input point, the MeasurementId of the input data must match the input point for it to be processed by this operator. |
CacheConfig¶
Name | Required? | Description |
---|---|---|
Cache Type | Yes | Select the storage type for cache data. Options are Redis and Local storage.
|