Record Formatter

Supports conversion of the format of the input data. During the conversion, the corresponding Asset Tags and Measurement Tags are queried based on the configuration information, and this tag information is appended to the record.

Configuration

The configuration tabs for this stage are General, Basic, Input/Output and CacheConfig.

General

Name

Required?

Description

Name

Yes

The name of the stage.

Description

No

The description of the stage.

Stage Library

Yes

The streaming operator library to which the stage belongs.

Required Fields

No

The fields that the data records must contain. If the specified fields are not included, the record will be filtered out.

Preconditions

No

The conditions that must be satisfied by the data records. Records that do not meet the conditions will be filtered out. For example, ${record:value('/value') > 0}. For the syntax of EL expressions, see Expression Language.

On Record Error

Yes

The processing method for error data.

  • Discard: Error data will be discarded and ignored

  • Send to Error: Error messages will be reported

  • Stop Pipeline: The pipeline will be stopped

Basic

Name

Required?

Description

Input Format

Yes

Select the format of the input data, currently 3 formats are supported:

Output Format

Yes

Select the format of the output data, currently 3 formats are supported.

Asset Tag Groups

No

Need to configure the tag group ID defined in the Data Asset Catalog - Tag Management, the operator will use the assetId to query the Data Asset Catalog if the corresponding asset has tags belonging to the configured Assert Tag Groups

Measurement Tag Groups

No

Need to configure the tag group IDs defined in the Data Asset Catalog - Tag Management, the operator will use the measurementId to query the Data Asset Catalog for tags belonging to the configured Measurement Tag Groups for the corresponding measurement points.

Note

When converting to DCM Format and exporting downstream to a chronological database or other service, you need to make sure that the modelId, modelIdPath, pointId and hasQuality fields are correct in advance. hasQuality is a special field used only by the Record Formatter operator and indicates whether the quality field value in the input data needs to be included when converting to DCM format. The modelId and modelIdPath can be queried by the Asset Lookup operator, and the hasQuality field can be queried by the Point Lookup.

Output Results

Output Example

Configuration information

../../../_images/record_formatter2.png ../../../_images/record_formatter.png