Dev Raw Data Source¶
This stage generates raw data based on the user-provided data, which can be used for debugging only.
This is a native StreamSets stage. For more information, see StreamSets User Guide.
Configuration¶
Before using this stage, set the Execution Mode of the pipeline as Standalone
.
The configuration tabs for this stage are General, Raw Data, and Data Format.
General¶
Name | Required? | Description |
---|---|---|
Name | Yes | The name of the stage. |
Description | No | The description of the stage. |
On Record Error | Yes | The processing method for error data.
|
Raw Data¶
Name | Required? | Description |
---|---|---|
Raw Data | Yes | The raw data (refer to the sample below). |
Stop After First Batch | No | Specify whether to stop after generating the first batch of data records. |
Raw Data sample¶
{
"orgId": "xxx",
"modelId": "Model",
"modelIdPath": "/rootModel/Model",
"assetId": "qXupozjG",
"pointId": "Point_A",
"time": 1567292293000,
"value": 1.2,
"quality": 0,
"attr": {}
}{
"orgId": "xxx",
"modelId": "Model",
"modelIdPath": "/rootModel/Model",
"assetId": "qXupozjG",
"pointId": "Point_B",
"time": 1567292292000,
"value": 1.2,
"quality": 0,
"attr": {}
}
Data Format¶
Name | Required? | Description |
---|---|---|
Data Format | Yes | Select the format of the generated data. Options include JSON, Log, Text, XML, etc. It is recommended to select JSON. |
Compression Format | Yes | Select the data compression format. It is recommended to select None. |
Other fields | No | Complete the configuration based on the raw data provided and selected data format. |