Common Library¶
EnOS provides various built-in SDKs in its common library to help you access and process data more conveniently. These SDKs lower the development thresholds and improve development efficiency.
SDKs Provided in the Library¶
SDK Name |
Description |
|---|---|
SYNC_HDFS_TO_S3 |
Synchronize data from a specified path in HDFS to a specified path in an S3 database. |
COLUMNS_TO_ROWS |
Converts the row data of your HIVE table, where each row contains values of all data collecting points of a device at a time, into a table where each row contains historical values of a single data collecting point. |
SYNC_MDM |
Synchronizes master data to HDFS. |
SYNC_REPORT_DB |
Performs one-time synchronization of full-load data from the Hive table to your target table. |
FLATTEN_POINTS |
Converts EnOS raw point data (each row contains historical values of a single data collecting point) to sql-like row data (each row contains values of all data collecting points of a device at a time). |
POWER_DATA_INTERPOLATION |
Interpolates power data, especially for the production missing data. |
HivePartitionDroppedSDK |
Deletes the metadata of both the specified Hive partition and the stored data. |
SYNC_REPORT_STRUCTURE |
Transfers table structure from Hive database to MySQL report database. |
SHORT_TERM_LOAD_FORECAST |
Provides 0-6 days load forecast for different time granularity levels (15 min, 30 min, 1 hour, 1 day) based on historical data and optional weather data for different power consumers in the grid. |
HADOOP_FILE_CRUSHER |
Reduces the number of files by combining multiple small files into several larger files. |
How to Use the SDK¶
The major procedure of using the built-in SDK is as per the below.
In Batch Processing > Data Development, browse the Common Library tree and locate the SDK that you want to use.
Double-click the version of the script and review the details about the script.
Click Use the Program.
In the pop-out window, provide the information for the workflow.
Provide the scheduling settings. For more information, see Creating a One-time Workflow or Creating a Periodic Workflow.