Viewing Metric Data Quality¶

EnOS Data Quality provides a visualized page for querying the completeness, validity and credibility of metrics. Data Quality also provides the root cause analysis with corresponding data remediation methods for the metrics with low credibility or other data quality issues. Thus, application users can understand the overview of metric data quality, formulate solutions for metric data quality issues, and ultimately fix data problems and ensure high quality of metrics.

Prerequisites¶

Before you start, make sure the following items:

Make sure the user account has been assigned the menu group containing Metric Credibility. If not assigned, contact the application administrator.
The current OU has uploaded Quality Rule Configuration and Quality Analysis Configuration files. For more information, see Configuring Metric Quality Rule and Analysis Templates.

Viewing Metric Credibility¶

Reliability is used to measure the data quality of a metric and is related to the completeness and validity of the metric. The calculation formula for metric credibility is as follows:

Credibility = (Completeness Rate * Validity Rate) * 100%

You can view the credibility of metrics by the following steps:

Select Data Quality > Metric Quality > Metric Credibility from the left navigation pane of Application Portal.

Configure the following information on the toolbar at the top of the page.

Field	Description
Asset	The site to which the metrics requiring data quality analysis belong. You can select multiple sites at a time.
Domain	The domain to which the metrics requiring data quality analysis belong to. You can select multiple domains at a time.
Statistical Period	The statistical period of the metric data and the time granularity for displaying query results. Support selecting `Month` (analyzing and displaying by month) or `Day`(analyzing and displaying by day).
Start/End Date	The start and end time for data quality analysis.

Select query. The data quality results of the target metrics will be displayed in various visual charts on the page.

An example of the Metric Credibility page is shown as below.

Analyzing the Root Cause of Metric Quality Issues¶

After querying the overall credibility of the metrics, application users can use the root cause analysis tool provided by Data Quality to further locate the possible causes of the problems that occur for metrics with low credibility, and formulate solutions to address the quality issues, to achieve the quickly locating and resolving on data quality issues.

Follow the steps in Viewing Metric Credibility to query the credibility profile for each metric.
Select the Analyze of the target metric in the metric credibility list.

View the following information in the pop-up window.

Field	Description
Issue Summary	The details of metric quality, including information such as completeness, validity, issue proportion, and causes.
Device Details	The list of devices with data quality issues.
Device	The name of the target device.
Date	If the statistical period is `Day`, it displays the date specified when querying metric quality. If the statistical period is `Month`, it displays the dates with quality issues in the specified months.
Problem Type	The type of the metric quality issues, such as abnormal measurement point onboarding, device communication interruption, and abnormal data sources.
Problem Description	The description of the metric quality issues.
Root Cause Analysis	The potential root cause of the metric quality issues.
Suggested Solution	The suggested solution to fix the metric quality issues.

An example of the analysis report on metric quality issues is shown as below.