Issue detection in Data Manager helps identify issues in your data that can lead to poor data quality. At a high-level, Data Manager surfaces three (3) types of issues:
- Outliers
- Gaps
- Account Issues
Outliers
Outlier detection in Data Manager helps identify data points that deviate significantly from expected patterns. This process ensures data integrity and accuracy across energy and water meter reading values.
Outlier Types
Data Manager currently supports the following types of outliers:
-
Usage Outliers
- Usage value may be incorrectly low
- Usage value may be incorrectly high
-
Cost Outliers
- Cost value may be incorrectly low
- Cost value may be incorrectly high
-
Cost vs Usage Ratio Outliers
- Cost per usage may be incorrectly low
- Cost per usage may be incorrectly high
- Usage per cost may be incorrectly low
- Usage per cost may be incorrectly high
-
Duplicate Outliers
- Reading may be incorrectly duplicated in another meter
- Reading may be incorrectly duplicated within its own meter
-
Date Outliers
- Period for reading is unusually long
- End date for reading is in the future
Gaps
Data Manager currently supports the following gap issues:
- Gaps (or True Gaps)
- End Gaps
Gaps
Gaps, or “True Gaps”, are when there is missing data between two or more meter readings. The “Action Needed” column in the Gaps table under Check will suggest the best option to resolve the issue.
End Gaps
End Gaps occur when a meter’s last reading is over 90 days before today’s date. Depending on the source of data for the meter, data may need to be entered by hand, uploaded through Bill Upload, or an account-level or provider-level issue in Connect needs to be resolved.
Both of these types of Gaps can be resolved through the Core application. Please reference the following guide for more details on this workflow: Data Integrity Monitoring at the Site-Level.
Account Issues
Data Manager surfaces the same Account Issues you are used to seeing in Core’s Connect Dashboard. There are two main categories of Account Issues: issues with Connect and issues with Bill Upload.
Connect Account Issues
The following Connect Account Issues are possible across your portfolio:
- Account Not Found
- E-Bill Enrollment Required
- Account Inactive
- Missing Security Answers
- Account Setup Required
- Username/Password Failure
- Unsupported Provider
More details about each of these issues can be found in the Connect Account Issues support article.
Bill Upload Account Issues
There is only one type of Bill Upload Account Issue and that is Invalid Bill. Use the following support article to learn more about this issue type: Connect Account Issues.