Troubleshooting Data Quality Issues

Achieve data accuracy and reliability by handling data errors and skipped records.

In this article

Types of the Data Quality Issues

Data Quality dashboard

Review a report

Create data quality rules

Fix Skipped or Errors

If you’re having trouble with data in School Passport after synchronization, learn more about data quality issues and troubleshooting methods.

The primary objective of the Data Quality in School Passport is to enable users to effectively monitor the accuracy and reliability of data received from the SIS and provided to the Vendor. By using synchronized data, this feature identifies any potential issues and assists users in promptly addressing and resolving them.

Types of the Data Quality Issues

There are three types of data quality issues:

Issue type

Fix priority

Description

Error

Optional

Indicates a compatibility issue with the application or a shortage of data for sharing with the Vendor according to their requirements. 

Record data remains accessible to the Vendor's App.

Skipped 

Required

Indicates that the record does not have enough data for sharing with the Vendors app according to Vendor's requirements.

Record data is not accessible to the Vendor's App.

Duplicate

Required

Indicates the presence of identical or replicated data records, where there are multiple instances of the same information within the SIS. Duplicate mostly appears when there are differences between two records and the system cannot merge those during processing, according to the established merging criteria.

Data Quality dashboard

To get to the Data Quality dashboard, click Data Quality on the sidebar.

There are four tabs on the Data Quality dashboard:

  • My Rules: Shows issues related to the data received from the SIS. It highlights issues in the data that could affect the interaction with data sources.
  • App Rules: Shows issues that are associated with the information submitted to the vendor. It highlights issues in the data that could affect the interaction with the vendor's application.
  • Duplicates:  Provides tools for effectively handling duplicates. It includes presenting a list of identified duplicates from the SIS, enabling the resolution of duplicate conflicts, and creating new duplicate detection rules.
  • Privacy Shield: Enables you to hide or mask sensitive data for Vendor app. For details, see Mask Personal Data.

The number of data quality issues is also displayed on the application panes.

Review a report

To review a list of broken or missing data for a specific app, navigate to the Data Quality tab and click on the number of issues to view them in your browser. 

For example, the screen below shows an Errors report for Contacts. 

Alternatively, you can click Download to save the report in CSV format on your computer.

Create data quality rules 

The rules that determine how data quality issues in the data imported from the SIS are detected are specified in the app settings.

Handling duplicates is done through the Uniqueness Domain tabs (if single data source) and the Field Master (if multiple data sources). For details on configuring duplicate detection, refer to the guidance.

Managing Errors and Warnings occurs in the Data Requirements tab:

  • Report if Missing - An error report will be added to the report list and the data item will be sent to the Vendor. 
  • Skip if Missing - An error report will be included in the list of reports, but the data entry is NOT sent to the supplier.

Fix Skipped or Errors

Note: To resolve a duplicate conflict, go to the relevant data source/SIS and follow the instructions.

If you have Skipped or Errors, it is recommended to adjust/add missing data in your data source or SIS. After applying the changes to the records with Data Errors/Warnings, the daily synchronization process will capture all the updates, leading to the resolution of the data quality issue.