University of Illinois System

Data Quality 

The Data Quality page contains information about Data Warehouse data quality. If you have any questions about data quality, please contact us.


Data Quality Advisories

The advisories listed in the table below impact the quality of data in the Data Warehouse. Users should be aware of potential issues with data quality when reporting on elements listed in these advisories.

Data quality issues can originate from many sources and can arise as the result of a variety of circumstances. Human error in data entry, discrepancies in the source system, or errors during processing into the Data Warehouse are all possible causes of data quality issues.

The information below is intended to identify what the issues are, when a user may encounter them in the EDW, and what actions a user can take to mitigate any discrepancies in reports or analysis.

Click a table name for related metadata. Click a universe name for the associated Quick Reference Guide. Click "More..." for the Data Advisories spreadsheet.

Table(s) Affected Universe(s) Affected Advisory Description
Data Collection: All
T_NETID EDW - HR - Employee Administration
EDW - HR - Position/Job Hierarchy
EDW - STU - Current Applicant
EDW - STU - Registration Complete
EDW - STU - Registration Limited
EDW - STU - Registration Directory
EDW - STU - Academic Records
This table may contain terminated and duplicate NetIDs. More...
T_ADDR_AUD_HIST   The Banner source system (table SPRADDR) allows updates without making changes to the timestamp on the record. The EDW is expecting the timestamp to be updated in order to pick up any changes. We are working with the appropriate groups to address this issue.
Data Collection: Finance and HR
N/A N/A Banner users should be aware of a potential issue involving labor encumbrances and carefully monitor their funds during the fiscal year end closeout process. For more information, see the OBFS notice.
Data Collection: Finance
T_AR_TRAN   At times, an accounts receivable transaction occurs before the customer's general student record is created. The Data Warehouse processing does not update the rows in AR_TRAN or perform additional history tracking. (The Data Warehouse processing writes the row with the information available at the time.) This causes an occasional mismatch between Banner and the Data Warehouse.
T_CMDTY_CD EDW - Finance - Fixed Assets This table may contain similar commodity codes (one with, and one without a leading space) that have different descriptions. More...
T_FA EDW - Finance - Fixed Assets There are several hundred records in this table that have a system status code of "C" but no related description. More...
T_FA_TFER EDW - Finance - Fixed Assets The Banner source system contains 152 duplicate rows for a given combination of keys. These duplicate records were created incorrectly by the surplus warehouse feeder process, and are contained in this Data Warehouse table. More...
T_INV_VCHR EDW - Finance - Purchase Order / Invoices This table may contain invalid Invoice Voucher dates such as "01/01/200". More...
T_OL_DETL EDW - Finance - Ledgers OL/GL Some records in this table that were created prior to 5/12/04 contain unusual budget periods. More...
T_OL_SUM EDW - Finance - Ledgers OL/GL Some records in this table that were created prior to 5/12/04 contain unusual budget periods. More...
T_PO EDW - Finance - Purchase Order / Invoices This table may contain invalid Purchase Order dates such as "01/01/200". More...
T_POST_TRAN EDW - Finance - Purchase Order / Invoices This table may contain anomalous and potentially invalid records for checks processed prior to October 2003. More...
T_REQ EDW - Finance - Purchase Order / Invoices This table may contain invalid Requisition Order dates such as "01/01/200". More...
Data Collection: HR/Pay
T_ACCR_LEAVE EDW - HR - Payroll
EDW - HR - Leave
This table may contain inaccurate or incomplete leave information for data prior to August 2004. More...
T_ACCR_LEAVE_BAL_HIST EDW - HR - Payroll
EDW - HR - Leave
This table may contain inaccurate or incomplete leave information for data prior to August 2004. More...
T_HR_ORG
(V_PAYR_ORG)
DM - HR - Payroll Reconciliation Please exercise caution when using this table. Error incidents have resulted from a new Payroll ID of "998". DS is actively working on a solution to be implemented with Banner 8 modifications.
T_HR_PAYR_EXPS_DETL
(V_HR_PAYR_EXPS_DETL)
DM - HR - Payroll Reconciliation Please exercise caution when using this table. Error incidents have resulted from a new Payroll ID of "998". DS is actively working on a solution to be implemented with Banner 8 modifications.
T_JOB_HIST EDW - HR - Employee Administration This table may contain inaccurate or incomplete primary job indicators.
There are approximately 3800 jobs that have incorrect end dates.
More...
T_JOB_LBR_DIST

EDW - HR - Employee Administration

EDW - HR - Position/Job Hierarchy

EDW - HR - Salary Planner

EDW - HR - UI2 Reports
EDW - HR - University Admin Reports

1. This table may contain inaccurate or incomplete primary job indicators.

2. A timing issue exists with this table. It is a history tracking table, therefore rows that have an effective date after midnight are not loaded. This is done to ensure the new rows are added on the correct day. A problem occurs because the new Labor Distribution Row expires the old row. The effect is that the individual will not have any active Labor Distributions until the next day when the new Labor Distribution is added.
More...
T_OL_EXPS_SRC_DETL EDW – HRFIN BOS Expenses The table T_OL_EXPS_SRC_DETL combines the data from T_OL_DETL (Operating Ledger), T_PAYR_ACCTG_DETL (Payroll Accounting Detail), and T_PCARD_TRAN_DETL (PCard Transaction Detail) to break out the details of payroll and PCard expenses that are stored at a summary level on the operating ledger. When an expense is a payroll or PCard expense on the operating ledger, the ETL process refers back to the payroll or PCard tables and displays the individual transactions that make up the expense.
Because of Banner processing, there are instances when the individual transactions cannot programmatically reconcile to the summary line item. The current instances can be viewed by clicking here.
Data Collection: Student
T_SECT_DEPT_RESTRICT_HIST   This table in the Data Warehouse is missing several rows because of a record type mis-match
T_SECT_RESERV_SEAT_HIST   Several rows of data are not posting to this table in the Data Warehouse because of a defect in Banner on the Activity Date. No timeframe has been established for a resolution.
T_STUDENT_OVERALL_CRS_DETL EDW - STU - Academic Records This table contains only 10 years of academic history information. If you are interested in data older than 10 years, you need to use Institutional and Transfer Course information (Tables: T_STUDENT_AH_CRS, T_TFER_INST, T_TFER_CRS, T_EQ_UI_CRS).
Data Collection: Helpdesk
T_ACTV_LOG   Some of the special characters in the source data for the T_ACTV_LOG.ACTV_DESC field are unrecognized characters and are being translated into ¿. When data is transformed from DSSTAGE into DSEDW, where there is now ¿, one or more characters at the end of the string is getting truncated