Decision Support

Data Quality

The Data Quality page contains information about Data Warehouse data quality. If you have any questions about data quality, please contact us.

Data Quality Advisories
The advisories listed in the table below impact the quality of data in the Data Warehouse. Users should be aware of potential issues with data quality when reporting on elements listed in these advisories.
Data quality issues can originate from many sources and can arise as the result of a variety of circumstances. Human error in data entry, discrepancies in the source system, or errors during processing into the Data Warehouse are all possible causes of data quality issues.
The information below is intended to identify what the issues are, when a user may encounter them in the EDW, and what actions a user can take to mitigate any discrepancies in reports or analysis.  Click the "More . . ." tabs for additional technical details about the issue.
Last Updated: May 20, 2008

Table(s) Affected Advisory Description Universe(s) Affected Details
Data Collection: All
T_NETID This table may contain terminated and duplicate NetIDs. EDW - HR - Employee Administration
EDW - HR - Position/Job Hierarchy
EDW - STU - Current Applicant
EDW - STU - Registration Complete
EDW - STU - Registration Limited
EDW - STU - Registration Directory
EDW - STU - Academic Records
More
Data Collection: Finance
T_AR_TRAN At times, an accounts receivable transaction occurs before the customer's general student record is created. The Data Warehouse processing does not update the rows in AR_TRAN or perform additional history tracking. (The Data Warehouse processing writes the row with the information available at the time.) This causes an occassional mismatch between Banner and the Data Warehouse.    
T_CMDTY_CD This table may contain similar commodity codes (one with, and one without a leading space) that have different descriptions EDW - Finance - Fixed Assets More
T_FA There are several hundred records ni this table that have a system status code of 'C' but no related description. EDW - Finance - Fixed Assets More
T_FA_TFER The Banner source system contains 152 duplicate rows for a given combination of keys. These duplicate records were created incorrectly by the surplus warehouse feeder process, and are contained in this Data Warehouse table. EDW - Finance - Fixed Assets More
T_GL_DETL This table may contain anomalous and potentially invalid records for checks processed prior to October 2003. EDW - Finance - Grants Streamlined More
T_GRANT A significant number of grant status codes in this table are blank. EDW - Finance - Grants More
T_GRANT
_STATUS
A significant number of grant status codes in this table are blank. EDW - Finance - Grants More
T_INV_VCHR This table may contain invalid Invoice Voucher dates such as "01/01/200". EDW - Finance - Purchase Order / Invoices More
T_OL_DETL Some records in this table that were created prior to 5/12/04 contain unusual budget periods. EDW - Finance - Ledgers OL/GL More
T_OL_SUM Some records in this table that were created prior to 5/12/04 contain unusual budget periods. EDW - Finance - Ledgers OL/GL More
T_PO This table may contain invalid Purchase Order dates such as "01/01/200". EDW - Finance - Purchase Order / Invoices More
T_POST_TRAN This table may contain anomalous and potentially invalid records for checks processed prior to October 2003. EDW - Finance - Purchase Order / Invoices More
T_REQ This table may contain invalid Requisition Order dates such as "01/01/200". EDW - Finance - Purchase Order / Invoices More
Data Collection: HR/Pay
T_ACCR
_LEAVE
This table may contain inaccurate or incomplete leave information for data prior to August 2004 EDW - HR - Payroll and EDW - HR - Time & Attendance More
T_ACCR
_LEAVE_BAL
_HIST
This table may contain inaccurate or incomplete leave information for data prior to August 2004 EDW - HR - Payroll and EDW - HR - Time & Attendance More
T_JOB_HIST This table may contain inaccurate or incomplete primary job indicators.
There are approximately 3800 jobs that have incorrect end dates.
EDW - HR - Employee Administration More
T_JOB_LBR
_DIST
This table may contain inaccurate or incomplete primary job indicators. EDW-HR Employee Administration
EDW-HR Position and Job Hierarchy
EDW-HR Salary Planner
EDW-HR - UI2 Reports
EDW-HR University Admin Reports
More
Data Collection: Student
T_STUDENT
_REG_HIST
(Case 20071218_216) The current business rules for populating the Student Registration Indicator in EDW.T_STUDENT_REG_HIST are not correct. The EDW Student Registration Indicator was created to allow users an easy way of finding out if a student was enrolled for a term because no flag exists in Banner to do this. Currently rows that should be receiving an "N" for the registration indicator are receiving a "Y". For example, a user has found instances of withdrawn or cancelled students that have a registration indicator set to "Y". The correction for T_STUDENT_REG_HIST will also need to be updated to T_RS_STUDENT_REG (for Registration Census data).
This discrepency will be fixed with the 2008-06 release.
   
T_PERS_HIST
T_RS_PERS
This table may contain inaccurate or incomplete non-international race/ethnic information for data between November, 2005-January, 2006. EDW-STU Registration Complete
EDW-STU Registration Limited (PR)
EDW-Current Applicant
EDW-STU Registration Census
EDW-Current Recruit
EDW-STU Academic Records
More
T_STUDENT
_AH_CRS
This table contains blank CRS_IDS for terms prior to Fall 2004 on all campuses. EDW - STU - Academic Records More
T_ADM_APPL
_ORIG_ADDR
This table contains approximately 78,000 blank addresses. EDW-Current-Applicant
EDW-Grad Admissions Data Mart
EDW-RA Contact Analysis Data Mart
EDW-STU Registration Census
EDW-Undergrad Admissions Data Mart
More
T_STUDENT
_OVERALL_CRS
_DETL
The T_STUDENT_OVERALL_CRS_DETL table is being populated with two rows because two current grades are available from the T_STUDENT_AH_CRS_GRADE_HIST table. As soon as the current information is corrected in case 20070530_264, this table should also be corrected.
Also, the population of the campus / college / department on this table is not working correctly. Decision Support has identified the issue and is addressing it in case 20070521_275.
   
T_RS_MAX_TEST
_SCORE
This advisory pertains to the following data:
Columns:
  • MAX_ACT_SAT_EQ_COMPOSITE_SCORE
  • ACT_SAT_EQ_COMPOSITE_TEST_DT
  • ACT_SAT_EQ_ENGL_TEST_DT
  • MAX_ACT_SAT_EQ_ENGL_SCORE
  • MAX_ACT_SAT_EQ_MATH_SCORE
  • ACT_SAT_EQ_MATH_TEST_DT
The data identified above is being derived by the Registration Census data collection incorrectly for the test codes (1001/2001/4001; 1003/2003/4003; 1005/2005/4005).
These nine test codes are not the correct test scores to use for deriving this data. The correct test codes (with the EQ_IND = Y) are:
a. UIUC: 1000, 1002, 1004, 1010, 1012, 1014
b. UIC: 2000, 2002, 2004, 2010, 2012, 2014
c. UIS: 4000, 4002, 4004, 4010, 4012, 4014
Decision Support has created a Clarify case to correct this logic (case 20070702_281).
Users who need the Maximum ACT/SAT Equivalency Test Scores can use the T_MAX_TEST_RESULT table and/or the Current Applicant and Current Recruit Universes.
EDW-STU Registration Census  

Related Information