Finding
Finding 5: USBE’s MIS Utopia (Advansys) does not meet NRS requirements regarding the credential rate indicator.
Discussion
Discussion: States are required to report valid and reliable data on the primary indicators of performance, which includes the credential attainment rate. A review of USBE’s data revealed that the State has been in the first quartile for credential rate indicators for the past three years with low outcomes each year (13.18% in PY 2018, 9.37% in PY 2019, and 8.15% in PY 2020). The rates are well below the national average for those years (24.91% in PY 2018, 24.03% in PY 2019, and 25.88% in PY 2020). A review of secondary credential data from NRS Table 4 during similar time frames revealed a discrepancy in the data. USBE has reported very few secondary credential successes towards the credential rate indicator (PY 2018 = 483, PY 2019 = 113, PY 2020 = 267) while NRS Table 4 data for the similar time frames show many more participants achieving secondary credentials (PY 2018 = 1,847, PY 2019 = 1,177, PY 2020 = 1,673). Although the credential rate indicator is much more restrictive in cohort requirements and qualifying actions (entry into postsecondary or employment within one year of exit) to report success, these conditions would be unlikely to negate 70% to 90% of the credentials achieved in the State. Discussions with USBE staff indicated a concern that the MIS may not be accurately tracking the high school equivalencies achieved in the State. USBE should further investigate the disparity and update the MIS to accurately reflect the value that should be reported.
Relevant sections of law and regulation
Relevant sections of law and regulation: Sections 116(b)(2)(A)(i)(IV), 116(d), and 116(d)(5) of WIOA