How Universities Measure and Report Student Success
How Universities Measure and Report Student Success
Every college website has a page somewhere with a headline number on it: "94% of our graduates are employed within six months." "Our four-year graduation rate is 82%." "Ranked #1 in student outcomes." These numbers show up in viewbooks, in emails from admissions counselors, and in the glossy brochures that arrive after you fill out an interest form.
Almost none of them tell you what you actually think they tell you.
That's not necessarily because schools are lying — although some marketing departments do get creative with denominators. It's because "student success" isn't one thing. It's a bundle of different metrics, each defined by a different federal agency, accreditor, or professional board, each with its own quirks, exclusions, and blind spots. If you're trying to compare two schools, or figure out whether a program is actually worth the tuition, you need to know what's being counted, who's being counted, and who got left out.
This guide walks through the real metrics universities are required to track and report, where the data comes from, and — maybe more importantly — what each number doesn't tell you.
The Federal Backbone: IPEDS and College Scorecard
Almost every "official" student success number you'll see traces back to one system: the Integrated Postsecondary Education Data System, or IPEDS, run by the National Center for Education Statistics (NCES). Any college that participates in federal student aid programs — which is nearly all of them — is legally required to report data to IPEDS every year. That data then feeds the U.S. Department of Education's public-facing College Scorecard tool, which is what most third-party ranking sites and comparison tools pull from.
Two metrics anchor this system: graduation rate and retention rate.
Graduation rate, as IPEDS defines it, tracks a specific cohort — first-time, full-time, degree-seeking undergraduates — and measures what percentage of them complete their program within 150% of the "normal" time. For a four-year bachelor's degree, that means the clock runs for six years. The rate is calculated as the number of completers within that window divided by the size of the original (adjusted) cohort.
Retention rate is simpler and shorter-horizon: it's the percentage of first-time, degree-seeking students from one fall who are still enrolled — at the same institution — the following fall. At four-year schools it specifically tracks bachelor's-seeking students; at two-year and other institutions it counts students who either re-enrolled or already completed their program.
The College Scorecard adds a third pillar that IPEDS alone doesn't provide well: earnings. Using data matched against federal tax records, the Scorecard reports median earnings for graduates at one, four, and (for some cohorts) more years after they leave school, plus a widely cited "10 years after entering" figure that some more recent updates have refined by including all graduates regardless of major. It's genuinely useful data — but it's built entirely from students who received federal financial aid, so it says nothing about students who paid cash or borrowed privately.
The Metrics Nobody Puts on the Homepage
Beyond the federal trio, there are field-specific accountability metrics that matter enormously if you're going into a licensed profession, even though they rarely make it into general marketing.
Licensure exam pass rates are the clearest example. If you're evaluating a nursing program, the number that matters most isn't the university's overall graduation rate — it's the program's NCLEX pass rate, the licensing exam every registered nurse must pass before they can practice. The national first-time pass rate for the NCLEX-RN sits around 86-87%, and nursing accreditors expect individual programs to stay close to or above that benchmark; falling meaningfully below it for multiple years can put a program's accreditation at risk. The same logic applies to law schools and bar passage: under the American Bar Association's Standard 316, ABA-approved law schools must have at least 75% of graduates who sit for the bar pass it within two years of graduation, or the school risks being found out of compliance.
Debt-to-earnings ratios, tracked under the Department of Education's "Gainful Employment" rule, are another metric most schools would rather you didn't dig into. Under the rule (effective July 2024, with the first enforcement data reported in 2025), career-training and for-profit programs — plus certificate programs everywhere — are measured on whether their graduates' loan payments exceed 8% of their annual earnings or 20% of discretionary income. Programs that fail this test (or an earnings-threshold test) two years out of three can lose eligibility for federal financial aid entirely. The Department has estimated roughly 1,700 programs, serving hundreds of thousands of students, could fail one of these tests.
Sector-specific accountability frameworks exist too. Community colleges, whose students are disproportionately part-time, working, and often not pursuing a traditional four-year degree in the first place, use the Voluntary Framework of Accountability (VFA), developed by the American Association of Community Colleges. It tracks things federal graduation-rate math simply isn't built for: term-to-term retention, progress out of developmental (remedial) coursework, transfer rates to four-year schools, and workforce outcomes for career and technical programs.
A Side-by-Side Look at the Metrics
| Metric | What it actually measures | Who tracks/publishes it | Biggest limitation |
|---|---|---|---|
| Graduation rate (IPEDS) | % of first-time, full-time students completing a degree within 150% of normal time (6 years for a bachelor's) | NCES / IPEDS, College Scorecard | Excludes transfer students, part-time students, and anyone who didn't start as a first-time freshman — often over a third of enrollment |
| Retention rate | % of first-time students who re-enroll at the same school the following fall | NCES / IPEDS | Fall-to-fall snapshot only; says nothing about whether a student ever finishes |
| Post-grad earnings | Median earnings of graduates 1, 4, and 10 years after entry/completion | College Scorecard (via IRS tax match) | Only covers federal financial aid recipients; varies heavily by local job market and cost of living, not just school quality |
| Licensure pass rate (NCLEX, bar, etc.) | % of graduates who pass the required professional licensing exam | Professional boards (NCSBN, state bar associations), reported by programs | Program-specific, not university-wide; a strong nursing program can sit inside a school with a mediocre overall graduation rate |
| Debt-to-earnings ratio | Whether loan payments exceed 8% of earnings or 20% of discretionary income | U.S. Dept. of Education, Gainful Employment rule | Applies mainly to certificate and for-profit programs, not most traditional bachelor's degrees |
| Student Achievement Measure (SAM) | Tracks outcomes across institutions, including transfers, for a fuller completion picture | Participating institutions, via studentachievementmeasure.org | Voluntary — only schools that opt in report it, so coverage is uneven |
| VFA metrics (community colleges) | Term-to-term retention, developmental ed progress, transfer rate, workforce outcomes | AACC | Community-college specific; not comparable to four-year graduation stats |
The Common Misconception: "The Graduation Rate Tells You Everything"
Here's the trap almost everyone falls into, including plenty of well-meaning parents comparing schools on a spreadsheet: treating a single number, usually the graduation rate, as a stand-in for overall school quality.
The federal graduation rate was designed for Student Right-to-Know Act compliance in the 1990s, built around a mid-1990s model of the "typical" college student: 18 years old, enrolling straight out of high school, attending full-time, staying at one institution until they finish. That student is now a minority of American undergraduates.
Community colleges, schools with large working-adult or part-time populations, and institutions that serve a lot of transfer students will always look worse on this metric — not necessarily because they're doing a worse job, but because the metric doesn't count most of their students in the first place. Nationally, more than one in five students who eventually earn a degree do so at a different institution than the one where they started; the federal rate counts that as a non-completion for the original school, even though the student succeeded.
This is exactly the gap the Student Achievement Measure was built to close, by tracking students across institutions rather than dropping them from the data the moment they transfer. It's also why a school's raw graduation-rate ranking can be a poor proxy for whether it's a good fit for a specific student. A school with a 55% federal graduation rate that primarily serves first-generation, working, and transfer-heavy students may be doing more for social mobility than a school with a 90% rate that only admits students who could probably graduate from almost anywhere.
The same logic applies to earnings data. A school with lower median graduate earnings might be training teachers and social workers; a school with higher earnings might be training software engineers in an expensive coastal metro. That's a difference in program mix and geography, not necessarily a difference in teaching quality.
So What Should You Actually Do With These Numbers?
Use them as a starting filter, not a final verdict. A few practical habits:
- Match the metric to the program, not just the school. If you're looking at nursing, pull up the program's NCLEX pass rate specifically — it's usually posted on the nursing school's own site or available through the state board of nursing — rather than relying on the university's overall graduation rate.
- Check the cohort behind any number. When a school advertises a completion or employment rate, ask (or look for the footnote) about who's included. "94% employed" often excludes graduates who didn't respond to the survey, which can be a large chunk of the class.
- Use College Scorecard's field-of-study data, not just the institution-level number, when it's available. Earnings and debt outcomes vary enormously by major within the same school — an English degree and an engineering degree from the same university will show very different numbers.
- Weight retention rate for near-term signal, graduation rate for long-term signal. A low first-year retention rate is often a faster warning sign of a poor advising or academic-support environment than a graduation rate you won't be able to verify for six years.
- Look for accreditation self-study data when you can get it, especially for professional programs. Accreditors like CCNE, ACEN, and the ABA require programs to report and act on outcome data as a condition of keeping their accreditation, which creates real accountability pressure beyond what marketing pages disclose voluntarily.
Bottom Line
There's no single number that captures "student success," because success itself means different things depending on who the student is and what they're trying to accomplish. Graduation rate, retention rate, post-grad earnings, licensure pass rates, and debt-to-earnings ratios each measure a real and useful slice of the picture — but each one also excludes a specific group of students or context by design. The smartest way to use this data isn't to find the school with the single highest headline number; it's to look at the combination of metrics that matches your actual situation — your intended major, whether you might transfer, whether you're going part-time, and what field you're entering — and to always ask who's missing from the denominator before you trust the percentage in the headline.
FAQ
Q: What's the difference between graduation rate and retention rate? A: Retention rate measures whether a student comes back for a second year at the same school (a fall-to-fall snapshot). Graduation rate measures whether a first-time, full-time student actually finishes their degree within 150% of the normal timeframe — six years for a typical bachelor's degree. A school can have decent retention but a mediocre graduation rate if students stall out or leave in later years.
Q: Why do graduation rates ignore transfer students? A: The federal IPEDS methodology was built around tracking a single cohort of first-time, full-time students at one institution over time. A student who transfers elsewhere and graduates there gets counted as a non-completer at their original school, even though they earned a degree. The Student Achievement Measure was created specifically to fix this by following students across institutions.
Q: Is the College Scorecard earnings data accurate for every student? A: It's accurate for what it measures — median earnings of graduates who received federal financial aid, matched against IRS tax records. It doesn't include students who never took federal aid, and earnings are heavily shaped by field of study, local cost of living, and job market, not just the school itself. Always check field-of-study-level data rather than the school-wide average when it's available.
Q: Why does the NCLEX pass rate matter more than a university's overall graduation rate for nursing programs? A: A university's overall graduation rate blends every major on campus. A nursing program's NCLEX first-time pass rate tells you specifically whether that program prepares students to actually get licensed and start practicing. Nursing accreditors track this number closely and can put a program under review if it falls well below the national average, which sits at roughly 86-87% for the NCLEX-RN.
Q: What is the "gainful employment" rule and does it apply to my program? A: It's a Department of Education rule, in effect since July 2024, that measures whether a program's graduates carry loan payments that exceed 8% of their earnings or 20% of their discretionary income. It applies to all certificate programs and to every program at for-profit institutions. It generally does not apply to most traditional bachelor's degree programs at public and private nonprofit universities.
Q: If a school doesn't participate in the Student Achievement Measure, does that mean it's hiding something? A: Not necessarily. SAM is voluntary, so plenty of solid schools simply haven't opted in yet, particularly smaller institutions with limited institutional research staff. It's worth asking admissions directly for transfer-inclusive completion data if SAM numbers aren't published, rather than assuming the absence of the metric is a red flag on its own.
Q: Where can I look up these numbers myself instead of trusting a school's marketing page? A: Start with the federal College Scorecard site, which pulls directly from IPEDS and IRS-matched earnings data for essentially every degree-granting institution in the country. For licensure programs, go to the relevant professional board directly (state boards of nursing for NCLEX data, individual law school ABA Standard 509 disclosures for bar passage) rather than relying on the program's own summary.
Sources
- College Scorecard Data Home - U.S. Department of Education
- College Scorecard Glossary
- Updates to College Scorecard Include Earnings Info, But Still Lack Program Costs - IHEP
- Graduation Rates (GR) Survey Component - IPEDS, NCES
- Fast Facts: Undergraduate Graduation Rates - NCES
- About the Student Achievement Measure (SAM)
- Student Achievement Measure (SAM) - APLU
- Gainful Employment Rule: What to Know - U.S. News
- NCLEX Pass Rates - NCSBN
- Understanding ABA 509 Reports - Spivey Consulting Group
- Voluntary Framework of Accountability - AACC
- College Scorecard Data by Field of Study - Documentation
