e-Literate

Present is Prologue

Tag: degrees

  • College Scorecard: With victories like these, who needs failures?

    Goldie Blumenstyk had a fascinating interview with the Depart of Education’s Ted Mitchell on Friday that is well worth reading and / or watching (they have video of the interview along with full transcript). One of Mitchell’s key points jumped off the page for me.

    I think it [College Scorecard] was one of the department and the administration’s greatest victories

    Really? I can see the consolidation of student loans, a strong focus on college affordability, shifting of conversation away from just elite schools, and significant push on funding public schools as worthy victories to mention. But the College Scorecard – I don’t buy it.

    Blumenstyk pushed back on Mitchell, which led to this interesting exchange [emphasis added].

    GOLDIE BLUMENSTYK: I’m glad you mentioned the College Scorecard. I was thinking about that a little bit. It’s probably one of the places where the department had perhaps its biggest defeat, or maybe you might consider it a retreat. We were originally envisioning the Scorecard as a tool for accountability. Obviously, a lot of colleges and a lot of other people opposed that idea. And it became a complicated process even to create the effective scorecard. What did you learn from that process?

    TED MITCHELL: So I guess I would have a slightly different interpretation.

    GOLDIE BLUMENSTYK: I would imagine. (more…)

  • College Scorecard: ED quietly adds in 700 missing colleges

    It’s worth giving credit where credit is due, and the US Department of Education (ED) has fixed a problem that Russ Poulin and I pointed out where they had previously left ~700 colleges out of the College Scorecard.

    When the College Scorecard was announced, Russ noticed a handful of missing schools. When I did the whole data OCD thing, I discovered that more than 700 2-year institutions were missing, including nearly 1-in-4 community colleges. Eventually we published an article in the Washington Post describing this (and other) problems.

    The missing community colleges were excluded on purely statistical grounds. If the college granted more certificates (official awards of less than a degree) than degrees in a year, then they were excluded as they were not “primarily degree-granting” institutions. We label this the “Brian Criterion” after the person authoring two discussion board posts that explained this undocumented filter. (more…)

  • College Scorecard Article Published In Washington Post

    I have written several posts looking at the new College Scorecard and its inherent flaws in the data, often starting with observations from Russ Poulin at WCET. Today Susan Svrluga, education reporter at the Washington Post, posted a new article co-written by me and Russ and titled “Hundreds of colleges missing from Obama’s College Scorecard?”. The gist of the article is taking a holistic view of data problems and why they exist.

    In a nutshell, the College Scorecard combines data from multiple sources – primarily from the Education Department’s own Integrated Postsecondary Education Data System (IPEDS) and National Student Loan Data System (NSLDS) – and publishes the results of both as a consumer-facing Web site and an analyst-friendly data download. The essence of the problem is that throughout this process the data is filtered based on questionable assumptions, leading to the fuzzy lens viewing subsets of the real data.

    Poulin Hill College Scorecard Graphic

  • College Scorecard Problem Gets Worse: One in three associate’s degree institutions are not included

    Late yesterday I posted about the Education Department (ED) new College Scorecard and how it omits a large number of community colleges based on an arbitrary metric.

    In particular, the Education Department (ED) is using a questionable method of determining whether an institution is degree-granting rather than relying on the IPEDS data source. In a nutshell, if an institution awarded more certificates than degrees, then it is not labeled as “predominantly awarded 2-year or 4-yeard degrees” and therefore excluded.

    I am not quite confident that the explanation for the vast majority of missing schools is based on this finding. In short, if an institutions awards more certificates than degrees, ED removes them from the public-facing website even if they are technically degree-granting institutions.

    Originally it appeared this situation encompassed 17% of all community colleges, but further analysis shows it to be more significant. (more…)

  • 17% Of Community Colleges Are Not Included In College Scorecard

    In addition to the highly-misleading usage of ‘first-time full-time’ qualification for official graduate rates reported in the College Scorecard, there appears to be another major issue with the data. In particular, the Education Department (ED) is using a questionable method of determining whether an institution is degree-granting rather than relying on the IPEDS data source. In a nutshell, if an institution awarded more certificates than degrees, then it is not labeled as “predominantly awarded 2-year or 4-yeard degrees” and therefore excluded.

    Russ Poulin noted in his WCET post that several community colleges were missing from the Scorecard based on a quick spot check:

    • Colorado – Aims, Front Range, Pueblo, and Otero Community Colleges.
    • Arizona – Rio Salado College.
    • California – Bakersfield College.

    The consumer website itself offers no explanation that certain degree-granting schools are excluded. The Technical Paper that corresponds to the data release explains that selection of schools on page 28: (more…)