e-Literate

Present is Prologue

Author: Michael Feldstein

  • California SB 520 Currently Misses the Mark, but Not By Much

    Phil has done a great job of covering the news of California’s new bill (or stub of a bill, really) that would create a state-wide system of third-party online courses that would be available to students who would otherwise be shut out of courses that they need to graduate. It’s a good problem to tackle, since it would both make life better for students and improve the long-term state budget situation. Unfortunately, I don’t think the current incarnation of the bill takes into account either the full context and needs of students who find themselves shut out of the core courses or the directions that MOOCs are evolving into. As a result, it offers a bad prescription for the solution. The good news is that the shortcomings can be fixed while remaining well within the spirit of the bill.

    (more…)

  • The 2013 Ed Innovation Return on Education Awards

    Well, it’s that time of year again. On April 15th, GSV Advisors‘ annual Education Innovation Conference will kick off. Reactions to the conference last year were a bit of a Rorschach Test, varying greatly depending on the person’s view of the role of venture capital in education in general (as well as whether they were attending the conference physically, watching remotely, or just reading the tweet stream). As I wrote about after last year’s conference in “What Are Ed Tech Entrepreneurs Good For?“, I am in the “cautious but positive” camp about the importance that venture funding could play in education.

    Love it or hate it, this year’s conference is going to be bigger than ever. There are going to be 180 companies presenting, which is double the number from the previous year, and the conference organizers predict a 50% increase in attendance when all last-minute and walk-in registrations have been tallied. I will be attending again this year and expect to be able to give more thorough coverage than I was last year, thanks in part to the new freedom that comes from working at MindWires.

    Anyway, one of the more interesting features of the conference this year is the Return on Education (ROE) awards. It’s basically a contest to recognize up-and-coming ed tech projects. There is no monetary award, but given that the conference is being heavily attended by education, business, and general news press, the winners can expect a lot of good PR and, likely, a lot of attention from people with money. There is a non-profit category for the awards, so it’s not just limited to start-ups. Projects have to be nominated by attendees, and there are 100 such nominations so far.

    Nominees are judged on the following criteria:

    • Significantly increase access to education;
    • Greatly reduce the cost for learners and/or learning institutions;
    • Dramatically improve learning outcomes;
    • Provide substantial leverage to learning leaders (teachers, professors); and/or
    • Make a sustainable and scaled impact.

    The nomination form has fields asking for explanations on how the nominee fits each of these criteria.

    Nominations are open until Friday. I’ll be curious to see what kinds of projects get nominated as well as what kinds of projects win.

  • A Taxonomy of Adaptive Analytics Strategies

    I almost never quote a blog post in its entirety, but this one from Dan Meyer is so good that I just can’t bear to cut a single word:

    Stephanie Simon, reporting for Reuters on inBloom and SXSWedu:

    Does Johnny have trouble converting decimals to fractions? The database will have recorded that – and may have recorded as well that he finds textbooks boring, adores animation and plays baseball after school. Personalized learning software can use that data to serve up a tailor-made math lesson, perhaps an animated game that uses baseball statistics to teach decimals.

    Three observations:

    One, it shouldn’t cost $100 million to figure out that Johnny thinks textbooks are boring.

    Two, nowhere in this scenario do we find out why Johnny struggles to convert decimals to fractions. A qualified teacher could resolve that issue in a few minutes with a conversation, a few exercises, and a follow-up assessment. The computer, meanwhile, has a red x where the row labeled “Johnny” intersects the column labeled “Converting Decimals to Fractions.” It struggles to capture conceptual nuance.

    Three, “adores” protests a little too much. “Adores” represents the hopes and dreams of the educational technology industry. The purveyors of math educational technology understand that Johnny hates their lecture videos, selected response questions, and behaviorist video games. They hope they can sprinkle some metadata across those experiences — ie. Johnny likes baseball; Johnny adores animation — and transform them.

    But our efforts at personalization in math education have led all of our students to the same buffet line. Every station features the same horrible gruel but at its final station you can select your preferred seasoning for that gruel. Paprika, cumin, whatever, it’s yours. It may be the same gruel for Johnny afterwards, but Johnnyadores paprika.

    Dan captures most of what I was trying to get at with my rant on the big data hype, but much more clearly and succinctly. Points two and three are the most salient here. First of all, the sort of surface-level analysis we can get from applying machine learning techniques to the current data we have from digital education system is insufficient to do some of the most important diagnostic work that real human teachers do. Think about the math classes is which you had to show your work on your homework. Why was that important? Because the teacher needs to see not only what you got wrong but why you got it wrong. Teachers generally don’t just say, “You got three out of five problems involving converting decimals to fractions wrong. Go study some more.” They sit down and work through the problems with the student to find the source of the errors. It’s really hard to get computers to do this well, even with highly procedural domains like math. (Forget about, say, literary analysis.) So in the vast majority of cases, we don’t even try to design systems where students show their work. And without the step-by-step data, no fancy algorithm is going to teach Johnny.

    Second, if the problem is that your content isn’t what the student needs, no fancy algorithm is going to fix that either. Videos are a prime example. I know of one textbook publisher whose teacher customers report that students won’t watch the publishers’ videos, but they can and do find videos on the same topic on YouTube and share them with each other. Think about that. Video-based pedagogical support is valuable enough to the students that they will expend energy searching for videos and sharing them. But they reject the expensive, carefully crafted videos from the publisher that are served up to them on a silver platter. It’s not that the publisher-supplied videos are necessarily “bad” in the sense that they have poor production qualities or are unclear or factually inaccurate. But the students have a particular use in mind for the videos. Maybe they’re struggling with a particular homework problem and just need a quick walk-through of a technique so that they can see the step that they are missing, for example. If the video doesn’t fit their needs—both utilitarian and aesthetic—then it won’t get used. Serving it up adaptively isn’t going to help that problem.

    That said, it’s worth taking a little time to break down the different types of adaptive learning analytics into a couple of categories and see just what we should and should not reasonably hope to gain from them.

    (more…)

  • The OpenClass Vision: An Example

    In my last post, I described a vision for combining elements of MOOC-like scale with a more traditional face-to-face classroom experience, as articulated by Pearson’s Adrian Sannier. (Full disclosure: Pearson is a client of MindWires Consulting.) A couple of months ago, I suggested in an interview with Josh Kim for Inside Higher Education that this is where MOOCs would go next:

    Question 6. Will MOOCs replace accredited curriculum? Why or why not?

    I don’t know how to answer this question, because I’m not convinced that we know what a MOOC is yet. Will there be massive elements that are integral to many curricula? Almost certainly, although I don’t know how much of it we will see in 2013. Will the curricula be all massive? Probably not in most cases. Will we consider the mix of massive and non-massive elements to be “MOOCs”? I don’t know.

    The problem that we have right now is that we have very few models for how this might work. So when Sannier mentioned a course called Habitable Worlds being developed by Professor Ariel Anbar and Lev Horodyskyj at Arizona State University that will eventually be brought to OpenClass to support this model, I asked to speak with Professor Anbar in order to get some specifics. The conversation shed some light not only on possibilities for the mixed model, but also on possible futures for the liberal arts and the role of the professor.

    (more…)

  • OpenClass vs the MOOC

    When Pearson’s OpenClass was announced about a year and a half ago, the natural question to ask was whether it would disrupt the LMS market. But that was then and this is now. (Full disclosure: Pearson is a client of MindWires Consulting.) The more interesting question today is where OpenClass stands vis-à-vis the MOOCs. To begin with, it certainly appears that the LMS and MOOC markets may be on a collision course. But beyond that, Pearson is a content provider first and foremost. With both the content and the platform at their disposal, as well as an array of assessment tools, they certainly have all the raw materials to build MOOCs. Is that where OpenClass is going? I recently had a short conversation with Pearson’s SVP of Product, Adrian Sannier, to find out. And the answer appears to be, “Not exactly.”

    (more…)

  • Apollo Group’s Technology Investments

    I had an unexpected opportunity to chat with the Apollo Group’s Rob Wrubel last week. Rob is their Chief Innovation Officers and Executive Vice President. It was a short conversation—only fifteen minutes—but boy, was it dense with information.

    (more…)

  • Kevin Carey Gives the Right Diagnosis; I’m Less Sure About the Prescription

    In  piece for the New Republic that I missed when it came out, Kevin Carey provides a compelling diagnosis of the cost problem in higher education that’s worth quoting at length:

    [H]ighly-profitable lower division courses in common subjects like Economics, Calculus, and Psychology have similar curricula at most colleges and rely on many of the same nationally-marketed textbooks. They are often taught by people with no formal training in teaching. These courses are, in the education context, commodities….

    Non-profit colleges don’t pay taxes, even when they have billions of dollars in the bank. People can use their publicly-financed college vouchers—and, increasingly, claim lucrative tax credits—for private college tuition. Because nobody really knows which colleges provide the best education, consumers have been trained to think of colleges like a luxury good: The best are the most expensive, by definition.

    Non-profit colleges also don’t have shareholders demanding that they maximize the difference between revenues and expenses. Instead, they’re run by administrators and faculty who are most interested in competing for status with other colleges, which is determined by the size, expense, and ornateness of the academic greenhouses in which basic research and scholarship are produced.

    For-profit colleges, on the other hand, do have shareholders, and the for-profit sector has expanded rapidly in recent years. But most have made the very rational decision to get in on the subsidy scam….

    In other words, everyone currently in the four-year higher education business has a host of strong incentives to raise prices and hardly any incentives to lower them. Unsurprisingly, prices often go up and almost never go down. In the long run, this will badly undermine the legitimacy of higher education and weaken the case for public subsidization. College will become a private good affordable only to the minority subset of the population that can afford it. America’s aggregate level of human capital will suffer and our competitive position relative to other nations will decline. According to the OECD, many other industrialized countries are already increasing their levels of college attainment faster than we are.

    Colleges have a strong collective interest in preventing this from happening. But each college has a strong individual interest in mainlining student tuition hikes for as long as they can. After all, if only rich people can afford to attend your college, that means you have a selective-admissions college full of rich people—which is what most colleges want to be. It’s mathematically impossible for all colleges to win this game, but they all think they can be among the winners. And the people running them today are concluding, correctly, that they’ll likely be long gone before the day of reckoning comes.

    All of which is to say that college tuition addiction, like any serious dependency, can’t be cured by gentle moral exhortation. College won’t kick the habit of raising prices until the things they care about—money and reputation—are seriously threatened by competitors. Therefore, federal policymakers should help create those competitors by helping establish many brand-new colleges and universities.

    I think he goes a little too far in ascribing a particularly selfish and short-sighted mindset to college administration leadership, but that’s really irrelevant to his argument. At its heart, he is claiming that we have a tragedy of the commons situation. As long as you assume that the individuals making the decisions are rational economic actors, then their personal attitudes don’t really matter. And I think he’s right about the fundamental dynamic.

    His answer, which he saw echoed (or at least hinted at) a few weeks later in President Obama’s State of the Union address, is to use the power of Federal Pell Grants to do an end run around existing accreditation processes, unbundle the degree, and empower non-traditional providers to compete. He writes in the original article:

    Congress and the Obama administration should create a new policy framework under which organizations can become officially recognized providers of higher education. Note, I do not say “officially recognized colleges or universities.” That’s because one of the things that makes college so expensive is that colleges (and the college experience these institutions provide) are expensive and currently people can only receive government-subsidized higher education services from colleges. Under the new system, any provider could receive payment via Pell grants, federal loans, or other current and imagined federal aid systems if they agree to a few baseline conditions.

    First, they would be subject to strict price regulation. They would be free to offer courses for less than the maximum allowable amount per credit, but not more. Second, they would have to be extremely transparent about quality. They would be required to provide public information about how much their students learn, and have their access to federal aid rescinded if students are not learning enough [emphasis added].

    These new providers would not have to be approved by independent accrediting bodies run by existing colleges and universities, as recipients of federal aid are today. In fact, they wouldn’t have to be colleges at all. InsideHigherEd recently reported that a pair of well-known Stanford professors are currently teaching an Artificial Intelligence course to about 200 Stanford students—and more than twenty thousand students around the world, online. The non-Stanford students won’t receive credits from Stanford, but they will receive official documentation from the professors as to how they scored on course tests and their overall rank. Under this new system, those professors would be free to set up their own business teaching Artificial Intelligence over the Internet, and students would be free to pay them with federal aid. Other providers might take advantage of the fast-growing body of open educational resources—free online courses, videos, lectures, and syllabi—and add value primarily through mentoring, designing course sequences, and assessing learning.

    Students, of course, won’t want to pay for these courses if they can’t receive college credit that can be translated into a degree. So as part of the new system, any existing colleges that want to continue receiving federal financial aid will be required to accept any credits granted by participants in the new system in transfer. Because these new providers will have the imprimatur of United States government approval, they will be able to compete for students who want degrees backed by sufficient reputation. And because they will be inexpensive and attached to verifiable data about how much students are learning, they will make a compelling value proposition when competing with traditional colleges that have no such data, charge more money, and are weighed down by legacy expenses and change-resistant cultures [emphasis added].

    I like the general idea of opening up opportunities for new entrants and changing the financial dynamic to break the tragedy of the commons vicious cycle, but there’s a bit of magical thinking regarding the verification of quality. How would we do that? What would it look like? Frankly, we’re not very good at verifying the quality of even traditional programs. There’s a certain amount of social capital that these institutions earn through their long histories, reputations and, above all, their alumni. As Kelly points out, this system doesn’t work very well. But dismantling it without a clear sense of what would replace it is dangerous, and I see no indication that he (or anybody else) has good ideas about quality verification in an unbundled system. I’m not throwing up my hands and giving up on that question or saying that it should be an excuse to justify the status quo. But I don’t think we should ignore it either.