e-Literate

Present is Prologue

Category: Strategy & Change Management

  • The Christensen Institute’s Calbright Position is Dangerously Dogmatic

    If your main intellectual response to the current health crisis is to double down on your previously held beliefs, then you are probably not thinking deeply enough. For example, suppose that we develop both treatments and a vaccine for COVID-19, but the immunity conveyed by that vaccine only lasts for a season (much like other flu vaccines). Suppose that flu strains become permanently more virulent and more deadly. Some of the changes in the healthcare system that we are seeing now—in point-of-care, supply chain, and research efforts—become permanent. The risk of getting together physically in groups is permanently altered. Not to the degree that it is now, but significantly higher than it was. Think about how that permanent change would impact all the many businesses that are being impacted now. The growth sectors of our economy would change. The geopolitical landscape would change. Everything would change. Much of what we thought we knew about the future of work would have to be thrown out and rethought. And much of what we thought we knew about the future of education—what jobs we need to prepare students for, how we should be teaching, what sustainability looks like for an educational institution, and so on—would also have to be thrown out and rethought.

    It is hard to think such thoughts. I find my mind desperately casting about for reasons to believe that this scenario is not plausible. That life will someday, somehow, return to normal. That the world has not changed.

    But it has. And we must all learn how to think the unthinkable. We have to find ways to let go of the comforting assumptions that enable us to glide through the day on autopilot, somehow not swerving off the road while we fiddle with the car radio or talk on the phone or think about what will happen when we arrive at where we are going. We have to look at the road with fresh eyes. See what is in front of us. Prepare our minds for unexpected obstacles. The adaptive cruise control and lane-assist and other comforting tools that we have built to protect us from the need to be in the moment will not serve us well on this road we have found ourselves on. In fact, they provide a dangerous illusion of comfort. We must seize the wheel and learn to be navigators again.

    Right now, as we respond to an unprecedented crisis, a lot of the safety mechanisms in the system are being thrown out even as we face massive uncertainty. Multi-trillion-dollar legislation is being passed through Congress incredibly quickly. The medical system is finding various shortcuts to get around the system of checks that are designed to make sure treatments that tinker with your immune system are safe. These safeguards were created for good reasons, one of which is to mitigate the impact of sloppy or reflexive thinking on consequential actions. If we are going to remove them, then we must think harder.

    Even under normal times, I would have been disturbed by the Christensen Institute’s argument that “California should double down on Calbright College—by leaving it alone.” The post author Richard Price asserts that California’s new, experimental online community college, which received a $100 million initial allocation and a $20 million annual budget from the California State Legislature, is already fabulously successful. And it will be even more successful if only it is freed from the shackles that the other 114 California community colleges manage to live by and State Senators would back off of their call for Calbright to be audited for its finances, progress, and its compliance with the conditions under which it was authorized. He makes these assertions without evidence or even much in the way of argument to back them up. While reading the piece, I can’t escape the feeling that I am in the back seat of a car with a habitually distracted driver who is reflexively trusting his GPS to guide him through territory that has not been mapped.

    I have been patient with the more careful proponents of disruptive innovation in education, despite my skepticism, because it is not their fault that the term has been appropriated by testosterone-addled Silicon Valley teenagers, and because they have made cogent (if unconvincing) arguments. But the opening line of Price’s Calbright post, while sounding completely anodyne, alarms me:

    As the COVID-19 outbreak increasingly prompts universities to move instruction online, California lawmakers may want to reconsider their deep skepticism of the state’s first fully online community college—the young institution is proving itself more vital than ever.

    California should double down on Calbright College—by leaving it alone

    There are just so many things wrong with this sentence. For starters, the author links to an article about lawmakers’ “deep skepticism” without mentioning anywhere in his own piece that the article describes the reasons why lawmakers are skeptical. He certainly doesn’t attempt to refute those reasons. To the contrary, he asserts that the “young institution is proving itself more vital than ever” without ever really explaining what that means. Second, the sentence conflates skepticism about Calbright with skepticism about online education. Reading it, one would never guess that the California Legislature has poured something like a quarter of a billion dollars into online programs for the California Community College System alone, plus hundreds of millions more into the Cal State and UC systems. Lawmakers are not demonstrating skepticism toward online education. Rather, they are demonstrating skepticism of Calbright’s implementation as the best application of the substantial investment they are making in online education.

    Worst of all, the introduction sets the tone for the article, which is to accuse others of dogmatism while itself making its case on pure dogma. In doing so, it links to another post on the Christensen Institute’s site by another author about another system. This article, unfortunately, also gave me the feeling of being an uncomfortable passenger sitting beside a driver who is barreling down the road toward a destination that he is determined to reach, heedless of what may lie between here and there.

    The end result is a specious chain of arguments made from a position that indirectly has Harvard’s imprimatur—because Christensen was a noted Harvard professor—arguing that the state of California should commit to throwing tens of millions of dollars at an unproven program. And that it should do so while declining to hold that program accountable or even expecting it to follow the rules that all the other community colleges manage to live under. The main justification for this position is a theory that was designed to explain what happened to steam shovels and old disk drive technologies and is now being applied to a dramatically different domain without attention to context or evidence.

    If you are going to argue for removing safeties at a time of historic emergency, then you must think harder.

    It is time for the more serious proponents of disruptive innovation in education to take a good look in the mirror and ask themselves if they have been thinking hard enough. As their predictions about mass closures of universities and other dramatic changes have failed to materialize repeatedly over many years, their assertions about the future have become increasingly strident and sloppily constructed. It is time for them to seriously consider the possibility that they are just plain wrong, and that their attachment to cherished ideas is doing more harm than good.

    My own prior assumptions

    If I’m going to be fair, I should lay out my own prior thinking about both disruptive innovation and Calbright so that you can decide whether I am the one who is stuck in old thinking.

    I am a fan of Clay Christensen’s work. I have three of his books on my shelves, all of which I have read at least once, and two of which I find myself occasionally dipping back into for reference or inspiration. I find his basic thesis to be clever, well-argued, reasonably grounded in evidence, and provocative. That said, his theory is interesting because of the inference chain he constructs rather than because any of his individual insights are particularly novel in and of themselves. For example, one central concept in disruptive innovation starts by “competing against non-consumption,” which is a fancy way of saying you should go to where the competition isn’t by figuring out who isn’t being served well. While this assertion is worth noting, it is the opposite of revelatory. It borders on the banal. Another stepping stone in his argument is that successful organizations will tend to resist ideas that are different than their historically successful ways of doing things. We nod at this without pausing. Christensen’s argument pulls us along not because the steps along the way stop us in our tracks but, to the contrary, we glide down an easy path and suddenly end up somewhere unexpected. As Price puts it in his article, “In the Innovator’s Dilemma, Clayton Christensen made an unsettling observation—CEOs of established companies that fell to disruptive entrants often did everything right, and for that very reason failed to save their companies.”

    Disruptive innovation theory boils down to the idea that companies that are fat and happy tend to result in products that are fat and customers that are less happy. At some point, Microsoft stopped building features into Office that were useful to everybody and started focusing on features that were useful to their most lucrative niche customers. Office customers who were not in those niches became less happy as the software became more expensive and harder to use. But the company was focused on maximizing revenues from its best customers.

    So they didn’t react much when Google came out with Docs, Sheets, etc. This was a perfectly reasonable business decision for them to make, since Google was not an immediate threat to their customer base and some very profitable corporate customers wanted specialized features. Google’s products were obviously inferior for mainstream word processing tasks. I tried and abandoned Google Docs a few times in the early years because it just didn’t meet my needs. But it got better over time, first satisfying needs for which Word wasn’t well suited, then nibbling at the simplest applications of Word, and eventually becoming sophisticated enough to challenge the dominant word processor for a substantial percentage of common tasks. Today there are a billion users of Google Drive. I am one of them. I have not abandoned Microsoft Office, but I have thought about it at times.

    Disruptive innovation is both a particular kind of disruption and a particular kind of innovation. It is important to understand this. When we learn to trust a theory, we begin to take it for granted like we take our cruise control for granted. We stop thinking about it. But we need to understand how our tools work so that we can know when we are safe to trust them and when we are not. As I put it in 2014,

    These days, “disruptive” and “innovation” seem to always come together in the same sentence. It’s a bit like “big galoot.” Theoretically, “big” is a modifier for “galoot.” But you never hear people talking about small galoots, average sized galoots, or galoots of indeterminate size. In modern common usage, galoots are always big. “Big galoot” has pretty much become an open form compound word, like “post office” or “real estate.” But “disruptive innovation” is not a compound word. Disruptive innovation is a particular kind of innovation, and a fairly narrow kind at that. Specifically, disruptive innovation is a phenomenon in which a new market entrant can overtake a leader in an established market by offering cheaper and simpler solutions. It’s important to remember that some of Clayton Christensen’s seminal examples of disruptive innovations were steam shovels and disk drives. This is not the same kind of innovation that produced the iPhone. It’s essentially about identifying the slow fat rich kid and taking his lunch money. To be fair, it’s not that inherently mean-spirited, because presumably one takes the rich kid’s lunch money (or market share) by providing solutions that consumers prefer. But the point is that disruptive innovation is generally not about solving new problems with brilliant out-of-the-box ideas. It’s primarily about solving old problems better because the old solutions have gotten overbuilt.

    Why VCs Usually Get Ed Tech Wrong

    The reason that I have been skeptical about disruptive innovation’s applicability to education has to do with differences in both demand and supply from the situations that Christensen analyzed in his books. On the demand side, I argued in 2013 that education doesn’t fit the disruptive innovation framework because it is not a product:

    Silicon Valley can’t disrupt education because, for the most part, education is not a product category. “Education” is the term we apply to a loosely defined and poorly differentiated set of public and private goods (where “goods” is meant in the broadest sense, and not just something you can put into your Amazon shopping cart). Consider the fact that John Adams included the right to an education in the constitution for the Commonwealth of Massachusetts. The shallow lesson to be learned from this is that education is something so integral to the idea of democracy that it never will and never should be treated exclusively as a product to be sold on the private markets. The deeper lesson is that the idea of education—its value, even its very definition—is inextricably tangled up in deeper cultural notions and values that will be impossible to tease out with A/B testing and other engineering tools. This is why education systems in different countries are so different from each other. “Oh yes,” you may reply, “Of course I’m aware that education in India and China are very different from how it is here.” But I’m not talking about India and China. I’m talking about Germany. I’m talking about Italy. I’m talking about the UK. All these countries have educational systems that are very substantially different from the U.S., and different from each other as well. These are often not differences that a product team can get around through “localization.” They are fundamental differences that require substantially different solutions. There is no “education.” There are only educations.

    Don’t Cry for Me, Argentina

    Students’ reasons for the college choices they make are much more complex and varied than their reasons for choosing a word processing program. So I’ve been skeptical about whether the nebulous cloud of ideas and ideals that we call “education” is a thing that can be disrupted in the Christensonian sense.

    There are also mismatches to the theory on the supply side. Christensen’s theory of organizational behavior fits best with organizations that conform to economist Ronald Coase’s theory of the firm. Command-and-control organizations that are optimized for profitability and growth will be particularly vulnerable to the pathologies that he identifies. Most universities don’t function that way, and no university systems do. While universities do have to worry about optimizing for sustainability, that goal is complicated by their strong mission focus and their shared governance structures.

    And university systems are even further from Christensen’s model because they are governed by political systems, which operate under entirely different decision-making processes than companies do. For example, with 114 physical community colleges grouped into 72 districts across California’s 58 counties, every state legislator has a local interest in protecting one or more of those colleges. There were mission-related reasons for this design decision, having to do with making education accessible in an era before modern online learning. Regardless of the degree to which those reasons may or may not still apply, decisions for the California Community College System are still driven by political representation of those county interests in the state’s legislature. Christensen wrote an entire book—The Innovator’s Solution—on how entrenched corporations can stay innovative. As far as I can recall, none of the example organizations in that book looked remotely like the California State Legislature. So at the very least, somebody would need to make the affirmative case that Christensen’s prescriptions for corporations can be applied in this very different context.

    And remember, it’s the chain of inferences that makes disruption theory interesting. If any of the links break, then we have to question whether the theory holds. Cherrypicking evidence for one or a couple of the individual common-sense assertions in the inference chain puts us on a fast road to Stupidville, however our GPS display may label the destination.

    I have historically been skeptical of Calbright for reasons that have less to do with disruptive innovation and more to do with math. COVID-19 has been giving us all a hard lesson on the mathematics of growth. If every person carrying the disease spreads to between two and three other people, then the number of people with the disease will double every few days. On the other hand, if the average infected person spreads the disease to at most one other person, then it will eventually die off.

    The challenge of Calbright has been that the math never worked for the kind of growth that the legislature expected it to achieve. If the main goal was to create an incubator that would eventually teach us better ways to serve underserved students, that would be one thing. But the goal was to actually serve millions of underserved students in a relatively short span of years. Calbright’s growth rate would have to be unprecedentedly high in order to achieve that aim. Phil Hill broke it down in a post in 2017:

    The maximum growth rate of [some] cherry-picked successful schools ranges from ~1,200 / year for Excelsior to ~7,700 / year for SNHU (note that Rio Salado at ~1,400 / year is the only public institution). Add to this the fact that all of these schools have been around for decades. No accreditation issues, no time-consuming establishment of core leadership team, etc.

    There is a big difference in dealing with institutional issues and statewide issues, particularly in California. One in five US community college students in the US do so in California, and the statewide issues tend to come in large numbers. Statewide issues tend to come in hundreds of thousands while institutional issues tend to come in tens of thousands.

    What this points to is that for a new fully-online institution to get to some meaningful level of enrollment (let’s say 20,000) in the same ballpark as these comparison schools, I estimate it would take a full decade at the least. This is the reason, by the way, that Mitch Daniels and Purdue University made the Kaplan University deal even though Kaplan’s enrollments are dropping. Daniels did not want to wait a decade to get to meaningful enrollment numbers for an online college serving working adults – if everything works out, within a year Purdue will have a fully-online institution serving 30,000+ working adults. That is a big if, by the way.

    Enrollment Implications Regarding Directive for Online Community College in California

    I have no problem with the idea of Calbright as an experiment in supporting underserved students. But the math doesn’t support the idea that it is going to have an impact at scale any time in the next decade, even under the most optimistic of scaling scenarios. So my concern with Calbright is that both California politicians and proponents of disruption theory have seized on it as a means for solving different problems than the ones it seems suited to solve.

    I have one more predilection that you should know about, which is that I believe theories should be disprovable if they are to be credible. You can’t say that disruptive innovation is going to result in 50% of schools going bankrupt—no, wait, maybe it’s 25%—and that it’s MOOCs that are the disruption—or maybe just online learning in general, or possibly CBE, or maybe adaptive learning—and continue to be taken seriously. There has to be a way to arrive at the statement, “data X would disprove my hypothesis.” It can’t be the case that any old data can support your hypothesis while no data can disprove it. That’s not a theory. It’s dogma. My patience with proponents of disruptive innovation in education has worn thin over time because I haven’t seen them demonstrate the willingness to ask themselves the question, “But what if we’re wrong?”

    Now that I have laid my own comforting assumptions on the table, it’s time to examine the assumptions that are evident in the arguments from the Christensen Institute.

    Is Calbright a disruptive innovator?

    Let’s return to the hyperlink in the very first sentence of Price’s post, which is attached to the words “their deep skepticism.” What is the skepticism described in the Education Dive article behind that link? First, the article emphasizes the question of whether Calbright would be best run in the existing structures rather than as an independent campus. That’s one surface resemblance to disruption theory. Again, you don’t have to believe in disruption theory to believe that sometimes a little autonomy from a large, entrenched bureaucracy might lead to fresh thinking. But at least it’s consistent.

    On the other hand, Price neglects to mention other salient facts. Like the fact that the legislative analyst’s report in 2018 said there is no evidence that Calbright will solve the problems that prevent Californians from enrolling in college (or, in Christensonian parlance, that it can compete against non-consumption). Here’s the relevant paragraph from that report:

    Unclear If Providing Online Offerings Will Solve Key Barriers for Target Student Group. One of the proposal’s goals is to increase educational attainment for adults who currently have no postsecondary credentials. Although this is a laudable goal, the administration has not provided any evidence that an online community college will address the key barriers for this potential student group. Although an online program can increase convenience, working adults may not be pursuing additional education for a number of reasons. The administration also has not provided evidence that those working adults who are interested in more education cannot access it through existing online or in‑person community college programs.

    California LAO report

    Is there reason to believe that the innovations of Calbright’s design will cause large numbers of students who were previously not enrolling in existing online offerings to enroll in Calbright’s? I don’t know. The California LAO’s office didn’t see such evidence, and Price fails to even mention it as a problem.

    The Education Dive article also mentions that Calbright has duplicated existing academic offerings of other community colleges in violation of state rules. Here Price does have a rejoinder, though he does not dispute that Calbright has violated state rules:

    [C]oncerns that Calbright’s courses may duplicate existing OEI offerings fail to acknowledge that competency-based, self-paced courses differ fundamentally from seat-time based courses covering the same material, and better serve time-constrained adult learners.

    OK, that’s a claim. Where is the supporting evidence? Such programs exist in the world. Western Governor’s University, SNHU’s College for America, and others implement the instructional approach that Calbright has chosen. I’m not arguing that evidence doesn’t exist. But I do think that if somebody is advocating for a $100 million initial allocation plus a $20 million allocation in support of a new and unproven institution while simultaneously advocating that rules should be relaxed and oversight waved off, then one should present any evidence so that we can examine it together. The action Price is calling for requires less reliance on cruise control and more on the blind-spot camera.

    Rather than focusing on making an evidence-based case for Calbright, Price chooses to make an argument against California Online Education Initiative (OEI):

    Consider CCCS’s Online Education Initiative (OEI), a course exchange program, which Calbright critics point to as obviating the need for a separate, online college. In theory, students can enroll in online courses offered by other state community colleges. In reality, CCCS’s enrollment-based funding model discourages school participation, since only the college that offers the course earns enrollment revenue. This has limited course offerings and engagement overall.

    Here is an example of how Calbright, operating under a different business model, could be an asset to CCCS as an autonomous institution. Free from the constraints of the funding model that has proven incongruent with expanding online course options, Calbright could work towards revenue and course enrollment models that best serve large numbers of job-seeking adult learners.

    This is factually wrong on several levels. First, the course exchange is just one component of OEI. Luckily, MindWires—the consulting practice that I used to be a partner in and that Phil Hill still runs—produced this convenient explainer on behalf of OEI (which is less than four minutes and is easily findable on YouTube):

    Intended Consequences

    (Video link: https://youtu.be/1DdlaIZYiDI)

    As Phil recently wrote, Calbright is currently serving about 450 students. In contrast, in the 2020-2021 academic year, OEI projects 99,000 enrollments in new academic pathways. (And word is that the OEI number is likely to be revised upward significantly based on more recent data.) Apples-to-apples, this translates into probably a couple of tens of thousands of students.

    The course exchange part of OEI is one component. It may or may not succeed at scale. But the broader OEI program is indisputably reaching many more students than Calbright. Worse than getting the incentive mechanism wrong for the course exchange, Price apparently failed to conduct even cursory research regarding the nature and impact of the program he was critiquing. Even if the course exchange portion of OEI fails utterly, the overall program is still tracking to increase enrollments by two orders of magnitude more than Calbright will in the next year.

    That doesn’t even count the ways in which Calbright’s progress toward (unspecified) milestones was accomplished, in part, by using resources built with OEI funding. Here is a screenshot of Calbright’s essentials course:

    The link at the bottom of that screen leads to this page:

    Of the Calbright students enrolled in October through December of last year, 449 enrolled in essentials courses, while 20 enrolled in a program pathway. In other words, the vast majority of students taking Calbright courses last term were taking courses that were using OEI content resources.

    Also, while Calbright’s mission was specifically to reach underserved students that aren’t being reached via the 114 existing community colleges, the results so far are not promising on that score. For example, despite specifically targeting Latinx students, they represent 16% of Calbright’s enrollments—in contrast to 45% Latinx enrollment system-wide. Calbright’s students are, in fact, disproportionately white:

    Calbright legislative review backgrounder

    In addition to these reasons for questioning Calbright’s progress toward and ability to accomplish the mission set for it by the State Legislature, there’s also the fact that Heather Hiles, former Calbright CEO, resigned abruptly without public explanation less than a year after being hired.

    So given these facts, is it reasonable for California to ask whether Calbright makes sense and is working as intended at this time? I think it is. While I don’t prejudge the outcome of that introspection, the legislators have a responsibility to at least ask the hard questions.

    But, worries Price, whether or not OEI may work in practice, does it work in theory? He seems to take a kind of libertarian position that any program that is regulated will inherently be inferior to one that is not. He is aghast at the LAO’s concern that Calbright will eventually have to comply with the system’s collective bargaining agreements and spend 50% of its budgets on instructional salaries.

    In other words, Calbright being embedded in CCCS subjects it to strictures that will eventually hamstring the school in its efforts to innovate for adult learners. The LAO report ironically makes the argument that even as an independent school, Calbright isn’t autonomous enough.

    Does it? How much does it cost to run a Calbright-style CBE program with quality? How much of that money goes into instructional costs? How does that compare to the requirements that it is currently required to comply with and that OEI online programs do comply with? Again, the data exist, but Price either doesn’t believe he needs to justify his position or doesn’t have the data in question.

    I don’t have it either. What I do have is a quote from the President of Southern New Hampshire University (SNHU), which the Christensen Institute valorizes without understanding—more on that in a bit—about the amount of human time and attention that is required to deliver quality CBE education:

    I think there is a general lack of awareness of how rich now the underlying data analytics are. We monitor our students 24/7. We know when someone hasn’t logged on. We know when someone has struggled with a project. We know when performance has dropped off. We actually have closer to a 360-degree view of our students than most traditional institutions do. Then, when those students are engaged in the work, they have ready access to qualified faculty if they’re really stuck. We’re never going to let somebody get stuck on a math concept, for example, and just say, well, just figure it out. We’re going to get you help.

    Why Competency-Based Education Stalled (but Isn’t Finished)

    SNHU is putting significant time and money into instructor support. Is it 50%? I don’t know, and Price apparently doesn’t either. Is there a case to be made for granting Calbright some flexibility based on evidence of results in successful programs? Possibly, but Price doesn’t make it. Instead, he simply declares,

    Without an autonomous Calbright, CA will struggle to properly serve its adult learner population. Innovators like WGU and SNHU will take good care of these learners, but CA will have ceded, rather than seized, the future of learning.

    With little in the way of argument and nothing to speak of in the way of evidence, he concludes that (a) only Calbright can “properly” serve California’s adult learner population, (b) Calbright can only do so if it is “autonomous,” (c) Calbright represents “the future of learning,” and (d) if the California Legislature doesn’t cede oversight Calbright while continuing to fund it, then out-of-state competitors may disrupt or otherwise somehow surpass the California Community College System. It’s not at all clear how Price got us here, or even what he means by “properly” serving California’s adult learner population, or making Calbright “autonomous,” “ceding” or “seizing” the “future of learning,” or what role he believes that “innovators” such as WGU and SNHU will play in California’s future should the State Legislature fail to follow his prescription. He does link to (without really explaining the relevance of) another Christensen Institute post by another author about how the PASSHE system partnered with SNHU. I wish I could say that I found that article more persuasive.

    Alas.

    Is SNHU disrupting PASSHE?

    Michael Horn’s post from February of this year bears the breathless title, “Why disruptive innovation is stealing Pennsylvania’s students.” The trigger for the article was an articulation agreement signed between Pennsylvania’s State System for Higher Education (PASSHE) and SNHU which enables PASSHE students to transfer up to 90 credits to SNHU and complete their bachelor’s degree at SNHU at a 10% tuition discount.

    Horn emphasizes his belief that state regulations and slow-moving bureaucracy have hobbled PASSHE’s ability to innovate in online education, leading it to the necessity of outsourcing. He does so mainly by analogy to SNHU. There are several problems with this approach.

    First, as I pointed out earlier, the idea of increasing autonomy to spur innovation was not newly introduced by disruption theory. Bell Labs embodied this strategy from its formation in 1925. Clayton Christensen wasn’t even born until 1952. Second, as I also pointed out earlier, the success of this strategy does not validate all of disruption theory, never mind its applicability to education. As Horn acknowledges in his post, PASSHE is not failing because its leaders did everything right in pursuing its most lucrative customers. (Not that we would want public education systems to do that anyway, which is yet another problem with disruption theory’s applicability.) To the contrary, PASSHE arranged for the articulation agreement because many of its (tuition-paying) students are not finishing their degrees, according to PASSHE Chancellor Dan Greenstein. Presenting those students with another reasonably priced online option was intended to increase student graduation rates, even at the possible cost of the system’s most lucrative customers. We have to follow Horn down a chain of several inferential steps—each of which is given with either thin factual support or none at all—to arrive at the implication that “disruptive innovation is stealing Pennsylvania’s students.”

    Horn relies on a loose comparison to SNHU to do most of the work from him. To give him the benefit of the doubt, let’s stipulate several points:

    • SNHU’s growth has been undeniably impressive at a time when PASSHE has been experiencing a slow-motion crisis.
    • SNHU President Paul LeBlanc, like me, is a fan of Clay Christensen’s work. He has thought about it a lot and credits it with influencing his thinking.
    • Specifically, in his 2015 interview with yet another Christensen Institute writer, he speaks at length about the value of creating some measure of autonomy among academic units as a critical success factor for SNHU, and he directly links that notion to Christensen.

    Even so, it’s not that simple. LeBlanc hasn’t applied the separation principle dogmatically. SNHU operates under one shared governance structure. Autonomy is not the same as freedom from rules or oversight. Second, he has not hesitated to revoke autonomy when it wasn’t working. SNHU’s competency-based education unit, the College for America, used to be autonomous but has since been pulled back into the larger online learning unit.

    Overall, Horn’s article is a confusing muddle. He readily acknowledges that the causes of PASSHE’s troubles look nothing like the causes of disruptive innovation described in The Innovator’s Dilemma. He also admits that better funding of the chronically underfunded system would help. He then swerves off into an explanation of disruption theory, connected only by the thread that SNHU employed the same basic strategy that Bell Labs used successfully nearly 30 years before Clayton Christensen was born. He ends with a call for state systems to create small incubators where new ideas can be piloted. I agree with that idea, but I don’t think it bears any relationship to the completely unjustified clickbait title of his post. I don’t think one has to believe in disruption theory to come to the conclusion that university systems have become sclerotic and need to find ways to get out of their own way. This could have been a perfectly good article if it weren’t trying so desperately hard to validate disruption theory. Horn’s rather modest call to action is not in any way proportionate to the dire pronouncement of the headline; nor does it justify Price’s call for Calbright to be exempted from oversight or collective bargaining rules before it has even proven that it can serve 1,000 students.

    This is all hauntingly familiar. I mentioned that I own three of Christensen’s books, two of which I occasionally dip into to this day. The other one is Disrupting Class, which is the book that Christensen co-wrote with Horn about the application of disruption theory to education. In stark contrast to The Innovator’s Dilemma and The Innovator’s Solution, it was a disappointing mess. Parts of it attempt to stretch disruption theory beyond recognition in order to fit educational examples. Other parts contain thoughtful, reasonable observations that bear no credible connection to disruption theory. It doesn’t hang together as a cohesive work. I found the book unpersuasive when it was published 12 years ago and do not believe it has aged well. And in subsequent publications by disruption theory proponents in education, the flaws that were apparent in that original work have been papered over rather than addressed. Christensen has passed away, but the people carrying his torch in this domain have not done his legacy a service, however diligently and earnestly they may have tried.

    Twelve years of trying is enough. It is time to think harder.

    Grieving our errances

    Alexander Pope wrote that to err is human, but he might have added that to err repeatedly due to habits of mind is particularly human. The disruption theory proponents love their idea. As a man who has written 7,000-word blog posts, I cannot credibly claim immunity from that particular siren song.

    It is not a propensity to be ridiculed. Our capacity to fall in love with a thing as aetherial as a concept has been a key to our survival as a species, and to creating lives for ourselves that are about more than just surviving.

    Sadly, we have not evolved to feel equal love for the process by which we produce, examine, and sometimes destroy ideas. We became toolmakers because tools enable us to accomplish more work with less effort. Ideas are tools that enable us to accomplish more work with less effortful thought. To err is human; to think is divine. These days, I am less inclined toward mocking people for being passionately wrong than when I was young enough to believe that only other people ever commit that sin. But I will attack their arguments without hesitation or mercy when I think they are harmful.

    It has become clear to me that all talk of disruptive innovation in the context of education is harmful. Not just when applied thoughtlessly by people who don’t understand the theory, but even when applied diligently by people who do. It is harmful to advocate for a failed idea as if the fate of education depends on believing it is true.

    Disruption theory in education is dead. Be sad if you need to, but move on. Seize the wheel and learn to be a navigator again.

    As for Calbright, I remain agnostic. I believe it is a good idea in principle for California to create a safe space to experiment with alternative means of reaching the millions of Californians who need education but aren’t getting it. I worry that this characterization is not fully aligned with the stated goals of the Calbright program. I do not know whether the experimental college is being run well, or whether now is the best time to prioritize it over other educational exigencies of the moment. I do believe it is not only fair but important to ask these questions and insist on arriving at fact-based, well-reasoned answers.

  • “We Really Need to Talk…” Now.

    Note from the editor: This is a guest post from Susan Baldridge, one of the authors of forthcoming book The College Stress Test: Tracking Institutional Futures across a Crowded Market.

    Clayton Christensen got the attention of campus leaders with his claim that 50% of colleges will be closed within a decade, and others – perhaps with less dramatic predictions – have joined the gloomy chorus.  As overstated as that number may be, you might expect that we would be moved by this prediction to ask hard questions about the future of higher education and what it means on our campuses.  And some of us are.  But the academic communities that are collectively engaging the challenges implicit in such dire predictions are few in number.  Not only are these difficult conversations infrequent, but when they do take place they are fraught with controversy and rarely result in significant, sustained change.  Why is it so hard?

    It isn’t because we don’t know what the challenges are.  Read the Chronicle or Inside Higher Ed on any given day and you’ll find a ready list of topics for campus conversations:  providing a relevant curriculum and effective pedagogy, responding to dwindling enrollments and resulting resource constraints, addressing failures of equity and inclusion in an increasingly diverse environment, developing the optimal role of technology to promote learning…the list goes on and on.    

    Even with so many places to focus a collective search for solutions, we seem to avoid naming the elephants in the room.  Even schools that are teetering on the brink – who presumably stand to gain (and lose) the most from collective action – are not talking openly about their institutions’ particular challenges.  Witness the shock and outrage when colleges (there have been a number in the last year in my home state of Vermont) announce that they are closing, or merging, or seeking partners to help them weather the storm.  In one highly-publicized case—Mt. Ida College in Massachusetts—lawsuits were filed following the closure announcement alleging that leaders intentionally kept the reality of the school’s circumstances from the campus and other stakeholders.  The outcry seems to be, “Why weren’t we informed?”

    It’s not hard to understand why a college president might not wish to share the problems of an institution with the wider world.  Candid efforts to confront challenges to the long-term health and success of an institution invite external scrutiny, and this creates a counter-pressure to focus solely on the positive.  My co-authors, Bob Zemsky and Susan Shaman, and I address this in our newly published book from Johns Hopkins University Press, “The College Stress Test,” in which we examine the market factors associated with institutional risk of closure:

    “…A common focus of campus messaging is on the particular data points that suggest that, whatever risks may be facing other schools, the future for my college is bright. The point would seem to be to reassure constituents that, in the landscape of higher education, one’s own school is well-positioned to withstand today’s threats. Thus, presidents’ communications are far more likely to share the good news that applications are up this fall or to highlight the positive publicity received by a recent graduate, than they are to speak to potential threats to long-term viability.

    This language of optimism and reassurance is understandable. Addressing threats to the sustainability of an institution requires persistent hard work by many, and a panicked community isn’t likely to be able to respond effectively. What’s more, if there is anxiety within the leadership ranks, it would not benefit anyone to acknowledge it. Much of the work of recruiting, enrolling, and retaining students—to say nothing of fund-raising—is about building reputations and managing the public’s perception of an institution’s desirability, prestige, and credibility. Potential students and donors are not likely to open their checkbooks to an institution whose future appears shaky. So, a struggling institution’s leaders may wait to publicly acknowledge that reality until the very last hope for recovery has faded.”

    The College Stress Test

    Understandable or not, as leaders work to keep the public perception oriented toward the strengths of the institution and its bright future, the opportunity to begin necessary, but likely difficult and nuanced conversations, is passing.

    The disincentives around meaningful conversation and collective problem-solving go beyond external pressures and marketing concerns, however.  When resources are diminishing or need to be reallocated, it shouldn’t surprise us that those who have been the beneficiaries of historical privilege (and I mean that in the broadest sense) tend to wrap their arms around what’s “theirs” and hold on tight.  Administrators who have made decisions to take funding away from one group in order to support the work of another, or who have closed an expensive and declining program to keep a college afloat, know what it means to incur the wrath of those accustomed to an institution’s historical beneficence.  And on some campuses, the need to make significant changes falls upon a community that has already suffered a kind of “death by a thousand cuts”—short-sighted, marginal, supposedly temporary budget reductions that have left those who might have been invited in to a collective conversation about long-term change and transformation feeling resistant, diminished, and beleaguered.

    I don’t mean to suggest that we resist these conversations merely out of avoidance, however.  Rather, the difficulty in addressing necessary change is often a function of something that is a source of strength:  the values, commitments, and identities of those who work in higher education.  Those who have made their careers on college campuses are typically deeply invested in the work that they do and the way that they do it.  For many, it is not merely a job, but a calling.  What’s more, faculty have spent years training to be critical evaluators of new ideas and initiatives.  These people bring all that commitment and all those critical skills to bear on a proposal for change.  Thus, we shouldn’t be surprised that moving an academic community in a new strategic direction can feel like a Sisyphean task.  

    I spent 15 years serving in a variety of administrative roles. It was my job to lead just this kind of challenging conversation and to work to bring a diverse community together in productive pursuit of collective action.  Sometimes I was successful – and I hold those successes close at night.  But even when change was achieved, it often required endless discussion and debate over months and even years.  In one particular case, I recall a colleague who was opposing a proposed change to the structure of several departments – a change that he felt called into question his past and future contributions.  Although the process had involved years (literally years) of meetings and votes, as it neared its conclusion, he said to me, “Susan, this is all happening with baffling speed.”  These conversations can be tests of endurance.

    This may be even more true when changes speak to the fundamental mission of an institution.  If an institution’s leaders decide that the curriculum must be more explicitly oriented toward career preparation in order to maintain financial viability, what does this mean for the faculty members whose work, and sense of professional identity, has always been focused on learning for learning’s sake?  And even if those colleagues are permitted to continue their work without participating in the broader institutional shift, what does it mean that they may no longer feel connected to the institution’s most visible priorities?  No wonder that these people might question and even resist attempts to promote change that leave them feeling sidelined and their work diminished.  Thus, it’s worth remembering that some resistance to change reflects the real and deep commitment of many individuals to the students and institutions they serve.  

    Sometimes the difficulty in these conversations isn’t nearly as meaningful as a fight for scarce resources or a battle over values and identity.  At times, it simply represents a kind of reflexive laziness, or at least mindlessness – administrators react this way because they’re administrators, faculty respond that way because they’re faculty.  Tackling these hard conversations can sometimes feel like staging a well-known play in which all the players know the text by heart.  No one need question the characters’ motivations– we know the tropes and how we are supposed to respond to them.  President X is the evil villain, Professor Y is the brave hero or heroine, Student Z is the pitiful victim.  One of the most common complaints I hear from administrative colleagues across the country is their frustration with being presumed to be ill-intentioned, motivated by corporate greed, and lacking a commitment to the mission and values of their institutions.  These presumptions seem to come with the role.  

    Even if everyone on a campus came to these conversations with good will and benign assumptions about one another, our governance practices and structures are often an impediment, not a facilitator of progress. If you read most college handbook provisions on changes to the curriculum or terms of employment, you’ll find a manual of hurdles and roadblocks.  Of course, these checks and balances have been put in place to prevent short-sighted, ill-advised, and possibly nefarious actions.  But they can also impede progress and necessary change.  Anyone wishing to undertake a candid campus-wide conversation had best be a student of campus governance and should pack for a long trip.  

    So there are many reasons why we are more likely to avoid than engage the complex challenges we face.  And yet, the stakes for many institutions, and ultimately for the students we seek to serve, could not be higher.  There are certainly some who will simply continue to avoid and delay, hoping that the path will be charted by someone else or that the turbulent times will resolve themselves and allow us all to return to life as we knew it.  But as we demonstrate in the analyses we present in the “College Stress Test,” and as others like Nathan Grawe and Jeff Selingo have shown, demographic change and shifting markets mean that many schools will need to respond and adapt, not simply wait out the turbulence.  Put another way, for many, there may be no way out but through.  

    So how do those most at risk begin a conversation that is so potentially fraught and that experience suggests may be unpleasant and perhaps ultimately unproductive?  At the risk of appearing to offer a facile answer, let me propose that the work starts with the realization that, difficult or not, we must have those conversations anyway.  How, in particular, we might approach them will be the subject of another post in a few weeks.  But let’s begin by acknowledging that many schools are facing, or will soon face, the necessity of some kind of significant change.  The path to success will require collective action – and I believe that the most creative and effective action will start with honest, clear-eyed conversation about our challenges.  The most important work is ahead of us.

  • The Future of Work for Academia

    I have long argued that the best path to long-term sustainability for many colleges and universities is to serve as many students within their geographic reach as possible, as well as they can, for 20 to 40 years rather than for two to four years. And that in order to do this, they need to transform from organizations with philosophical commitments to student success into ones that are operationally excellent at enabling student success. In other words, we need more student-ready colleges.

    The reasons for this need are becoming increasingly clear and uncontroversial. On one hand, both real and hypothetical alternative revenue sources are not materializing. States are not dramatically increasing funding for public universities and in some cases continue to do the opposite. Demographics are reducing the number of “traditional” students who would almost automatically apply to their local schools. Grant funding is down. And distance learning reach to non-local students is proving to be limited. On the other hand, today’s workers are in constant need of more education as their jobs continually change. We expect that trend to accelerate. All of this argues that the way forward for many colleges and universities is (a) to increase the enrollment and success rates of students who haven’t traditionally applied to or completed college, and (b) maintain close, continual, long-term relationships with graduates by offering them “small bite” opportunities at education that fit with what they need to stay current and get ahead in their career paths.

    Academic institutions were not designed for this (to the extent that they were designed at all). And I think that we have been singularly bad at talking about change management. There’s a lot of finger-wagging and angst but not a lot of clarity about how to get the front-line folks from here to there. For all our talk about the future of work for the whole world, we seem to have a blind spot for the future of work in academia. We’re not thinking about it, never mind planning for it.

    One way to think about both the Empirical Educator Project and the broader new mission of e-Literate is as just that: helping to clarify the future of work for academia. To that end, I am calling out two e-Literate events happening this week that are thematically related to this idea.

    Developing a growth mindset

    Carol Dweck’s idea of a growth mindset is a deceptively simple one. In contrast to a fixed mindset, where we believe that we are who we are, fundamentally limited by the talents and abilities we are born with, the growth mindset is the disposition that talents can be developed and that we can become more than who we are now. As Dweck often writes, it is easy to oversimplify the idea in practice. But this summary is at least a good place to start.

    If academic institutions are going to be resilient in the face of the massive changes they face in their environment, then academic workers will need to cultivate a growth mindset. On an individual level, they will have to define their professional identities not just on what they have already been trained to do but what they could learn to do on the path forward from where they already are. And on a cultural level, they will need to engage in positive conversations about how they could grow together to meet the future. Strategic planning in the context of shared governance and an environment of rapid change is all about cultivating a growth mindset. It only works when the participants are willing to let go of their customary roles and explore new ways that they can constructively participate in defining both the future of the institution and their roles in it.

    I’m proud to announce that Susan Baldridge will be writing (at least) a couple of guest posts on this topic. I met Susan at Middlebury College where, as Provost, she created a new role of Associate Provost for Digital Learning as one important element for fostering new thinking among the faculty about how Middlebury could continue to thrive as recognizably Middlebury in the 21st Century.

    Since leaving that role and starting her own consulting business, she has co-authored a forthcoming book with Bob Zemsky and Susan Shaman called The College Stress Test: Tracking Institutional Futures Across a Crowded Market. Because the authors developed a quantitative method for identifying sustainability risk levels for colleges, the academic press wants to write stories about the output of that method. They want to write about which schools are most in danger of going bankrupt. But focusing on the output misses the point of the book. Rather, the authors’ goal is to provide academics with new analytic tools which, when coupled with a growth mindset in a functional shared governance process, will enable institutional communities to steer clear of rocky shoals and chart a course toward safer waters.

    I have offered Susan space here on e-Literate to frame the conversation she would like to encourage us to have. She has so far said that she will write two posts, the first of which will go live later this week. If we are lucky, she won’t stop there.

    Guided pathways

    The second “happening” I want to talk about is not new but rather a reminder: On Thursday, February 20th at 2 PM, I’ll be hosting the e-Literate Standard of Proof webinar, Competency-based Credentials for Educational Professionals: LX Pathways from iDesign. I had the pleasure of attending the IMS’s summit on digital credentials last week, which put this webinar in a new perspective for me. What are digital credentials, anyway? What’s the point? What are badges, how do they tie into guided pathways, and how do those, in turn, connect with a growth mindset or the future of work?

    One of my realizations of the week is that these things are all tied together. A badge is just a way of signifying that something that you did has some value to somebody. A digital badge is designed to do this in a way that hopefully makes it possible for people (and machines) to see some evidence that connects the thing you did to the value being assigned. And it’s a small step, which is the point. If you are trying to move somebody from a fixed mindset to a growth mindset, you want them to have the experience of feeling that something they did counts. And you want them to have that feeling often because it is addictive. Achievement is addictive. We get a little rush of dopamine. My Apple Watch told me today that I am on a “streak” for my standing and moving goals. It also gave me a badge for my “longest move streak.” We sometimes call that strategy of frequent reward through recognition “gamification.” When the person internalizes their ability to earn those little rewards, that represents movement toward a growth mindset.

    At some point under the right circumstances, those rewards can add up to something. The participant can “level up.” In modern academic parlance, this is called a “guided pathway.” It both cultivates a growth mindset and channels that impulse toward the participant’s real-world goals rather than just satisfying the immediate need for a sense of accomplishment. And micro-credentials, like turns in a game that can be saved and returned to later, are durable. Part-time learners who are squeezing their further education in around the rest of their lives typically need to “save the game” and come back to it often. They need an easy way to save their place and pick up where they left off, but also to choose a different path forward from there depending on how they have changed since the last time they were engaged in the coursework. Maybe they thought they wanted to be an instructional designer but since learned that they have an affinity for—and maybe a job opportunity as—a learning architect. The badges they earned that are relevant toward both paths should help them evaluate and accelerate their progress on their revised path.

    One of the aspects that I like about iDesign’s LX Pathways competency-based program is that it has all of these features. Learners work toward one of several certificates of 21st-Century academic work skills, like instructional technologist or learning architect. They do it one competency at a time. Competencies that apply to multiple credentials give learners the flexibility to make different choices at a fairly granular level. This is a model that we need to think about providing for academic workers if we want to support the future of academic work. This, in turn, is something we need to think about if we want our academic institutions to continue serving society well in the next millennium.

    Register here.

    More to come

    These are not the first two e-Literate/EEP efforts in the “future of work for academic workers” theme, but they are the first two that I have explicitly labeled as such. I will be developing this theme going forward.

  • SoP Webinar on Instructional Designer Professional Development

    Improvement in post secondary education will require converting teaching from a solo sport to a community based research activity.

    Herb Simon

    For all the talk lately of the “future of work,” we don’t talk enough about the future of work for educators. We have a growing shortage of well-trained instructional designers, course architects, accessibility experts, learning engineers, and similar specialists. This gap is only going to grow as improving student outcomes becomes increasingly critical to sustainability for colleges.

    That’s one reason why I’m pleased to announce an e-Literate Standard of Proof webinar on iDesign’s LX Pathways program, a new competency-based digital curriculum for professionals looking to develop these skills. iDesign created them, in part, to help with their own employee recruitment challenges as the company grows. This is a great resource for the sector, which was developed by iDesign, made available free or cheap—depending on which option you take and how far you go with it—to anyone, and tested with Harvard School of Education graduate students.

    Come hear iDesign Chief Learning Officer Whitney Kilgore and Patrice Torcivia Prusko, the Associate Director of Learning Design at the Harvard University Graduate School of Education Teaching and Learning Lab talk with me about LX Pathways.

    The webinar is on Thursday, February 20th, at 2 PM ET.

    Sign up here!

  • D2L Steps Up for EEP

    I’m delighted to announce that D2L has become the Empirical Educator Project’s first official Foundational Sponsor. The major principle behind sponsorship in EEP has always been that we only accept sponsors who have something to contribute in addition to money. The same is true for Foundational Sponsors. D2L is offering more to the academic participants in the Empirical Educator Project than just money and free resources. They have both demonstrated through participation to-date that they are good participants and offered enough value in future participation to earn pride of place. Their behavior is a model for other commercial participants in the educational community to emulate.

    To begin with, D2L VP of Market Research Kenneth Chapman, who I’ve known almost as long as I’ve been in EdTech, has been incredibly supportive of our work to-date. He arranged an integration demo to support Carnegie Mellon University’s OpenSimon announcement at our last summit. He’s sent staff to CMU’s LearnLab summer school as a follow-up. He’s made his people available for our work and has consistently and actively looked for ways to collaborate. Ken’s leadership and enthusiasm convinced me that I wanted to deepen the relationship between D2L and EEP.

    In terms of what D2L is offering as a Foundational Sponsor going forward, as I wrote earlier in this post, there’s the money (and contributions of financial value) and the participation. Let’s address the material part of the contribution first. D2L has committed to sponsoring EEP for the next three years. They have also offered up Brightspace as the EEP online community space for that period of time. This second part is going to be increasingly important as EEP work starts to become year-round and as we prepare to open up at least some of that work—both sharing and participation—to the general public. And D2L has offered up the help of its support team, including superstar Ben Campbell, to help us get the site set up and to teach us how to take maximum advantage of the affordances of the platform.

    By themselves, as generous as those offers are, they wouldn’t be enough to earn D2L a place as an EEP Foundational Sponsor. What sealed the deal was D2L’s interest in increased participation. I can’t share details yet, but at a high level, there are two aspects. First, they are actively interested in offering up Brightspace as a laboratory for experimentation. One natural place where that collaboration may go, as mentioned in D2L’s press release, is integration with Carnegie Mellon University’s OpenSimon software. As I mentioned further up in the post, there has already been a little work done in this regard, and there is plenty more to explore.

    At least as important is D2L’s offer to help bring the work and contributions of the EEP participants to the Brightspace user community. I’m really, really excited about the direction that this part of the conversation is taking and can’t wait to share more details as we nail them down.

    After EEP’s summit this spring, Bart Epstein, the CEO of the Jefferson Education Exchange and a passionate advocate for the kind of efficacy work that EEP is attempting to promote, offered up a note of reasonable skepticism in EdSurge’s coverage of the event and the contributions announced at it:

    When Tesla says that it’s making its battery patents available for free, you can be sure that all of the other car companies have incentives to invest time in reading and understanding those battery patents to read them and see if they can use them,” he said. “But when CMU opens up this software, it’s unclear who is out there that is saying, ‘Oh, there’s something in there that I want.’ We just don’t know how much impact it will have.

    Bart Epstein

    Nowhere is this concern more valid than in higher education. There are probably billions of dollars’ worth of intellectual property contributions that, practically speaking, are languishing on university servers where nobody knows that they exist, what they are good for, or how to use them. If we want to bridge this divide specifically in terms of new knowledge that could actually help students succeed in the real world, then we have to go beyond publishing papers and releasing open source software and OER (as important as those activities are). We have to develop an ecosystem and a culture for the diffusion and uptake of this knowledge.

    I invited D2L to be EEP’s first official Foundational Sponsor because their participation and other contributions will support our work in achieving this ambition.

    Stay tuned for more information as this collaboration continues to evolve.

  • Our First Standard of Proof Webinar, on Beating Summer Melt

    Our First Standard of Proof Webinar, on Beating Summer Melt

    I am just thrilled to post the archive of our inaugural Standard of Proof webinar:

    Summer Melt Standard of Proof webinar
    https://youtu.be/7NoYUa_VHfs

    It is a near-perfect encapsulation of everything that the Empirical Educator Project aspires to promote and foster: front-line educators, academic researchers, and commercial vendors working together to measurably increase student success and to do so in a way that is both persuasive in terms of the rigor of evidence and repeatable by other institutions.

    As a reminder, Standard of Proof highlights academic collaborations by the Empirical Educator Project’s commercial sponsors with academic researchers and academic practitioners. All projects must either contribute new knowledge to the commons or promote the diffusion of established evidence-backed practices.

    In this case, we have a story of a small EdTech start-up—AdmitHub—that has a total of nine randomized controlled trials either completed or in process with academic partner institutions.

    Nine.

    How many of your EdTech vendors have nine randomized controlled trials either done or in the works? How many have one? How many have you even asked this question? (If you want better answers on the first two questions, then try to improve your answer to the last one.)

    They were able to do this, in part, because institutions like Georgia State University had real leaders, like GSU’s Tim Renick, who refused to accept the proposition that disadvantaged students were already beyond help by the time they got to college. Instead, the GSU folks (and their colleagues at other academic institutions conducting research with AdmitHub) set out to study their own practices and identify areas that they were failing students in ways that could be fixed. Using data, with the help of their vendor and an academic researcher—in this case, University of Pittsburgh Professor and summer melt expert Lindsay Page—GSU demonstrated that we can make education better and more equitable. It is the perfect counter-example to the sad situation I described in my post on what I didn’t see at EDUCAUSE.

    This is the future that we all should be reaching for, folks. And it is reachable, as all three of my guests made clear. The video is well worth an hour of your time. Standard of Proof webinar production values will improve as we learn our craft, but the conversation quality just doesn’t get much better than this.

    We’re actively working on the spring webinar line-up and will have some juicy conversations scheduled by the time you return from your holiday break.

    Watch this space.

  • Summer Melt

    Summer Melt: Read this book

    This post is partly a nudge for you to sign up for the inaugural e-Literate Standard of Proof webinar coming up this Monday at 2 PM and partly a post to tell you why I’m so excited to be kicking off the series with this particular story.

    My macro thesis for a while now has been that colleges and universities are in the early stages of a transformation from having a philosophical commitment to student success toward being operationally excellent at supporting and enabling student success. That proposition has been a little abstract for some. If you want to understand what that looks like in the real world, I can’t think of a better example than Georgia State University (GSU) under Tim Renick’s leadership. And this webinar will tell the story of one of his seminal achievements.

    Summer Melt is the classic example of the kind of problem that is traditionally invisible to universities that think of student success as a philosophical commitment rather than a core operational responsibility. It’s the phenomenon where students graduate high school, apply to college, get admitted, say they’re coming, fully intend to come, and then never show up. It disproportionately hits first-generation students, students of color, and economically disadvantaged students. Why? Because getting from admission to the first day of classes is a lot harder than many of us remember. You have to fill out a FAFSA form, which as Renick put it yesterday in his IMS presentation, is basically a tax return. I don’t know about you, but I didn’t fill out my FAFSA. My dad did. Not every seventeen-year-old is lucky enough to be able to hand off that responsibility. Then there are inoculations, forms to be filled out and signed by relatives with whom you may or may not have contact, places to get to, fees to pay, and so on, and so on. In their eponymous book on the topic, researchers Benjamin Castleman and Lindsay Page tell us,

    In some school districts where as many as 40 percent of college-intending students fail to matriculate, it would be more appropriate to refer to this as a “summer flood.”

    Castleman and Page, Summer Melt: Supporting Low-Income Students Through the Transition to College

    Forty. Percent.

    And some of these problems are very solvable—if you know about them. For example, once the GSU folks realized that immunizations were a problem that was preventing students from getting to the first day of classes, they started parking free immunization trucks outside during times when those soon-to-be students would be visiting campus.

    The trick is knowing. So Tim Renick and his team partnered with an AI chatbot company called AdmitHub. It turns out that their CEO, Drew Magliozzi, had read the summer melt book too. And he thought his tool could do something about it. GSU brought in AdmitHub to try it out. But they also brought in Lindsay Page to conduct a randomized controlled trial. It’s one thing to say that you think your intervention improved a problem. It’s quite another to gather credible evidence.

    And that’s what they did. According to GSU’s web page on the topic,

    To help these students, the university identified the common obstacles to enrollment that students face between graduating high school and the start of college, including financial aid applications and documents, immunization records, placement exams and class registration, among others. Georgia State developed an approach that would help at-risk students through these obstacles by instituting a combination of a new student portal to guide students through the steps needed to be ready for the first day of classes and an artificial-intelligence-enhanced chatbot, “Pounce,” to answer thousands of questions from incoming students 24/7 via text messages on their smart devices.

    In 2016, during the first summer of implementation, Pounce delivered more than 200,000 answers to questions asked by incoming freshmen, and the university reduced summer melt by 22 percent. This translated into an additional 324 students sitting in their seats for the first day of classes at Georgia State rather than sitting out the college experience.

    GSU, “Reduction of Summer Melt

    The “Standard of Proof” webinar series is designed to tell stories like this one: Universities working with credible vendor partners to learn and share something new and important about supporting students that is a benefit to the entire sector.

    This is a canonical example of that, folks.

    Sign up for the webinar.

    The webinar: Come for the enlightenment. Bring your own food.