e-Literate

Present is Prologue

Tag: MITx

  • Miami, Harvard and MIT: Disability discrimination lawsuits focused on schools as content providers

    In the discussions at Google+ based on last week’s post about the Miami University of Ohio disability discrimination lawsuit ((Insert joke here about G+ and its hundreds of active users.)), George Station made two important points that deserve more visibility.

    It’s been a-coming for several years now. Cal State has some pretty strong rules in place for compliance with ADA and state-level disability laws. Still, [Universal Design for Learning] UDL is a little-known acronym on any campus you care to visit, and staff support is probably one person in an office, except for Miami of Ohio as of this week, I guess…

    Add the recent edX settlement with the US Department of Justice, and the whole direction of edtech changes…

    Put another way, it should come as no surprise that the US Department of Justice is ramping up its enforcement of disability discrimination regulations in the education world. Captioning service provider CaptionSync has an excellent summary of the field, written before the DOJ intervention at Miami. (more…)

  • The Quotable Justin Reich: MOOC research needs to reboot

    Thanks to Audrey Watters I just read a new article in Science Magazine and publicly posted here by Justin Reich, the lead researcher for HarvardX (Harvard’s implementation of edX and associated research team) ((Note that Science Magazine access requires a subscription or purchase or individual article.)). Justin calls out the limitations of current MOOC research that focuses on A/B testing and engagement instead of learning, single-course context, and post hoc analysis with proper course design. While praising the field for making available cleansed data for any type of analysis, his core argument is that we need new approaches that cannot be solved just by research teams.
    Update: Added link to publicly-available DOCX article.

    While the whole article is worth reading, there are quite a few insightful quotes should get past the journal paywall.

    • Big data sets do not, by virtue of their size, inherently possess answers to interesting questions.
    • We have terabytes of data about what students clicked and very little understanding of what changed in their heads.
    • It does not require trillions of event logs to demonstrate that effort is correlated with achievement.

    (more…)

  • Learner-Centered Analytics: Example from UW La Crosse MOOC research

    Last week I wrote a post What Harvard and MIT could learn from the University of Phoenix about analytics. As a recap, my argument was:

    Beyond data aggregated over the entire course, the Harvard and MIT edX data provides no insight into learner patterns of behavior over time. Did the discussion forum posts increase or decrease over time, did video access change over time, etc? We don’t know. There is some insight we could obtain by looking at the last transaction event and number of chapters accessed, but the insight would be limited. But learner patterns of behavior can provide real insights, and it is here where the University of Phoenix (UoP) could teach Harvard and MIT some lessons on analytics.

    Beyond the University of Phoenix, there other examples of learner-centered analytics exploring usage patterns over time. While I was at a summit at the University of Wisconsin at La Crosse last week, Bob Hoar showed me some early results of their “UW-System College Readiness Math MOOC” research that is part of the MOOC Research Initiative. I interviewed Bob Hoar and Natalie Solverson as part of e-Literate TV, where they described their research project:

    The results to date focus on capturing and visualizing the student patterns, and progress can be tracked at this project site (go to the site to see interactive graphics). (more…)

  • No, I don’t believe that Harvard or MIT are hiding edX data

    Since my Sunday post What Harvard and MIT could learn from the University of Phoenix about analytics, there have been a few comments with a common theme about Harvard and MIT perhaps withholding any learner-centered analytics data. As a recap, my argument was:

    Beyond data aggregated over the entire course, the Harvard and MIT edX data provides no insight into learner patterns of behavior over time. Did the discussion forum posts increase or decrease over time, did video access change over time, etc? We don’t know. There is some insight we could obtain by looking at the last transaction event and number of chapters accessed, but the insight would be limited. But learner patterns of behavior can provide real insights, and it is here where the University of Phoenix (UoP) could teach Harvard and MIT some lessons on analytics.

    Some of the comments that are worth addressing:

    “Non-aggregated microdata (or a “person-click” dataset, see http://blogs.edweek.org/edweek/edtechresearcher/2013/06/the_person-click_dataset.html ) are much harder (impossible?) to de-identify. So you are being unfair in comparing this public release of data with internal data analytic efforts.”

    “Agreed. The part I don’t understand is how they still don’t realize how useless this all is. Unless they are collecting better data, but just not sharing it openly, hogging it to themselves until it ‘looks good enough for marketing’ or something.”

    “The edX initiative likely has event-level data to analyze. I don’t blame them for not wanting to share that with the world for free though. That would be a very valuable dataset.”

    The common theme seems to be that there must be learner-centered data over time, but Harvard and MIT chose not to release this data either due to privacy or selfish reasons. This is a valid question to raise, but I see no evidence to back up these suppositions.

    (more…)

  • What Harvard and MIT could learn from the University of Phoenix about analytics

    Last week Harvard and MIT released de-identified data from their edX-based MOOCs. Rather than just produce a summary report, the intent of this release was to open up the data and share it publicly. While it is good to see this approach to Open Data, unfortunately the data set is of limited value, and it actually illustrates a key problem with analytics in higher ed. From MIT News description:

    A research team from Harvard University and MIT has released its third and final promised deliverable — the de-identified learning data — relating to an initial study of online learning based on each institution’s first-year courses on the edX platform.

    Specifically, the dataset contains the original learning data from the 16 HarvardX and MITx courses offered in 2012-13 that formed the basis of the first HarvardX and MITx working papers (released in January) and underpin a suite of powerful open-source interactive visualization tools (released in February).

    At first I was eager to explore the data, but I am not sure how much useful insight is possible due to how the data was collected. The data is structured with one student per row for each course they took (taking multiple courses would lead to multiple rows of data). The data columns (pulled from the Person Course Documentation file) are shown below:

    (more…)

  • Two MOOC curriculum announcements in one week

    In two apparently unrelated announcements, both MIT and Wharton announced they were moving beyond just courses and putting significant parts of their curriculum into MOOC platforms, both with identity verification. MIT is putting several undergraduate sequences online through MITx (their implementation of  edX), while Wharton business school is putting a “foundation series” of first-year courses online through Coursera.

    First the MIT news from Inside Higher Ed (see the Chronicle for additional coverage):

    The Massachusetts Institute of Technology will this fall package some of its online courses into more cohesive sequences, just as edX prepares to roll out certificates of completion using identity verification. Seen together, the two announcements may provide a glimpse at what the future holds for the massive open online course provider.

    The “XSeries” sequences add a new layer of structure to MITx, the institution’s section of the edX platform. The first of seven courses in the Foundations of Computer Science XSeries will be offered this fall, with one or more new courses being rolled out each semester until the fall of 2015. The Supply Chain Management XSeries, consisting of three courses, will begin in the fall of 2014. The two sequences will target undergraduates and working professionals, respectively. [snip]

    (more…)

  • Four Barriers That MOOCs Must Overcome To Build a Sustainable Model

    Given the hype of national media coverage of massive open online courses (MOOCs), it is refreshing to see more recent analysis looking at important attributes such as revenue models, dropout rates, and instructional design. Steve Kolowich at Inside Higher Ed wrote a revealing and important article looking at early demographic data. Jeff Young at the Chronicle wrote an excellent article about Coursera’s contract with the University of Michigan, along with key insights into Coursera’s and the university’s motivations. Audrey Watters, in response to an article in the Atlantic, asks the tough question of whether we should care about the high dropout rates of current courses offered in this new model.

    When analyzing the disruption potential of MOOCs, it is easy to forget that the actual concept is just 4 or 5 years old. Furthermore, the actual definition of the concept has undergone a significant change in the past 12 months as an entirely new branch has emerged.

    While the current examples of massive online courses are interesting, the real potential of MOOCs will be revealed in future generations. (more…)