e-Literate

Present is Prologue

Category: LMS & Learning Platforms

Everything you want to know about Learning Management Systems and whatever comes after them.


  • California Community College OEI Selects LMS Vendor

    The Online Education Initiative (OEI) for California’s Community College System has just announced its vendor selection for a Common Course Management System (CCMS) ((Note that this is an Intent to Award, not yet a contract.)). For various reasons I cannot provide any commentary on this process, so I would prefer to simply direct people to the OEI blog site. Update: To answer some questions, the reason I cannot comment is that CCC is a MindWires client, and I facilitated the meetings. Based on this relationship we have a non-disclosure agreement with OEI.

    Here is the full announcement.

    The California Community Colleges (CCC) Online Education Initiative (OEI) announced its intent to award Instructure Inc. the contract to provide an online course management system and related services to community colleges statewide.

    Support for Instructure’s Canvas system was nearly unanimous among the OEI’s Common Course Management System (CCMS) Committee members, with overwhelming support from student participants, officials said. Canvas is a course management platform that is currently being used by more than 1,000 colleges, universities and school districts across the country.

    “Both the students and faculty members involved believed that students would be most successful using the Canvas system,” said OEI Statewide Program Director Steve Klein. “The student success element was a consistent focus throughout.”

    The announcement includes some information on the process as well. (more…)

  • Flat World and CBE: Self-paced does not imply isolation

    As competency-based education (CBE) becomes more and more important to US higher education, it would be worth exploring the learning platforms in use. While there are cases of institutions using their traditional LMS to support a CBE program, there is a new market developing specifically around learning platforms that are designed specifically for self-paced, fully-online, competency-framework based approaches.

    Several weeks ago Flat World announced their latest round of funding, raising $5 million of debt financing, raising their total to $40.7 million. The company started out by offering full e-textbooks (and was previously named FlatWorld Knowledge), developing 110 titles that included 25 of the 50 most-used lecture courses. The e-textbook market was not working out, however, and the company pivoted to competency-based education around the time that Chris Etesse became CEO two years ago. Now the company is developing a combined CBE learning platform with integrated course content – much of it repurposing the pre-existing e-textbook materials. Their first academic partner for CBE is Brandman University, a non-traditional part of the Chapman University system and is currently one of the CBEN network.

    One central tenet of the Flat World approach is based on their history and pivot – a tight integration of content and platform. As Etesse describes it, content is a 1st-class citizen in their system whereas other loosely-coupled approaches that do not tie content and platform together can be difficult to navigate and collect learning analytics. In other words, this intentionally is a walled-garden approach. For Brandman, approximately 70% of the content comes from the pre-existing FlatWorld texts, 25% comes from various OER sources, and about 5% has been custom-designed for Brandman.

    In other words, this is very much a walled garden by design. While there is support for outside content, I believe this integration must be done by Flat World designers.

    As was the case for the description of the Helix CBE-based learning platform, my interest here is not merely to review one company’s products, but rather to illustrate aspects of the growing CBE movement using the demo. (more…)

  • Instructure Releases 4th Security Audit, With a Crowd-sourcing Twist

    In the fall of 2011 I made the following argument:

    We need more transparency in the LMS market, and clients should have access to objective measurements of the security of a solution. To paraphrase Michael Feldstein’s suggestions from a 2009 post:

    • There is no guarantee that any LMS is more secure just because they say they are more secure
    • Customers should ask for, and LMS vendors should supply, detailed information on how the vendor or open source community has handled security issues in practice
    • LMS providers should make public a summary of vulnerabilities, including resolution time

    I would add to this call for transparency that LMS vendors and open source communities should share information from their third-party security audits and tests.  All of the vendors that I talked to have some form of third-party penetration testing and security audits; however, how does this help the customer unless this information is transparent and available?  Of course this transparency should not include details that would advertise vulnerabilities to hackers, but there should be some manner to be open and transparent on what the audits are saying. [new emphasis added]

    Inspired by fall events and this call for transparency, Instructure (maker of the Canvas LMS) decided to hold an public security audit using a white hat testing company, where A) the results of the testing would be shared publicly, and B) I would act as an independent observer to document the process. The results of this testing are described in two posts at e-Literate and by a post at Instructure.

    Instructure has kept up the process, this year with a crowd-sourcing twist: (more…)

  • The Quotable Justin Reich: MOOC research needs to reboot

    Thanks to Audrey Watters I just read a new article in Science Magazine and publicly posted here by Justin Reich, the lead researcher for HarvardX (Harvard’s implementation of edX and associated research team) ((Note that Science Magazine access requires a subscription or purchase or individual article.)). Justin calls out the limitations of current MOOC research that focuses on A/B testing and engagement instead of learning, single-course context, and post hoc analysis with proper course design. While praising the field for making available cleansed data for any type of analysis, his core argument is that we need new approaches that cannot be solved just by research teams.
    Update: Added link to publicly-available DOCX article.

    While the whole article is worth reading, there are quite a few insightful quotes should get past the journal paywall.

    • Big data sets do not, by virtue of their size, inherently possess answers to interesting questions.
    • We have terabytes of data about what students clicked and very little understanding of what changed in their heads.
    • It does not require trillions of event logs to demonstrate that effort is correlated with achievement.

    (more…)

  • Helix Education puts their competency-based LMS up for sale

    Back in September I wrote about the Helix LMS providing an excellent view into competency-based education and how learning platforms would need to be designed differently for this mode. The traditional LMS – based on a traditional model using grades, seat time and synchronous cohort of students – is not easily adapted to serve CBE needs such as the following:

    1. Explicit learning outcomes with respect to the required skills and concomitant proficiency (standards for assessment)
    2. A flexible time frame to master these skills
    3. A variety of instructional activities to facilitate learning
    4. Criterion-referenced testing of the required outcomes
    5. Certification based on demonstrated learning outcomes
    6. Adaptable programs to ensure optimum learner guidance

    In a surprise move, Helix Education is putting the LMS up for sale.  (more…)

  • Blackboard’s SVP of Product Development Gary Lang Resigns

    Gary Lang, Blackboard’s senior vice president in charge of product development and cloud operations, has announced his resignation and plans to join Amazon. Gary took the job with Blackboard in June 2013 and, along with CEO Jay Bhatt and SVP of Product Management Mark Strassman, formed the core management team that had worked together previously at AutoDesk. Gary led the reorganization effort to bring all product development under one organization, a core component of Blackboard’s recent strategy.

    Michael described Blackboard’s new product moves toward cloud computing and an entirely new user experience (UX) for the Learn LMS, and Gary was the executive in charge of these efforts. These significant changes have yet to fully roll out to customers (public cloud in pilot, new UX about to enter pilot). Gary was also added to the IMS Global board of directors in July 2014 – I would expect this role to change as well given the move to Amazon. (more…)

  • Vendors as Traditional Revolutionaries

    In a post titled “The LMS for Traditional Revolutionaries,” Instructure’s VP of Research and Education for Canvas Jared Stein responded to my LMS rant with some numbers and some thoughts about the role of the vendor in encouraging progressive teaching practices. First, the numbers on the use of open education features in Canvas:

    • 3.8% of courses are “public”; you don’t need a login to see them.
    • 0.6% of courses are Creative Commons-licensed.
    • 4.0% of assignments are URL submissions (suggesting that students are completing their assignments on their blogs or elsewhere on the open web).

    On the one hand, as Jared acknowledges, these percentages are very low. On the other hand, as he points out, 4% of assignments is close to 250,000 assignments, which is non-trivial as an absolute number. And all of this raises the question: What is the role of the vendor in promoting progressive educational practices?

    Let’s take the best-case scenario. Suppose you’re a good person and a thoughtful educator who happens to work for a vendor at the moment. (For those of you who don’t know him, Jared enjoys just such a reputation, having spent a number of years as an excellent academic ed tech blogger and practitioner before joining Instructure.) What can you do? What is your role? On the one hand, you will get criticized by educators who want more and faster change for being too conventional. I certainly have leveled that sort of criticism at vendors before. And maybe those criticisms will sting particularly hard if you were one of those educators yourself before you joined the company (and maybe still are, in your heart of hearts). On the other hand, you are likely to be criticized as arrogant, high-handed, and unwilling to listen to your customers if you put yourself in the position of lecturing to educators (or, at worst, bullying them) about what you, as a vendor, define as best teaching practices. I certainly have leveled this sort of criticism as well.

    So what’s a vendor to do? Jared writes,

    These [open education features] are just a few examples of capabilities in Canvas that we believe add flexibility and encourage different approaches to teaching and learning. I recognize that sharing this data is a little risky; some may use it to argue that Canvas shouldn’t worry so much about the small percentage of educators who may take advantage of these fringe capabilities. After all, won’t teachers who are actually invested in open educational practices just eschew the LMS for their own platforms anyway?

    Focusing only on “users like us” and ignoring the others may work in the short-term, but for long-term success you have to build bridges, not walls.

    To help education improve itself for all teachers and learners we have to try to connect with those teachers who aren’t comfortable with radical shifts in pedagogy or technology. We believe that the best way to encourage positive change in educational practices across the broad landscape of content areas, learning objectives, and teaching philosophies is by providing tools that are easy-to-use, flexible, and comfortable to the majority of teachers and learners. The door to change must be open and the doorkeeper must be deposed.

    Some of the ways we do this is by having an open community, engaging with people who disagree with us, and investing in the open platform aspect of Canvas. We need both traditionalists, critical pedagogues, progressive researchers, and open educators to contribute to Canvas.That doesn’t have to be done through pull requests or by building LTI apps or integrations, though that’s a brilliant way to build solutions that are right for your context. But by dialoging what works in teaching and learning and what doesn’t. By debating what technology is best for, and when it leads us away from our shared goals of teaching and learning better in an open and connected world.

    Shorter Jared: We put capabilities to support progressive practices in our product in the hopes that our users will discover, adopt, and promote them, but it’s not our place to push our preferred educational practices on our customers.

    In many cases—particularly with a platform that serves a large and heterogeneous swath of the campus community—that’s the best attitude you can get from your vendor. That’s the most they can do without rightly pissing off (more) people.

    All of which brings me back to a single point: If you want better educational technology, then work to make sure that your colleagues in your campus community are asking for the things that you think would make educational technology better. If 40% rather than 4% of assignments created by your colleagues were on the open web, then learning platforms like LMSs would look and work differently. I guarantee it. Likewise, as long as most educators tend to use the technology to reproduce existing classroom practices, LMSs will look the same. I guarantee that too. And that’s not a vendor thing. That’s a software development thing. Community-developed open source learning platforms generally haven’t broken the mold, and the few that have tend to be the ones that you probably have never heard of because they don’t get adopted. They build what their community members ask for and what they think will attract other community members. So if you want better tech, then the best thing you can do to get it is to create demand for it among your colleagues.