home image

The Online Unit Creation Process

  Overview
  Analysing Needs
  Design Issues
       Traditional Instructional Design
       Rapid Instructional Design
  Production Stage
  Deployment Stage
  Evaluation Stage
  Using Web 2.0 Technologies


eLearning 2.0 / Web 2.0 Technologies

  VU Social Networking Site
  The FLU eLearning Blog
  The VU Wiki

  The Learning Technologies Wiki
  The Learning Technologies Blog
  Elgg at Univ. of Brighton (UK)

Cathy Moore's eLearning Blog

Useful Software

  Software Main Page
      

Resources
  Master Resources Page

   
Selected resources
       Writing Learning Outcomes

       Ed Technology Conferences
       (A very large Word doc)
     



Made by FLU



Unit evaluation can involve 4 or more phases:

Criterion-referenced evaluation by the development team

Constructive feedback from 'critical friends'

Useability testing


Feedback from learners

 

The phases of unit evaluation:

Criterion-referenced evaluation

Criterion-referenced evaluation, possibly using appropriate rubrics, may be used by the development team. Rubrics can range from simplistic grids to ponderous tomes of byzantine complexity. Choose or develop one that suits you and is congruent with your learning design.

Here are some sample rubrics:

 

A Rubric for Online Instruction from California State University

 

A rubric for evaluating Social Studies web pages by Joseph A. Braun, Jr of Illinpois State University

 

 

The WebCT/Blackboard Exemplary Course Project

... and the scoring rubric (Word doc) used.

 

 

Peer Review

It may be useful to obtain constructive feedback from 'critical friends'. An informal peer review such as this can help reduce the effects of mental scotoma which might have crept in during the development process.


 

Useability testing

 Useability testing is sometimes performed at this stage. Focus groups of students are given access to the unit prior to roll-out and their attempts to navigate your learning landscape observed. You are generally tied down at this point to avoid giving 'helpful' pointers to the group as to how to find their way around. The effectiveness of the group's learning experience is measured and their subjective feedback is sought.

 

Unless your thought processes during the design stage were in close alignment with those of your intended target learners, be prepared for some humbling revelations. Then be prepared to adjust, correct, or even redo the unit if necessary.

 

Steve Krug, of Advanced Common Sense, is the author of 'Don't Make Me Think' - A common sense approach to web useability.

It is an easy read and it may save you hours of rebuilding online units or web pages if you are exposed to it early enough in the design process.
book cover image

 

 

 

Feedback from learners

Feedback from learners who have completed the unit will give you plenty of raw material to evaluate the effectiveness of your unit. One way to collect data is to embed a survey tool in your online program. Alternatively, you might like to use SurveyMonkey, which can produce comprehensive reports for later analysis. Your School or Department may already have a site licence for this application.

 

Response rates will be higher if you make the survey an integral part of the process - if there are 9 modules in your online unit, call the survey 'Module 10'. If students have managed to get through 9 of your modules, inertia will do the rest.

 

 



 

 

 

**

Other pages in this section
eLearning 2.0
Useful Software


For hungry minds
An Evaluation Rubric
Another Evaluation Rubric
Don't Make Me Think - by Steve Krug

 


 

**

David Cummings
(Head, FLU)

Vyt Karazija
(Instructional Design & Production)

Ant Marsh
(Online Systems Training, Planning & Projects)

Lisa Curran
(Projects & Production)
Top of page

Policies | Disclaimer | Privacy | Contact Us | Print Friendly