Figure 4. Evaluation of Software (Class Outline)

TH 423 -EVALUATING COMMERCIAL SOFTWARE

Ideas for on-line journal stack

ITEM OVERVIEW:

    - Name of program
    - Author
    - Publisher
    - Hardware requirements
    - Support phone number
    - Publication Date
    - Audience
    - Objectives
    - Published Reviews
    - Overall rating

USER INTERFACE:

    - Visual Style, such as:
    - fonts (readily available, legible)
    - integrated modalities (sound, graphics, speech, etc.)
    - consistent interface from card to card (intuitive)
    - layout (clutter-factor, icons instead of words, etc.)
    - attractiveness
    - consistent placement of navigation buttons, etc.
    - Navigation
    - Clear indication of where you are and where can go
    - Consistency of buttons and fields (location style)
    - Standard buttons (home, help, next, previous, etc.)
    - Path through material (linear vs. nonlinear)
    - Instructions
    - User friendly?
    - Can you get to it from any card
    - Mode (menu, pop up)
    - Clarity
    - Concision
    - Optional?
    - Sample run
    - Mode of user input (typing, midi keyboard, check box,
    can user take notes on-line? undo?)

GENERAL DISCUSSION -- Content Depends upon Type:

1) Tutorial (content oriented)

Consider the following:

- Content & Sequence (useful information?)
- Are good examples given?
- Is there some student involvement?
- Does it test mastery? Immediate or delayed feedback?
- Does it allow different pacing?

2) Drill and Practice

Consider the following:

    - Content & Sequence
    - Pedagogical Appropriateness
    (does it develop the skills it is supposed to?)
    - Appropriateness of medium
    - Is the activity fun, engaging?
    - Is speed a factor?
    - Feedback
    - immediate or delayed?
    - branching for remediation and advancement?
    - automated record keeping?
    - use of humor, sound, graphics?
    - mastery levels to be attained before advancing?
    - adequate randomization of drill items
    - can student specify subcategories? (e.g., 3rds and 6ths only)

3) Games

Consider the following:

    - Content & Sequence
    - Speed a factor? (Beat the clock, etc.)
    - Number of players (networking)
    - Motivation issues (fantasy elements? something to add fun)
    - Branching: does it get harder as you go?
    - Pedagogical appropriateness: does it exercise useful skills?
    - Feedback: use of humor, sound, graphics?

4) Simulations

Consider the following:

    - What is simulated and how?
    - Why use a simulation, is it appropriate?
    - Content & Sequence
    - Are good examples given?
    - Is there some student involvement?
    - Does it test mastery? Immediate or delayed feedback?

CONTENT:

- more detail

OTHER:

- anything else?