Example Tasks

Before you begin

Tell subjects what Xwais is. i.e., that it is (at least in this case) a database search and retrieval system that lets you search for articles contained by various citation databases. Tell them that it lets you select databases, enter search terms, and save search requests. Don't tell them any more than that.

Don't forget to administer the questionnaire!

Initial conceptual model

Note: the reason you are doing this is to see what initial conceptual model people have of the system, based upon their prior experiences and their interpretation of the visuals on the screen. You are looking for places where the model is incorrect.

Ask subjects to type Xwais.

Have them explain what things mean on the introductory window.

Now have them read the help screen.

Ask them if they can now explain things that they couldn't before.

Ask the same questions for every new dialogue screen they see.

Task 1. Finding a reference and related articles in the HCI bibliography.

Note. To do this task, people will have to get beyond the first screen, determine how to enter and submit search term(s), how to read the results, and how to bring up details on particular results.

• Find out if the CSCWbibliography has an article by Saul Greenberg on the topic of GroupKit which is a groupware toolkit.
• If it does, is there an abstract available? Also, find out where it was published.

Task 2. Using other bibliographies and searching for related topics.

Note. XWais provides an option that automatically finds articles related to the selected article. Did the subject use this? Or did they submit their own new search terms?

Xwais also ranks articles. Did the subject consider the article ranking, or just read them to see which fits the best?

• Find out if there are other articles in the CSCW bibliography that are on similar topics.
• Of these, suggest two other articles that are worth reading.

Task 3. Saving questions.

Note: Xwais lets people save searches as "questions." Can subjects do this easily?

Save this search so you can reuse it later.

Other tasks you should develop.

• Find information about an author in several databases at a time.
• Create a search using several terms. (Does Boolean search apply here?)
• Look for things that don't exist (ie, any articles by Zlotrinsky)
• put your own here!

The developing conceptual model

When complete, repeat the exercise the subject did at the beginning i.e., have them explain what each interface component does in each window. Has their conceptual model changed through their experiential learning? Is their model correct?