Friday, August 8, 2008 - 9:00 AM

COS 107-4: Can citizen scientists think spatially: Evaluating the publics’ ability to understand and use an online GIS map application for invasive species

Greg Newman1, Linda Stapel2, Don Zimmerman2, Thomas J. Stohlgren3, Alycia Crall4, Jim Graham1, Catherine Jarnevich3, Tracy Holcombe1, and Mohammed A. Kalkhan1. (1) Natural Resource Ecology Laboratory, (2) Center for Research on Communication and Technology, (3) United States Geological Survey, (4) University of Wisconsin-Madison

Background/Question/Methods

Citizen science websites are emerging as a common way of having citizens collect and report ecological field data.  Successfully engaging the public through citizen science is challenging, and, when focused on the complex issues surrounding invasive species, becomes more daunting.  The simple task of mapping invasive plants, for example, could explode into educating those involved about Geographic Information Systems, Global Positioning Systems, species distributions at multiple spatial and temporal scales, taxonomy, physiology, and ecology.  Can these concepts be taught to a diverse public?  Is an understanding of such concepts required to ensure quality data collection, and, if so, what level of understanding must be achieved?  Can a website effectively communicate required information for citizen scientists to accurately map invasive species?  To begin addressing these questions, we built a prototype website for mapping invasive species (CitSci.org).  Our objective was to evaluate the prototype’s usability. Specifically, we sought to identify problems citizen scientists would have in using the website and determine general perceptions.  We had a purposeful sample of citizen scientists (n =16) try our prototype website in individual 90-minute sessions.  For each session, we briefed the participant, had them complete a consent form, gave them $25 in appreciation, and had them sign an honorarium receipt.  Next, we asked each participant to register, find information, and use the map application.  Participants talked aloud and were observed and videotaped.  We noted the time to complete the tasks, successfully or unsuccessfully, and problems they encountered.  Finally, participants completed a perception questionnaire.

Results/Conclusions

Results show that (1) users had difficulty using the map functions, (2) the font size was too small, and (3) overall, users had a positive reaction.  Based on observations, participants had difficulty finding links on the profile page and those without a GIS background found the map features not intuitive.  The tasks took from 20 seconds to 8:21 minutes, and they completed 85% of the tasks successfully.  Per the questionnaire, participants liked the website graphics, colors, pictures, and maps.  However, they noted that the map functions were confusing and not intuitive, the font size was too small, and the ‘help’ feature was difficult to find and was not helpful or easy to understand.  Finally, participants suggested adding links to other invasive species websites, adding contact information, and adding more pictures and descriptions to existing project information.  Given these results, we will redesign the website to reduce usability problems.