product that includes biological and chemical control options. The
Abstract: Extension and Agricultural Experiment Station entomologists and plant pathologists from Montana State University, Colorado State University, University of Wyoming, and University of Nebraska (western districts) are working cooperatively to produce and disseminate high-quality pest management information that includes biological and comprehensive pest management options. This effort has produced The High Plains Integrated Pest Management Guide for Colorado–Western Nebraska–Wyoming–Montana (Guide). Conversion of the print edition, first published in 1998, to an online edition (High Plains IPM Guide 2005) eliminated printing and distribution expenses, incorporated pest illustrations, and made it possible to include a search engine. A users-group helped the Guide’s developers quantify the benefits of a web-based approach to deliver IPM information to a regional audience. Through the users’ group and a web analysis of use, factors affecting use and user satisfaction of the Guide’s design are being used for future modifications.
xtension and Agricultural Experiment Station entomologists and plant pathologists from Montana State University, Colorado State University, University of Wyoming, and University of Nebraska (western districts) have been working cooperatively to produce high-quality pest management information and disseminate this information effectively. This effort led to the production of The High Plains Integrated Pest Management Guide for Colorado–Western Nebraska–Wyoming–Montana (Guide), which provides biology and pest management information on field crop, vegetable crop, range, and livestock pests. The first print edition was released in 1998; the original plan was to send five annual updates to subscribers before considering a new edition. With the proliferation of web-based information provided by universities and their extension services (Jackson 2004), a web-based version was planned beginning in 2000 and launched in 2001. Our goal was to use the expertise of cooperating universities to efficiently package and deliver IPM information to a regional audience via the Web.
The Guide allows Extension and Agricultural Experiment Station pest management experts at universities in four states to coordinate the development and delivery of a comprehensive pest management original publication offered consultants, producers, county extension agents and government agencies a regionally consistent annual publication. Conversion of the print edition to an on-line edition, www.HighPlainsIPM.org, resulted in significant enhancements. The costly printing and distribution of updates were eliminated, and the web format makes it possible to update whenever new information is available. Access to numerous on-line resources through the Guide became available including high-resolution images and a search engine to explore the content of the 650 page-equivalent document.
The Guide currently highlights insects and diseases of field crops, rangeland, vegetable crops, and livestock. The content, format, and structure of the Guide were based initially on pest management strategies taken from individual state recommendation guides. This initial focus was on allowable and safe pesticide use, but we rapidly agreed to provide equal space to other management approaches whenever available. The size of the printed guide (~300 pp) precluded major changes except during major revisions every fifth year; yearly print updates were distributed to subscribers. Conversion to an on-line document provided much greater flexibility to improve the content, format, and structure of the Guide as the need arose.
Following the original print format, chapters are organized into introductory IPM and crop groups. Introductory chapters include discussions of IPM concepts (e.g., IPM principles, economic thresholds, insect and disease sampling), toxicity of pesticides, how to read a label, and safe use of pesticides. For the crop-oriented chapters and related chapters, the format includes a section heading identifying the crop(s), a subheading listing the pest(s), chapter author name, and, if available, a black-and-white reminder graphic or icon of key pest(s). The body of each section contains a general description of the pest, damage, economic thresholds, and sampling guidelines; this is followed by a discussion of available management strategies categorized into host plant resistance and other cultural controls, biological control, and chemical control. The chemical control section lists approved pesticides and rates with the appropriate cautionary statements. A date and a list of terms are included at the end of each chapter, allowing it to be categorized by an on-line search engine.

Example of High Plains IPM Guide Pest article format.
damage, and other signs and symptoms. With the conversion to the Web, images from the Colorado State University Bioagricultural Science and Pest Management Department AgImage database (AgImage 2002) have been linked to the on-line version.
In addition to the search capacity and a keyword index, specific
The change from print to an on-line version involved reformatting chapters into MS Word .doc files and converting them to filtered html files(Fig. 1). The two file types (.doc and .html) are required because neither one meets the practical need for formatted printed hardcopy and the efficiency of delivering electronic information through the Internet. The MS Word .doc files are large files with robust print qualities that are good for printing complex tables.
Filtered MS Word .html files use a tag format to delineate content; they are small and suitable for quick delivery to web browsers. The .html files are easy to index, search, and compare with each other, making it easier for users to search for information in the Guide and for authors to update Guide contents. Updated chapters are quickly entered into the Guide by editing and saving the MS Word .doc file and then using the “Save as filtered .html” option to replace the old .html file. This process facilitates searching capabilities not available in the print version.
The search engine allows users to search the index by entering search word(s) and by checking boxes beside a list of indexed search terms provided by the authors and editor (this option reduces spelling errors and directs a user to primary indexed words).
Another on-line enhancement was to incorporate insect and disease images to help users recognize pests, their crop and general IPM chapter indexes (Fig. 2) were developed that are consistent with a commodity-based organizational structure. These additional indexes make it easier for users to navigate specific chapters by way of several alternatives. Users can view images linked to the chapter, view .html-formatted content on the screen, and print or request hard copy of a .doc file be sent through surface mail services. Certain information delivered on-line, printed, or mailed is appended to all requested files; for example, acknowledgment of the cooperating universities, disclaimers, and information on protecting pollinators.


The home page provides links to the structure of crop and IPM indexes, search options, images, and other resources (Fig. 3) (High Plains IPM Guide 2005).
Our goal in converting to an on-line guide was to use the infrastructure that had created the printed guide efficiently and to enhance it with the advantages of web packaging and delivery. But users’ relationships with the electronic guide, unlike the printed version, can be complicated by the proliferation of web-based information and the ever-shifting focus of advancing technology. Our desire was to build strong relationships between the Guide and users to facilitate the adoption of IPM practices, and we knew that we would benefit from an understanding of web-based user experience and an in-depth analysis of our specific product. Our analysis was intended to quantify use, identify barriers to use, and evaluate whether users attitudes were positive about using the on-line Guide.
To quantify on-line use, we assessed frequencies, uniqueness, and intensity of use with software (WebTrends 2000). A hit is a single action directed at an electronic file. A visitor viewing or downloading a single file is logged as a single hit, providing an indicator of web server traffic. Visit tracking indicates where and when a unique user’s access began and ended, providing a record of what chapters are being viewed. Uniqueness is defined by a user’s Internet protocol (IP) address that has not been previously recorded. The chapter a user spends the most time on is recorded as the destination for a viewing session. When users return, their IP addresses are matched, and return visits are recorded. There was a steady rise in visits by unique visitors between June and September 2002 (Fig 4).
Of 6,512 unique visitors, 5,407
visited once, and 1,105 returned during
a one-year reporting period (January 1
through December 31, 2002). Return visitors returned on average
more than 8 times, and an average visit lasted more than 16 minutes
(Table 1). A 2004 tally indicated that users accessed the Guide throughout
the year and more often (Fig. 5) than was recorded in 2002. In
2004, 75,196 hits were made to the Guide, compared with 33,297
in 2002. From January to December 2004, the number of returning
unique visitors increased from 1,105 to 4,994, and an average visit
increased to more than 17 minutes.
To help authors and web site designers, a users’ group was formed; and they met with principal authors of the Guide in Scottsbluff, NE,

Table 1. High Plains IPM Guide Successful Visit Duration Summary,
| 2002. | |
|---|---|
| Measurement Categories | Frequency |
| Hits at entire site | 33,297 |
| Average hits/day | 91 |
| Visits, total | 15,873 |
| Average visits/day | 43 |
| Average visit length (minutes) | 16:44 |
| Unique visitors who visited once | 5,407 |
| Unique visitors who visited more than once | 1,105 |
| Chapter views | 22,352 |
| Average chapter views/day/visitor | 61 |
Visits: Number of times a visitor came to the Guide. If a visitor is idle longer than the idle-time limit, it is assumed the visit was voluntarily terminated. If the visitor continues to browse after reaching the idle-time limit, a new visit is counted. The default idle-time limit is thirty minutes. Unique visitors who visited once: Number of individual visitors who appear only once in the log file. Unique visitors who visited more than once: Number of individual visitors who appear more than once in the log file. Chapter views: Hits to files designated as chapters. Supporting graphics and other nonarticle files are not counted.
in October 2002. The intent of the meeting was to develop, package, and deliver IPM information that was applicable to IPM professionals in the High Plains region. The users learned about the development, conception, structure, and content of the Guide; provided feedback and suggestions by answering questions about their access and use; and participated in hands-on, on-line training.
User Group Demographics. The users’ group comprised professionals who provide IPM-based recommendations in the four-state region. Of 16 user group members, 7 were from Nebraska, 5 from Colorado, 3 from Wyoming, and 1 from Montana. Five respondents described themselves as having agricultural business careers; four were extension agents; four were certified crop advisers; one was a producer; and one was employed in research.
Barriers to Use. To determine whether there were significant barriers to using the Guide, we created a questionnaire to gather information about the group’s on-line experience.
Most (11) of the users had not visited the Guide before the meeting; 3 had visited the site more than once, but fewer than 10 times. Only one user had visited the site more than 10 times, but fewer than 24 times. None of the users had visited the site more than 25 times. Four users used hardware to transfer data from the web at 56,000 bytes/s; four used hardware that operated faster than 56,000 bytes/s; and three did not know the speed at which their hardware operated. Three users used the MS Explorer Web browser to view and print MS Word html files, six users responded that they downloaded MS Word .doc for local printing. Fourteen users preferred contacting the author by e-mail, 1 preferred the phone, and 7 indicated that they used phone and e-mail.
The Guide’s site provided a method to receive a hard copy of selected chapters. Entering a mailing address into the web site allows the mail room of the Montana State University Extension to send a hard copy of selected chapters to the requester or a third party. No one had used the postal service option at the time of training, but some expected to use the feature later.
The answers to the questionnaire suggested that for the group, familiarity with web offerings was the highest ranked barrier, followed by lack of hardware, and lack of software, high telephone charges with service provider charges ranked as the least important barrier to navigating the Guide (Table 2). Users’ estimates of their related monthly telephone expenses averaged $24.50, and ranged from $21 to $40 per month. The average Internet charge was $25.60 and ranged from $7 to $60.
The questionnaire also gathered users’ feedback and suggestions for improvements. They fell into one of the following categories: technical changes to increase the value of existing content, improvements in accessibility, and suggestions for additional content. The users ranked pest life cycles as having the most value, followed by chemical controls, economic thresholds, distinguishing damage symptoms, infestation patterns, conditions favoring susceptibility, crop susceptibility, cultural controls, and scouting frequency (Table 3). These nine factors ranked 5.1 or greater, suggesting that they are all valuable to the users.

Whereas tallies quantify traffic to the Guide, and user group feedback identifies barriers to this traffic, research suggests that users who are comfortable navigating a site and feel satisfied with the time spent there will continue to visit and use it (Chen and Wells 1999). To qualify web site users’ comfort in navigating the Guide, we used scales adapted from methods of studying mass media advertising (Chen and Wells 1999, Chen et al. 2002) to measure attitudes. Before the users were trained how to use the Guide, they were asked to find information in different guide indexes (Topic/Keyword index and Crop index) and describe their experience, using two “Attitude Toward Site” (ATS) scales—Attitude (relationship, visit in future, satisfaction, comfortable, well spent time, rating) and Dimensional (entertainment, informative, and organizational). Then the participants were provided with introductory hands-on training and examples of the Guide’s technical features. After the training, the ATS scales were used again to measure the user group’s attitude toward the Guide. The scales offer the users a range of descriptive terms describing good or bad websites with which to describe their
Table 2. High Plains IPM Guide Users’ Group Ranking of Barriers Affecting Web Guide Access.
| Factors Affecting Access, listed in descending | Average Ranking |
| order | (no. of responses) |
| 1. Familiarity with the Web | 3.6 (13) |
| 2. Lack of Computer hardware | 2.6 (11) |
| 3. Lack of Computer software | 1.8 (10) |
| 4. High telephone charges | 1.1 (11) |
| 5. Monthly internet service | 1.0 (4) |
| provider charges |
Scale: 0 = No effect to 5 = Strongest effect
comfort navigating the format and organization of the Guide (Chen and Wells 1999, Chen et al. 2002). The descriptive expressions in the scales were chosen by researchers because they reliably calibrate a user’s attitude (Chen and Wells 1999).
The participants were asked to choose which dimensional terms—entertaining (fun, exciting, cool, imaginative, entertaining, flashy) and informative terms (intelligent, knowledgeable, resourceful, useful, helpful)—best described the Guide. In addition, the users chose from dimensional organizational terms (messy, cumbersome, confusing, or irritating) to gauge whether the Guide leads to a destination with too many links, too many layers, or distracting animations or colors (Chen and Wells 1999, Chen et al. 2002). Combining the pre-and post-training attitude and dimensional measurements provides the authors with another indication of whether the Guide is using the expertise of cooperating universities to efficiently package and deliver IPM information via the Web to a regional audience.
When the pre- and post-training session evaluations were compared, 9.1% in the pre-session ranked their attitude as very comfortable; in the post-session, the number of members who were very comfortable using the site had increased to 32.5% (Table 4).
Pre-session dimensional entertainment responses were less evenly distributed (Very entertaining, 10.6%; Not entertaining, 19.7%) than were post-session responses (Very entertaining, 20.2%; Not entertaining, 23.8%). The Guide had lower rankings for dimensional informative (Very informative, 54.5%; Not informative,
Table 3. High Plains IPM Guide Users’ Group Value Ranking of Guide Contents.
Guide Contents, Average Ranking Ranking in Descending Value (No. of respondents)
Scale: 0 = No value to 8 = High value
Table 4. High Plains IPM Guide Users’ Attitude Evaluation Using Pre- and Post-Training Session Responses to Six Web Site Factors.
| Attitude Factors | Pre-session Average | Post-session Average |
| Ranking | Ranking | |
| (No. of responses) | (No. of responses) |
| Relationship | 2.7 (9) | 3.5 (14) |
|---|---|---|
| Visit in Future | 3.5 (9) | 4.7 (14) |
| Satisfied with Service | 3.4 (9) | 4.0 (14) |
| Comfortable Surfing | 3.0 (9) | 4.2 (14) |
| Well Spent Time | 2.8 (10) | 3.9 (14) |
| Rating | 2.8 (9) | 3.6 (13) |
Scale: 0 = uncomfortable to 5 = very comfortable
0.0%) before the session than after (Very informative, 71.4%; Not informative, 0.0%) and lower scores for dimensional organization before (Very organized, 31.8%; Not organized, 2.2%) than after (Very organized, 52.7%; Not organized 1.8%) (Table 5).
The High Plains IPM Guide allows Extension and Agricultural Experiment Station pest management experts housed at universities in four states to develop and deliver a single pest recommendation product at a regional scale. A main objective of the Guide was to deliver biological information with comprehensive control information to facilitate an IPM approach to pest management. The web publication offers users, including consultants, producers, county
Table 5. High Plains IPM Guide Users’ Attitude Evaluation Using
Pre- And Post-Training Session Responses to Three Groups of
| Web Site Descriptors. | ||
|---|---|---|
| Dimensional Term | Pre-session | Post-session |
| Average Ranking | Average Ranking | |
| (No. of responses) | (No. of responses) | |
| Entertainment | ||
|---|---|---|
| Fun | 2.1 (11) | 2.1 (14) |
| Exciting | 2.1 (11) | 1.9 (14) |
| Cool | 2.0 (11) | 1.8 (14) |
| Imaginative | 1.9 (11) | 1.6 (14) |
| Entertaining | 2.1 (11) | 2.2 (14) |
| Flashy | 2.4 (11) | 2.5 (14) |
| Informative | ||
| Intelligent | 1.5 (11) | 1.3 (14) |
| Knowledgeable | 1.5 (11) | 1.1 (14) |
| Resourceful | 1.4 (11) | 1.4 (14) |
| Useful | 1.5 (11) | 1.2 (14) |
| Helpful | 1.5 (11) | 1.4 (14) |
| Organization | ||
| Messy | 2.5 (11) | 2.5 (13) |
| Cumbersome | 2.0 (11) | 1.7 (14) |
| Confusing | 2.3 (11) | 1.4 (14) |
| Irritating | 2.5 (11) | 1.3 (14) |
Scale: 1 = Very [dimensional term] to 3 = Not at All [dimensional term]
extension agents, and government agencies, a regionally consistent publication that is updated as needed. The content of the Guide is organized by General IPM and then crop chapters. Pest life cycle, chemical controls, and economic threshold content was ranked as most valuable by users.
A tally of web traffic to the Guide suggested large increases in visits as interpreted from hits and visitor statistics from January 2002 to December 2004. Answers to a users’ group questionnaire indicated that familiarity (i.e., concerns with being able to find what was available and obtain useful information) was a greater barrier than what electronic access cost. Users are motivated to overcome barriers to accessing the Guide’s information; not only are more people visiting the site, but they are viewing material longer. We believe the longer visits indicate higher user engagement of the information, and we hope that this will facilitate implementation of IPM practices.
Evaluating the users’ group by using pre-and post-training session Attitude and Dimensional scales showed favorable attitudes toward the Guide, and these attitudes were more favorable after a training session. AST research shows that favorable attitudes increase the likelihood the user will build a relationship and use the product (Chen and Wells 1999, Chen et al. 2002). The favorable attitude and dimensional evaluation and software tallies provided the author’s confidence to further use and develop the on-line version of the Guide. Continuing to incorporate users into the assessment process will assist us in making future modifications to the Guide.
The authors acknowledge the Extension and Agricultural Experiment Stations services in Montana, Wyoming, Colorado, and Nebraska for supporting this project. Additional funding support was provided by Western Region IPM Competitive Grants Program, the Environmental Protection Agency Region 8 discretionary funds, and USDA CSREES.
AgImage. 2002. Colorado State University Bioagricultural Science and Pest Management Department AgImage database (Web Resource as of No
vember 2005: http://www.ext.colostate.edu/staffres/agimage.html). Chen, Q., and W. D. Wells. 1999. Attitude toward the site. J. Advert. Res.
39(5): 27–37. Chen, Q., S. J. Clifford, and W. D. Wells. 2002. Attitude toward the site II:
New Information. J. Advert. Res. 42(2): 33–45. High Plains IPM Guide. 2005. Montana State University, Integrated Pest
Management Program (Web Resource as of November 2005: http://
highplainsipm.org/). Jackson, S. W., G. M. Hopper, and W. K. Clatterbuck. 2004. Developing
a national web-based learning center for natural resource education. J.
Extens. 42(1).
Webtrends. 2001. WebTrends Log Analyzer v6.5, Web Trends Corporation; www.webtrends.com.
WilliamT. Lanier is an extension public education specialist and insect diagnostician for the IPM program at Montana State University. Michael J. Brewer is integrated pest management coordinator and associate professor of Entomology at Michigan State University, and formally with the University of Wyoming. He provides leadership for statewide IPM educational activities, focusing on increasing implementation of IPM tactics in cropping systems. His research interests are in effects of crop habitat manipulation on pests and their enemies. Frank B. Peairs is a professor of entomology in the Department of Bioagricultural Sciences and Pest Management at Colorado State University. He has extension, research, and teaching responsibilities in arthropod pests of Colorado field crops. Gary L. Hein is a professor of entomology at the University of Nebraska, Panhandle Research and Extension Centers. He provides extension entomology programming for management of insect pests in numerous field crops grown in western Nebraska. Howard F. Schwartz is a professor of plant pathology in the Department of Bioagricultural Sciences and Pest Management at Colorado State University. John B. Campbell is a professor of entomology with the West Central Research and Extension Center for the University of Nebraska. He provides extension programming for field crop insects in central Nebraska and statewide for livestock insects. Sue Blodgett is an associate professor and IPM coordinator in the Animal and Range Science Department at Montana State University. She provides leadership for statewide strategic planning program development and evaluation.