home purpose join itg ITG Publication job bank itg listserv hf/Web conferences library

ARTICLE Banner Blindness: Web Searchers Often Miss "Obvious" Links Jan Panero Benway, panero@oxy.edu David M. Lane , lane@rice.edu Rice University Suppose you are designing a web page where one particular link among many is likely to be the most used by visitors. For example, perhaps you have a web page for sending text messages to pagers. "Send a message" is likely to be a very popular link, and it is important that all users notice it. On a travel reservations page, the designer wants to be sure that users notice the link for "make a reservation." Web guidelines usually recommend that to make an important item stand out, it should be near the top, and be large and/or brightly colored. For example, the Ameritech web design guidelines state: "In general, the larger an item is, the greater its perceived visual importance and likelihood of attracting attention. Make sure that items of greatest importance are easy to see, and clearly distinguished from other items. (Detweiler & Omanson, 1996)" Although this seems like perfectly good design advice, we have reason to believe it may not be. In a usability test of a corporate intranet, we were interested in finding out whether the novice users could make their way easily from the main home page to a lower-level page on computer training courses. We gave the users the task of finding information about Internet courses. The training page contained the seemingly highly-salient link shown below. None of the participants in the study had any trouble moving from the home page to the page containing this item, but to our surprise, when they reached the training page almost every participant scrolled past this "Internet Courses" link and selected a small link labeled "courses" from a menu at the bottom of the page. Unfortunately, the information on Internet courses wasn't available there, and the participants were forced to give up on the task. When the facilitator directed them back to the earlier page and showed them banner-style link, most participants showed extreme surprise that they could have missed it. Similarly, Spool, Scanlon, Schroeder, Snyder & DeAngelo (1997) noted that a participant in a usability test overlooked an animated banner containing the information she was looking for. It may be that people searching for specific information on the web tend to ignore large, colorful items that are clearly distinguished from other items on the page. Ironically, they miss the very items the page designers want them to see and that would in fact help them reach their goal. We have dubbed this phenomenon "banner blindness" and have investigated it in two experiments. Experiment 1 The purpose of our first experiment was to verify the occurrence of banner blindness under controlled conditions. We designed a strictly hierarchical web site in the style of a typical personal "home page." The depth of the site was four levels: a top-level home page which gave broad category choices, "category-level" pages which gave narrower category choices, "item-level" pages, which provided links to specific content, and content pages. Each non-content page had a title, a very short paragraph of "comment" text that was irrelevant to the task, and a menu of between three and six text links. The participants were asked to perform 24 short searches for specific facts (e.g., the email address for a hotel). They were told that in some cases, the information would not be available on the site. After each task the participants were to report whether they had found the item, and if so, how difficult the item was to find (on a five-point scale). For most of the searches (the control tasks) the requested information could be found using only the text menus available on each page. For four of the searches (the banner tasks) the participants were required to click on red banners that contained "short cuts" to the goal. Below is an example of a page with a banner link: The banner content was closely linked to the tasks. The page above was used as part of the task "Find the email address for Neemrana Hotels." Because the banner tasks required selecting a banner to accomplish the task and control tasks did not, success on banner tasks relative to control tasks was used to determine whether the users in this study noticed the banners. Six people (three men and three women) volunteered to participate in the study. All were working professionals with substantial web experience. The participants ranged in age from the late 20's to the late 30's. Results The following figure shows that there was substantial banner blindness. The experimental banners were found only about 58% of the time compared to 94% of time for the control items, t(5) = 2.80, p = 0.03. On the tasks where the users did locate the banners, they indicated the search was more difficult than the control tasks, and they spent more time looking for the needed link. The banners used in this experiment seem like they should have been obvious to users: they were large, brightly colored, and stood out from everything else on the page. However, this study shows that they were frequently missed by the users who were specifically looking for the information they contained. Not only did the banners fail to jump out at the users and grab attention, they were frequently ignored. This first study examined only a limited range of salient items, namely red, rectangular banners. There are several possible explanations for why the banners were ignored beyond the fact that the banners were salient. For instance, the banners in this study resembled advertisements, and it is possible that the participants in this study have learned to ignore advertisements when searching for information on the web. A second possibility is that since searchers tend to look for linked text, they focused on small, blue text objects. Perhaps banners that more greatly resembled linked text would be less likely to be ignored. A third possibility is based on perceptual grouping. Although some design guidelines recommend that important items be set apart from other objects, perhaps a better strategy would be to increase the perceptual grouping between the menu of links, which searching users presumably focus on, and the salient banner. Experiment 2 We performed a second experiment to examine these possibilities. A new web site was used, again with a strict four-level hierarchy. The top level provided three choices, the second level had 18 subcategories, the third level had five specific items, and the bottom level contained content. All banners appeared on the second level of the hierarchy. We are using the term "banner" broadly defined to mean anything that is intended to stand out from other items on the page and attract attention. It does not just refer to advertising-style banners. In this experiment, one of the screens the participants saw looked like this: The "banner" in this case is the large text that states "Coaching Youth Basketball in Item C5." The task the participants were asked to complete was to find a book entitled "Coaching Youth Basketball." Therefore, at this point in the task, if the banner "jumps out" at the users, they should immediately look to area C5 of the grid and select the category "Sports." (The users were given experience at locating items in a grid like this one before the experiment began, and so should be familiar with the concept of "Item C5.") Users who do not notice the banner would have to examine many of the 18 possible categories before locating the correct one. Therefore, people who notice and read the banner should be able to select the correct category more quickly than those who do not. Notice that in the web page shown above, the menu (the 18 text links surrounded by the table) is perceptually grouped with the large text banner. The banner and the menu share a common gray background which is intended to make them seem related to one another. We called this condition "menu grouping" and we predicted that the participants would be more likely to see the banners under the menu grouping condition than under the title grouping condition which is shown below. In the page shown above, we have created "title grouping" where the title of the page and the banner share a common gray background color, but the menu is white. In this case we expected that since the banner is perceptually separated from the menu, the banner would be more likely to be ignored. Notice also that on this page, the banner is written in small blue text. It may be that web searchers learn to ignore large things. If this is so, they may be more likely to notice this small text banner than the larger one. A third banner type we examined is a graphic-style one, which looked like this: In this case, the banner is more perceptually salient than the large text and small text banners (in that it is more different from other items on the page) but it also resembles advertising banners, and therefore may be more likely to be ignored for that reason. The participants were divided into six groups. During their search tasks, the individuals in each group were shown one of the three types of banners presented with either menu grouping or title grouping. The participants' times to select the correct category were compared to the average of their times on two control tasks. The control tasks used the same types of banners and grouping, but the content of the banners was not relevant to the users' tasks. The second part of this experiment examined advertising banners. The participants did the same type of searches, but this time, the banners they were shown looked like this: or like this: Each participant saw some unanimated ads and some ads with a small amount of animation as shown above. As in the non-advertising tasks described earlier, some of the ads were placed with menu grouping and some with title grouping. The participants completed 24 tasks in which banner advertisements were shown. After they were done, they were shown the 24 advertisements that had been previously been exposed to and 24 advertisements that were new. The ads were shown one by one, in random order. For each ad, the participants were asked to indicate, on a four-point scale, whether they thought they had been exposed the ad during the search tasks. Seventy-two (39 females and 33 males) undergraduate psychology students participated for partial course credit. All had some previous experience with the web. 90% of them used the web every day or several times a week. 7% used the web several times a month, and 3% used it once a month or less. The average age was just under 20 years. Results The average time it took to select the correct category in non-ad trials where the banner was not relevant to the current task (the controls) was 6.02 seconds. In cases where the banner could have potentially been helpful, the time was 5.51 seconds. This difference was not significant in a multivariate analysis of variance, Wilks' Lambda F(2,59) = 0.97, p = .38. Overall, there did not seem to be any advantage to having these banners. And, a comparison of menu-grouping to title-grouping conditions and among the large text, small text, and graphical type banners showed no advantage of any of these conditions over any others. Although the non-ad banners did not seem to make the selection more efficient, it is possible that the banner format and grouping variables could influence whether the banners were seen at all. The participants were asked at the end of the study whether they remembered seeing anything that directed them to a particular cell in the menu of choices. Only 17 of the 71 participants (one participant did not answer the question) reported seeing these non-ad banners. Table 1 shows the number of participants who reported seeing any of the non-ad banners in each page format. Although the fact that none of the participants saw the banner in the condition with a graphical banner and title grouping suggests that that condition may lead to particularly bad banner blindness, the general base rate of the recall of these banners makes it difficult to draw any strong conclusions as the effects of the variables. Table 1: Number of participants who reported seeing either of the non-ad banners.   Menu Grouped Title Grouped Small Text 2 out of 12 4 out of 11 Large Text 4 out of 12 4 out of 12 Graphical 3 out of 12 0 out of 12 The irrelevant ads were also largely ignored by the participants. In the post-experiment questionnaire, only 20% of the participants stated that they recalled seeing any advertisements at all during the search trials. And, in fact, neither changing the type of grouping (menu grouping versus title grouping) nor the presence or absence of animation had any effect on whether the banners were recognized in the recognition test. Reanalysis of the data using only participants who recalled noticing the existence of the ads did not change the results. The main purpose of this experiment was originally to investigate whether changes in how banners were presented could mitigate banner blindness. These formatting variables did not lead to significant differences, but the results are telling for the overall phenomenon. There was no difference in whether a banner was recalled based on whether it was grouped with the menu or with the title, or whether the banner was animated, or even whether the banner looked like a banner advertisement. The non-ad banners that were composed of blue text were not any more helpful than those which looked more like advertisements, although the participants' recall of seeing these banners indicate that there may have been a slight advantage for the text "banners" over the more graphical ones (see Table 1). Conclusions The first study demonstrated that banner blindness occurs, although some users did eventually find the banners when there was no other way to find the required information. The second experiment showed that in some cases, banners will be entirely missed by searching users. Use of a small amount of animation and common region grouping did not mitigate the effect. It also showed that "banner" blindness can occur with text items that do not look like advertisements. So, although web users may learn to ignore advertisements and other graphics which look like advertisements, the phenomenon of ignoring salient items while searching for specific items is wider than just an advertising effect. Many web sites use salient links to attract searching users to particular parts of the site. Web indexes sometimes provide direct links to hot topics like sports league finals or election results. News sites similarly provide special direct links to top stories, and advertisers place banner advertisements on search pages based on the keywords entered by the user. If searchers don't see these salient links, they may still find the information needed using category links on the same page. But this can cause a higher load on the server and it costs the user in time and effort. And it is possible the user could get lost on the way. There is evidence that most web users search for specific information. One researcher has found that two thirds of web users are looking for something specific (Koman, 1998). In the second experiment of the current study, when asked to rate the percent of web time they spend searching for specific information as opposed to browsing, the mean response was 77% (SD = 22%). So it makes sense to design for searchers, and help them find what they need as fast as possible. Some recent studies have shown that banner advertisements are effective. One study showed that people who were exposed to an advertising banner and volunteered to participate in a survey were influenced by the content of the ad (Briggs & Hollis, 1997). An article in the New York Times indicated similar results. This article reported three findings: sites that advertise more have more traffic, spikes in site traffic coincide with banner advertising campaigns, and users who are exposed to banner ads increase their brand awareness as demonstrated in subsequent surveys (Tedeschi, 1998). Our findings don't necessarily contradict these reports. First, our experiments focused exclusively on users who were searching for facts. The findings described by Briggs and Hollis and by Tedeschi either combine searching users together with browsing users (usage spikes during ad campaigns) or focus on browsing users only (people willing to fill out surveys). Secondly, our studies do not show that users never see or use banners, just that they are less likely to see and use banners than they are to use links in menus. Finally, our findings go beyond advertising and examine attempts to attract attention to important or popular items through salient links created through non-graphical means such as large text and placing important links at the top of the page. Guidelines that recommend placing important items at the top of the page may be misguided. Spool, Scanlon, Schroeder, Snyder, and DeAngelo (1997) found in usability tests that users turn to navigation bars after determining that the page does not contain the information they need. At this point the user tends to have scrolled to the top or the bottom of the page. Users may start viewing the page in the center, and examine the very top and bottom only after they determine what they want is not located in the center. Therefore, it may not be better to place the "important" items at the top because the user may look there last. A key problem with banners like those used in our study may be the physical separation of the banners from the menu. Despite our efforts to increase the relationship between the banner and the menu by increasing perceptual grouping through background colors or greater similarity, a physical separation remained. The solution may be to indicate clearly that the "important" item is part of menu, and then to add distinguishing characteristics to make that item seem more important and draw attention. For example, this page keeps all links within a single text "menu": The above page was used in a task asking users to find information on the book PeopleWare. The users essentially had to choose between the first item, highlighted in yellow, and the identical 6th item, which is not highlighted. Preliminary results indicate that the yellow highlighting not only does not cause banner blindness but appears to make users more likely to choose a highlighted item over one that is not highlighted. We are continuing to study whether this effect would carry over to choices between non-identical items, and what other methods of highlighting are effective. Design Recommendations One item separated visually from everything else on a web page may be completely ignored by web searchers, even by searchers who are deliberately searching for the information provided in that item. Designers should be cautious about following guidelines stating that increasing the visual distinction between "important" items and other items is desirable; the visual distinctiveness may actually make important items seem unimportant. Any item that is visually distinguished on a page should be duplicated within a collection of links or other content areas of the page. That way, if searchers ignore the large, salient item, they can still find what they need through basic navigation. Any method that is created to make something stand out should be carefully tested with users who are specifically looking for that content to ensure that the distinctiveness does not cause banner blindness. References Briggs, R., & Hollis, N. (1997). Advertising on the Web: Is there response before click-through? Journal of Advertising Research, 37(2), 33-45. Detweiler, M. C., & Omanson, R. C. (1996). Ameritech Web Page User Interface and Design Guidelines Koman, R. (1998). The Scent of Information: Helping users find their way by making your site "smelly". http://webreview.com/wr/pub/98/05/15/feature/index.html Spool, J. M., Scanlon, T., Schroeder, W., Snyder, C., & DeAngelo, T. (1997). Web Site Usability: A Designer's Guide Andover, MA: User Interface Engineering. Tedeschi, B. (1998, Oct. 7). Study finds ad banners make an impression. The New York Times. Acknowledgments We are very grateful to Linda Johansen who suggested the term "banner blindness" and encouraged the first author to investigate the phenomenon. Note. A paper based on this work was presented at the Human Factors and Ergonomics Society 42nd Annual Meeting in Chicago, IL and can be found in the conference proceedings: Benway, J. P. (1998). Banner blindness: The irony of attention grabbing on the World Wide Web. Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting, 1, 463-467. © Internet Technical Group Last update: December 5, 1998 URL: http://www.sandia.gov/itg/newsletter/dec98/banner_blindness.html hosted by Sandia National Labs Disclaimer: Neither Sandia Corporation, the United States Government, nor any agency thereof, nor any of their employees makes any warranty, express or implied, or assumes any legal liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or represents that its use would not infringe privately-owned rights. Reference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise does not necessarily constitute or imply its endorsement, recommendation, or favoring by Sandia Corporation, the United States Government, or any agency thereof. The views and opinions expressed herein do not necessarily state or reflect those of Sandia Corporation, the United States Government or any agency thereof.