Web Site Evaluation
Quote
"The net is like a hugh, vandalized library. Someone has destroyed the
catalog and removed the front matter, indexes, etc. from hundreds of
thousands of books and torn and scattered what remains. ...'Surfing" is the
process of sifting through this disorganized mess in the hope of coming
across some useful fragments of text and images that can be related to
other fragments. The net is even worse than a vandalized library because
thousands of additional unorganized fragments are added daily by the myriad
of cranks, sages, and persons with time on their hands who launch their
unfiltered messages into cyberspace." -- Michael Gorman, 1955
When To Use the Web
Often, there is a temptation to use the web simply because it is relatively
easy to use from home. Obvious questions include:
- Do you need facts, opinions, statistics, narratives, descriptions?
- The type of information needed will suggest different types of
information sources and potential publishers or information providers
- Is the information needed likely to be found on the web?
- Are there obvious organizations, institutions, or firms likely to place
this information on the web?
- Do these organizations have a reputation for quality and objectivity?
- Are web resources easy to use?
- Are web resources comparable in quality to traditional hard copy
resources?
Rapid, incontrolled growth of information
Anyone can publish on the web. There are no enforced standards, quality
control may be minimal, and the information is of varying quality and
reliability.
- Vanity publishing
- Info-glut
- Info-garbage
Much of what we find published on the Internet is vanity publishing. In
hard copy publishing, vanity publications are generally ignored because of
the lack of quality control. However, some vanity or self-published works
are of substantial quality and utility. Typically, self-published content
needs to be greeted with more suspicion or doubt.Some information professionals are suspicious of net sites that contain
considerable advertising or promotional material for an organization or
company. While one would not expect a General Motors site to be objective
in presenting information on new cars, it is important to note that
information about products, particularly product specifications, is often
an important information need for many clients.
The Internet contains a large variety of advocacy sites, including some
for viewpoints that many would find hateful or disgusting. While we would
not use these sites for objective information on a social or economic
problem, they can be useful for those who wish to know more about a
particular viewpoint.
Individuals and organizations that might find it difficult to print and
publish a print document can easily place information that appears
convincing on the WWW. Caveat lector--let the user beware. For example,
look at Webworst. A site may look
authoritative but may not be trustworthy.Information may be harmful. Donıt
believe everything you read. Attractive, convincing web sites may
perpetuate stereotypes, encourage inappropriate behavior or action or may
the unreasonable seem reasonable. This is especially a problem with
health-related sites and sites that deal with controversial political and
social topics. It is particularly important to compare content and
treatment of topics using a variety of sites as well as traditional hard
copy sources. In traditional print sources, information and advertising
content are usually separated. On the web, it may be difficult to tell
where one stops and the other begins. There are many "infomercial" sites
on the web.Ideally, follow the scholar's rule: "never use information tht
you cannot verify."
Web sites may be categorized as:
- Reference/informational
- News
- Entertainment
- Business/marketing
- Advocacy
- Personal page
Lack of a standard instrument
Many different
evaluation forms and checklists exist. Sites that review and evaluate WWW
sites use different criteria, but a few variables are mentioned
repeatedly: authority, scope, currency, purpose, and accuracy. Note that
there is no "single perfect indicator of reliability, truthfulness, or
value. Instead, you must make an inference from a collection of clues or
indicators based on the use you plan to make of the source.
Sites change rapidly
Intellectual content that was useful yesterday may be gone tomorrow. A site
with marginal content may have improved content tomorrow. Normally, web
site evaluation must be repeated at frequent intervals to insure that the
evaluation still matches site content. Some information is relatively
timeless, for example, primary source material on the Spanish-American War.
Other material, cost of living in a retirement community, for example, may
not be useful if it is two years old.
Cost
Some web sites are pass word protected or require the use of a credit
card before useful information is provided. Many commericial information
providers will provide a small amount of free information, sometimes as a
teaser for their subscription or pay for site.
- Are there any out of pocket costs associated with using this site?
- If payment is required, are fees reasonable?
Navigation
Utility is often a function of how easy it is to find what you are
looking for.
- Is there a clear indication of what is there and how to get to it?
- Is there a good table of contents or site map?
- Is the site well organized?
- Does consistency from page to page facilitate navigation?
- Are pages uncluttered, attractive, and easy to use?
- Is there a logical sequence from page to page?
- Are appropriate short cuts available (For example, to return to the
home page)?
- Is site design appropriate for the subject matter?
- How easy is it to find information on the site? Is there a search
engine? If yes, does it work well?
- If links are present, is it clear what information will be found at a
particular link?
- Are links annotated or described?
- Do labels clearly indicate action associated with particular
buttons and links?
- Does the site work well with a text browser?
- If frames are used, do they add to ease of use?
- Is a no-frames version available?
Design
The home page of the web site should be pleasing and easy to view.It
should be aesthetically pleasing. It should have a consistency from page to
page.
- Does your first impression encourage use and exploration?
- Do the pages on this site represent a harmonious whole?
- Are the colors and textures used appropriate?
- Is all text clearly legible?
- Are images used appropriate?
- Are they attractive?
- Are pages concise or is there considerable scrolling?
- Does this site have a distinctive character?
Performance
An attractive, potentially useful site will not be used if it performs
poorly. A coherent structure is essential.
- Does the page download in a reasonable amount of time without any snags?
- Is it usually possible to reach the site?
- Is there a text only option?
- Is a password required?
- Are media elements clearly identified?
- If so, is download information for needed resources, including file
size clearly stated?
- Are graphics appropriate?
- Do they download quickly?
- Are thumbnail versions seen when large graphics are used?
- Are sound files appropriate?
- Do they download quickly and play with common plug-ins?
- Are video files appropriate?
- Do they download quckly and play with common plug-ins?
- Are Java scripts used?
- Do they download quickly?
- Are links active?
- Do they load quickly?
Currency and Stability
There are many neglected web sites where once useful information is now
dated.
- Is the creation or revision date visible?
Any indication of the currency of information or data presented at this site?
- What is the date of the most recent information presented?
- Does the site appear to be current?
- Is there a whatıs new section?
- Are the links alive and current?
- Does the site appear to be a stable one? Is it likely to be there
tomorrow?
Audience
It is difficult to evaluate a web site without first considering
the local audience as well as the audience envisioned by those responsible
for the web site.
- What is the intended audience?
- Does the site include a purpose statement that
identifies an audience?
- Can you identify an audience with a quick browse
of the home page?
- Purpose _ What does this site intend to do?
- Is there a purpose statement?
- Does the site inform? Explain? Persuade?
Content
It is the quality and utility of the intellectual content that make a web
site noteworthy. Authorship is especially important. As is true with hard
copy sources, well-known, reputable authors are important. The publisher
is also of considerable importance. Intemperate language, exaggerated
claims, lack of evidence, and anonymous sources are likely to indicate a
site with questionable content.
- Is the primary purpose of the site to inform, to explain, or to
persuade?
- Is the topic covered in a popular or scholarly manner?
- Is there an explicit purpose, a clear indication of scope and
criteria for inclusion?
- What topics are included?
- Is there a geographical focus?
- Is there a chronological focus?
- Is the topic covered in a comprehensive or selective manner?
- Is the content unique or original?
- How does this site differ from others dealing with this topic?
- Is there enough depth or detail for a reasonable understanding of the
topic or issue?
- Is the text clear and interesting?
- Does it flow well?
- Does the text follow correct grammar, spelling, and composition rules?
- Are appropriate special features included?
- Are links provided to related sites?
- Do these appear to be well-selected ?
- Do they complement the information presented at this site?
- Specifically, what is the value of this site?
- Return appeal or how often would you visit this site?
Comparability
Traditionally, librarians have tried to compare similar sources.
This should also be done with web sites.
- How does this site compare with others devoted to this topic?
- To what degree is the content unique?
- How much of the content found here overlaps with that found
elsewhere?
- Is this the best site for this topic?
Advertising?
Some educational institutions will not link to a site that contains
advertising. Advertising may be informative and useful for those looking
for product information. It may also be inappropriate and intrusive.
- Is advertising present?
- Is it appropriate given the purpose and nature of the site?
- How much page space is given to advertising?
- Does it inhibit download time and ease of navigation?
- Is it reasonably attractive and intereting?
Reliability/accuracy/authority
Confirmation is important before using information from any
publication, digital or hard copy, unless it is issued by a well-known,
reputable publisher. This is particularly important when claims are made
without evidence where reasonable people may disagree.
- Who is the author or sponsor?
- Disclosure of web site ownership as well as any sponsorship,
advertising or other potential conflicts of interest should be
prominently stated
- If an individual, is she affiliated with a well-regarded institution?
- Is this individual or organiation clearly identified?
- Is their authority or positive reputation visible or well-known?
- Are they qualified to develop an objective site on this topic?
- Can you verify their standing/reputation?
- What is the source of the information appearing on the site?
- Are references/sources for content clearly listed?
- Is copyright information included for original and other content?
- Is information presented supported by evidence and appropriate
resources?
- Is this a controversial topic where authority is especially important?
- Is it likely that the institution or individual responsible for the
site has a political, social, economic, or religious agenda?
- Any indication of bias?
- Are you looking for particular viewpoints?
- Are you looking for a reasonably objective over-view?
- Did you follow a link from an authoritative site to this one?
- Is the content credible?
- Where did the information come from?
- How do we know that this information is accurate and current?
- Do you find evidence from reputable sources?
- Are sources listed for information/data presented?
- Is a product being sold that might impact information
objectivity?
- Has the site received any notable awards?
Web Sites that Evaluate Web sites
The Institute for Learning and Research Technology at the University of
Bristol has developed an on-line
tutorial for evaluating web site quality and utility.
If you visit these or similar sites, attempt to answer these questions:
- What evaluation criteria are used?
- Who provides this service and why?
- Check some selections and see if they seem to be of value
Return to Course Page