Print Sources or Electronic?
In the early years of the Internet, there was a wide-spread mistrust of the World Wide Web and the information it had to offer. While some of this mistrust is still present, including among writing teachers and students, the undeniable fact is that the authority of the Internet as a legitimate and reliable source of information has increased considerably in recent years. For example, academic journals in almost every discipline compliment their printed volumes with web versions, and some have gone completely online. These online journals employ the same rigorous submission review processes as their printed counterparts. Complete texts of academic and other books are sometimes available on the Internet. Respected specialized databases and government document collections are published entirely and exclusively online.
Print and electronic sources are not created equal, and, although online and other electronic texts are gaining ground rather quickly as legitimate research resources, there is still a wide-spread, and often justified, opinion among academics and other writers that printed materials make better research sources. Some materials that are available in some libraries simply cannot be found online and vice versa.
For example, if you are a Shakespeare scholar wishing to examine manuscripts from the Elizabethan times, you will not find them online. To get to them, you will have to visit the Folger Shakespeare Library in Washington, DC, or a similar repository of scholarship on Shakespeare. On the other hand, if you are researching the Creative Commons movement which is a community dedicated to reforming copyright laws in this country, then your best bet is to begin your search on the Internet at http://www.creativecommons.org/. Surely, after reading the website, you will need to augment your research by reading other related materials, both online and in print, but in this case, starting online rather than in the library is a reasonable idea.
As a researching writer, you should realize that, inherently, printed and electronic sources are not bad or good. Both kinds can be reliable and unreliable, although with printed materials, publishers and libraries take care of not letting utterly unreliable works through to readers. Both kinds can be appropriate and inappropriate for a specific research project. It is up to researchers and writers to learn how to select both print and electronic sources judiciously and how to evaluate them for their reliability and appropriateness for these writers’ research and writing purposes.
Determining the Suitability and Reliability of Research Sources
Much of the discussion about the relative value of printed and electronic, especially Internet, sources revolves around the issue of reliability. When it comes to libraries, the issue is more or less clear. Libraries keep books, journals, and other publications that usually undergo a rigorous pre and post-publication review process. It is a fairly safe bet that your campus library contains very few or no materials which are blatantly unreliable or false, unless those materials are kept there precisely to demonstrate their unreliability and falsehood.
As a faculty member, I am sometimes asked by my university librarians to recommend titles in my academic field which, I feel, our university library should have. Of course, my opinion, as well as the opinions of my colleagues, do not provide a one- hundred-percent guarantee against errors and inaccurate facts, we use our experience and knowledge in the field to recommend certain titles and omit certain others.
These faculty recommendations are the last stage in the long process before a publication gets to a campus library. Before that, every book, journal article, or other material undergoes a stringent review from the publisher’s editors and other readers. And while researchers still need to use sound judgment in deciding which library sources to use in their project, the issue is usually one of relevance and suitability for a specific research project and specific research questions rather than one of whether the information presented in the source is truthful or not.
The same is true of some electronic sources. Databases and other research sources published on CD-ROMs, as well as various online research websites which accompany many of contemporary writing textbooks, for example, are subject to the same strict review process as their printed counterparts. Information contained in specialized academic and professional databases is also screened for reliability and correctness.
If, as we have established, most of the materials which you are likely to come across in your campus library are generally trustworthy, then your task as a researcher is to determine the appropriateness of the information which these books, journals, and other materials contain, for your particular research project. It is a simple question, really: will my research sources help me answer the research questions that I am posing in my project? Will they help me learn as much as I can about my topic and create a rhetorically effective and interesting text for my readers? Consider the following example.
Recently, the topic of the connection between certain anti-depressant drugs and suicidal tendencies among teenagers that take those drugs has received a lot of coverage in the media. Suppose that you are interested in researching this topic further. Suppose also that you want not only to give statistical information about the problem in your paper, but also to study first-hand accounts of the people, who have been negatively affected by the anti-depressants.
When you come to your campus library, you have no trouble locating the latest reports and studies that give you a general overview of your topic, including rates of suicidal behavior in teenagers who took the drugs, tabulated data on the exact relationships between the dosage of the drugs and the changes in the patients’ moods, and so on. All this may be useful information, and there is a good chance that, as a writer, you will still find a way to use it in your paper. You could, for example, provide the summary of the statistics in order to introduce the topic to your readers. However, this information does not fulfill your research purpose completely. You set out to find out, first-hand, what it is like to be a teenager whose body and mind are affected by the anti-depressants, yet the printed materials that you have found so far offer no such insight. They fulfill your goal only partially.
To find such first- hand accounts, then, you will either have to keep looking in the library or to conduct interviews with the people who have affected by these drugs, if you can locate such people. The library website of the University of California at Berkeley offers a comprehensive list of criteria for critical evaluation of all research sources which I find very useful. The expanded list of criteria and examples can be found at (http://www.lib.berkeley.edu/TeachingLib/Guides/Evaluation.html).
Suitability of Sources
Determine how suitable a particular source is for your current research project. To do this, consider the following factors:
Scope
What topics and subtopics does the source cover? Is it a general overview of your subject or it is a specialized resource?
Audience
Who is the intended audience for the text? If the text itself is too basic or too specialized, it may not match the expectations and needs of your own target audience.
Timeliness
When was the source published? Does it represent the latest information, theories, and views on the subject? Bear in mind, though, that if you are conducting a historical investigation, you will probably need to consult older materials, too.
Authority
What the credentials of the author or authors of the sources? This may be particularly important when you use Internet sources since a lot of materials by various authors are posted online. As a part of your evaluation of the source’s authority, you should also pay attention to the kinds of external sources that were used during its creation. Look through the bibliography or list of works cited attached to the text. Not only will it help you determine how reliable and suitable the source is, but it may also provide you with further leads for your own research. Try asking the above questions of any source you are using for a research project you are currently conducting.
Reliability of Internet Sources
Charles Lowe, the author of the essay “The Internet Can be a Wonderful Place, But…,” offers the following opinion of the importance of the Internet as a research source for contemporary researchers:
“To a generation raised in the electronic media culture, the Internet is an environment where you feel more comfortable, more at home than the antiquated libraries and research arenas of the pre-electronic, print culture. To you, instructors just don’t get it when they advise against using the Internet for research or require the bulk of the sources for a research paper to come from the library” (129-130).
Indeed, the Internet has become the main source of information not only for college students, but also for a lot of people outside of the academe. And while I do not advise you to stay away from the Internet when researching and I generally do not require my own students to use primarily printed sources, I do know that working with Internet sources places additional demands on the researcher and the writer.
Because much of the Internet is a democratic, open space, and because anyone with a computer can post materials online, evaluating online sources is not always easy. A surprisingly large number of people believe much of the information on the Internet, even if this information is blatantly misleading or if its authors have a self-serving agenda. In the chapter of this book dedicated to research and writing in academic disciplines, we discussed how authority of a text can influence its reception by the readers. I think many students uncritically accept information they find on the internet because some of the sites on which this information appears look and sound very authoritative. Used to believing the published word, inexperienced writers often fall for such information as legitimate research data.
So, what are some of strategies you can use to determine that reliability? The key to successful evaluation of Internet research sources, as any other research sources, is application of your critical reading and thinking skills. In order to determine the reliability of every source, including online sources, it is generally useful to conduct a basic rhetorical analysis of that source. When deciding whether to use a particular website as a research source, every writer should ask and answer the following questions:
- Who is the author (or, authors) of the website and the materials presented on it?
- What is known about the site’s author or authors and its publishers and their agendas and goals?
- What is the purpose of the website?
- Who is the target audience of the website
- How do the writing style and the design of the website contribute to (or detract from) its meaning?
Website Authors and Publishers
Just like with a printed source, first, we need to consider the author and the publisher of a website. Lowe whom I mentioned earlier suggest that first we need to look at the tag in the website’s URL. Whether it is a “.com,” a “.org,” a “.net, ”or a “.edu” site can offer useful clues about the types of materials located on the site and about their credibility. In addition to the three most common URL tags which are listed above, websites of military organizations use the extension “.mil” while websites hosted in other countries have other tags which are usually abbreviations of those countries’ names. Sites of government agencies end in “.gov.”
For example, most sites hosted in Great Britain have the tag “uk” which stands for “United Kingdom.” Websites out of Italy usually have the tag “it,” and so on. Typically, a “.com” site is set up to sell or promote a product or service. Therefore, if you are researching Nike shoes, you will probably not want to rely on http://www.nike.com/ if you want to get a more or less unbiased review of the product. While Nike’s website may provide some useful information about the products it sells, the site’s main purpose is to sell Nike’s goods, playing up the advantages of their products their competitors’.
Keep in mind that not all “.com” websites try to sell something. Sometimes, academics and other professionals obtain “.com” addresses because they are easy to obtain. For example, the professional website Charles Lowe whose work I mentioned earlier is located at http://www.cyberdash.com/.Political candidates running for office also often choose “.com” addresses for their campaign websites. In every case, you need to apply your critical reading skills and your judgment when evaluating a website. The “.org” sites usually belong to organizations, including political groups. These sites can present some specific challenges to researchers trying to evaluate their credibility and usefulness for their research.
To understand these challenges, let us consider the “.org” sites of two political research organizations, also known as “think tanks.” One is the conservative Heritage Foundation (http://www.heritage.org), and the traditionally liberal Center for National Policy (http://www.cnponline.org). Both sites have “About” pages intended to explain to their readers the goals and purposes of the organizations they represent. The Heritage Foundation’s site, contains the following information:
…The Heritage Foundation is a research and educational institute – a think tank – whose mission is to formulate and promote conservative public policies based on the principles of free enterprise, limited government, individual freedom, traditional American values, and a strong national defense. (http://www.heritage.org/about)
This statement can tell a researcher a lot about the research articles and other materials contained in the site. It tells us that the authors of the site are not neutral, nor do they pretend to be. Instead, they are advancing a particular political agenda, and so, when used as research sources, the writings on the site should not be seen as unbiased “truths”, but as arguments. The same is true of the Center for National Policy’s website, although its authors choose a different rhetorical strategy explaining their political leanings to the readers. They write:
The Center for National Policy (CNP) is a non-profit, non-partisan public policy organization located in Washington, DC. Founded in 1981, the Center’s mission is to engage national leaders with new policy options and innovative programs designed to advance progressive ideas in the interest of all Americans (http://www.cnponline.org/people_and_programs.html).
It takes further study of the Center’s website, as well as a certain knowledge of the American political scene to realize that the organization is leaning towards the left of the political spectrum. The websites of both organizations contain an impressive amount of research, commentaries, and other materials designed to advance the groups’ causes.
When evaluating “.org” sites, it is important to realize that they belong to organizations, and each organization has a purpose or a cause. Therefore, each organizational website will try to advance that cause and fulfill that purpose by publishing appropriate materials. Even if the research and arguments presented on those sites are solid (and they often are), there is no such thing as an unbiased and disinterested source.
This is especially true of political and social organizations whose sole purpose is to promote agendas. The Internet addresses ending in “.edu” are rather self- explanatory—they belong to universities and other educational institutions. On these sites, we can expect academic articles and other writings, as well as, often, papers and other works created by students. These websites are also useful resources if you are looking for information on a specific college or university. Be aware, though, that typically any college faculty member or student can obtain web space from their institution and publish materials of their own choosing on that space. Thus, some of the texts that appear on “.edu” sites may be personal rather than academic.
In recent years, some political research organizations have begun to use web addresses with the “edu” tag. One of these organizations is The Brookings Institution, whose address is http://www.brookings.edu. Government websites which end in “.gov” can be useful sources of information on the latest legislation and other regulatory documents. The website with a “dot net” extension can belong to commercial organizations or online forums.
Website Content
Now that we have established principles for evaluating the authors and publishers of web materials, let us look at the content of the writing. As I have stated above, like all writing, web writing is argumentative, therefore it is important to recognize that authors of web texts work to promote their agendas or highlight the events, organizations, and opinions that they consider right, important, and worthy of public attention. Different writers work from different assumption and try to reach different audiences. Websites of political organizations are prime examples of that.
Activity: Evaluating the Content of Websites
Go to one of the following websites:
- The Heritage Foundation (http://www.heritage.org)
- The Center for National Policy (http://www.cnponline.org)
- The Brookings Institution (http://www.brookings.edu)
- The American Enterprise Institute (http://www.aei.org)
- Or choose another website suggested by your instructor. Browse through the content of the site have to offer and consider the following questions:
Answer the following questions about the site:
- What is the purpose of the site?
- What is its intended audience? How do we know?
- What are the main subjects discussed on the sites?
- What assumptions and biases do the authors of the publications on the site seem to have? How do we know?
- What research methods and sources do the authors of these materials use
- How does research help the writers of the site state their case?
Apply the same analysis to any online sources you are using for one of your research projects.
Website Design and Style
The style and layout of any text is a part of that text’s message, and online research sources are no exception. Well-designed and written websites add to the ethos (credibility) of their authors while badly designed and poorly written ones detract from it. Sometimes, however, a website with a good-looking design can turn out to be an unreliable or unsuitable research source.
In Place of a Conclusion: Do not Accept A Source Just because it Sounds or Looks Authoritative
Good writers try to create authoritative texts. Having authority in their writing helps them advance their arguments and influence their audiences. To establish such authority, writers use a variety of methods. As has been discussed throughout this chapter, it is important for any researcher to recognize authoritative and credible research sources. On the other hand, it is also important not to accept authoritative sources without questioning them. After all, the purpose of every researcher piece of writing is to create new views and new theories on the subject, not to repeat the old ones, however good and well-presented those old theories may be. Therefore, when working with reliable and suitable research sources, consider them solid foundations which will help you to achieve a new understanding of your subject, which will be your own. Applying the critical source evaluation techniques laid out in this chapter will help you to accomplish this goal.