{"id":21,"date":"2014-08-16T20:00:36","date_gmt":"2014-08-16T20:00:36","guid":{"rendered":"https:\/\/courses.candelalearning.com\/orgbehavior1xmaster\/?post_type=chapter&p=21"},"modified":"2019-04-15T17:09:09","modified_gmt":"2019-04-15T17:09:09","slug":"1-4-understanding-how-ob-research-is-done","status":"publish","type":"chapter","link":"https:\/\/courses.lumenlearning.com\/suny-orgbehavior\/chapter\/1-4-understanding-how-ob-research-is-done\/","title":{"raw":"1.3 Understanding How OB Research Is Done","rendered":"1.3 Understanding How OB Research Is Done"},"content":{"raw":"
\r\n
\r\n
\r\n

Learning Objectives<\/h3>\r\n
\r\n
    \r\n \t
  1. Learn the terminology of research.<\/li>\r\n \t
  2. Understand the different types of OB research methods used.<\/li>\r\n<\/ol>\r\n<\/div>\r\n<\/div>\r\n

    OB Research Methods<\/h3>\r\n<\/div>\r\n
    \r\n\r\nOB researchers have many tools they use to discover how individuals, groups, and organizations behave. Researchers have working hypotheses<\/span><\/span> based on their own observations, readings on the subject, and information from individuals within organizations. Based on these ideas, they set out to understand the relationships among different variables<\/span><\/span>. There are a number of different research methods that researchers use, and we will discuss a few of these below. Imagine that your manager has asked you to find out if setting goals will help to make the employees at your company more productive. We will cover the different ways you could use research methods to answer this question, impress your boss, and hopefully get a promotion.\r\n
    \r\n

    Surveys<\/h2>\r\nSurveys<\/span><\/span> are one of the primary methods management researchers use to learn about OB. A basic survey involves asking individuals to respond to a number of questions. The questions can be open-ended or close-ended. An example of an open-ended question that could be used to address your manager\u2019s question would be to ask employees how they feel about goal setting in relation to productivity, then summarize your findings. This might work if you have a small organization, but open-ended surveys can be time consuming to summarize and hard to interpret at a glance. You could get more specific by asking employees a series of close-ended questions in which you supply the response key, such as a rating of 1 to 5. Today it is easy to create online surveys that quickly compile the results automatically. There are even several free survey tools available online such as http:\/\/freeonlinesurveys.com\/<\/a> and http:\/\/www.surveygizmo.com\/<\/a>, or you can use paper-and-pencil surveys.\r\n
    \r\n

    Sample Survey About the Effectiveness of Goal Setting<\/h3>\r\nInstructions:<\/em> We would like to gather your opinions about different aspects of work. Please answer the following three questions using the scale below:\r\n\r\nResponse Scale:<\/em>\r\n\r\n1=Strongly disagree\r\n\r\n2=Disagree\r\n\r\n3=Neither agree nor disagree\r\n\r\n4=Agree\r\n\r\n5=Strongly agree\r\n
    \r\n\r\n\r\n\r\n\r\n\r\n
    Setting goals at work helps me to focus<\/td>\r\n1<\/td>\r\n2<\/td>\r\n3<\/td>\r\n4<\/td>\r\n5<\/td>\r\n<\/tr>\r\n
    Goal setting is effective in improving performance<\/td>\r\n1<\/td>\r\n2<\/td>\r\n3<\/td>\r\n4<\/td>\r\n5<\/td>\r\n<\/tr>\r\n
    I get more done when I use goal setting<\/td>\r\n1<\/td>\r\n2<\/td>\r\n3<\/td>\r\n4<\/td>\r\n5<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/div>\r\n<\/div>\r\nRegardless of the method you choose to collect your information, the next step is to look at the average of the responses to the questions and see how the responses stack up. But this still wouldn\u2019t really answer the question your boss asked, which is whether using goal setting would help employees be more effective on the job. To do this, you would want to conduct a field study.\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n
    \r\n

    Field Studies<\/h2>\r\nField studies<\/span><\/span> are also effective ways to learn about what is truly going on within organizations. There are survey field studies like the one above, but more compelling evidence comes from field studies that employ an experimental design<\/span><\/span>. Here you would assign half the employees at your company to the goal setting condition and the other half to the control group<\/span><\/span> condition. The control group wouldn\u2019t get any information on goal setting but the treatment group<\/span><\/span> would. If you found that the treatment group was more effective than the control group, you could tell your boss that goal setting works.\r\n\r\n<\/div>\r\n
    \r\n

    Laboratory Studies<\/h2>\r\nOB researchers are often interested in basic research questions such as \u201cCan we show that goal setting increases performance on a simple task?\u201d This is how research on goal setting started, and it is also how we can establish the conditions under which it works more or less effectively. Again, to address this, researchers may conduct a lab study<\/span><\/span> in which one group is assigned one condition and the other group is assigned the control condition (generally the control condition involves no change at all). You may even have been involved in a lab study during your time at your university. One of the most important concepts to understand with lab studies is that they give the researcher a great deal of control over the environment they are studying but do so in a less \u201crealistic\u201d way, since they are not studying real employees in real work settings. For example, in a lab study, a researcher could simulate hiring and firing employees to see if firing some employees affected the goal-setting behavior of the remaining employees. While this wouldn\u2019t be legal or ethical to do in a real organization, it could be a compelling lab study. At the same time, however, firing someone in a lab setting does not necessarily carry the same consequences as it would in real life.\r\n\r\n<\/div>\r\n
    \r\n

    Case Studies<\/h2>\r\nCase studies<\/span><\/span> are in-depth descriptions of a single industry or company. Case writers typically employ a systematic approach to gathering data and explaining an event or situation in great detail. The benefits of case studies are that they provide rich information for drawing conclusions about the circumstances and people involved in the topics studied. The downside is that it is sometimes difficult to generalize<\/span><\/span> what worked in a single situation at a single organization to other situations and organizations.\r\n\r\n<\/div>\r\n
    \r\n

    Meta-Analysis<\/h2>\r\nMeta-analysis<\/span><\/span> is a technique used by researchers to summarize what other researchers have found on a given topic. This analysis is based on taking observed correlations from multiple studies, weighting them by the number of observations in each study, and finding out if, overall, the effect holds or not. For example, what is the average relationship between job satisfaction and performance? Research shows that, looking across 300 studies, the relationship is moderately strong.Judge, T. A., Thoresen, C. J., Bono, J. E., & Patton, G. K. (2001). The job satisfaction-job performance relationship: A qualitative and quantitative review. Psychological Bulletin<\/em>, 127<\/em>, 376\u2013407.<\/span> This is useful information because for years people had thought that the relationship did not exist, but when all the studies to date were examined together, the original beliefs about the satisfaction\u2013performance relationship deteriorated. The advantage of meta-analysis is that it gives a more definitive answer to a question than a single study ever could. The downside is that meta-analysis is only possible if sufficient research has been done on the topic in question.\r\n\r\n<\/div>\r\n
    \r\n

    Measurement Issues in OB<\/h2>\r\nAnother important thing to understand is the difference between reliability<\/span><\/span> and validity<\/span><\/span>. Imagine you own a trucking company. A major component in trucking is managing the weight of different cargo. If you had a scale that gave you the same weight three times, we would say that was a very reliable scale. But, if it turns out the weights given are in kilograms instead of pounds, it would not be a valid measure if you charge for delivery by the pound.\r\n\r\nFinally, much of management research addresses correlations<\/span><\/span> between two concepts rather than actual causation<\/span><\/span>. Correlation simply means that two things co-vary. For example, it would be inaccurate to assume that because 99% of the people who died this year also drank water, consuming water kills people. Yet many people claim their product caused a positive outcome when, in fact, the data do not support their claim any more than the water example. This brings up something that confuses even seasoned researchers. When you have only one observation it is called a datum<\/span><\/span>. When you use the word data<\/span><\/span>, it refers to multiple observations, so it is always plural.\r\n
    \r\n
    \r\n

    Key Takeaway<\/h3>\r\nOB researchers test hypotheses using different methods such as surveys, field studies, case studies, and meta-analyses. Reliability refers to consistency of the measurement while validity refers to the underlying truth of the measurement. It is important to recognize the difference between correlation and causation.\r\n\r\n<\/div>\r\n
    \r\n

    Exercises<\/h3>\r\n
    \r\n
      \r\n \t
    1. Create a hypothesis about people at work. Now that you have one in mind, which method do you think would be most effective in helping you test your hypothesis?<\/li>\r\n \t
    2. Have you used any of the OB research methods before? If not, what can you do to become more familiar with them?<\/li>\r\n \t
    3. Give an example of a reliable measure.<\/li>\r\n \t
    4. Give an example of a valid measure.<\/li>\r\n \t
    5. How can you know if a relationship is causal or correlational?<\/li>\r\n<\/ol>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>","rendered":"
      \n
      \n
      \n

      Learning Objectives<\/h3>\n
      \n
        \n
      1. Learn the terminology of research.<\/li>\n
      2. Understand the different types of OB research methods used.<\/li>\n<\/ol>\n<\/div>\n<\/div>\n

        OB Research Methods<\/h3>\n<\/div>\n
        \n

        OB researchers have many tools they use to discover how individuals, groups, and organizations behave. Researchers have working hypotheses<\/span><\/span> based on their own observations, readings on the subject, and information from individuals within organizations. Based on these ideas, they set out to understand the relationships among different variables<\/span><\/span>. There are a number of different research methods that researchers use, and we will discuss a few of these below. Imagine that your manager has asked you to find out if setting goals will help to make the employees at your company more productive. We will cover the different ways you could use research methods to answer this question, impress your boss, and hopefully get a promotion.<\/p>\n

        \n

        Surveys<\/h2>\n

        Surveys<\/span><\/span> are one of the primary methods management researchers use to learn about OB. A basic survey involves asking individuals to respond to a number of questions. The questions can be open-ended or close-ended. An example of an open-ended question that could be used to address your manager\u2019s question would be to ask employees how they feel about goal setting in relation to productivity, then summarize your findings. This might work if you have a small organization, but open-ended surveys can be time consuming to summarize and hard to interpret at a glance. You could get more specific by asking employees a series of close-ended questions in which you supply the response key, such as a rating of 1 to 5. Today it is easy to create online surveys that quickly compile the results automatically. There are even several free survey tools available online such as http:\/\/freeonlinesurveys.com\/<\/a> and http:\/\/www.surveygizmo.com\/<\/a>, or you can use paper-and-pencil surveys.<\/p>\n

        \n

        Sample Survey About the Effectiveness of Goal Setting<\/h3>\n

        Instructions:<\/em> We would like to gather your opinions about different aspects of work. Please answer the following three questions using the scale below:<\/p>\n

        Response Scale:<\/em><\/p>\n

        1=Strongly disagree<\/p>\n

        2=Disagree<\/p>\n

        3=Neither agree nor disagree<\/p>\n

        4=Agree<\/p>\n

        5=Strongly agree<\/p>\n

        \n\n\n\n\n\n
        Setting goals at work helps me to focus<\/td>\n1<\/td>\n2<\/td>\n3<\/td>\n4<\/td>\n5<\/td>\n<\/tr>\n
        Goal setting is effective in improving performance<\/td>\n1<\/td>\n2<\/td>\n3<\/td>\n4<\/td>\n5<\/td>\n<\/tr>\n
        I get more done when I use goal setting<\/td>\n1<\/td>\n2<\/td>\n3<\/td>\n4<\/td>\n5<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

        Regardless of the method you choose to collect your information, the next step is to look at the average of the responses to the questions and see how the responses stack up. But this still wouldn\u2019t really answer the question your boss asked, which is whether using goal setting would help employees be more effective on the job. To do this, you would want to conduct a field study.<\/p>\n<\/div>\n<\/div>\n<\/div>\n

        \n

        Field Studies<\/h2>\n

        Field studies<\/span><\/span> are also effective ways to learn about what is truly going on within organizations. There are survey field studies like the one above, but more compelling evidence comes from field studies that employ an experimental design<\/span><\/span>. Here you would assign half the employees at your company to the goal setting condition and the other half to the control group<\/span><\/span> condition. The control group wouldn\u2019t get any information on goal setting but the treatment group<\/span><\/span> would. If you found that the treatment group was more effective than the control group, you could tell your boss that goal setting works.<\/p>\n<\/div>\n

        \n

        Laboratory Studies<\/h2>\n

        OB researchers are often interested in basic research questions such as \u201cCan we show that goal setting increases performance on a simple task?\u201d This is how research on goal setting started, and it is also how we can establish the conditions under which it works more or less effectively. Again, to address this, researchers may conduct a lab study<\/span><\/span> in which one group is assigned one condition and the other group is assigned the control condition (generally the control condition involves no change at all). You may even have been involved in a lab study during your time at your university. One of the most important concepts to understand with lab studies is that they give the researcher a great deal of control over the environment they are studying but do so in a less \u201crealistic\u201d way, since they are not studying real employees in real work settings. For example, in a lab study, a researcher could simulate hiring and firing employees to see if firing some employees affected the goal-setting behavior of the remaining employees. While this wouldn\u2019t be legal or ethical to do in a real organization, it could be a compelling lab study. At the same time, however, firing someone in a lab setting does not necessarily carry the same consequences as it would in real life.<\/p>\n<\/div>\n

        \n

        Case Studies<\/h2>\n

        Case studies<\/span><\/span> are in-depth descriptions of a single industry or company. Case writers typically employ a systematic approach to gathering data and explaining an event or situation in great detail. The benefits of case studies are that they provide rich information for drawing conclusions about the circumstances and people involved in the topics studied. The downside is that it is sometimes difficult to generalize<\/span><\/span> what worked in a single situation at a single organization to other situations and organizations.<\/p>\n<\/div>\n

        \n

        Meta-Analysis<\/h2>\n

        Meta-analysis<\/span><\/span> is a technique used by researchers to summarize what other researchers have found on a given topic. This analysis is based on taking observed correlations from multiple studies, weighting them by the number of observations in each study, and finding out if, overall, the effect holds or not. For example, what is the average relationship between job satisfaction and performance? Research shows that, looking across 300 studies, the relationship is moderately strong.Judge, T. A., Thoresen, C. J., Bono, J. E., & Patton, G. K. (2001). The job satisfaction-job performance relationship: A qualitative and quantitative review. Psychological Bulletin<\/em>, 127<\/em>, 376\u2013407.<\/span> This is useful information because for years people had thought that the relationship did not exist, but when all the studies to date were examined together, the original beliefs about the satisfaction\u2013performance relationship deteriorated. The advantage of meta-analysis is that it gives a more definitive answer to a question than a single study ever could. The downside is that meta-analysis is only possible if sufficient research has been done on the topic in question.<\/p>\n<\/div>\n

        \n

        Measurement Issues in OB<\/h2>\n

        Another important thing to understand is the difference between reliability<\/span><\/span> and validity<\/span><\/span>. Imagine you own a trucking company. A major component in trucking is managing the weight of different cargo. If you had a scale that gave you the same weight three times, we would say that was a very reliable scale. But, if it turns out the weights given are in kilograms instead of pounds, it would not be a valid measure if you charge for delivery by the pound.<\/p>\n

        Finally, much of management research addresses correlations<\/span><\/span> between two concepts rather than actual causation<\/span><\/span>. Correlation simply means that two things co-vary. For example, it would be inaccurate to assume that because 99% of the people who died this year also drank water, consuming water kills people. Yet many people claim their product caused a positive outcome when, in fact, the data do not support their claim any more than the water example. This brings up something that confuses even seasoned researchers. When you have only one observation it is called a datum<\/span><\/span>. When you use the word data<\/span><\/span>, it refers to multiple observations, so it is always plural.<\/p>\n

        \n
        \n

        Key Takeaway<\/h3>\n

        OB researchers test hypotheses using different methods such as surveys, field studies, case studies, and meta-analyses. Reliability refers to consistency of the measurement while validity refers to the underlying truth of the measurement. It is important to recognize the difference between correlation and causation.<\/p>\n<\/div>\n

        \n

        Exercises<\/h3>\n
        \n
          \n
        1. Create a hypothesis about people at work. Now that you have one in mind, which method do you think would be most effective in helping you test your hypothesis?<\/li>\n
        2. Have you used any of the OB research methods before? If not, what can you do to become more familiar with them?<\/li>\n
        3. Give an example of a reliable measure.<\/li>\n
        4. Give an example of a valid measure.<\/li>\n
        5. How can you know if a relationship is causal or correlational?<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n\n\t\t\t
          \n\t\t\t

          Candela Citations<\/h3>\n\t\t\t\t\t
          \n\t\t\t\t\t\t
          \n\t\t\t\t\t\t\t
          CC licensed content, Original<\/div>