{"id":232,"date":"2015-09-16T22:58:13","date_gmt":"2015-09-16T22:58:13","guid":{"rendered":"https:\/\/courses.candelalearning.com\/compreader\/?post_type=chapter&#038;p=232"},"modified":"2015-09-16T22:58:13","modified_gmt":"2015-09-16T22:58:13","slug":"can-we-use-social-media-to-support-content-validity-of-patient-reported-outcome-instruments-in-medical-product-development-by-margaret-rothman-et-al","status":"publish","type":"chapter","link":"https:\/\/courses.lumenlearning.com\/readinganthology\/chapter\/can-we-use-social-media-to-support-content-validity-of-patient-reported-outcome-instruments-in-medical-product-development-by-margaret-rothman-et-al\/","title":{"raw":"\"Can We Use Social Media to Support Content Validity of Patient-Reported Outcome Instruments in Medical Product Development?\" by Margaret Rothman, et al","rendered":"&#8220;Can We Use Social Media to Support Content Validity of Patient-Reported Outcome Instruments in Medical Product Development?&#8221; by Margaret Rothman, et al"},"content":{"raw":"<div id=\"frag_1\" class=\"page_fragment auth_frag\" data-first=\"true\" data-fid=\"1\">\r\n<div id=\"doc0005\" class=\"publicationType\"><span id=\"\">COMMENTARY<\/span><\/div>\r\n<div class=\"module_topic_paths\"><\/div>\r\n<h2 id=\"tit0005\" class=\"svTitle\">Can We Use Social Media to Support Content Validity of Patient-Reported Outcome Instruments in Medical Product Development?<\/h2>\r\n<ul class=\"authorGroup noCollab svAuthor\">\r\n\t<li class=\"smh5\"><a id=\"authname_N35440de0N6543cb00\" class=\"authorName svAuthor\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#\" target=\"_blank\" data-orcid=\"\" data-t=\"a\" data-fn=\"Margaret\" data-ln=\"Rothman\" data-pos=\"1\" data-tb=\"\">Margaret Rothman<\/a>, <span class=\"authorDegrees\">PhD<\/span><a id=\"baff0005\" class=\"intra_ref auth_aff\" title=\"Affiliation: 1\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#aff0005\"><sup>1<\/sup><\/a><\/li>\r\n\t<li class=\"smh5\"><a id=\"authname_N35440de0N6543cc68\" class=\"authorName svAuthor\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#\" target=\"_blank\" data-orcid=\"\" data-t=\"a\" data-fn=\"Ari\" data-ln=\"Gnanaskathy\" data-pos=\"2\" data-tb=\"\">Ari Gnanaskathy<\/a>, <span class=\"authorDegrees\">MSc, MBA<\/span><a id=\"baff0010\" class=\"intra_ref auth_aff\" title=\"Affiliation: 2\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#aff0010\"><sup>2<\/sup><\/a><\/li>\r\n\t<li class=\"smh5\"><a id=\"authname_N35440de0N6543cd1c\" class=\"authorName svAuthor\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#\" target=\"_blank\" data-orcid=\"\" data-t=\"a\" data-fn=\"Paul\" data-ln=\"Wicks\" data-pos=\"3\" data-tb=\"\">Paul Wicks<\/a>, <span class=\"authorDegrees\">PhD<\/span><a id=\"baff0015\" class=\"intra_ref auth_aff\" title=\"Affiliation: 3\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#aff0015\"><sup>3<\/sup><\/a><\/li>\r\n\t<li class=\"smh5\"><a id=\"authname_N35440de0N6543cdd0\" class=\"authorName svAuthor\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#\" target=\"_blank\" data-orcid=\"\" data-t=\"a\" data-fn=\"Elektra J.\" data-ln=\"Papadopoulos\" data-pos=\"4\" data-tb=\"\">Elektra J. Papadopoulos<\/a>, <span class=\"authorDegrees\">MD, MPH<\/span><a id=\"baff0020\" class=\"intra_ref auth_aff\" title=\"Affiliation: 4\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#aff0020\"><sup>4<\/sup><\/a><\/li>\r\n<\/ul>\r\n<div id=\"currtAsOf\"><\/div>\r\n<div class=\"moreInformation\"><dl class=\"citation\"><dd class=\"oaUserLicense wrap2\">Under a Creative Commons <a id=\"ddOAuserLicense\" href=\"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/\" target=\"_blank\">license<\/a><\/dd><\/dl><\/div>\r\n<dl class=\"extLinks nonEmpty\"><dd class=\"doiLink\"><\/dd><dd class=\"doi\"><a id=\"ddDoi\" class=\"S_C_ddDoi\" href=\"http:\/\/dx.doi.org\/10.1016\/j.jval.2014.10.001\" target=\"_blank\">doi:10.1016\/j.jval.2014.10.001<\/a><\/dd><dd class=\"rightsLink\"><a class=\" cExLink S_C_outLinks\" title=\"Get rights and content\" href=\"https:\/\/s100.copyright.com\/AppDispatchServlet?publisherName=ELS&amp;contentID=S1098301514047263&amp;orderBeanReset=true\" target=\"_blank\" data-url=\"\/science\/RedirectURL?_method=outwardLink&amp;_partnerName=936&amp;_eid=1-s2.0-S1098301514047263&amp;_pii=S1098301514047263&amp;_origin=article&amp;_zone=art_page&amp;_targetURL=https:\/\/s100.copyright.com\/AppDispatchServlet?publisherName%3DELS%26contentID%3DS1098301514047263%26orderBeanReset%3Dtrue\"><span class=\"outText\">Get rights and content<\/span><\/a><\/dd><\/dl>\r\n<div class=\"articleOAlabelForced\"><\/div>\r\n<div id=\"refersToAndreferredToBy\"><\/div>\r\n<div class=\"page_fragment_ind auth_frag\" data-id=\"frag_2\"><\/div>\r\n<\/div>\r\n<div id=\"frag_2\" class=\"page_fragment\" data-fid=\"2\">\r\n<div class=\"OAlabel\"><span class=\"articleOAstatus\">\u00a0\u00a0Open Access<\/span>\r\n\r\n<hr id=\"abs_authorab00051\" class=\"artHeader\" \/>\r\n\r\n<\/div>\r\n<div class=\"abstract svAbstract \" data-etype=\"ab\">\r\n<h2 id=\"authorab00051\" class=\"secHeading\">Abstract<\/h2>\r\n<p id=\"sp0010\">We report a panel designed to open a dialog between pharmaceutical sponsors, regulatory reviewers, and other stakeholders regarding the use of social media to collect data to support the content validity of patient-reported outcome instruments in the context of medical product labeling. Multiple stakeholder perspectives were brought together to better understand the issues encountered in pursuing social media as a form of data collection to support content validity. Presenters represented a pharmaceutical sponsor of clinical trials, a regulatory reviewer from the Food and Drug Administration, and an online data platform provider. Each presenter shared its perspective on the advantages and disadvantages of using social media to collect this type of information. There was consensus that there is great potential for using social media for this purpose. There remain, however, unanswered questions that need to be addressed such as identifying which type of social media is most appropriate for data collection and ensuring that participants are representative of the target population while maintaining the advantages of anonymity provided by online platforms. The use of social media to collect evidence of content validity holds much promise. Clarification of issues that need to be addressed and accumulation of empirical evidence to address these questions are essential to moving forward.<\/p>\r\n\r\n<\/div>\r\n<div id=\"SD_BA1P\" class=\"sgfNoTitleBar sgfNoGadgetBorder svDoNotLink ui-sortable\"><\/div>\r\n<h2 id=\"kwd_1\" class=\"svKeywords\">Keywords<\/h2>\r\n<ul id=\"keys0005\" class=\"keyword\">\r\n\t<li id=\"key0005\" class=\"svKeywords\"><span id=\"\">clinical trials<\/span>;<\/li>\r\n\t<li id=\"key0010\" class=\"svKeywords\"><span id=\"\">online communities<\/span>;<\/li>\r\n\t<li id=\"key0015\" class=\"svKeywords\"><span id=\"\">patient-reported outcomes<\/span>;<\/li>\r\n\t<li id=\"key0020\" class=\"svKeywords\"><span id=\"\">social media<\/span><\/li>\r\n<\/ul>\r\n\r\n<hr class=\"artHeader\" \/>\r\n\r\n<h2 id=\"s0005\" class=\"svArticle\">Introduction<\/h2>\r\n<p id=\"p0005\" class=\"svArticle section\">Patient-reported outcomes (PROs) are increasingly recognized as important tools in adding value to the drug review and evaluation process <span id=\"bbib1\"><a id=\"ancbbib1\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib1\">[1]<\/a><\/span> because they provide unique perspectives on medical conditions or their therapies that are known only to the patient<span id=\"bbib2\"><a id=\"ancbbib2\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib2\">[2]<\/a><\/span>. \u201cContent validity\u201d describes the extent to which a PRO intended to assess such subjective outcomes actually measures the concept of interest <span id=\"bbib3\"><a id=\"ancbbib3\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib3\">[3]<\/a><\/span> and is an ongoing process that relies on the generation of qualitative and quantitative evidence. Crucially, PRO measures must reflect patient concerns relative to the concept being assessed and, therefore, documentation of content validity relies on patient input from the target population of patients <span id=\"bbib4\"><a id=\"ancbbib4\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib4\">[4]<\/a><\/span>. Qualitative studies are used to generate appropriate items and domains; to ensure the instrument is comprehensive relative to its intended measurement concept, population, and context of use; and to ensure patient understanding of the instrument, that is, instructions, items, and response options through cognitive debriefing <span id=\"bbib5\"><a id=\"ancbbib5\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib5\">[5]<\/a><\/span>. Best practices usually include either individual interviews or focus groups with participants who are experiencing the target condition or have recent experience with it. These traditional methods of collecting qualitative data to support the content validity of a new or existing PRO instrument, however, are labor intensive, time consuming, and relatively expensive. Although detailed figures are not available for specific parts of the instrument, development estimates from the New England Research Institutes suggest that developing a PRO from beginning to end takes at least 24 months and costs between $1 million and $5 million <span id=\"bbib6\"><a id=\"ancbbib6\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib6\">[6]<\/a><\/span>, whereas estimates shared at the 2011 C-Path meeting suggest up to 4 years for development and costs between $725,000 and $2.1 million <span id=\"bbib7\"><a id=\"ancbbib7\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib7\">[7]<\/a><\/span>. Furthermore, there are potential limitations in the diversity of the sample and the amount of data that may be collected to support both comprehensiveness of concepts and understanding of the PRO instrument using these methodologies <span id=\"bbib5\"><a id=\"ancbbib5\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib5\">[5]<\/a><\/span>.<\/p>\r\n\r\n<h2 id=\"s0010\" class=\"svArticle\">Social Media<\/h2>\r\n<p id=\"p0010\" class=\"svArticle section\">A new tool that may offer a technological boost to these efforts is \u201csocial media,\u201d a group of Internet-based applications (such as Facebook, Twitter, forums, or blogs) that allow the creation and exchange of user-generated content. The Pew Internet &amp; American Life Project noted in 2011 that the Internet has \u201cchanged people\u2019s relationships with information\u201d in many areas that affect our lives including health. For example, \u201conline resources, including advice from peers, are a significant source of heath information in the US\u201d <span id=\"bbib8\"><a id=\"ancbbib8\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib8\">[8]<\/a><\/span>. In a large and nationally representative survey of US adults in 2013, Pew found that 26% of the Internet users had read or watched someone else\u2019s experience about health or medical issues in the past year and 16% had tried to find others with the same health concerns, typically through social media <span id=\"bbib9\"><a id=\"ancbbib9\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib9\">[9]<\/a><\/span>.<\/p>\r\n<p id=\"p0015\" class=\"svArticle section\">The reach of such online communities is their greatest strength. For example, it is estimated that in 2013 the number of total users for the four largest social media platforms was 1.15 billion for Facebook, 500 million for Twitter, 500 million for Google+, and 238 million for LinkedIn (<span id=\"ir0005\" class=\"interref\" data-locatortype=\"url\" data-locatorkey=\"http:\/\/visual.ly\/social-media-2013\"><a class=\"cExLink\" href=\"http:\/\/visual.ly\/social-media-2013\" target=\"externObjLink\" data-url=\"\/science\/RedirectURL?_method=externObjLink&amp;_locator=url&amp;_cdi=270559&amp;_issn=10983015&amp;_origin=article&amp;_zone=art_page&amp;_targetURL=http%253A%252F%252Fvisual.ly%252Fsocial-media-2013\" data-itrprs=\"Y\">http:\/\/visual.ly\/social-media-2013<\/a><\/span>). Given that a proportion of the cost of PRO development lies in contacting and recruiting people with specific medical conditions and gathering data from them, social media presents an intriguing new route to accelerating research.<\/p>\r\n<p id=\"p0020\" class=\"svArticle section\">This new form of technology is relatively untested in terms of the adequacy of the information collected to support current definitions of best practices for data generation and analysis. This is particularly true of research to support content validity for the development of PROs for use in clinical trials to support labeling claims in the United States. To capitalize on the advantages of this new technology, stakeholders need to agree on what is appropriate methodology and focus research on resolving these issues. Currently, there is limited knowledge in the public domain on this topic.<\/p>\r\n<p id=\"p0025\" class=\"svArticle section\">To address this question, the authors organized a panel at a recent ISPOR meeting (2013, New Orleans) to discuss the application of social media for this type of data collection. We identified four stakeholders to share their perspective although there are certainly others who may be able to contribute knowledge, expertise, and experience to understanding the topic. Panelists who contributed to this article included representatives from a pharmaceutical sponsor of clinical trials (M.R. and A.G.), a US regulatory reviewer (E.J.P.), and a provider of a patient-powered research network for data collection through social media (P.W.). Presenters were asked to share their knowledge and experience, particularly with respect to their perception of the advantages and disadvantages of using social media to generate data to support the content validity of PRO measures in the context of drug development (<span id=\"bt0005\"><a id=\"ancbt0005\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#t0005\">Table 1<\/a><\/span>). The focus of this panel was on concept elicitation.<\/p>\r\n\r\n<div id=\"table_t0005\" class=\"figTblUpiOuter svArticle\"><dl id=\"t0005\" class=\"table \" data-t=\"t\" data-label=\"Table 1\"><dd class=\"lblCap\">\r\n<div class=\"caption\"><span class=\"label\">Table 1.<\/span>Comparison of traditional methods and potential for social media in PRO development.\r\n\r\n<\/div>\r\n<\/dd><dd class=\"table\" title=\"Comparison of traditional methods and potential for social media in PRO ...\">\r\n<table><colgroup><col \/><col \/><col \/><\/colgroup>\r\n<thead>\r\n<tr>\r\n<th colspan=\"1\" rowspan=\"1\" scope=\"col\"><\/th>\r\n<th colspan=\"1\" rowspan=\"1\" scope=\"col\"><strong class=\"boldFont\">Tradi<\/strong><strong class=\"boldFont\">tional methods<\/strong><\/th>\r\n<th colspan=\"1\" rowspan=\"1\" scope=\"col\"><strong class=\"boldFont\">Social media<\/strong><\/th>\r\n<\/tr>\r\n<\/thead>\r\n<tbody>\r\n<tr>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Participant identification<\/td>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Clinicians, hospital referral, advertising<\/td>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Patient self-identification and membership of online communities<\/td>\r\n<\/tr>\r\n<tr>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Diagnostic validation<\/td>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Primarily physician or medical records, sometimes self-reported<\/td>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Primarily self-reported, sometimes electronic medical records of physician<\/td>\r\n<\/tr>\r\n<tr>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Data collection setting<\/td>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Face-to-face individual or group interviews<\/td>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Asynchronous message boards, instant message chat, video chat<\/td>\r\n<\/tr>\r\n<tr>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Data collection format<\/td>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Semi-structured interview, in-person cognitive debriefing<\/td>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Interactive surveys, questionnaires, rating scales, video cognitive debriefing<\/td>\r\n<\/tr>\r\n<tr>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Advantages<\/td>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Criterion standard widely accepted by researchers and regulators as producing high-quality outputs<\/td>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Rapid, cheap, participatory, large-scale, new methods iterate rapidly. Typed data do not require transcription<\/td>\r\n<\/tr>\r\n<tr>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Limitations<\/td>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Time and labor intensive tasks such as transcription and recruitment<\/td>\r\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">New, untested in the regulatory approval process<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/dd><dd class=\"menuButtonLinks\">\r\n<div class=\"btnHolder\">\r\n<div class=\"down_Btn\"><\/div>\r\n<\/div>\r\n<\/dd><\/dl><\/div>\r\n<div class=\"page_fragment_ind\" data-id=\"frag_3\"><\/div>\r\n<\/div>\r\n<div id=\"frag_3\" class=\"page_fragment\" data-fid=\"3\">\r\n<h2 id=\"s0015\" class=\"svArticle\">Benefits of Social Media for PRO Concept Elicitation<\/h2>\r\n<p id=\"p0030\" class=\"svArticle section\">All the speakers indicated their belief that there are potential benefits to using social media for collecting concept elicitation data. The potential to access larger numbers of persons in the target population and thus obtain a greater amount of information in a shorter period of time is an advantage over traditional methods. Each social network has its own strengths and weaknesses (which should be tailored to each study); however, it is important to recognize that networks go through life cycles far more rapidly than do traditional social establishments <span id=\"bbib10\"><a id=\"ancbbib10\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib10\">[10]<\/a><\/span>. Although a full review of each network\u2019s strengths and limitations was outside the scope of the panel, a recent review by Grajales et al. <span id=\"bbib11\"><a id=\"ancbbib11\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib11\">[11]<\/a><\/span>provides a comprehensive overview of the scientific literature describing research with blogs (e.g., Wordpress), microblogs (e.g., Twitter), social networks (e.g., Facebook), professional sites (e.g., LinkedIn), wikis (e.g., Wikipedia), mashups (e.g., HealthMap), collaborative filtering sites (e.g., Reddit), media sharing sites (e.g., YouTube), and multiuser virtual environments (e.g., Second Life).<\/p>\r\n<p id=\"p0035\" class=\"svArticle section\">In a comparison of semi-structured interviews with blogs for purposes of PRO development, Acaster and Wild <span id=\"bbib12\"><a id=\"ancbbib12\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib12\">[12]<\/a><\/span> reported a high degree of convergence about symptoms experienced by women with menopausal hot flashes, with no major discrepancies in themes elicited between the two methods. In a study eliciting concepts among children from ulcerative colitis, Yen et al. <span id=\"bbib13\"><a id=\"ancbbib13\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib13\">[13]<\/a><\/span> used blogs to substantiate concepts identified through traditional interviews and found these data to be supportive. This area is still developing, however, and the most recent ISPOR PRO Good Practices Task Force guidance makes no mention of data gathered online <span id=\"bbib14\"><a id=\"ancbbib14\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib14\">[14]<\/a><\/span>. It is worth acknowledging, however, that different forms of social media might have differing potential to offer useful data. For example, the patient-powered research network PatientsLikeMe was recently described in the \u201ctapestry of big data\u201d as differing from blogs and tweets in that it not only captures structured data including demographic characteristics, medication, and diagnoses but also has aspects of a social network <span id=\"bbib15\"><a id=\"ancbbib15\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib15\">[15]<\/a><\/span>.<\/p>\r\n<p id=\"p0040\" class=\"svArticle section\">Although the authors are unaware of examples of the use of social media to develop PRO instruments for regulatory use to support labeling claims, it is often informative to draw from examples of uses of social media in instrument development outside this specific regulatory context. For instance, among the potentially broader online population there may be more participants who would not be responsive to traditional methods such as those who are too frail to travel or are not located within reasonable travel distance of a site. In one example provided to the panel, a long-term patient with amyotrophic lateral sclerosis (ALS) (who was a psychologist in her working life) complained that the ALSFRS-R scale <span id=\"bbib16\"><a id=\"ancbbib16\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib16\">[16]<\/a><\/span> had a floor effect\u2014she had been a \u201czero\u201d on this scale for many years. Determined not to be measured as a zero when there were many things she could still do, she collaborated with the research team and other patients with an advanced form of ALS to elicit the things that people who were nearly \u201clocked in\u201d to their bodies could still do, using the Internet to survey patients who might be responding using assistive technology such as eyeblink sensors or tiny switches. Within just a few weeks, a survey was fielded to over 300 patients with ALS, including those who had lost their ability to speak as would be required by traditional research, with subsequent 1-week and 3-month retests providing additional data, and three new PRO items were developed for use in those patients in the most advanced stages of ALS. These ALSFRS-Extension items have subsequently been translated into other languages <span id=\"bbib17\"><a id=\"ancbbib17\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib17\">[17]<\/a><\/span> and are used even by the Department of Veteran\u2019s Affairs brain bank <span id=\"bbib18\"><a id=\"ancbbib18\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib18\">[18]<\/a><\/span>, demonstrating a path from patient experience to clinical research use in a relatively short space of time. Although this example does not represent a PRO instrument that has undergone US regulatory review, it does represent the relevance and importance of broad patient input and the potential feasibility of very quickly and efficiently assessing the impact of such input on the psychometric properties of the revised instrument. This also demonstrates that the use of \u201csocial media\u201d is not merely limited to passive monitoring of otherwise purely social channels such as Facebook or Twitter <span id=\"bbib19\"><a id=\"ancbbib19\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib19\">[19]<\/a><\/span>, which users may feel are not appropriate channels for the sharing of medical information <span id=\"bbib20\"><a id=\"ancbbib20\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib20\">[20]<\/a><\/span>.<\/p>\r\n<p id=\"p0045\" class=\"svArticle section\">The naturalistic discussions that patients have with one another online in forums have been used to develop PROs in other conditions too, such as multiple sclerosis (MS). The MS Treatment Adherence Questionnaire <span id=\"bbib21\"><a id=\"ancbbib21\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib21\">[21]<\/a><\/span> and the MS Rating Scale have also been translated into other languages, evaluated against clinical measurement in the case of the MS Rating Scale <span id=\"bbib22\"><a id=\"ancbbib22\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib22\">[22]<\/a><\/span>, and are being deployed in prospective phase IV studies (e.g., EMD-Serono\u2019s \u201cAdherence Trial with MS Lifelines\u00ae Services,\u201d NCT01905527). As noted in the ALS example, this PRO instrument has not undergone US regulatory scrutiny but does offer a model of some of the advantages that use of social media may bring to PRO instrument development.<\/p>\r\n<p id=\"p0050\" class=\"svArticle section\">More recently, the Robert Wood Johnson Foundation\u2013funded \u201cOpen Research Exchange\u201d (ORE) has been piloted to allow researchers from external institutions to develop, iterate upon, and deploy new PRO measures using volunteers from social media to develop and provide rapid feedback on PRO items through five distinct phases: concept elicitation, feedback, test, retest, and follow-up <span id=\"bbib23\"><a id=\"ancbbib23\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib23\">[23]<\/a><\/span>. By selecting participants from among a wider pool, researchers can balance their sample to counteract the biases inherent in an online platform. Because the marginal resources needed to recruit 100 participants are not much higher than those needed to recruit 50 participants, the process can be more efficient than interviewer-led concept elicitation. For example, the development of an Insomnia Impact Questionnaire consisted of a concept elicitation phase with 16,331 words from 75 patients. This was used to develop items for a questionnaire that gathered item-level feedback from 54 selected participants, which yielded qualitative and quantitative data for improvement to the items. The refined questionnaire was then fielded to over 1300 patients for a psychometric test phase to establish scale performance. Each phase (concept elicitation, feedback, and test) took just 7 days. The software and the engaged population ensure that it is also relatively straightforward to automate test-retest at different intervals or the use of different response options with sample sizes adequate for statistical testing. In a second ORE example, the Treatment Burden Questionnaire, originally developed in French, underwent an English language pretest in 200 patients from around the world in less than a month, followed by a 610 patient psychometric test and a 282 patient retest, all in less than 2 months <span id=\"bbib24\"><a id=\"ancbbib24\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib24\">[24]<\/a><\/span>. All PROs developed on the ORE platform will remain free for anybody to use or build upon, using Creative Commons licensing arrangements. It is hoped that this technology can rapidly accelerate and improve upon the range of PROs available <span id=\"bbib23\"><a id=\"ancbbib23\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib23\">[23]<\/a><\/span>.<\/p>\r\n\r\n<h2 id=\"s0020\" class=\"svArticle\">Limitations of Social Media for PRO Concept Elicitation<\/h2>\r\n<p id=\"p0055\" class=\"svArticle section\">Several concerns with using social media to collect concept elicitation data were noted by the panel. The primary concern expressed by the panelists related to the uncertainty of the characteristics of the respondent, extending from demographic characteristics to diagnosis. In conducting face-to-face interviews or focus groups, researchers are usually able to seek confirmation of diagnosis via physician verification through a signed waiver from the patient for access to health information, though this has the effect of biasing respondents toward those comfortable with this level of sharing. In contrast, a well-known maxim states that \u201cOn the Internet, nobody knows you\u2019re a dog\u201d <span id=\"bbib25\"><a id=\"ancbbib25\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib25\">[25]<\/a><\/span>. This situation is changing though as online providers such as MediGuard undergo similar physician verification processes to their offline colleagues <span id=\"bbib26\"><a id=\"ancbbib26\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib26\">[26]<\/a><\/span>, or increasingly use electronic medical records to validate that patients are who they say they are <span id=\"bbib27\"><a id=\"ancbbib27\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib27\">[27]<\/a><\/span>. In a concept elicitation study of 50 patients with chronic lymphocytic leukemia, 80% of the patients agreed that researchers could contact their physicians to verify their diagnosis<span id=\"bbib28\"><a id=\"ancbbib28\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib28\">[28]<\/a><\/span>. This approach, however, might have downsides too, in that patients may feel less comfortable participating or sharing their experiences of embarrassing or stigmatized conditions, knowing that their identity will be known and verified.<\/p>\r\n<p id=\"p0060\" class=\"svArticle section\">Next, it was noted that recruiting the right patients is important regardless of the platform. For the development of instruments intended for use in medical product development, the respondents should adequately represent the targeted clinical trial population because content validity is context specific. In uncommon conditions such as organ transplantation, social media can have a wide reach; as many as 1% of all those receiving an organ transplant in 2009 shared their medical data on PatientsLikeMe <span id=\"bbib29\"><a id=\"ancbbib29\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib29\">[29]<\/a><\/span>, and Facebook was recently used to identify pediatric transplant patients who had been lost to follow-up by a clinical center <span id=\"bbib30\"><a id=\"ancbbib30\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib30\">[30]<\/a><\/span>. Participants in social media currently tend to be biased, however, toward younger patients, those who are female, or those with higher levels of education relative to clinical populations <span id=\"bbib1\"><a id=\"ancbbib1\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib1\">[1]<\/a><\/span>. With a sufficiently large sample, this issue can be addressed, however, by taking a stratified sampling approach in the recruitment phase.<\/p>\r\n<p id=\"p0065\" class=\"svArticle section\">Another concern related to the definition of social media, in that there are different types of digital media that may be used for collecting qualitative data. For instance, contacting patients who have volunteered to participate in a medical community associated with research (such as Genomera or 23andMe) is different from attempting to recruit people through Facebook who might not be expecting to be targeted on the basis of their profile data or medical charity pages they have \u201cliked.\u201d Some forms of social media such as Twitter are inherently limited to brief (140 character) communications, and it is unclear to what extent the abbreviated and asynchronous nature of online communication will hold up to the nuanced probing of a trained qualitative interviewer. Branthwaite and Pattterson<span id=\"bbib19\"><a id=\"ancbbib19\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib19\">[19]<\/a><\/span> suggest that social media fails to capitalize on the distinguishing features of qualitative research: having a conversation (rather than an instantaneous static expression of an individual in a given moment), active listening (rather than a software textbox unable to probe the \u201cspace between words\u201d), and an interactive \u201cmerging of minds\u201d or \u201crapport\u201d (rather than an audience of \u201cfollowers\u201d). Research will be needed to map out the advantages and disadvantages of each type of social media so that they may be more clearly understood moving forward, and if social media is going to have a place in the researchers toolkit, it is possible that these systems will adapt to overcome the limitations identified.<\/p>\r\n\r\n<h2 id=\"s0025\" class=\"svArticle\">Conclusions<\/h2>\r\n<p id=\"p0070\" class=\"svArticle section\">Overall, the panelists indicated that social media holds great potential as a means of recruitment of patients for qualitative research and collecting data to support the content validity of PRO measures used in product labeling as long as best practices are applied. The efforts of professional bodies such as ISPOR to embrace and validate other newer digital techniques such as e-PRO <span id=\"bbib1\"><a id=\"ancbbib1\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib1\">[1]<\/a><\/span> provide reassurance that research required to advance our understanding can be achieved. Specific concerns that need to be addressed include ways to have more confidence in the characteristics of the participant, especially diagnostic criteria, and more research is needed to understand the specific strengths and weaknesses of different forms of social media. It may be the case that a mixture of both face-to-face and online data collection offers advantages over either methodology alone.<\/p>\r\n<p id=\"p0075\" class=\"svArticle section\">Source of financial support: The authors have no other financial relationships to disclose.<\/p>\r\n\r\n<h2 class=\"p1\"><span class=\"s1\">References<\/span><\/h2>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib1\">[1]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">C. Acquadro, R. Berzon, D. Dubois, <i>et al.<\/i><\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Incorporating the patient\u2019s perspective into drug development and communication: an ad hoc task force report of the Patient-Reported Outcomes (PRO) Harmonization Group meeting at the Food and Drug Administration, February 16, 2001\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Value Health, 6 (2003), pp. 522\u2013531\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510601659\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510601659\/pdf?md5=6255efc8fc273319034f5f798827580f&amp;pid=1-s2.0-S1098301510601659-main.pdf\"><span class=\"s4\">\u00a0PDF (142 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-0141506945&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=141425f6e0debc310b8500b9264572f3\"><span class=\"s4\">View Record in Scopus<\/span><\/a> | <a href=\"http:\/\/dx.doi.org\/10.1046%2Fj.1524-4733.2003.65309.x\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-0141506945&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=141425f6e0debc310b8500b9264572f3\"><span class=\"s4\">Citing articles (214)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib2\">[2]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">D.L. Patrick, L.B. Burke, J.H. Powers, <i>et al.<\/i><\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Patient-reported outcomes to support medical product labeling claims: FDA perspective\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Value Health, 10 (Suppl) (2007), pp. S125\u2013S137\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510606377\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510606377\/pdf?md5=79d0ea789c8d3e7754db4da1030dda0c&amp;pid=1-s2.0-S1098301510606377-main.pdf\"><span class=\"s4\">\u00a0PDF (211 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-36048995250&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=90cd8c8810e03b375bdadc7f26d7a77d\"><span class=\"s4\">View Record in Scopus<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-36048995250&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=90cd8c8810e03b375bdadc7f26d7a77d\"><span class=\"s4\">Citing articles (173)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib3\">[3]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">P. Fayers, D. Machin<\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Quality of Life: The Assessment\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Analysis and Interpretation of Patient-Reported Outcomes (2007)\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib4\">[4]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">U.S. Department of Health and Human Services, Food and Drug Administration<\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Guidance for industry: patient-reported outcome measures\u2014use in medical product development to support labeling claims\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Fed Reg, 74 (2009), pp. 65132\u201365133\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib5\">[5]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">M. Rothman, L. Burke, P. Erickson, <i>et al.<\/i><\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Value Health, 12 (2009), pp. 1075\u20131083\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510603129\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510603129\/pdf?md5=5fcb0e3a5f99f14eed7db5e75e030556&amp;pid=1-s2.0-S1098301510603129-main.pdf\"><span class=\"s4\">\u00a0PDF (109 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-70350751583&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=4897ccedfe488570f001a31052a84c87\"><span class=\"s4\">View Record in Scopus<\/span><\/a> | <a href=\"http:\/\/dx.doi.org\/10.1111%2Fj.1524-4733.2009.00603.x\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-70350751583&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=4897ccedfe488570f001a31052a84c87\"><span class=\"s4\">Citing articles (64)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib6\">[6]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">Rosen R. Development of patient reported outcome (PRO) measures: how feasible is a PRO for asymptomatic PCa treatment? In: FDA Public Workshop: Clinical Trial Design Issues\u2014Drug and Device Development for Localized Prostate Cancer; San Diego, CA; May 5, 2013<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib7\">[7]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">Hayes R. Patient-reported outcome (PRO) instruments as drug development tools (session III). In: Consensus Science: New Tools and Tactics for Next-Gen Drug Development. Washington, DC; 2011<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib8\">[8]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">S. Fox<\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>The social life of health information\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Pew Research Center\u2019s Internet &amp; American Life ProjectPew Research Center, Washington, DC (2011)\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib9\">[9]<\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s3\">Fox S, Duggan M. Health online 2013. Available from: <a href=\"http:\/\/www.pewinternet.org\/2013\/01\/15\/health-online-2013\/\"><span class=\"s4\">http:\/\/www.pewinternet.org\/2013\/01\/15\/health-online-2013\/<\/span><\/a>.<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib10\">[10]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">C. Young<\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Community management that works: how to build and sustain a thriving online health community\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">J Med Internet Res, 15 (2013), p. e119\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/dx.doi.org\/10.2196%2Fjmir.2501\">Full Text via CrossRef<\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib11\">[11]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">F.J. Grajales, S. Sheps, K. Ho, <i>et al.<\/i><\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Social media: a review and tutorial of applications in medicine and health care\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">J Med Internet Res, 16 (2014), p. e13\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib12\">[12]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">S.L. Acaster, D. Wild<\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>PMC65: a novel comparison of qualitative data sources: content analysis of semi-structured patient interviews versus weblogs (Blogs)\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Value Health, 12 (2009), p. A31\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510732162\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510732162\/pdfft?md5=11b9482b967a2debafe5e9ed5d2a58d5&amp;pid=1-s2.0-S1098301510732162-main.pdf\"><span class=\"s4\">\u00a0PDF (87 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84920757053&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=60f22c96a05bd48a95ed01218c204644\"><span class=\"s4\">View Record in Scopus<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84920757053&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=60f22c96a05bd48a95ed01218c204644\"><span class=\"s4\">Citing articles (1)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib13\">[13]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">L. Yen, E. Flood, K. Beusterien, <i>et al.<\/i><\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>PGI25\u2014development of patient-reported outcomes (Pro) and observer-reported outcomes (Obsro) measures for pediatric ulcerative colitis: concept elicitation findings\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Value Health, 16 (2013), p. A216\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301513011662\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301513011662\/pdfft?md5=a79444198ae586801aaa0ec24e79bc26&amp;pid=1-s2.0-S1098301513011662-main.pdf\"><span class=\"s4\">\u00a0PDF (82 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84920765627&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=636cf81ee99a1c090a69356216830fc9\"><span class=\"s4\">View Record in Scopus<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84920765627&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=636cf81ee99a1c090a69356216830fc9\"><span class=\"s4\">Citing articles (1)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib14\">[14]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">D.L. Patrick, L.B. Burke, C.J. Gwaltney, <i>et al.<\/i><\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Content validity\u2014establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO Good Research Practices Task Force report: part 1\u2014eliciting concepts for a new PRO instrument\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Value Health, 14 (2011), pp. 967\u2013977\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301511033237\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301511033237\/pdfft?md5=8f92a282fdd5049bbd7d16cec5851451&amp;pid=1-s2.0-S1098301511033237-main.pdf\"><span class=\"s4\">\u00a0PDF (1333 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-80055007179&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=9178490d300e7c27f606078eca35b007\"><span class=\"s4\">View Record in Scopus<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-80055007179&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=9178490d300e7c27f606078eca35b007\"><span class=\"s4\">Citing articles (74)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib15\">[15]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">G.M. Weber, K.D. Mandl, I.S. Kohane<\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Finding the missing link for big biomedical data\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">JAMA, 311 (2014), pp. 2479\u20132480\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84902799705&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=92710b0379b50233d49323bbc2da53be\">View Record in Scopus<\/a><\/span><span class=\"s3\">\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84902799705&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=92710b0379b50233d49323bbc2da53be\"><span class=\"s4\">Citing articles (27)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib16\">[16]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">J.M. Cedarbaum, N. Stambler, E. Malta, C. Fuller<\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">J Neurol Sci, 169 (1999), pp. 13\u201321\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0022510X99002105\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0022510X99002105\/pdfft?md5=6b60cf6ca6dc26fe31fe988ff89cc544&amp;pid=1-s2.0-S0022510X99002105-main.pdf\"><span class=\"s4\">\u00a0PDF (151 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-0032692481&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=1267e27abfd1c6c32d6a811a7fb3b6fa\"><span class=\"s4\">View Record in Scopus<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-0032692481&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=1267e27abfd1c6c32d6a811a7fb3b6fa\"><span class=\"s4\">Citing articles (721)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib17\">[17]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">S. Abdulla, S. Vielhaber, S. K\u00f6rner, <i>et al.<\/i><\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Validation of the German version of the extended ALS functional rating scale as a patient-reported outcome measure\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">J Neurol, 260 (2013), pp. 2242\u20132255\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84884352115&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=aef2b5de6d05ec37b5671fa641f15605\">View Record in Scopus<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/dx.doi.org\/10.1007%2Fs00415-013-6955-6\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84884352115&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=aef2b5de6d05ec37b5671fa641f15605\"><span class=\"s4\">Citing articles (6)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib18\">[18]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">C.B. Brady, K.T. Trevor, T.D. Stein, <i>et al.<\/i><\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>The Department of Veterans Affairs Biorepository Brain Bank: a national resource for amyotrophic lateral sclerosis research\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Amyotroph Lateral Scler Frontotemporal Degener, 14 (2013), pp. 591\u2013597\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84887437762&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=88165f6436326d99851e01c597aac3e2\">View Record in Scopus<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/dx.doi.org\/10.3109%2F21678421.2013.822516\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84887437762&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=88165f6436326d99851e01c597aac3e2\"><span class=\"s4\">Citing articles (3)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib19\">[19]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">A. Branthwaite, S. Patterson<\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>The power of qualitative research in the era of social media\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Qual Market Res, 14 (2011), pp. 430\u2013440\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-80053055179&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=cb6efffa40e99fa2233fd8e3ec29b329\">View Record in Scopus<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/dx.doi.org\/10.1108%2F13522751111163245\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-80053055179&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=cb6efffa40e99fa2233fd8e3ec29b329\"><span class=\"s4\">Citing articles (11)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib20\">[20]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">M. van der Velden, K. El Emam<\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>\u201cNot all my friends need to know\u201d: a qualitative study of teenage patients, privacy, and social media\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">J Am Med Inform Assoc, 20 (2013), pp. 16\u201324\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84871883914&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=cbd0d142b37f82ea9342d8659e3fc6c4\">View Record in Scopus<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/dx.doi.org\/10.1136%2Famiajnl-2012-000949\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84871883914&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=cbd0d142b37f82ea9342d8659e3fc6c4\"><span class=\"s4\">Citing articles (16)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib21\">[21]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">P. Wicks, M. Massagli, A. Kulkarni, H. Dastani<\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Use of an online community to develop patient-reported outcome instruments: the Multiple Sclerosis Treatment Adherence Questionnaire (MS-TAQ)\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">J Med Internet Res, 13 (2011), p. e12\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84915784978&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=54f6acb9f4ad1eb408ad139ce51e78cd\">View Record in Scopus<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/dx.doi.org\/10.2196%2Fjmir.1687\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84915784978&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=54f6acb9f4ad1eb408ad139ce51e78cd\"><span class=\"s4\">Citing articles (1)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib22\">[22]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">R. Bove, E. Secor, B.C. Healy, <i>et al.<\/i><\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Evaluation of an online platform for multiple sclerosis research: patient description, validation of severity scale, and exploration of BMI effects on disease course\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">PLoS One, 8 (2013), p. e59707\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pone.0059707\">Full Text via CrossRef<\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib23\">[23]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">P. Wicks, B. Heywood, J. Heywood<\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Online platform to accelerate patient involvement in open instrument development\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Qual Life Res, 22 (2013), p. 55\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84901656720&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=fe6c69aa88f796fb5596d73e945eccba\">View Record in Scopus<\/a><\/span><span class=\"s3\">\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84901656720&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=fe6c69aa88f796fb5596d73e945eccba\"><span class=\"s4\">Citing articles (3)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib24\">[24]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">V.-T. Tran, M. Harrington, V.M. Montori, <i>et al.<\/i><\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Adaptation and validation of the Treatment Burden Questionnaire (TBQ) in English using an internet platform\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">BMC Med, 12 (2014), p. 109\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/dx.doi.org\/10.1186%2F1741-7015-12-109\">Full Text via CrossRef<\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib25\">[25]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">P. Steiner<\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>On the Internet, nobody knows you\u2019re a dog\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">New Yorker, 69 (1993), p. 61\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84930682242&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=9bc9cb71b1fc5d46b70fa402d0b568b1\">View Record in Scopus<\/a><\/span><span class=\"s3\">\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84930682242&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=9bc9cb71b1fc5d46b70fa402d0b568b1\"><span class=\"s4\">Citing articles (1)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib26\">[26]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">E. Cascade, D. Ford, M. Nixon, <i>et al.<\/i><\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>PCV124 Combining electronic health records and patient-reported information in the UK: preliminary results from wasps (Wales Sail + Pro Study)\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Value Health, 15 (2012), pp. A134\u2013A135\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301512016002\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301512016002\/pdfft?md5=b502f02a76e486f24a5e9e82169c6ca5&amp;pid=1-s2.0-S1098301512016002-main.pdf\"><span class=\"s4\">\u00a0PDF (70 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84920769341&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=dc896871b2d54bf785e8cefb576eaa2c\"><span class=\"s4\">View Record in Scopus<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84920769341&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=dc896871b2d54bf785e8cefb576eaa2c\"><span class=\"s4\">Citing articles (1)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib27\">[27]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">E. Cascade, P. Marr, M. Winslow, D. Tuttle<\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>PMS94 Integrating patient-reported outcomes (PRO) and medical record data (MR) in observational study designs: results from a direct-to-patient pilot study in gout\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Value Health, 15 (2012) A51\u2013A51\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib28\">[28]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">K.P. McCarrier, S. Bull, K.F. Simacek, <i>et al.<\/i><\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Online social networks-based qualitative research to identify patient-relevant concepts in chronic lymphocytic leukemia\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Value Health, 17 (2014), p. A196\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514011942\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514011942\/pdfft?md5=550234fe26f40b86c803677248e54689&amp;pid=1-s2.0-S1098301514011942-main.pdf\"><span class=\"s4\">\u00a0PDF (61 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84920861341&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=88a7bd1ad4e1e8611277c5fb4932a8a1\"><span class=\"s4\">View Record in Scopus<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84920861341&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=88a7bd1ad4e1e8611277c5fb4932a8a1\"><span class=\"s4\">Citing articles (1)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib29\">[29]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">P. Wicks, K.A. Sulham, A. Gnanasakthy<\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Quality of life in organ transplant recipients participating in an online transplant community\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Patient, 7 (2014), pp. 73\u201384\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84899118870&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=57b9016772e8e5ac36902684b4d21ed3\">View Record in Scopus<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/dx.doi.org\/10.1007%2Fs40271-013-0033-0\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84899118870&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=57b9016772e8e5ac36902684b4d21ed3\"><span class=\"s4\">Citing articles (3)<\/span><\/a><\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib30\">[30]<\/a><\/span><\/p>\r\n<p class=\"p3\"><span class=\"s1\">S. Mohammad, L. Hormaza, K. Neighbors, <i>et al.<\/i><\/span><\/p>\r\n<p class=\"p4\"><span class=\"s1\"><b>Health status in young adults two decades after pediatric liver transplantation\r\n<\/b><\/span><\/p>\r\n<p class=\"p5\"><span class=\"s1\">Am J Transplant, 12 (2012), pp. 1486\u20131495\r\n<\/span><\/p>\r\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84861813236&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=5d4a271199271a9e634b7bc0344b24d4\">View Record in Scopus<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/dx.doi.org\/10.1111%2Fj.1600-6143.2012.04080.x\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84861813236&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=5d4a271199271a9e634b7bc0344b24d4\"><span class=\"s4\">Citing articles (17)<\/span><\/a><\/span><\/p>\r\n\r\n<div class=\"page_fragment_ind\" data-id=\"frag_4\"><\/div>\r\n<\/div>\r\n<div id=\"frag_5\" class=\"page_fragment\" data-fid=\"5\">\r\n<div class=\"artFooterContent\"><dl id=\"cor1\" class=\"correspondence\"><dd><em>Address correspondence to:<\/em> Margaret Rothman, Janssen Pharmaceutical Companies of Johnson &amp; Johnson LLC, Raritan, NJ, USA.<\/dd><\/dl><\/div>\r\n<p class=\"copyright\">Copyright \u00a9 2015 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc.<\/p>\r\n\r\n<\/div>","rendered":"<div id=\"frag_1\" class=\"page_fragment auth_frag\" data-first=\"true\" data-fid=\"1\">\n<div id=\"doc0005\" class=\"publicationType\"><span id=\"\">COMMENTARY<\/span><\/div>\n<div class=\"module_topic_paths\"><\/div>\n<h2 id=\"tit0005\" class=\"svTitle\">Can We Use Social Media to Support Content Validity of Patient-Reported Outcome Instruments in Medical Product Development?<\/h2>\n<ul class=\"authorGroup noCollab svAuthor\">\n<li class=\"smh5\"><a id=\"authname_N35440de0N6543cb00\" class=\"authorName svAuthor\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#\" target=\"_blank\" data-orcid=\"\" data-t=\"a\" data-fn=\"Margaret\" data-ln=\"Rothman\" data-pos=\"1\" data-tb=\"\">Margaret Rothman<\/a>, <span class=\"authorDegrees\">PhD<\/span><a id=\"baff0005\" class=\"intra_ref auth_aff\" title=\"Affiliation: 1\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#aff0005\"><sup>1<\/sup><\/a><\/li>\n<li class=\"smh5\"><a id=\"authname_N35440de0N6543cc68\" class=\"authorName svAuthor\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#\" target=\"_blank\" data-orcid=\"\" data-t=\"a\" data-fn=\"Ari\" data-ln=\"Gnanaskathy\" data-pos=\"2\" data-tb=\"\">Ari Gnanaskathy<\/a>, <span class=\"authorDegrees\">MSc, MBA<\/span><a id=\"baff0010\" class=\"intra_ref auth_aff\" title=\"Affiliation: 2\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#aff0010\"><sup>2<\/sup><\/a><\/li>\n<li class=\"smh5\"><a id=\"authname_N35440de0N6543cd1c\" class=\"authorName svAuthor\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#\" target=\"_blank\" data-orcid=\"\" data-t=\"a\" data-fn=\"Paul\" data-ln=\"Wicks\" data-pos=\"3\" data-tb=\"\">Paul Wicks<\/a>, <span class=\"authorDegrees\">PhD<\/span><a id=\"baff0015\" class=\"intra_ref auth_aff\" title=\"Affiliation: 3\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#aff0015\"><sup>3<\/sup><\/a><\/li>\n<li class=\"smh5\"><a id=\"authname_N35440de0N6543cdd0\" class=\"authorName svAuthor\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#\" target=\"_blank\" data-orcid=\"\" data-t=\"a\" data-fn=\"Elektra J.\" data-ln=\"Papadopoulos\" data-pos=\"4\" data-tb=\"\">Elektra J. Papadopoulos<\/a>, <span class=\"authorDegrees\">MD, MPH<\/span><a id=\"baff0020\" class=\"intra_ref auth_aff\" title=\"Affiliation: 4\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#aff0020\"><sup>4<\/sup><\/a><\/li>\n<\/ul>\n<div id=\"currtAsOf\"><\/div>\n<div class=\"moreInformation\">\n<dl class=\"citation\">\n<dd class=\"oaUserLicense wrap2\">Under a Creative Commons <a id=\"ddOAuserLicense\" href=\"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/\" target=\"_blank\">license<\/a><\/dd>\n<\/dl>\n<\/div>\n<dl class=\"extLinks nonEmpty\">\n<dd class=\"doiLink\"><\/dd>\n<dd class=\"doi\"><a id=\"ddDoi\" class=\"S_C_ddDoi\" href=\"http:\/\/dx.doi.org\/10.1016\/j.jval.2014.10.001\" target=\"_blank\">doi:10.1016\/j.jval.2014.10.001<\/a><\/dd>\n<dd class=\"rightsLink\"><a class=\"cExLink S_C_outLinks\" title=\"Get rights and content\" href=\"https:\/\/s100.copyright.com\/AppDispatchServlet?publisherName=ELS&amp;contentID=S1098301514047263&amp;orderBeanReset=true\" target=\"_blank\" data-url=\"\/science\/RedirectURL?_method=outwardLink&amp;_partnerName=936&amp;_eid=1-s2.0-S1098301514047263&amp;_pii=S1098301514047263&amp;_origin=article&amp;_zone=art_page&amp;_targetURL=https:\/\/s100.copyright.com\/AppDispatchServlet?publisherName%3DELS%26contentID%3DS1098301514047263%26orderBeanReset%3Dtrue\"><span class=\"outText\">Get rights and content<\/span><\/a><\/dd>\n<\/dl>\n<div class=\"articleOAlabelForced\"><\/div>\n<div id=\"refersToAndreferredToBy\"><\/div>\n<div class=\"page_fragment_ind auth_frag\" data-id=\"frag_2\"><\/div>\n<\/div>\n<div id=\"frag_2\" class=\"page_fragment\" data-fid=\"2\">\n<div class=\"OAlabel\"><span class=\"articleOAstatus\">\u00a0\u00a0Open Access<\/span><\/p>\n<hr id=\"abs_authorab00051\" class=\"artHeader\" \/>\n<\/div>\n<div class=\"abstract svAbstract\" data-etype=\"ab\">\n<h2 id=\"authorab00051\" class=\"secHeading\">Abstract<\/h2>\n<p id=\"sp0010\">We report a panel designed to open a dialog between pharmaceutical sponsors, regulatory reviewers, and other stakeholders regarding the use of social media to collect data to support the content validity of patient-reported outcome instruments in the context of medical product labeling. Multiple stakeholder perspectives were brought together to better understand the issues encountered in pursuing social media as a form of data collection to support content validity. Presenters represented a pharmaceutical sponsor of clinical trials, a regulatory reviewer from the Food and Drug Administration, and an online data platform provider. Each presenter shared its perspective on the advantages and disadvantages of using social media to collect this type of information. There was consensus that there is great potential for using social media for this purpose. There remain, however, unanswered questions that need to be addressed such as identifying which type of social media is most appropriate for data collection and ensuring that participants are representative of the target population while maintaining the advantages of anonymity provided by online platforms. The use of social media to collect evidence of content validity holds much promise. Clarification of issues that need to be addressed and accumulation of empirical evidence to address these questions are essential to moving forward.<\/p>\n<\/div>\n<div id=\"SD_BA1P\" class=\"sgfNoTitleBar sgfNoGadgetBorder svDoNotLink ui-sortable\"><\/div>\n<h2 id=\"kwd_1\" class=\"svKeywords\">Keywords<\/h2>\n<ul id=\"keys0005\" class=\"keyword\">\n<li id=\"key0005\" class=\"svKeywords\"><span id=\"\">clinical trials<\/span>;<\/li>\n<li id=\"key0010\" class=\"svKeywords\"><span id=\"\">online communities<\/span>;<\/li>\n<li id=\"key0015\" class=\"svKeywords\"><span id=\"\">patient-reported outcomes<\/span>;<\/li>\n<li id=\"key0020\" class=\"svKeywords\"><span id=\"\">social media<\/span><\/li>\n<\/ul>\n<hr class=\"artHeader\" \/>\n<h2 id=\"s0005\" class=\"svArticle\">Introduction<\/h2>\n<p id=\"p0005\" class=\"svArticle section\">Patient-reported outcomes (PROs) are increasingly recognized as important tools in adding value to the drug review and evaluation process <span id=\"bbib1\"><a id=\"ancbbib1\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib1\">[1]<\/a><\/span> because they provide unique perspectives on medical conditions or their therapies that are known only to the patient<span id=\"bbib2\"><a id=\"ancbbib2\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib2\">[2]<\/a><\/span>. \u201cContent validity\u201d describes the extent to which a PRO intended to assess such subjective outcomes actually measures the concept of interest <span id=\"bbib3\"><a id=\"ancbbib3\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib3\">[3]<\/a><\/span> and is an ongoing process that relies on the generation of qualitative and quantitative evidence. Crucially, PRO measures must reflect patient concerns relative to the concept being assessed and, therefore, documentation of content validity relies on patient input from the target population of patients <span id=\"bbib4\"><a id=\"ancbbib4\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib4\">[4]<\/a><\/span>. Qualitative studies are used to generate appropriate items and domains; to ensure the instrument is comprehensive relative to its intended measurement concept, population, and context of use; and to ensure patient understanding of the instrument, that is, instructions, items, and response options through cognitive debriefing <span id=\"bbib5\"><a id=\"ancbbib5\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib5\">[5]<\/a><\/span>. Best practices usually include either individual interviews or focus groups with participants who are experiencing the target condition or have recent experience with it. These traditional methods of collecting qualitative data to support the content validity of a new or existing PRO instrument, however, are labor intensive, time consuming, and relatively expensive. Although detailed figures are not available for specific parts of the instrument, development estimates from the New England Research Institutes suggest that developing a PRO from beginning to end takes at least 24 months and costs between $1 million and $5 million <span id=\"bbib6\"><a id=\"ancbbib6\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib6\">[6]<\/a><\/span>, whereas estimates shared at the 2011 C-Path meeting suggest up to 4 years for development and costs between $725,000 and $2.1 million <span id=\"bbib7\"><a id=\"ancbbib7\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib7\">[7]<\/a><\/span>. Furthermore, there are potential limitations in the diversity of the sample and the amount of data that may be collected to support both comprehensiveness of concepts and understanding of the PRO instrument using these methodologies <span id=\"bbib5\"><a id=\"ancbbib5\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib5\">[5]<\/a><\/span>.<\/p>\n<h2 id=\"s0010\" class=\"svArticle\">Social Media<\/h2>\n<p id=\"p0010\" class=\"svArticle section\">A new tool that may offer a technological boost to these efforts is \u201csocial media,\u201d a group of Internet-based applications (such as Facebook, Twitter, forums, or blogs) that allow the creation and exchange of user-generated content. The Pew Internet &amp; American Life Project noted in 2011 that the Internet has \u201cchanged people\u2019s relationships with information\u201d in many areas that affect our lives including health. For example, \u201conline resources, including advice from peers, are a significant source of heath information in the US\u201d <span id=\"bbib8\"><a id=\"ancbbib8\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib8\">[8]<\/a><\/span>. In a large and nationally representative survey of US adults in 2013, Pew found that 26% of the Internet users had read or watched someone else\u2019s experience about health or medical issues in the past year and 16% had tried to find others with the same health concerns, typically through social media <span id=\"bbib9\"><a id=\"ancbbib9\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib9\">[9]<\/a><\/span>.<\/p>\n<p id=\"p0015\" class=\"svArticle section\">The reach of such online communities is their greatest strength. For example, it is estimated that in 2013 the number of total users for the four largest social media platforms was 1.15 billion for Facebook, 500 million for Twitter, 500 million for Google+, and 238 million for LinkedIn (<span id=\"ir0005\" class=\"interref\" data-locatortype=\"url\" data-locatorkey=\"http:\/\/visual.ly\/social-media-2013\"><a class=\"cExLink\" href=\"http:\/\/visual.ly\/social-media-2013\" target=\"externObjLink\" data-url=\"\/science\/RedirectURL?_method=externObjLink&amp;_locator=url&amp;_cdi=270559&amp;_issn=10983015&amp;_origin=article&amp;_zone=art_page&amp;_targetURL=http%253A%252F%252Fvisual.ly%252Fsocial-media-2013\" data-itrprs=\"Y\">http:\/\/visual.ly\/social-media-2013<\/a><\/span>). Given that a proportion of the cost of PRO development lies in contacting and recruiting people with specific medical conditions and gathering data from them, social media presents an intriguing new route to accelerating research.<\/p>\n<p id=\"p0020\" class=\"svArticle section\">This new form of technology is relatively untested in terms of the adequacy of the information collected to support current definitions of best practices for data generation and analysis. This is particularly true of research to support content validity for the development of PROs for use in clinical trials to support labeling claims in the United States. To capitalize on the advantages of this new technology, stakeholders need to agree on what is appropriate methodology and focus research on resolving these issues. Currently, there is limited knowledge in the public domain on this topic.<\/p>\n<p id=\"p0025\" class=\"svArticle section\">To address this question, the authors organized a panel at a recent ISPOR meeting (2013, New Orleans) to discuss the application of social media for this type of data collection. We identified four stakeholders to share their perspective although there are certainly others who may be able to contribute knowledge, expertise, and experience to understanding the topic. Panelists who contributed to this article included representatives from a pharmaceutical sponsor of clinical trials (M.R. and A.G.), a US regulatory reviewer (E.J.P.), and a provider of a patient-powered research network for data collection through social media (P.W.). Presenters were asked to share their knowledge and experience, particularly with respect to their perception of the advantages and disadvantages of using social media to generate data to support the content validity of PRO measures in the context of drug development (<span id=\"bt0005\"><a id=\"ancbt0005\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#t0005\">Table 1<\/a><\/span>). The focus of this panel was on concept elicitation.<\/p>\n<div id=\"table_t0005\" class=\"figTblUpiOuter svArticle\">\n<dl id=\"t0005\" class=\"table\" data-t=\"t\" data-label=\"Table 1\">\n<dd class=\"lblCap\">\n<div class=\"caption\"><span class=\"label\">Table 1.<\/span>Comparison of traditional methods and potential for social media in PRO development.<\/p>\n<\/div>\n<\/dd>\n<dd class=\"table\" title=\"Comparison of traditional methods and potential for social media in PRO ...\">\n<table>\n<colgroup>\n<col \/>\n<col \/>\n<col \/><\/colgroup>\n<thead>\n<tr>\n<th colspan=\"1\" rowspan=\"1\" scope=\"col\"><\/th>\n<th colspan=\"1\" rowspan=\"1\" scope=\"col\"><strong class=\"boldFont\">Tradi<\/strong><strong class=\"boldFont\">tional methods<\/strong><\/th>\n<th colspan=\"1\" rowspan=\"1\" scope=\"col\"><strong class=\"boldFont\">Social media<\/strong><\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Participant identification<\/td>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Clinicians, hospital referral, advertising<\/td>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Patient self-identification and membership of online communities<\/td>\n<\/tr>\n<tr>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Diagnostic validation<\/td>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Primarily physician or medical records, sometimes self-reported<\/td>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Primarily self-reported, sometimes electronic medical records of physician<\/td>\n<\/tr>\n<tr>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Data collection setting<\/td>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Face-to-face individual or group interviews<\/td>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Asynchronous message boards, instant message chat, video chat<\/td>\n<\/tr>\n<tr>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Data collection format<\/td>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Semi-structured interview, in-person cognitive debriefing<\/td>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Interactive surveys, questionnaires, rating scales, video cognitive debriefing<\/td>\n<\/tr>\n<tr>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Advantages<\/td>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Criterion standard widely accepted by researchers and regulators as producing high-quality outputs<\/td>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Rapid, cheap, participatory, large-scale, new methods iterate rapidly. Typed data do not require transcription<\/td>\n<\/tr>\n<tr>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Limitations<\/td>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">Time and labor intensive tasks such as transcription and recruitment<\/td>\n<td class=\"alignTD\" colspan=\"1\" rowspan=\"1\">New, untested in the regulatory approval process<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/dd>\n<dd class=\"menuButtonLinks\">\n<div class=\"btnHolder\">\n<div class=\"down_Btn\"><\/div>\n<\/div>\n<\/dd>\n<\/dl>\n<\/div>\n<div class=\"page_fragment_ind\" data-id=\"frag_3\"><\/div>\n<\/div>\n<div id=\"frag_3\" class=\"page_fragment\" data-fid=\"3\">\n<h2 id=\"s0015\" class=\"svArticle\">Benefits of Social Media for PRO Concept Elicitation<\/h2>\n<p id=\"p0030\" class=\"svArticle section\">All the speakers indicated their belief that there are potential benefits to using social media for collecting concept elicitation data. The potential to access larger numbers of persons in the target population and thus obtain a greater amount of information in a shorter period of time is an advantage over traditional methods. Each social network has its own strengths and weaknesses (which should be tailored to each study); however, it is important to recognize that networks go through life cycles far more rapidly than do traditional social establishments <span id=\"bbib10\"><a id=\"ancbbib10\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib10\">[10]<\/a><\/span>. Although a full review of each network\u2019s strengths and limitations was outside the scope of the panel, a recent review by Grajales et al. <span id=\"bbib11\"><a id=\"ancbbib11\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib11\">[11]<\/a><\/span>provides a comprehensive overview of the scientific literature describing research with blogs (e.g., WordPress), microblogs (e.g., Twitter), social networks (e.g., Facebook), professional sites (e.g., LinkedIn), wikis (e.g., Wikipedia), mashups (e.g., HealthMap), collaborative filtering sites (e.g., Reddit), media sharing sites (e.g., YouTube), and multiuser virtual environments (e.g., Second Life).<\/p>\n<p id=\"p0035\" class=\"svArticle section\">In a comparison of semi-structured interviews with blogs for purposes of PRO development, Acaster and Wild <span id=\"bbib12\"><a id=\"ancbbib12\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib12\">[12]<\/a><\/span> reported a high degree of convergence about symptoms experienced by women with menopausal hot flashes, with no major discrepancies in themes elicited between the two methods. In a study eliciting concepts among children from ulcerative colitis, Yen et al. <span id=\"bbib13\"><a id=\"ancbbib13\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib13\">[13]<\/a><\/span> used blogs to substantiate concepts identified through traditional interviews and found these data to be supportive. This area is still developing, however, and the most recent ISPOR PRO Good Practices Task Force guidance makes no mention of data gathered online <span id=\"bbib14\"><a id=\"ancbbib14\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib14\">[14]<\/a><\/span>. It is worth acknowledging, however, that different forms of social media might have differing potential to offer useful data. For example, the patient-powered research network PatientsLikeMe was recently described in the \u201ctapestry of big data\u201d as differing from blogs and tweets in that it not only captures structured data including demographic characteristics, medication, and diagnoses but also has aspects of a social network <span id=\"bbib15\"><a id=\"ancbbib15\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib15\">[15]<\/a><\/span>.<\/p>\n<p id=\"p0040\" class=\"svArticle section\">Although the authors are unaware of examples of the use of social media to develop PRO instruments for regulatory use to support labeling claims, it is often informative to draw from examples of uses of social media in instrument development outside this specific regulatory context. For instance, among the potentially broader online population there may be more participants who would not be responsive to traditional methods such as those who are too frail to travel or are not located within reasonable travel distance of a site. In one example provided to the panel, a long-term patient with amyotrophic lateral sclerosis (ALS) (who was a psychologist in her working life) complained that the ALSFRS-R scale <span id=\"bbib16\"><a id=\"ancbbib16\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib16\">[16]<\/a><\/span> had a floor effect\u2014she had been a \u201czero\u201d on this scale for many years. Determined not to be measured as a zero when there were many things she could still do, she collaborated with the research team and other patients with an advanced form of ALS to elicit the things that people who were nearly \u201clocked in\u201d to their bodies could still do, using the Internet to survey patients who might be responding using assistive technology such as eyeblink sensors or tiny switches. Within just a few weeks, a survey was fielded to over 300 patients with ALS, including those who had lost their ability to speak as would be required by traditional research, with subsequent 1-week and 3-month retests providing additional data, and three new PRO items were developed for use in those patients in the most advanced stages of ALS. These ALSFRS-Extension items have subsequently been translated into other languages <span id=\"bbib17\"><a id=\"ancbbib17\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib17\">[17]<\/a><\/span> and are used even by the Department of Veteran\u2019s Affairs brain bank <span id=\"bbib18\"><a id=\"ancbbib18\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib18\">[18]<\/a><\/span>, demonstrating a path from patient experience to clinical research use in a relatively short space of time. Although this example does not represent a PRO instrument that has undergone US regulatory review, it does represent the relevance and importance of broad patient input and the potential feasibility of very quickly and efficiently assessing the impact of such input on the psychometric properties of the revised instrument. This also demonstrates that the use of \u201csocial media\u201d is not merely limited to passive monitoring of otherwise purely social channels such as Facebook or Twitter <span id=\"bbib19\"><a id=\"ancbbib19\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib19\">[19]<\/a><\/span>, which users may feel are not appropriate channels for the sharing of medical information <span id=\"bbib20\"><a id=\"ancbbib20\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib20\">[20]<\/a><\/span>.<\/p>\n<p id=\"p0045\" class=\"svArticle section\">The naturalistic discussions that patients have with one another online in forums have been used to develop PROs in other conditions too, such as multiple sclerosis (MS). The MS Treatment Adherence Questionnaire <span id=\"bbib21\"><a id=\"ancbbib21\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib21\">[21]<\/a><\/span> and the MS Rating Scale have also been translated into other languages, evaluated against clinical measurement in the case of the MS Rating Scale <span id=\"bbib22\"><a id=\"ancbbib22\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib22\">[22]<\/a><\/span>, and are being deployed in prospective phase IV studies (e.g., EMD-Serono\u2019s \u201cAdherence Trial with MS Lifelines\u00ae Services,\u201d NCT01905527). As noted in the ALS example, this PRO instrument has not undergone US regulatory scrutiny but does offer a model of some of the advantages that use of social media may bring to PRO instrument development.<\/p>\n<p id=\"p0050\" class=\"svArticle section\">More recently, the Robert Wood Johnson Foundation\u2013funded \u201cOpen Research Exchange\u201d (ORE) has been piloted to allow researchers from external institutions to develop, iterate upon, and deploy new PRO measures using volunteers from social media to develop and provide rapid feedback on PRO items through five distinct phases: concept elicitation, feedback, test, retest, and follow-up <span id=\"bbib23\"><a id=\"ancbbib23\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib23\">[23]<\/a><\/span>. By selecting participants from among a wider pool, researchers can balance their sample to counteract the biases inherent in an online platform. Because the marginal resources needed to recruit 100 participants are not much higher than those needed to recruit 50 participants, the process can be more efficient than interviewer-led concept elicitation. For example, the development of an Insomnia Impact Questionnaire consisted of a concept elicitation phase with 16,331 words from 75 patients. This was used to develop items for a questionnaire that gathered item-level feedback from 54 selected participants, which yielded qualitative and quantitative data for improvement to the items. The refined questionnaire was then fielded to over 1300 patients for a psychometric test phase to establish scale performance. Each phase (concept elicitation, feedback, and test) took just 7 days. The software and the engaged population ensure that it is also relatively straightforward to automate test-retest at different intervals or the use of different response options with sample sizes adequate for statistical testing. In a second ORE example, the Treatment Burden Questionnaire, originally developed in French, underwent an English language pretest in 200 patients from around the world in less than a month, followed by a 610 patient psychometric test and a 282 patient retest, all in less than 2 months <span id=\"bbib24\"><a id=\"ancbbib24\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib24\">[24]<\/a><\/span>. All PROs developed on the ORE platform will remain free for anybody to use or build upon, using Creative Commons licensing arrangements. It is hoped that this technology can rapidly accelerate and improve upon the range of PROs available <span id=\"bbib23\"><a id=\"ancbbib23\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib23\">[23]<\/a><\/span>.<\/p>\n<h2 id=\"s0020\" class=\"svArticle\">Limitations of Social Media for PRO Concept Elicitation<\/h2>\n<p id=\"p0055\" class=\"svArticle section\">Several concerns with using social media to collect concept elicitation data were noted by the panel. The primary concern expressed by the panelists related to the uncertainty of the characteristics of the respondent, extending from demographic characteristics to diagnosis. In conducting face-to-face interviews or focus groups, researchers are usually able to seek confirmation of diagnosis via physician verification through a signed waiver from the patient for access to health information, though this has the effect of biasing respondents toward those comfortable with this level of sharing. In contrast, a well-known maxim states that \u201cOn the Internet, nobody knows you\u2019re a dog\u201d <span id=\"bbib25\"><a id=\"ancbbib25\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib25\">[25]<\/a><\/span>. This situation is changing though as online providers such as MediGuard undergo similar physician verification processes to their offline colleagues <span id=\"bbib26\"><a id=\"ancbbib26\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib26\">[26]<\/a><\/span>, or increasingly use electronic medical records to validate that patients are who they say they are <span id=\"bbib27\"><a id=\"ancbbib27\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib27\">[27]<\/a><\/span>. In a concept elicitation study of 50 patients with chronic lymphocytic leukemia, 80% of the patients agreed that researchers could contact their physicians to verify their diagnosis<span id=\"bbib28\"><a id=\"ancbbib28\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib28\">[28]<\/a><\/span>. This approach, however, might have downsides too, in that patients may feel less comfortable participating or sharing their experiences of embarrassing or stigmatized conditions, knowing that their identity will be known and verified.<\/p>\n<p id=\"p0060\" class=\"svArticle section\">Next, it was noted that recruiting the right patients is important regardless of the platform. For the development of instruments intended for use in medical product development, the respondents should adequately represent the targeted clinical trial population because content validity is context specific. In uncommon conditions such as organ transplantation, social media can have a wide reach; as many as 1% of all those receiving an organ transplant in 2009 shared their medical data on PatientsLikeMe <span id=\"bbib29\"><a id=\"ancbbib29\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib29\">[29]<\/a><\/span>, and Facebook was recently used to identify pediatric transplant patients who had been lost to follow-up by a clinical center <span id=\"bbib30\"><a id=\"ancbbib30\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib30\">[30]<\/a><\/span>. Participants in social media currently tend to be biased, however, toward younger patients, those who are female, or those with higher levels of education relative to clinical populations <span id=\"bbib1\"><a id=\"ancbbib1\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib1\">[1]<\/a><\/span>. With a sufficiently large sample, this issue can be addressed, however, by taking a stratified sampling approach in the recruitment phase.<\/p>\n<p id=\"p0065\" class=\"svArticle section\">Another concern related to the definition of social media, in that there are different types of digital media that may be used for collecting qualitative data. For instance, contacting patients who have volunteered to participate in a medical community associated with research (such as Genomera or 23andMe) is different from attempting to recruit people through Facebook who might not be expecting to be targeted on the basis of their profile data or medical charity pages they have \u201cliked.\u201d Some forms of social media such as Twitter are inherently limited to brief (140 character) communications, and it is unclear to what extent the abbreviated and asynchronous nature of online communication will hold up to the nuanced probing of a trained qualitative interviewer. Branthwaite and Pattterson<span id=\"bbib19\"><a id=\"ancbbib19\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib19\">[19]<\/a><\/span> suggest that social media fails to capitalize on the distinguishing features of qualitative research: having a conversation (rather than an instantaneous static expression of an individual in a given moment), active listening (rather than a software textbox unable to probe the \u201cspace between words\u201d), and an interactive \u201cmerging of minds\u201d or \u201crapport\u201d (rather than an audience of \u201cfollowers\u201d). Research will be needed to map out the advantages and disadvantages of each type of social media so that they may be more clearly understood moving forward, and if social media is going to have a place in the researchers toolkit, it is possible that these systems will adapt to overcome the limitations identified.<\/p>\n<h2 id=\"s0025\" class=\"svArticle\">Conclusions<\/h2>\n<p id=\"p0070\" class=\"svArticle section\">Overall, the panelists indicated that social media holds great potential as a means of recruitment of patients for qualitative research and collecting data to support the content validity of PRO measures used in product labeling as long as best practices are applied. The efforts of professional bodies such as ISPOR to embrace and validate other newer digital techniques such as e-PRO <span id=\"bbib1\"><a id=\"ancbbib1\" class=\"intra_ref\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib1\">[1]<\/a><\/span> provide reassurance that research required to advance our understanding can be achieved. Specific concerns that need to be addressed include ways to have more confidence in the characteristics of the participant, especially diagnostic criteria, and more research is needed to understand the specific strengths and weaknesses of different forms of social media. It may be the case that a mixture of both face-to-face and online data collection offers advantages over either methodology alone.<\/p>\n<p id=\"p0075\" class=\"svArticle section\">Source of financial support: The authors have no other financial relationships to disclose.<\/p>\n<h2 class=\"p1\"><span class=\"s1\">References<\/span><\/h2>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib1\">[1]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">C. Acquadro, R. Berzon, D. Dubois, <i>et al.<\/i><\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Incorporating the patient\u2019s perspective into drug development and communication: an ad hoc task force report of the Patient-Reported Outcomes (PRO) Harmonization Group meeting at the Food and Drug Administration, February 16, 2001<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Value Health, 6 (2003), pp. 522\u2013531<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510601659\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510601659\/pdf?md5=6255efc8fc273319034f5f798827580f&amp;pid=1-s2.0-S1098301510601659-main.pdf\"><span class=\"s4\">\u00a0PDF (142 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-0141506945&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=141425f6e0debc310b8500b9264572f3\"><span class=\"s4\">View Record in Scopus<\/span><\/a> | <a href=\"http:\/\/dx.doi.org\/10.1046%2Fj.1524-4733.2003.65309.x\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-0141506945&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=141425f6e0debc310b8500b9264572f3\"><span class=\"s4\">Citing articles (214)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib2\">[2]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">D.L. Patrick, L.B. Burke, J.H. Powers, <i>et al.<\/i><\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Patient-reported outcomes to support medical product labeling claims: FDA perspective<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Value Health, 10 (Suppl) (2007), pp. S125\u2013S137<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510606377\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510606377\/pdf?md5=79d0ea789c8d3e7754db4da1030dda0c&amp;pid=1-s2.0-S1098301510606377-main.pdf\"><span class=\"s4\">\u00a0PDF (211 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-36048995250&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=90cd8c8810e03b375bdadc7f26d7a77d\"><span class=\"s4\">View Record in Scopus<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-36048995250&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=90cd8c8810e03b375bdadc7f26d7a77d\"><span class=\"s4\">Citing articles (173)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib3\">[3]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">P. Fayers, D. Machin<\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Quality of Life: The Assessment<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Analysis and Interpretation of Patient-Reported Outcomes (2007)<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib4\">[4]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">U.S. Department of Health and Human Services, Food and Drug Administration<\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Guidance for industry: patient-reported outcome measures\u2014use in medical product development to support labeling claims<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Fed Reg, 74 (2009), pp. 65132\u201365133<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib5\">[5]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">M. Rothman, L. Burke, P. Erickson, <i>et al.<\/i><\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Value Health, 12 (2009), pp. 1075\u20131083<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510603129\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510603129\/pdf?md5=5fcb0e3a5f99f14eed7db5e75e030556&amp;pid=1-s2.0-S1098301510603129-main.pdf\"><span class=\"s4\">\u00a0PDF (109 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-70350751583&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=4897ccedfe488570f001a31052a84c87\"><span class=\"s4\">View Record in Scopus<\/span><\/a> | <a href=\"http:\/\/dx.doi.org\/10.1111%2Fj.1524-4733.2009.00603.x\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-70350751583&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=4897ccedfe488570f001a31052a84c87\"><span class=\"s4\">Citing articles (64)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib6\">[6]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">Rosen R. Development of patient reported outcome (PRO) measures: how feasible is a PRO for asymptomatic PCa treatment? In: FDA Public Workshop: Clinical Trial Design Issues\u2014Drug and Device Development for Localized Prostate Cancer; San Diego, CA; May 5, 2013<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib7\">[7]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">Hayes R. Patient-reported outcome (PRO) instruments as drug development tools (session III). In: Consensus Science: New Tools and Tactics for Next-Gen Drug Development. Washington, DC; 2011<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib8\">[8]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">S. Fox<\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>The social life of health information<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Pew Research Center\u2019s Internet &amp; American Life ProjectPew Research Center, Washington, DC (2011)<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib9\">[9]<\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s3\">Fox S, Duggan M. Health online 2013. Available from: <a href=\"http:\/\/www.pewinternet.org\/2013\/01\/15\/health-online-2013\/\"><span class=\"s4\">http:\/\/www.pewinternet.org\/2013\/01\/15\/health-online-2013\/<\/span><\/a>.<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib10\">[10]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">C. Young<\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Community management that works: how to build and sustain a thriving online health community<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">J Med Internet Res, 15 (2013), p. e119<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/dx.doi.org\/10.2196%2Fjmir.2501\">Full Text via CrossRef<\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib11\">[11]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">F.J. Grajales, S. Sheps, K. Ho, <i>et al.<\/i><\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Social media: a review and tutorial of applications in medicine and health care<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">J Med Internet Res, 16 (2014), p. e13<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib12\">[12]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">S.L. Acaster, D. Wild<\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>PMC65: a novel comparison of qualitative data sources: content analysis of semi-structured patient interviews versus weblogs (Blogs)<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Value Health, 12 (2009), p. A31<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510732162\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301510732162\/pdfft?md5=11b9482b967a2debafe5e9ed5d2a58d5&amp;pid=1-s2.0-S1098301510732162-main.pdf\"><span class=\"s4\">\u00a0PDF (87 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84920757053&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=60f22c96a05bd48a95ed01218c204644\"><span class=\"s4\">View Record in Scopus<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84920757053&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=60f22c96a05bd48a95ed01218c204644\"><span class=\"s4\">Citing articles (1)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib13\">[13]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">L. Yen, E. Flood, K. Beusterien, <i>et al.<\/i><\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>PGI25\u2014development of patient-reported outcomes (Pro) and observer-reported outcomes (Obsro) measures for pediatric ulcerative colitis: concept elicitation findings<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Value Health, 16 (2013), p. A216<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301513011662\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301513011662\/pdfft?md5=a79444198ae586801aaa0ec24e79bc26&amp;pid=1-s2.0-S1098301513011662-main.pdf\"><span class=\"s4\">\u00a0PDF (82 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84920765627&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=636cf81ee99a1c090a69356216830fc9\"><span class=\"s4\">View Record in Scopus<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84920765627&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=636cf81ee99a1c090a69356216830fc9\"><span class=\"s4\">Citing articles (1)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib14\">[14]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">D.L. Patrick, L.B. Burke, C.J. Gwaltney, <i>et al.<\/i><\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Content validity\u2014establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO Good Research Practices Task Force report: part 1\u2014eliciting concepts for a new PRO instrument<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Value Health, 14 (2011), pp. 967\u2013977<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301511033237\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301511033237\/pdfft?md5=8f92a282fdd5049bbd7d16cec5851451&amp;pid=1-s2.0-S1098301511033237-main.pdf\"><span class=\"s4\">\u00a0PDF (1333 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-80055007179&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=9178490d300e7c27f606078eca35b007\"><span class=\"s4\">View Record in Scopus<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-80055007179&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=9178490d300e7c27f606078eca35b007\"><span class=\"s4\">Citing articles (74)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib15\">[15]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">G.M. Weber, K.D. Mandl, I.S. Kohane<\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Finding the missing link for big biomedical data<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">JAMA, 311 (2014), pp. 2479\u20132480<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84902799705&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=92710b0379b50233d49323bbc2da53be\">View Record in Scopus<\/a><\/span><span class=\"s3\">\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84902799705&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=92710b0379b50233d49323bbc2da53be\"><span class=\"s4\">Citing articles (27)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib16\">[16]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">J.M. Cedarbaum, N. Stambler, E. Malta, C. Fuller<\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">J Neurol Sci, 169 (1999), pp. 13\u201321<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0022510X99002105\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0022510X99002105\/pdfft?md5=6b60cf6ca6dc26fe31fe988ff89cc544&amp;pid=1-s2.0-S0022510X99002105-main.pdf\"><span class=\"s4\">\u00a0PDF (151 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-0032692481&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=1267e27abfd1c6c32d6a811a7fb3b6fa\"><span class=\"s4\">View Record in Scopus<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-0032692481&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=1267e27abfd1c6c32d6a811a7fb3b6fa\"><span class=\"s4\">Citing articles (721)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib17\">[17]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">S. Abdulla, S. Vielhaber, S. K\u00f6rner, <i>et al.<\/i><\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Validation of the German version of the extended ALS functional rating scale as a patient-reported outcome measure<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">J Neurol, 260 (2013), pp. 2242\u20132255<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84884352115&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=aef2b5de6d05ec37b5671fa641f15605\">View Record in Scopus<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/dx.doi.org\/10.1007%2Fs00415-013-6955-6\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84884352115&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=aef2b5de6d05ec37b5671fa641f15605\"><span class=\"s4\">Citing articles (6)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib18\">[18]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">C.B. Brady, K.T. Trevor, T.D. Stein, <i>et al.<\/i><\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>The Department of Veterans Affairs Biorepository Brain Bank: a national resource for amyotrophic lateral sclerosis research<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Amyotroph Lateral Scler Frontotemporal Degener, 14 (2013), pp. 591\u2013597<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84887437762&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=88165f6436326d99851e01c597aac3e2\">View Record in Scopus<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/dx.doi.org\/10.3109%2F21678421.2013.822516\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84887437762&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=88165f6436326d99851e01c597aac3e2\"><span class=\"s4\">Citing articles (3)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib19\">[19]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">A. Branthwaite, S. Patterson<\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>The power of qualitative research in the era of social media<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Qual Market Res, 14 (2011), pp. 430\u2013440<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-80053055179&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=cb6efffa40e99fa2233fd8e3ec29b329\">View Record in Scopus<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/dx.doi.org\/10.1108%2F13522751111163245\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-80053055179&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=cb6efffa40e99fa2233fd8e3ec29b329\"><span class=\"s4\">Citing articles (11)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib20\">[20]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">M. van der Velden, K. El Emam<\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>\u201cNot all my friends need to know\u201d: a qualitative study of teenage patients, privacy, and social media<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">J Am Med Inform Assoc, 20 (2013), pp. 16\u201324<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84871883914&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=cbd0d142b37f82ea9342d8659e3fc6c4\">View Record in Scopus<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/dx.doi.org\/10.1136%2Famiajnl-2012-000949\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84871883914&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=cbd0d142b37f82ea9342d8659e3fc6c4\"><span class=\"s4\">Citing articles (16)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib21\">[21]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">P. Wicks, M. Massagli, A. Kulkarni, H. Dastani<\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Use of an online community to develop patient-reported outcome instruments: the Multiple Sclerosis Treatment Adherence Questionnaire (MS-TAQ)<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">J Med Internet Res, 13 (2011), p. e12<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84915784978&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=54f6acb9f4ad1eb408ad139ce51e78cd\">View Record in Scopus<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/dx.doi.org\/10.2196%2Fjmir.1687\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84915784978&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=54f6acb9f4ad1eb408ad139ce51e78cd\"><span class=\"s4\">Citing articles (1)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib22\">[22]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">R. Bove, E. Secor, B.C. Healy, <i>et al.<\/i><\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Evaluation of an online platform for multiple sclerosis research: patient description, validation of severity scale, and exploration of BMI effects on disease course<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">PLoS One, 8 (2013), p. e59707<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/dx.doi.org\/10.1371%2Fjournal.pone.0059707\">Full Text via CrossRef<\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib23\">[23]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">P. Wicks, B. Heywood, J. Heywood<\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Online platform to accelerate patient involvement in open instrument development<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Qual Life Res, 22 (2013), p. 55<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84901656720&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=fe6c69aa88f796fb5596d73e945eccba\">View Record in Scopus<\/a><\/span><span class=\"s3\">\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84901656720&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=fe6c69aa88f796fb5596d73e945eccba\"><span class=\"s4\">Citing articles (3)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib24\">[24]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">V.-T. Tran, M. Harrington, V.M. Montori, <i>et al.<\/i><\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Adaptation and validation of the Treatment Burden Questionnaire (TBQ) in English using an internet platform<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">BMC Med, 12 (2014), p. 109<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/dx.doi.org\/10.1186%2F1741-7015-12-109\">Full Text via CrossRef<\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib25\">[25]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">P. Steiner<\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>On the Internet, nobody knows you\u2019re a dog<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">New Yorker, 69 (1993), p. 61<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84930682242&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=9bc9cb71b1fc5d46b70fa402d0b568b1\">View Record in Scopus<\/a><\/span><span class=\"s3\">\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84930682242&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=9bc9cb71b1fc5d46b70fa402d0b568b1\"><span class=\"s4\">Citing articles (1)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib26\">[26]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">E. Cascade, D. Ford, M. Nixon, <i>et al.<\/i><\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>PCV124 Combining electronic health records and patient-reported information in the UK: preliminary results from wasps (Wales Sail + Pro Study)<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Value Health, 15 (2012), pp. A134\u2013A135<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301512016002\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301512016002\/pdfft?md5=b502f02a76e486f24a5e9e82169c6ca5&amp;pid=1-s2.0-S1098301512016002-main.pdf\"><span class=\"s4\">\u00a0PDF (70 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84920769341&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=dc896871b2d54bf785e8cefb576eaa2c\"><span class=\"s4\">View Record in Scopus<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84920769341&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=dc896871b2d54bf785e8cefb576eaa2c\"><span class=\"s4\">Citing articles (1)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib27\">[27]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">E. Cascade, P. Marr, M. Winslow, D. Tuttle<\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>PMS94 Integrating patient-reported outcomes (PRO) and medical record data (MR) in observational study designs: results from a direct-to-patient pilot study in gout<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Value Health, 15 (2012) A51\u2013A51<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib28\">[28]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">K.P. McCarrier, S. Bull, K.F. Simacek, <i>et al.<\/i><\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Online social networks-based qualitative research to identify patient-relevant concepts in chronic lymphocytic leukemia<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Value Health, 17 (2014), p. A196<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514011942\">Article<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514011942\/pdfft?md5=550234fe26f40b86c803677248e54689&amp;pid=1-s2.0-S1098301514011942-main.pdf\"><span class=\"s4\">\u00a0PDF (61 K)<\/span><\/a> | <a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84920861341&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=88a7bd1ad4e1e8611277c5fb4932a8a1\"><span class=\"s4\">View Record in Scopus<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84920861341&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=88a7bd1ad4e1e8611277c5fb4932a8a1\"><span class=\"s4\">Citing articles (1)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib29\">[29]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">P. Wicks, K.A. Sulham, A. Gnanasakthy<\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Quality of life in organ transplant recipients participating in an online transplant community<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Patient, 7 (2014), pp. 73\u201384<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84899118870&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=57b9016772e8e5ac36902684b4d21ed3\">View Record in Scopus<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/dx.doi.org\/10.1007%2Fs40271-013-0033-0\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84899118870&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=57b9016772e8e5ac36902684b4d21ed3\"><span class=\"s4\">Citing articles (3)<\/span><\/a><\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263#bib30\">[30]<\/a><\/span><\/p>\n<p class=\"p3\"><span class=\"s1\">S. Mohammad, L. Hormaza, K. Neighbors, <i>et al.<\/i><\/span><\/p>\n<p class=\"p4\"><span class=\"s1\"><b>Health status in young adults two decades after pediatric liver transplantation<br \/>\n<\/b><\/span><\/p>\n<p class=\"p5\"><span class=\"s1\">Am J Transplant, 12 (2012), pp. 1486\u20131495<br \/>\n<\/span><\/p>\n<p class=\"p2\"><span class=\"s1\"><a href=\"http:\/\/www.scopus.com\/inward\/record.url?eid=2-s2.0-84861813236&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=5d4a271199271a9e634b7bc0344b24d4\">View Record in Scopus<\/a><\/span><span class=\"s3\"> | <a href=\"http:\/\/dx.doi.org\/10.1111%2Fj.1600-6143.2012.04080.x\"><span class=\"s4\">Full Text via CrossRef<\/span><\/a>\u00a0|\u00a0<a href=\"http:\/\/www.scopus.com\/inward\/citedby.url?eid=2-s2.0-84861813236&amp;partnerID=10&amp;rel=R3.0.0&amp;md5=5d4a271199271a9e634b7bc0344b24d4\"><span class=\"s4\">Citing articles (17)<\/span><\/a><\/span><\/p>\n<div class=\"page_fragment_ind\" data-id=\"frag_4\"><\/div>\n<\/div>\n<div id=\"frag_5\" class=\"page_fragment\" data-fid=\"5\">\n<div class=\"artFooterContent\">\n<dl id=\"cor1\" class=\"correspondence\">\n<dd><em>Address correspondence to:<\/em> Margaret Rothman, Janssen Pharmaceutical Companies of Johnson &amp; Johnson LLC, Raritan, NJ, USA.<\/dd>\n<\/dl>\n<\/div>\n<p class=\"copyright\">Copyright \u00a9 2015 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc.<\/p>\n<\/div>\n\n\t\t\t <section class=\"citations-section\" role=\"contentinfo\">\n\t\t\t <h3>Candela Citations<\/h3>\n\t\t\t\t\t <div>\n\t\t\t\t\t\t <div id=\"citation-list-232\">\n\t\t\t\t\t\t\t <div class=\"licensing\"><div class=\"license-attribution-dropdown-subheading\">CC licensed content, Shared previously<\/div><ul class=\"citation-list\"><li>Can We Use Social Media to Support Content Validity of Patient-Reported Outcome Instruments in Medical Product Development?. <strong>Authored by<\/strong>: Margaret Rothman, PhD, Ari Gnanaskathy, MSc, MBA, Paul Wicks, PhD, and Elektra J. Papadopoulos, MD, MPH. <strong>Provided by<\/strong>: Value in Health. <strong>Located at<\/strong>: <a target=\"_blank\" href=\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263\">http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263<\/a>. <strong>License<\/strong>: <em><a target=\"_blank\" rel=\"license\" href=\"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/\">CC BY-NC-ND: Attribution-NonCommercial-NoDerivatives <\/a><\/em><\/li><\/ul><\/div>\n\t\t\t\t\t\t <\/div>\n\t\t\t\t\t <\/div>\n\t\t\t <\/section>","protected":false},"author":277,"menu_order":6,"template":"","meta":{"_candela_citation":"[{\"type\":\"cc\",\"description\":\"Can We Use Social Media to Support Content Validity of Patient-Reported Outcome Instruments in Medical Product Development?\",\"author\":\"Margaret Rothman, PhD, Ari Gnanaskathy, MSc, MBA, Paul Wicks, PhD, and Elektra J. Papadopoulos, MD, MPH\",\"organization\":\"Value in Health\",\"url\":\"http:\/\/www.sciencedirect.com\/science\/article\/pii\/S1098301514047263\",\"project\":\"\",\"license\":\"cc-by-nc-nd\",\"license_terms\":\"\"}]","CANDELA_OUTCOMES_GUID":"","pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"class_list":["post-232","chapter","type-chapter","status-publish","hentry"],"part":110,"_links":{"self":[{"href":"https:\/\/courses.lumenlearning.com\/readinganthology\/wp-json\/pressbooks\/v2\/chapters\/232","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/courses.lumenlearning.com\/readinganthology\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/courses.lumenlearning.com\/readinganthology\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/readinganthology\/wp-json\/wp\/v2\/users\/277"}],"version-history":[{"count":1,"href":"https:\/\/courses.lumenlearning.com\/readinganthology\/wp-json\/pressbooks\/v2\/chapters\/232\/revisions"}],"predecessor-version":[{"id":233,"href":"https:\/\/courses.lumenlearning.com\/readinganthology\/wp-json\/pressbooks\/v2\/chapters\/232\/revisions\/233"}],"part":[{"href":"https:\/\/courses.lumenlearning.com\/readinganthology\/wp-json\/pressbooks\/v2\/parts\/110"}],"metadata":[{"href":"https:\/\/courses.lumenlearning.com\/readinganthology\/wp-json\/pressbooks\/v2\/chapters\/232\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/courses.lumenlearning.com\/readinganthology\/wp-json\/wp\/v2\/media?parent=232"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/readinganthology\/wp-json\/pressbooks\/v2\/chapter-type?post=232"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/readinganthology\/wp-json\/wp\/v2\/contributor?post=232"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/courses.lumenlearning.com\/readinganthology\/wp-json\/wp\/v2\/license?post=232"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}