How to Measure Survey Reliability and Validity

In addition, he covers issues such as: how to measure reliability (including test-retest, alternate form, internal consistency, inter-observer and intra-observer reliability); how to measure validity (including content, criterion and ...


Author: Arlene Fink

Publisher: SAGE

ISBN: 0803957041

Category: Medical

Page: 87

View: 459

Improving the accuracy of a survey is the focus of Mark S. Litwin's book, which shows how to assess and interpret the quality of survey data by thoroughly examining the survey instrument used. He explains how to code and pilot test new and established surveys. In addition, he covers issues such as: how to measure reliability (including test-retest, alternate form, internal consistency, inter-observer and intra-observer reliability); how to measure validity (including content, criterion and construct validity); how to address cross-cultural issues in survey research; and how to scale and score a survey.

Encyclopedia of Survey Research Methods

Reliability and validity assessment (Sage University Paper Series on Quantitative
Applications in the Social Sciences, No. 07-017). Beverly Hills, CA: Sage. Litwin,
M. S. (1995). Survey kit: Vol. 7. How to measure survey reliability and validity.


Author: Paul J. Lavrakas

Publisher: SAGE Publications

ISBN: 9781452261478

Category: Social Science

Page: 1072

View: 864

In conjunction with top survey researchers around the world and with Nielsen Media Research serving as the corporate sponsor, the Encyclopedia of Survey Research Methods presents state-of-the-art information and methodological examples from the field of survey research. Although there are other "how-to" guides and references texts on survey research, none is as comprehensive as this Encyclopedia, and none presents the material in such a focused and approachable manner. With more than 600 entries, this resource uses a Total Survey Error perspective that considers all aspects of possible survey error from a cost-benefit standpoint.

Conducting Survey Research in the Social Sciences

Psychometric Considerations The three psychometric considerations (
measurement considerations) are reliability, validity, and usability. Reliability
means ... Validity means that the survey item really does measure what you want
it to measure.


Author: Isadore Newman

Publisher: University Press of America

ISBN: 076181227X

Category: Social Science

Page: 103

View: 227

Conducting Survey Research in the Social Sciences presents basic concepts and general guidelines for those who are interested in conducting a survey by breaking the process down into eight steps and twenty-three questions. It outlines the appropriate sequential steps necessary to help the reader initiate and develop a survey. Following each of the eight steps as depicted in the eight chapters and answering the questions provided enables the creation of an effective survey. The authors also include three fictitious vignettes to illustrate how the decisions should be made, and how proper survey research should be conducted to meet many different needs.

Foundations of Psychological Testing

Survey. Reliability. and. Validity. Good surveys are reliable and valid. A reliable
survey is free of measurement error and provides you with similar information
each time you use it. As with psychological tests, we can determine the reliability
of a ...


Author: Sandra A. McIntire

Publisher: SAGE

ISBN: 9781412924849

Category: Psychology

Page: 632

View: 683

The Second Edition of Foundations of Psychological Testing: A Practical Approach is a scholarly, yet pragmatic and easy to understand text for undergraduate students new to the field of psychological testing. Using an engaging, conversational format, authors Sandra A. McIntire and Leslie A. Miller aim to prepare students to be informed consumers—as test users or test takers—not to teach students to administer or interpret individual psychological tests.

The SAGE Handbook of Public Opinion Research

Obtaining accurate, reliable and valid assessments of public opinion is critical for
any survey project, but it is not a simple task. ... to produce questions with these
qualities and methods to measure the degree of reliability and validity present.


Author: Wolfgang Donsbach

Publisher: SAGE

ISBN: 9781446206515

Category: Political Science

Page: 640

View: 784

'Some of the most experienced and thoughtful research experts in the world have contributed to this comprehensive Handbook, which should have a place on every serious survey researcher's bookshelf' - Sir Robert Worcester, Founder of MORI and President of WAPOR '82-'84. 'This is the book I have been waiting for. It not only reflects the state of the art, but will most likely also shape public opinion on public opinion research' - Olof Petersson, Professor of political science, SNS, Stockholm, Sweden 'The Handbook of Public Opinion Research is very authoritative, well organized, and sensitive to key issues in opinion research around the world. It will be my first choice as a general reference book for orienting users and training producers of opinion polls in Southeast Asia' - Mahar K. Mangahas, Ph.D., President of Social Weather Stations, Philippines ( 'This is the most comprehensive book on public opinion research to date' - Robert Ting-Yiu Chung, Secretary-Treasurer, World Association for Public Opinion Research (WAPOR); Director of Public Opinion Programme, The University of Hong Kong Public opinion theory and research are becoming increasingly significant in modern societies as people's attitudes and behaviours become ever more volatile and opinion poll data becomes ever more readily available. This major new Handbook is the first to bring together into one volume the whole field of public opinion theory, research methodology, and the political and social embeddedness of polls in modern societies. It comprehensively maps out the state-of-the-art in contemporary scholarship on these topics. With over fifty chapters written by distinguished international researchers, both academic and from the commercial sector, this Handbook is designed to: - give the reader an overview of the most important concepts included in and surrounding the term 'public opinion' and its application in modern social research - present the basic empirical concepts for assessing public opinion and opinion changes in society - provide an overview of the social, political and legal status of public opinion research, how it is perceived by the public and by journalists, and how it is used by governments - offer a review of the role and use of surveys for selected special fields of application, ranging from their use in legal cases to the use of polls in marketing and campaigns. The Handbook of Public Opinion Research provides an indispensable resource for both practitioners and students alike.

Qualitative Inquiry in Geoscience Education Research

Litwin, M.S., 1995, How to Measure Survey Reliability and Validity: Thousand
Oaks, California, Sage Publications, 87 p. Lopez, W., 1996, Communication
validity and rating scales: Rasch Measurement Transactions, v. 10, no. 1, p. 482–


Author: Anthony D. Feig

Publisher: Geological Society of America

ISBN: 9780813724744

Category: Science

Page: 211

View: 449

How To Report On Surveys

If it does , it is valid ( and reliable ) . When you make the claim that your survey
measures depression , or any other construct , you must quantitatively
demonstrate its reliability and validity . Reliability refers to the consistency of a
score and the ...


Author: Arlene Fink

Publisher: SAGE

ISBN: 0761925759

Category: Education

Page: 104

View: 509

From making presentations to general versus technical/academic audiences to preparing computerized presentations, How to Report on Surveys, Second Edition shows you how to create more effective verbal and written survey reports. The volume includes guidelines for preparing and interpreting charts, tables, and figures, and a step-by-step account of how to present each part of the survey--from the survey's objectives, design and psychometric properties through to the conclusions. New to this edition: * How to identify characteristics of good Web reporting * How to prepare computerized presentations * How to explain what's on-screen This book will show you how to prepare and explain accurate and useful survey reports in a highly effective manner. "Good tips on doing slides and describing the differences between oral and written report writing. I was glad that the difference between academic and general reports was stated at the beginning." --Carol J. Lancaster, Medical University of South Carolina

Handbook of Health Survey Methods

With psychometrics as the parallel in health survey research, the reliability and
validity of measures of ecologic settings has been referred to as ecometrics (
Raudenbush and Sampson 1999). As mentioned earlier, the consistency of
ratings ...


Author: Timothy P. Johnson

Publisher: John Wiley & Sons

ISBN: 9781118594742

Category: Medical

Page: 840

View: 448

A comprehensive guidebook to the current methodologies and practices used in health surveys A unique and self-contained resource, Handbook of Health Survey Methods presents techniques necessary for confronting challenges that are specific to health survey research. The handbook guides readers through the development of sample designs, data collection procedures, and analytic methods for studies aimed at gathering health information on general and targeted populations. The book is organized into five well-defined sections: Design and Sampling Issues, Measurement Issues, Field Issues, Health Surveys of Special Populations, and Data Management and Analysis. Maintaining an easy-to-follow format, each chapter begins with an introduction, followed by an overview of the main concepts, theories, and applications associated with each topic. Finally, each chapter provides connections to relevant online resources for additional study and reference. The Handbook of Health Survey Methods features: 29 methodological chapters written by highly qualified experts in academia, research, and industry A treatment of the best statistical practices and specific methodologies for collecting data from special populations such as sexual minorities, persons with disabilities, patients, and practitioners Discussions on issues specific to health research including developing physical health and mental health measures, collecting information on sensitive topics, sampling for clinical trials, collecting biospecimens, working with proxy respondents, and linking health data to administrative and other external data sources Numerous real-world examples from the latest research in the fields of public health, biomedicine, and health psychology Handbook of Health Survey Methods is an ideal reference for academics, researchers, and practitioners who apply survey methods and analyze data in the fields of biomedicine, public health, epidemiology, and biostatistics. The handbook is also a useful supplement for upper-undergraduate and graduate-level courses on survey methodology.

The Psychology Research Handbook

Construct Validity With respect to construct validity, surveys share the strengths
and weaknesses of other self-report and ... Reliability and validity of survey
measures can be examined, as with any other measure, and research findings
support ...


Author: Frederick T. L. Leong

Publisher: SAGE

ISBN: 9780761930228

Category: Psychology

Page: 516

View: 576

A comprehensive, easy-to-understand guide to the entire research process, this book quickly and efficiently equips advanced students and research assistants to conduct a full-scale investigation. The book is organized around the idea of a 'research script' that is, it follows the standard mode of research planning and design, data collection and analysis, and results writing. The volume contains 35 chapters, some co-authored by advanced graduate students who give their fellow students a touch of the 'real world' adding to the clarity and practicality of many chapters.

Values Beliefs and Attitudes

But what about the reliability of survey questions? Like validity, there are several
aspects of reliability and several ways to test a survey's reliability. One way is
called test- retest reliability. If we have a valid measure of intelligence (IQ), ...


Author: Stewart D. Allen

Publisher: DIANE Publishing

ISBN: 9781437926644


Page: 112

View: 817

Knowing about public values, beliefs, and attitudes (VBA) relevant to public land mgmt. is one foundation for understanding the linkages between the needs of nearby communities, and regional and nat. residents. Managers aware of the systematic differences in VBA held by the public and stakeholders are in a better position to define resource issues, develop alternative ways of addressing them, assess their social and cultural impacts, identify acceptable mgmt. measures, and monitor the results. This guide is designed to acquaint Forest Service staff with the concepts of VBA; to demonstrate ways in which VBA and assoc, concepts can be measured; and to suggest methods for applying VBA info. to decisions about projects and plans. Illus.

Handbook of Survey Research

Chapter 3 Measurement' George W. Bohrnstedt Measurement is a sine qua non
of any science. ... surprising that historically survey researchers have paid scant
attention to examining the reliability and validity of their measurements. Of current


Author: Peter H. Rossi

Publisher: Academic Press

ISBN: 9781483276304

Category: Social Science

Page: 774

View: 148

Handbook of Survey Research provides an introduction to the theory and practice of sample survey research. It addresses both the student who desires to master these topics and the practicing survey researcher who needs a source that codifies, rationalizes, and presents existing theory and practice. The handbook can be organized into three major parts. Part 1 sets forth the basic theoretical issues involved in sampling, measurement, and management of survey organizations. Part 2 deals mainly with ""hands-on,"" how-to-do-it issues: how to draw theoretically acceptable samples, how to write questionnaires, how to combine responses into appropriate scales and indices, how to avoid response effects and measurement errors, how actually to go about gathering survey data, how to avoid missing data (and what to do when you cannot), and other topics of a similar nature. Part 3 considers the analysis of survey data, with separate chapters for each of the three major multivariate analysis modes and one chapter on the uses of surveys in monitoring overtime trends. This handbook will be valuable both to advanced students and to practicing survey researchers seeking a detailed guide to the major issues in the design and analysis of sample surveys and to current state of the art practices in sample surveys.

Chinese Strategic Culture and Foreign Policy Decision Making

Face validity does not depend on established theories for support. See Arlene
Fink, How to Measure Survey Reliability and Validity (Thousand Oaks, CA: Sage
Publications, 1995). My attention was first drawn to some of the translations 1111
2 ...


Author: Huiyun Feng

Publisher: Routledge

ISBN: 9781134113729

Category: History

Page: 200

View: 662

Examining the major academic and policy debates over China’s rise and related policy issues, this book looks into the motivations and intentions of a rising China. Most of the scholarly works on China’s rise approach the question at a structural level by looking at the international system and the systemic impact on China’s foreign policy. Traditional Realist theorists define China as a revisionist power eager to address wrongs done to them in history, whilst some cultural and historical analyses attest that China’s strategic culture has been offensive despite its weak material capability. Huiyun Feng’s path-breaking contribution to the debate tests these rival hypotheses by examining systematically the beliefs of contemporary Chinese leaders and their strategic interactions with other states since 1949 when the communist regime came to power. The focus is on tracing the historical roots of Chinese strategic culture and its links to the decision-making of six key Chinese leaders via their belief systems. Chinese Strategic Culture will be of interest to students of Chinese politics, foreign policy, strategic theory and international relations in general.

International Handbook of Survey Methodology

Reliability and validity are the standards by which we measure how well a
question performs. The validity of measurement refers to how well the answer to
a question corresponds with the true value for the construct that is being
measured ...


Author: Edith D. de Leeuw

Publisher: Routledge

ISBN: 9781136910623

Category: Psychology

Page: 560

View: 106

Taking into account both traditional and emerging modes, this comprehensive new Handbook covers all major methodological and statistical issues in designing and analyzing surveys. With contributions from the world's leading survey methodologists and statisticians, this invaluable new resource provides guidance on collecting survey data and creating meaningful results. Featuring examples from a variety of countries, the book reviews such things as how to deal with sample designs, write survey questions, and collect data on the Internet. A thorough review of the procedures associated with multiple modes of collecting sample survey information and applying that combination of methods that fit the situation best is included. The International Handbook of Survey Methodology opens with the foundations of survey design, ranging from sources of error, to ethical issues. This is followed by a section on design that reviews sampling challenges and tips on writing and testing questions for multiple methods. Part three focuses on data collection, from face-to-face interviews, to Internet and interactive voice response, to special challenges involved in mixing these modes within one survey. Analyzing data from both simple and complex surveys is then explored, as well as procedures for adjusting data. The book concludes with a discussion of maintaining quality. Intended for advanced students and researchers in the behavioral, social, and health sciences, this "must have" resource will appeal to those interested in conducting or using survey data from anywhere in the world, especially those interested in comparing results across countries. The book also serves as a state-of-the-art text for graduate level courses and seminars on survey methodology. A companion website contains additional readings and examples.

Indexes to Survey Methodology Literature

... The Reliability and validity of Measures of Family Life and Relationships I
72266 04801 On the validity of Projective Questions 71110 22801 ttendance in
an Adult Education Program Validity of Questionnaire Data — Reported and
Observed ...


Author: United States. Bureau of the Census. Statistical Research Division


ISBN: UOM:39015005438323

Category: Social surveys

Page: 225

View: 424

Handbook of Research on Electronic Surveys and Measurements

1996, research that has measured the cognitive load placed on subjects has
used this rating scale. To date, no better method of rating has been found, and
the validity and reliability of the original 9point Likert scale has been very


Author: Reynolds, Rodney A.

Publisher: IGI Global

ISBN: 9781591407935

Category: Business & Economics

Page: 418

View: 211

"This book is the comprehensive reference source for innovative knowledge on electronic surveys. It provides complete coverage of the challenges associated with the use of the Internet to develop online surveys, administer Web-based instruments, and conduct computer-mediated assessments. This combination of how-to information about online research coupled with profiles of specific measures makes it an indispensable reference"--Provided by publisher.

Measuring Functioning and Well being

Chapter 16 describes its development and the reliability and validity findings in
the general population . The mos 6 - Item General Health Survey ( chapter 17 )
represents an approach that is also comprehensive but is based on six single -
item ...


Author: Anita L. Stewart

Publisher: Duke University Press

ISBN: 0822312123

Category: Medical

Page: 449

View: 877

Measuring Functioning and Well-Being is a comprehensive account a broad range of self-reported functioning and well-being measures developed for the Medical Outcomes Study, a large-sale study of how patients fare with health care in the United States. This book provides a set of ready-to-use generic measures that are applicable to all adults, including those well and chronically ill, as well as a methodological guide to collecting health data and constructing health measures. As demand increases for more practical methods to monitor the outcomes of health care, this volume offers a timely and valuable contribution to the field. The contributors address conceptual and methodological issues involved in measuring such important health status concepts as: physical, social, and role functioning; psychological distress and well-being; general health perceptions; energy and fatigue; sleep; and pain. The authors present psychometric results and explain how to administer, score, and interpret the measures. Comprising the work of a number of highly respected scholars in the field of health asessment, Measuring Functioning and Well-Being will be of great interest and value to the growing number of researchers, policymakers, and clinicians concerned with the management and evaluation of health care.

Understanding Education Indicators

Reliability is the extent to which a measure yields consistent estimates. It refers ...
populations (Asians, American Indians) tend to be unreliable since only a small
number of respondents are selected to participate in the survey. ... Instead, the
concepts of reliability and validity can best be conceived as lying along


Author: Mike Planty

Publisher: Teachers College Press

ISBN: 9780807771723

Category: Education

Page: 161

View: 579

In the push to bring data to bear on all of the important education issues of the day, one essential fact is often overlooked: Not all indicators are created equal. This bookprovides a comprehensive approach for understanding how statistical measures of achievement are developed, evaluated, and interpreted. Given the extent to which accountability measures determine outcomes for schools and students, this practical introduction is essential reading for a wide audience that includes school administrators, teachers, policymakers, and the media. The authors strive to increase “statistical literacy” by engaging readers in the process of becoming thoughtful and critical users of data. With the practitioner in mind, this hands-on primer: Outlines a viable approach to interpreting the vast array of available data about education in the United States.Uses clear, jargon-free language with real examples from local, national, and international indicator systems.Offers a website ( with additional resources, examples, and a forum for up-to-the-minute policy discussions.Mike Planty is a statistician at the U.S. Department of Justice, Washington, DC. Deven Carlson is a Ph.D. candidate in political science and a graduate research fellow at the Wisconsin Center for Education Research at the University of Wisconsin–Madison. “Mike Planty and Deven Carlson have taken pity on nonexpert readers of the glut of information about schools and, in this incisive and clearly written book, show how to figure it all out.” —Jay Mathews, Washington Post education columnist “In a data-driven world where competing experts will cite conflicting stats and figures to make their case, Planty and Carlson have penned a volume that will prove invaluable to parents, practitioners, and policymakers trying to separate fact from fiction. If you want to know what’s really going on in education today, read this book.” —Frederick M. Hess, Director of Education Policy Studies at the American Enterprise Institute “Education researchers, policy analysts, and journalists interested in understanding what really is going on behind the ‘simple’ data that drive the education policy debate need this book.” —Jack Buckley, New York University and former Deputy Commissioner of the National Center for Education Statistics

Online Research Essentials

If you create a survey that has mistakes or really does not measure what you
intended to measure, then the whole ... Also, keep in mind that if a survey exists
that measures what you need and is known to be reliable and valid, there is no ...


Author: Brenda Russell

Publisher: John Wiley & Sons

ISBN: 9780470185681

Category: Education

Page: 344

View: 323

Online Research Essentials Designing and Implementing Research Studies Online Research Essentials Written by experts in the field, Online Research Essentials provides step-b-step guidance to the student or new practitioner in how to create, test, and deploy online survey research. The book includes everything needed for planning and developing a survey, putting it online, and formatting data for further analysis. Russell and Purcell provide support for using the popular Microsoft Expression Web and Adobe Dreamweaver web page authoring tools and for using the Access database that is used to collect and store survey results. Online Research Essentials is a comprehensive resource that discusses the practical aspects of survey development and applied research and offers information on a wide range of research-related topics that include: Scientific method and research design Ethical considerations on using the Internet for research Creating web pages Planning the research study Creating a simple survey on the Internet Developing an e-survey Creating more complicated Internet surveys Sampling procedures Developing experimental designs JavaScript and web programming and advanced JavaScript programming Repeated measures and matched group designs