The Science of Evaluation

The Science of Evaluation PDF

Author: Ray Pawson

Publisher: SAGE

Published: 2013-02-01

Total Pages: 244

ISBN-13: 1446290980

DOWNLOAD EBOOK →

Evaluation researchers are tasked with providing the evidence to guide programme building and to assess its outcomes. As such, they labour under the highest expectations - bringing independence and objectivity to policy making. They face huge challenges, given the complexity of modern interventions and the politicised backdrop to all of their investigations. They have responded with a huge portfolio of research techniques and, through their professional associations, have set up schemes to establish standards for evaluative inquiry and to accredit evaluation practitioners. A big question remains. Has this monumental effort produced a progressive, cumulative and authoritative body of knowledge that we might think of as evaluation science? This is the question addressed by Ray Pawson in this sequel to Realistic Evaluation and Evidence-based Policy. In answer, he provides a detailed blueprint for an evaluation science based on realist principles.

Fundamental Issues in Evaluation

Fundamental Issues in Evaluation PDF

Author: Nick L. Smith

Publisher: Guilford Press

Published: 2008-01-01

Total Pages: 289

ISBN-13: 1593853424

DOWNLOAD EBOOK →

Providing state-of-the-art perspectives on what evaluation is, its purpose, and how to ensure it is done well, this book brings together major evaluation researchers from a variety of social and behavioral science disciplines. Each chapter identifies a fundamental issue facing the field today; considers its implications for theory, method, practice, or the profession; and explores one or more approaches to dealing with the issue. Among the topics addressed are the nature of expertise in evaluation, how to build a better evidence base for evaluation theory, promoting cultural competence in evaluation, how to synthesize evaluation research findings, ways to involve stakeholders in decision making, and much more.

Program Theory-Driven Evaluation Science

Program Theory-Driven Evaluation Science PDF

Author: Stewart I. Donaldson

Publisher: Routledge

Published: 2007-05-21

Total Pages: 253

ISBN-13: 1136677321

DOWNLOAD EBOOK →

Program Theory-Driven Evaluation Science fills the gap between 21st century literature on evaluation and what is happening in practice. It features detailed examples of how evaluations actually unfold in practice to develop people, programs, and organizations. Commonly accepted strategies for practicing evaluation are outlined, followed by comprehe

The Evaluation of Research by Scientometric Indicators

The Evaluation of Research by Scientometric Indicators PDF

Author: Peter Vinkler

Publisher: Elsevier

Published: 2010-01-20

Total Pages: 336

ISBN-13: 1780630255

DOWNLOAD EBOOK →

Aimed at academics, academic managers and administrators, professionals in scientometrics, information scientists and science policy makers at all levels. This book reviews the principles, methods and indicators of scientometric evaluation of information processes in science and assessment of the publication activity of individuals, teams, institutes and countries. It provides scientists, science officers, librarians and students with basic and advanced knowledge on evaluative scientometrics. Especially great stress is laid on the methods applicable in practice and on the clarification of quantitative aspects of impact of scientific publications measured by citation indicators. Written by a highly knowledgeable and well-respected scientist in the field Provides practical and realistic quantitative methods for evaluating scientific publication activities of individuals, teams, countries and journals Gives standardized descriptions and classification of the main categories of evaluative scientometrics

Leading Change Through Evaluation

Leading Change Through Evaluation PDF

Author: Kristen L. Rohanna

Publisher: SAGE Publications

Published: 2021-10-04

Total Pages: 140

ISBN-13: 1071847872

DOWNLOAD EBOOK →

Evaluators who are interested in developing or improving a program or policy frequently look to formative evaluation as a guiding framework. This book shows why those hoping to use evaluation to drive change in complex systems, rather than develop or improve one program, policy, or product, need to shift from the oversimplified idea of formative evaluation to a more specified continuous improvement model grounded in improvement science. In doing so, author Kristen L. Rohanna provides guidance to both evaluators and others, such as K-12 educators or hospital administrators, who lead improvement initiatives in their organizations and seek to solve persistent problems of practice. The book includes an extended case study: a networked improvement community of five public middle and high schools.

Question Evaluation Methods

Question Evaluation Methods PDF

Author: Jennifer Madans

Publisher: John Wiley & Sons

Published: 2011-10-14

Total Pages: 299

ISBN-13: 1118036999

DOWNLOAD EBOOK →

Insightful observations on common question evaluation methods and best practices for data collection in survey research Featuring contributions from leading researchers and academicians in the field of survey research, Question Evaluation Methods: Contributing to the Science of Data Quality sheds light on question response error and introduces an interdisciplinary, cross-method approach that is essential for advancing knowledge about data quality and ensuring the credibility of conclusions drawn from surveys and censuses. Offering a variety of expert analyses of question evaluation methods, the book provides recommendations and best practices for researchers working with data in the health and social sciences. Based on a workshop held at the National Center for Health Statistics (NCHS), this book presents and compares various question evaluation methods that are used in modern-day data collection and analysis. Each section includes an introduction to a method by a leading authority in the field, followed by responses from other experts that outline related strengths, weaknesses, and underlying assumptions. Topics covered include: Behavior coding Cognitive interviewing Item response theory Latent class analysis Split-sample experiments Multitrait-multimethod experiments Field-based data methods A concluding discussion identifies common themes across the presented material and their relevance to the future of survey methods, data analysis, and the production of Federal statistics. Together, the methods presented in this book offer researchers various scientific approaches to evaluating survey quality to ensure that the responses to these questions result in reliable, high-quality data. Question Evaluation Methods is a valuable supplement for courses on questionnaire design, survey methods, and evaluation methods at the upper-undergraduate and graduate levels. it also serves as a reference for government statisticians, survey methodologists, and researchers and practitioners who carry out survey research in the areas of the social and health sciences.

An Introduction to Evaluation

An Introduction to Evaluation PDF

Author: Chris Fox

Publisher: SAGE

Published: 2016-10-18

Total Pages: 329

ISBN-13: 1473987040

DOWNLOAD EBOOK →

Both practical and theoretical in approach, this book is the perfect companion for student researchers and policy makers alike. It provides actionable advice for planning and implementing evaluations, while also instilling an ability to assess the evaluations of others and consider the ways in which evaluation evidence could influence policy and practice. Drawing upon a wide range of examples from policy areas like education, criminal justice, and health and social care, this book showcases how evaluation is an interdisciplinary research practice with a spectrum of applications. Each chapter contains philosophical underpinnings and applied knowledge as well as examples from published evaluations. Specific topics include how to: Choose an approach to evaluation Plan, design, and conduct evaluations Approach evaluations using theories of change Differentiate between process, impact, and economic evaluations Understand the role of quantitative and qualitative methods in data collection Use systematic reviews and other tools to assess and disseminate evaluation findings From getting started in the field to turning evidence into policy, this book will guide you through every step of the evaluation process.

Evaluation Design for Complex Global Initiatives

Evaluation Design for Complex Global Initiatives PDF

Author: Institute of Medicine

Publisher:

Published: 2014

Total Pages: 0

ISBN-13: 9780309302586

DOWNLOAD EBOOK →

Every year, public and private funders spend many billions of dollars on large-scale, complex, multi-national health initiatives. The only way to know whether these initiatives are achieving their objectives is through evaluations that examine the links between program activities and desired outcomes. Investments in such evaluations, which, like the initiatives being evaluated, are carried out in some of the world's most challenging settings, are a relatively new phenomenon. In the last five years, evaluations have been conducted to determine the effects of some of the world's largest and most complex multi-national health initiatives. Evaluation Design for Complex Global Initiatives is the summary of a workshop convened by the Institute of Medicine in January 2014 to explore these recent evaluation experiences and to consider the lessons learned from how these evaluations were designed, carried out, and used. The workshop brought together more than 100 evaluators, researchers in the field of evaluation science, staff involved in implementing large-scale health programs, local stakeholders in the countries where the initiatives are carried out, policy makers involved in the initiatives, representatives of donor organizations, and others to derive lessons learned from past large-scale evaluations and to discuss how to apply these lessons to future evaluations. This report discusses transferable insights gained across the spectrum of choosing the evaluator, framing the evaluation, designing the evaluation, gathering and analyzing data, synthesizing findings and recommendations, and communicating key messages. The report also explores the relative benefits and limitations of different quantitative and qualitative approaches within the mixed methods designs used for these complex and costly evaluations.

The Evaluation of Research in Social Sciences and Humanities

The Evaluation of Research in Social Sciences and Humanities PDF

Author: Andrea Bonaccorsi

Publisher: Springer

Published: 2018-01-04

Total Pages: 416

ISBN-13: 3319685546

DOWNLOAD EBOOK →

This book examines very important issues in research evaluation in the Social Sciences and Humanities. It is based on recent experiences carried out in Italy (2011-2015) in the fields of research assessment, peer review, journal classification, and construction of indicators, and presents a systematic review of theoretical issues influencing the evaluation of Social Sciences and Humanities. Several chapters analyse original data made available through research assessment exercises. Other chapters are the result of dedicated and independent research carried out in 2014-2015 aimed at addressing some of the debated and open issues, for example in the evaluation of books, the use of Library Catalog Analysis or Google Scholar, the definition of research quality criteria on internationalization, as well as opening the way to innovative indicators. The book is therefore a timely and important contribution to the international debate.