Developing a finer grained analysis of research impact: Can we assess the wider effects of public engagement?by Marco Haenssgen
This article, published with a creative commons licence on the LSE Impact Blog, suggests a more comprehensive and balanced approach for the evaluation of public engagement, drawing on evaluation criteria commonly used in aid evaluation.
INTRAC has launched the M&E universe, a free, online resource for development practitioners involved in monitoring and evaluation (M&E).
A resource from the International Federation of Red Cross and Red Crescent to support Community Engagement at the centre of humanitarian work.
Summary of academic paper critiquing experimental approaches to public engagement advocating instead an 'organic engagement' approach with 'ecological validation' which explores the context and mechanisms in which public's deliberations and opinions are formed. The paper is not open access however a comprehensive summary is given here.
This resource from the Oxford University Clinical Research Unit in Vietnam shares their Science Theatre work and evaluation. The piece results from a presentation given at the March 2017 Mesh Evaluation workshop. For more information and links to other resources that emerged from the workshop (which will be built upon over time) visit the workshop page.
This resource about critical realist evaluation resulted from a presentation given by Emma Richardson at the March 2017 Mesh Evaluation workshop. For more information and links to other resources that emerged from the workshop (which will be built upon over time) visit the workshop page.
Science Communication evaluation methods at Malawi-Liverpool-Wellcome Trust (MLW)– the case of the Samala Moyo projectby Mesh Editorial Team
This study, which took place in the U.S, may be of interest to Mesh readers interested in the power of 'community voice' on decision-making in health policy and research.
A summary of a report exploring Community Engagement, what it means to global health researchers and its relationship to research ethics.
This case study is about a proposed programme of work on evaluation of the various engagement activities (public and community) that are undertaken at the KEMRI-Wellcome Trust Research Programme (KWTRP). The case study was based on a presentation delivered at the Mesh Evaluating Community Engagement Workshop 2017.
An overview of a project which used participatory theatre methods to disseminate messages about health promoting behaviours within informal settlements in Gujurat, India. The project was evaluated using 'quasi-experimental' quantitative methods.
Article: Community Engagement for the Rapid Elimination of Malaria: the Case of Kayin State, Myanmarby Mesh Editorial Team
Project Report: Using Traditional Arts to Engage School Students on Environmental Health Issues in Delhi, Indiaby Rachita Gupta, Kartik Sharma, Banalata Sen
A participant of the Mesh evaluating engagement workshop (March 2017) gives there reflection on the workshop and the key learning that came from it.
Project Report/Blog: Evaluating public/community engagement: Implications for gender and ethics in health systems researchby Sassy Molyneux
A participant of the Mesh evaluating engagement workshop (March 2017) reflects on the learning from the workshop, focusing on points useful for health policy and systems researchers with an interest in gender and ethics.
A participant reflection on the Mesh Evaluating Community Engagement Workshop (March 2017) which aimed to move forward the debates surrounding evaluation by drawing on practical experiences.
Project Report: A puppet show to engage the community addressing antimicrobial resistance and research with childrenby Alice Hawryszkiewycz, Phaik Yeong Cheah
Fishy Clouds, a puppet theatre show, was created to engage the community on issues of antimicrobial resistance and research with children in Thailand. Fishy Clouds ran for twelve shows during the months of November and December 2016 in schools, hospitals, theatres and health centres. The show was performed in Bangkok and in the greater Mae Sot area in the Tak district of Thailand.
This user friendly set of quantitative and qualitative monitoring and evaluation tools allows users to capture, collate and analyze Community and Stakeholder Engagement (CSE) data at the clinical trial site-level. The database is designed to support engagement teams working on clinical trials on a daily, monthly, quarterly and biannual basis.
Project Report: Art in Global Health: Report and Video giving Insights and Considerations for Future Artist Residenciesby Sian Aggett
In 2013, Art in Global Health set up artist residencies in six Wellcome Trust-funded research centres as a way of teasing out some of the more personal, philosophical, cultural and political dimensions of health research. This exciting project was born out of Wellcome Collection's desire to engage the curious public globally with the health research that the Trust funds - in Kenya, Malawi, South Africa, Thailand, Vietnam and the UK.
Summary of Project Reports: Types of Change in Wellcome Trust Linked Community Engagement Programmes and Projectsby Robin Vincent
A descriptive summary in table form of community and public engagement activities from a selection of Wellcome Trust linked programmes and projects in low- and middle-income countries.
The original manual to Outcome Mapping produced by the International Development Research Centre (IDRC).
Wellcome Trust International Engagement workshop report: Engaging with Impact: How do we know if we have made a difference? (South Africa 2012)by Wellcome Trust
This report is based on conversations that took place at the Wellcome Trust’s fourth international engagement workshop: ‘Engaging with impact: how do we know if we have made a difference?’ The workshop took place in South Africa in October 2012.
The ‘Rainbow’ framework guides the reader through a series of key questions to systematically look at all the issues involved when planning an evaluation.
Developed for engagement in community regeneration in the UK, Auditing Community Participation looks at ways of assessing levels of community involvement in area regeneration initiatives.
A guide to evaluation of public engagement developed by the Royal Academy of Engineers, UK. Whilst not specific to health and community engagement it is a useful starting point to those looking to evaluate any engagement project.
A guide to evaluating public engagement events, with a focus on events and research dissemination rather than more concerted community engagement.
A comprehensive guide to theory of change which can be used as a valuable tool for evaluating community engagement projects.
A guide to developmental evaluation.
A Mesh introduction to developmental evaluation. An evaluation approach used when it isn’t clear at the start of a project which intervention is the most appropriate and what aspects of the context are most important to address.
Introduction to a realist evaluation discussion list for those working with realist evaluation. Realist Evaluation can be a valuable tool to evaluate community engagement projects.
Introduction to two influential introductory texts on Realist Evaluation: Realistic Evaluation and The Science of Evaluation: a realist manifesto. Realist evaluation can be used to effectively evaluate community engagement activities.
A clear and accessible introduction to evaluation of social media linked to community radio initiatives but with wider application.
Literature: Future Connect: a review of social networking today, tomorrow and beyond, and the challenge or HIV Communicatorsby Pete Cranston and Tim Davies et al.
an extensive introduction to the growing and changing role of social media in communication with an emphasis on developing country experience.
A blog post from Kissmetrics describing how best to get started with social media measurement. Whilst primarily business and Northern focused this post nevertheless clearly explains the general steps of how to evaluate social media and incudes links to social media tracking tools that are useful for CE activities using social media.
A Mesh introduction to evaluating projects that engage communities through social media.
This annotated bibliography is a useful tool for those looking to analyse and visualise networks as a way to evaluate community engagement projects.
A tookit and guide to participatory methods for collectively visualising and analysing networks for planning and evaluation purposes.
A Mesh introduction to network based approaches to evaluation which focus on changes in relationships and networks as a key outcome of interest.
A practical guide including clear step by step explanations of how to develop a theory of change for an organisation or project
This case study acts as an example of using participatory system inquiry and systemic action research to evaluate complex projects.
Literature: Assessing Impact in Dynamic and Complex Environments: Systemic Action Research and Participatory System Inquiry (2014)by Danny Burns
Short paper exploring systemic action research and participatory system inquiry as approaches to assessing impact in social programmes and initiatives.
An introduction to Participatory System Inquiry and Systemic Action Research and their use in evaluating community engagement.
This resource presents a list of useful websites and discussion forums on evaluation.
Introduction to one-stop site for evaluation of community sustainability engagement projects.
An introduction to the Manchester University (UK) Guide to evaluating engagement.
Introduction to RCUK's Evaluation of Engagement guide.
An introduction to the book Who Counts? The power of participatory statistics and some of the case studies within it.
Outcome Mapping is a planning, monitoring and evaluation approach that is particularly helpful for evaluating multi-stakeholder projects. It seeks to assess the contribution of a project to changes in the relationships and behaviour of those it comes into direct contact with and has influence over. This page gives a brief introduction to the 'Outcome Mapping' evaluation approach, with links to the Outcome Mapping manual, the Outcome Mapping Learning community, some introductory presentations and videos, and case studies.
An introduction to the use of Participatory Statistics for evaluating engagement.
An introduction to Most Significant Change, a qualitative and participatory monitoring and evaluation approach that uses stories of change to assess the impact of projects and programmes.
An Introduction to Realist Evaluation, a valuable method for addressing the complexity of social programmes.
An introduction to what is meant by a Theory of Change in evaluation.
An introduction to Complexity Theory, a theory from which a number of evaluation methods draw.
An introduction to Qualitative Comparative Analysis, an approach for systematic comparison of cases.
An Introduction to Evalutaion Case Studies.
Case studies and tools for evaluating community engagement activities that engage through the arts.
A summary of research and consultation with the community dance sector in the UK designed to address the ‘quality’ of artistic practice, and highlight the criteria that people were using in practice in their work, rather than seeking to define a prescriptive evaluation approach.
Evaluation report from the Wellcome Trust's Sciart funding programme
Global Food Matters: An appetite for engaging with research (Wellcome Trust International Engagement workshop report, Botswana 2015)by Wellcome Trust
Workshop Report: Discussion on the ethical, social and cultural issues that surround research into food, health and the environment as well as the best ways of producing activities that inform, consult and collaborate with communities.