Workshop day 1 – 14 October

8:00 am – 9:00 am
FOYER 1st floor

Registrations

HILDALGO Room (1st floor)

09:00 – 13:00 pm

CHWK1

Conducting searches for evidence synthesis

Presenters and affiliations:

Sarah Young, Carnegie Mellon University
Kate Ghezzi-Kopel, Cornell University
Erin Eldermire, Cornell University

Abstract:

Conducting comprehensive and reproducible evidence syntheses requires high quality searches across multiple sources of information. This workshop will include a combination of lecture and hands-on activities to provide participants with knowledge and skills to conduct searches for systematic reviews, scoping reviews and other types of evidence synthesis. We will cover database selection, constructing and documenting reproducible search strategies, information management and searching grey literature. Participants will be familiarized with the key databases searched in a variety of disciplines, will understand the concept of database syntax and how to use syntax to construct quality searches. They will understand the role of database filters and limits. Participants will also get hands-on experience with information management and screening tools like Covidence and Rayyan.

13:00 -14:00 pm
NUEVO LEON II Room (3rd floor) 

Lunch

14:00 – 18:00 pm

ECOWK14

Bring back theory to theory of change

Affiliations:

FHI 360

Presenter:

Annette Brown

Abstract:

This workshop will demonstrate the importance of social science theories when developing program theory of change for project design and evaluation. Often the logic models used to design programs rely on assumed causal relationships or mechanisms, meaning people assume that activities will lead to desired outcomes without considering the social science theories and supporting research that examine those relationships. Understanding theory is not just crucial for making the right prediction about how programs produce outcomes, it is also necessary for identifying the situational assumptions needed for the prediction. In this workshop, participants will learn about key theories in psychology, economics, and political science and practice applying them to program and evaluation design. Participants will also learn how these theories have been tested to learn how they work in the field.

QUERETARO Room (1st floor)

09:00 – 18:00 pm

BDWK1 – full day workshop

Evidence and gap maps

Affiliations:

Campbell Collaboration

Presenter: 

Ashrita Saran

 

(lunch break 1PM-2PM)

 

Abstract:

This workshop is designed for review authors and individuals interested in understanding the concepts and applications of evidence and gap maps.
This workshop covers following topics:
• What are evidence and gap maps?
• Formulating research question for EGMs
• Search strategies for EGMs
• Framework construction
• EGM exercise
The workshop begins with outlining key principles and concepts of evidence and gap maps. It then go on to explore how to formulate questions, search strategies and framework construction of EGMs. The relevance for use of EGM for minimising research waste and developing research strategies will be further explained. By the end of this participants should be able to:
• What are EGMs?
• Understanding question formulation, inclusion and exclusion criteria and search for EGMs
• EGM framework development
• Display of EGMs
• Methodological standards for Campbell EGMs

JALISCO Room (3rd floor)

09:00 – 11:00 am

ECOWK4

Engaging stakeholders with evidence and uncertainty

Affiliation:

University College London

Presenter: 

Sandy Oliver

Abstract:

This workshop will present a framework for engaging stakeholders with evidence and uncertainty based on systematic reviews conducted by academics or NGOs. The framework distinguishes the appropriateness of models for stakeholder engagement depending on what is known from generalizable research and what is known about specific contexts. Workshop participants will explore the face validity of the framework and models, and their appropriate application for generating evidence and using evidence for making decisions. They will share practical ideas about these models and discuss the framework as a potential decision aid when planning to engage stakeholders either with evidence for policy or programming decisions, or with the research process for generating useful evidence.

11:00 – 13:00 pm 

ECOWK7

Designing and using policy briefs effectively

Affiliation:

International Initiative for Impact Evaluation (3ie)

Presenter: 

Beryl Leach

Abstract:

Policy briefs are plain-language summaries of research tailored for specific audiences. While they can be effective formats for presenting technical information in more accessible language and style, their effectiveness depends on how they are used and whether they are relevant to the needs of a decision maker. At the end of this workshop, participants will have achieved these objectives:
 Get an overview of the role of briefs, their strengths and limitations
 Examine different types of briefs
 Develop an understanding of how to design, adapt and use policy briefs for diverse audiences
This workshop will run for two hours and will be a combination of interactive presentations and group exercises. It will build on a separate 4-hour workshop on strategic communication for evidence-informed decision-making. Participants may sign up for either or both.

13:00 – 14:00 pm
NUEVO LEON II Room (3rd floor)

Lunch

14:00 – 18:00 pm

ECOWK10

Measurement of effective access to social rights: The Information System on Social Development with a human rights approach (SIDS-DH in Spanish) of CONEVAL

Affiliation:

Coneval

Presenter:

Paloma Villagómez Ornelas

Abstract:

CONEVAL carries out the official poverty measurement in Mexico through a multidimensional methodology with a human rights perspective. However, not living in poverty does not guarantee an effective access to human rights. With the objective of going beyond poverty and moving towards measuring effective access to social rights, CONEVAL developed the Information System on Social Development with a Human Rights Approach, a platform of indicators that allows characterizing the availability, accessibility and quality of people’s access to their social rights and make visible the inequalities that several populations experience in the exercise of these rights. The workshop will describe the legal, conceptual and methodological components of SIDS-DH, as well as a brief diagnosis regarding the current state of effective access to social rights in Mexico and its states.

AGUASCALIENTES Room (2nd floor)

09:00 – 13:00 pm

—–

Using EPPI-Reviewer for the production of Campbell reviews, Evidence Gap Maps and the automation of review updates

Affiliation:

EPPI-Centre, UCL London

Presenter: 

Jeff Brunton

Abstract:

EPPI-Reviewer, the EPPI-Centre’s online tool for research synthesis, has been free of charge to researchers working on Campbell reviews since 2018. This workshop will show how EPPI-Reviewer can support the production of Campbell systematic reviews, produce coding for Evidence Gap Maps and automate the process of updating reviews.
Using the new EPPI-Reviewer, that works in any modern web browser, participants will be introduced to the core concepts behind the EPPI-Reviewer architecture and tools and be given a general overview of how to use the software according to different needs (qualitative, quantitative, mixed-methods, “living” systematic reviews, meta-ethnographies, etc.).
The session will provide an opportunity for participants to explore the many functions available in EPPI-Reviewer. This will include coding research studies to produce an Evidence Gap Map using the EPPI-Centre’s mapping utility (developed in partnership with Campbell).
EPPI-Reviewer is also a methodological research tool: its flexibility allows and facilitates methodological research and innovation; our current research focuses on enabling automation in the search and screening phases, integrating them both in ways that are specifically designed to support workflows for “living” systematic reviews. This session will show how to use these underlying technologies to support the automation of review updates though data reuse and discoverability.
Participants should bring their own laptop or tablets to the session. Working in small groups will be encouraged.

13:00 – 14:00 pm
NUEVO LEON II Room (3rd floor)

Lunch

14:00 – 16:00 pm

ENWK1

Qualitative evidence synthesis: when to use it & how to do it

Affiliation:

University of Exeter

Presenter: 

Ruth Garside

Abstract:

“Statistics represent people with the tears wiped off” (Bradford Hill).
Qualitative research can answer questions that quantitative research cannot. While qualitative evidence synthesis (QES) is increasingly recognised as an important aspect of evidence-based practice in health research, it is not yet commonplace in other fields. A recently convened Working Group is developing guidance for QES for Campbell and the Collaboration for Environmental Evidence. QES share some features of quantitative systematic reviews, and differ in others. There are also a number of approaches that have been developed for synthesizing the findings of qualitative research.
This workshop introduce QES and, through practical sessions, explore the challenges for identifying, categorising and synthesizing qualitative data, using examples which examine the interconnections between the environment and human health.

16:00 – 18:00 pm

EDWK1 – Workshop presented in Spanish

Evidence to policy in: Practical tools for co-creating research with governments

Affiliation:

Innovations for Poverty Action

Presenters:

Sergio De Marco
Pablo Vasquez
Mónica Seminario
Christopher Neilson

Abstract:

Co-creation of evidence is the collaborative process of researchers and stakeholders generating knowledge together in order to ensure research is applicable to real world situations. This two-hour workshop will provide participants with theoretical frameworks and practical tools for creating rigorous, policy-relevant research in a variety of sectors including education, crime and justice, and international development, to improve the lives of communities around the world. The workshop leaders come from academia, government, and NGOs to provide insight on how to collaborate. Concepts explored will include:
• Engaging an ecosystem of decision-makers and researchers
• Research questions that address decision-makers felt needs
• Maintaining stakeholder engagement throughout a research project
• Building capacity over time
• Empowering decision-makers to use evidence, beyond dissemination

NUEVO LEON I Room (3rd floor)

09:00 – 13:00 pm

HHWK1

Weight of Evidence: Incorporating stakeholder knowledge in evidence synthesis for health service improvement

Affiliation:

McGill University

Presenters: 

Anna Dion
Iván Sarmiento
Emilie Robert
Neil Andersson

Abstract:

Weight of Evidence is a new evidence synthesis approach that combines stakeholder voices with conventional systematic reviews. The emphasis is on giving those carrying the greatest burden of health inequities a stronger voice in the planning and implementation of health care and health care systems. Weight of Evidence shifts the boundary of who and what counts as expertise, formally including experiential knowledge from patients and/or communities, care providers and resource decision-makers, on even footing with epidemiological studies. The method leverages well-established tools from participatory research, systems science, Bayesian analysis, and critical realism. The workshop guides participants through applied examples of Weight of Evidence from Canada and Mexico, allowing them to validate the Weight of Evidence approach and to evaluate the workshop to improve future dissemination.

13:00 – 14:00 pm
NUEVO LEON II Room (3rd floor)

Lunch

14:00 – 18:00 pm

ECOWK6

Strategic communication for evidence-informed decision-making

Affiliation:

International Initiative for Impact Evaluation (3ie)

Presenters:

Radhika Menon
Beryl Leach

Abstract:

This workshop is designed for anyone interested in improving how they engage with and influence their main audiences about their work. At the end of the workshop, participants will have achieved these objectives:
• Identify their communicator persona
• Understand what one needs to know about different audiences
• Know the importance of making an engagement and communication plan and how to do it
• Understand how to tailor communication to given audiences
• Understand types of engagement and communication tools and how to integrate them
• Pick up tips on using communication tools effectively
The session will run for four hours. It will be a combination of interactive presentations and group exercises. There will be a separate 2-hour workshop on creating effective briefs that will follow this one. Participants may sign up for either or both.

YUCATAN Room (1st floor)

09:00 – 18:00 pm

SIDE EVENT (open to all)

Frontiers in evaluating causality presented by the Centre of Excellence for Development Impact and Learning (CEDIL)

Presenters:

Howard White, Campbell Collaboration and CEDIL Research Director
Edoardo Masset, CEDIL Deputy Director
Marcella Vigneri, University of Durham
Marie Gaarder, 3ie
Sandy Oliver, EPPI- Centre, UCL

Programme:

CEDIL is a DFID-supported international research collaboration to identify and test innovative approaches to impact evaluation and evidence synthesis. This one day event will provide an overview of CEDIL and present work to date.

09.00-09.30 Registration
09.30-10.15 The CEDIL Vision and Progress to Date Howard White, Campbell Collaboration and CEDIL Research Director
10.15-10.45 Tea/coffee break
10.45-11.55 Evaluating complexity Edoardo Masset, CEDIL Deputy Director
11.55-13.00 Mid-level theory Nancy Cartwright, University of Durham
13.00-14.00 Lunch – Nuevo Leon I room
14.00-14.45 New measures and new technologies for data collection Marie Gaarder, 3ie
14.45-15.30 Stakeholder engagement in evidence production and use Sandy Oliver, EPPI- Centre, UCL
15.30-15.45 Tea/coffee break
15.45-16.30 Presentation TBC
17.00 Close

Registration: Registration is free but space is limited. To register email wwgs@campbellcollaboration.org with name and affiliation, titling your email: CEDIL Side Event Registration
Find out more about CEDIL here: https://cedilprogramme.org/

Copyright 2019 wwgs2019. All rights reserved