Evaluation Projects

Current evaluation projects are listed below. Published evaluation reports can be found on the Evaluation Publications page.

What works in industry based harm minimisation

Evaluation of the Safer Gambling Messaging Phase 2 - Behavioural Insights Team

Overview
This project focuses on developing safer gambling messaging in collaboration with gambling industry operators. New formats of messages will be trialled by operators, originally in both in online and land-based gambling contexts. However, the impact of the COVID-19 pandemic has meant that land-based gambling contexts were unavailable from the end of March 2020.

There are two key components to this piece of research. First, gambling operators will be supported to develop and trial new approaches to communicating messages about safer gambling behaviours. Second, operators will be provided with instruction and guidance on how to measure the impact of their message trials.

In February 2020, GambleAware appointed Behavioural Insights Team to conduct process and impact evaluations to capture learnings from its delivery

The Evaluation
The aims of the evaluation are to assess the effectiveness and outcomes of the Safer Gambling Messaging Phase 2 project; and to set out the implications for the extension of the pilot project nationally.

The process evaluation will explore and report on the different management processes used by operators; these will include the co-creation process for developing the interventions, the implementation of specific interventions, and the factors affecting their effectiveness.

The impact evaluation will investigate and report on the causal impact of the messages on consumer behaviour.

Methods
Qualitative research methods, including depth interviews, will be used for the process evaluation. Secondary data analysis of management information will also be conducted.

Quantitative research methods will be used to determine the causal impact of the designed intervention(s) to the highest degree of scientific rigour. Wherever possible, randomised controlled trials (RCTs), will be used. Where RCTs are not possible, either quasi-experimental methods such as difference-in-difference, or pre-post evaluation methods will be deployed.

Project Lead
James Lawrence, Behavioural Insights Team

Timeline
Spring 2020-Autumn 2020

Related resources
Safer Gambling Campaign 

Evaluation of the impact of Multi-Operator Self-Exclusion Schemes (MOSES) - Ipsos MORI

Overview
Multi-operator self-exclusion schemes are designed to allow those who gamble to choose to block their access to local gambling businesses with one request to the scheme representing that sector; for example, bookmakers, arcades, bingo or casinos. This evaluation explores whether these relatively new schemes have been implemented effectively and lessons that can be learned from their roll-out and operation.

The Evaluation
This is a multi-stage evaluation of multiple-operator self-exclusion schemes, with the first phase focusing on conducting a process evaluation of the introduction and operation of schemes for the following sectors: arcades, betting, bingo, casinos, and online gambling.

Initially the research will investigate the execution of the schemes against the programme’s logic model and theory of change, producing insight into aspects of the delivery of the schemes that are working well, and where there are areas for improvement. These learnings will be shared with the scheme operators to ensure a collaborative approach between gambling sectors in making the schemes as effective as possible in protecting customers.

In the longer-term, the research will move onto a second phase, measuring the impacts of the schemes for users and their contribution to the overall aim of reducing gambling harms.

The first phase of the research was completed in March 2020 but publication of the findings has been delayed due to the evolving public health situation.

Methods
The evaluation entails a mixed-methods approach to data collection with a range of audiences. Depth interviews and focus groups will be conducted with those who gamble, frontline gambling operator staff and scheme leads. Quantitative surveys measuring awareness and use of the schemes amongst the general population will also be conducted.

Project Lead
Nicola Moss, Ipsos MORI

Timeline
Phase One: Spring 2019 – Spring 2020
Phase Two: To be confirmed

Treatment and support

Evaluation of the Gambling Support Service (England and Wales) - KantarPublic

Overview
Gambling Support Service (England and Wales) is run and managed by Citizens Advice (England and Wales). The programme aims to raise awareness of gambling harms and provide advice to the public about the risks of gambling and what support is available. It provides education and training for frontline service providers, and delivers support for individuals experiencing gambling harms, referring them to specialist services where appropriate.

Following a successful pilot in Newport, a new programme was commissioned to run between October 2018 and December 2020. The service runs across 12 regions within the Citizens Advice network in England and Wales.  A similar programme has been commissioned with Citizens Advice Scotland, commencing in April 2020.

In spring 2020, GambleAware conducted a mini-competition tender to appoint an independent evaluation consultancy to conduct process and impact evaluations to capture learnings from its delivery, in line with our commitment to understand what works and continuously improve.

The Evaluation
The aims of the evaluation are to report on the effectiveness and early outcomes of Gambling Support Service (England and Wales); and to identify lessons learned and recommendations for service delivery improvement in the remainder of the England and Wales programme and for the new programme in Scotland.

The process evaluation will explore and report on the management processes used to create and deliver the programme across the 12 regions. The impact evaluation will investigate and report on the early achieved outcomes of the service, both at a preliminary stage and then on the close of the programme.

Methods
Qualitative and quantitative research methods will be used to create primary data for the evaluation, including depth interviews, case studies, impact reflection workshops and an online survey. Secondary data analysis of management information and survey findings will also be conducted.

Project Lead
Ben Collins, KantarPublic

Timeline
Summer 2020-Spring 2021

Related Resources
Citizens Advice England & Wales Project

Evaluation of Scottish Gambling Education Hub - IFF

Overview
The Scottish Gambling Education Hub is a national gambling education and prevention programme which works in a variety of settings across Scotland. The programme is delivered by Fast Forward, and offers free training, support and resources for professionals working with young people and families, as well as for young people themselves. The Hub encompasses seven different activities including CPD training, policy guidance, a professional network, education toolkit and advice booklets, online gambling harm messages for Further and Higher Education institutions and the delivery of theatrical performances to secondary school pupils

Following a successful pilot, in November 2018 GambleAware funded this three-year programme, which is due to conclude in December 2021.

In early 2020, GambleAware conducted a mini-competition tender to appoint an independent evaluation consultancy to conduct an integrated process and impact evaluation of the programme.

The Evaluation
The aims of the evaluation are to assess the effectiveness and early outcomes of the Scottish Gambling Education Hub programme; to inform decision making on improvements or extensions to the programme; and to create an evaluation legacy by strengthening monitoring and evaluation capacity and capabilities.

The process evaluation will provide formative and summative feedback on the implementation of the Hub and its seven activities. The impact evaluation will explore the added value of the Hub.

Methods
Qualitative and quantitative research methods will be used to create primary data for the evaluation, including depth interviews and an online survey. Secondary data analysis of management information, survey findings and website statistics will also be conducted.

Project Lead
Kelsey Beninger, IFF

Timeline
Summer 2020- Spring 2022

Related Resources
Scottish Gambling Education Hub Project, Fast Forward 

Evaluation of GambleAware Funded Treatment System - Leeds Beckett University

Overview
This phase entails the development of a framework and methodology for conducting an evaluation of the GambleAware funded treatment system which will be implemented in Phase 2.   

The Research
Evaluation is key to the delivery of an effective and efficient gambling treatment system. This project builds on previous literature and learning from existing treatment systems in other sectors to create an evaluation framework which will be implemented as part of Phase 2 of the project. Phase 1 will begin with a rapid review of academic and grey literature on use and effectiveness of existing evaluation frameworks. Secondly, the research team will engage with stakeholders across the GambleAware funded treatment system, including commissioners and service provider managers to build relationships and to find out “what works well and why”. Finally, the current treatment system will be mapped using network analysis in order to understand user journeys and to assess how elements of the system work together.

The resulting evaluation framework will be implemented in Phase 2 to provide clear, practical, evidence-based recommendations and identify opportunities for increased system effectiveness, potential gaps in and/or improvements that could be made to the current national treatment system.

Methods
A mix of qualitative and quantitative methodologies, rapid evidence review, interviews and network analysis.

Project Lead
Dr Jim Morgan, Leeds Beckett University

Timeline
Spring 2019 - Spring 2020

Setting up a service for gambling addiction: a formative evaluation of the NHS Northern Gambling Clinic Leeds Hub - Leeds Beckett University

Overview
A formative evaluation of the Northern Gambling Clinic Leeds Hub to provide insight into the process and experience of the conception, commissioning, and delivery of a problem gambling treatment service.  This evaluation will also provide a “How to” guide for the commissioning and setup of future place-based gambling treatment services across Great Britain.

The Evaluation
There is a recognised need to increase the national capacity for the treatment of gambling problems. Furthermore, there is a need to ensure that there is a high-quality framework for commissioning and setting up treatment services generally.  This evaluation considers the set-up phase of the Northern Gambling Clinic Leeds Hub to provide a framework for the set-up of similar future services.

This evaluation will draw on and collate the feedback and insight of key stakeholders involved in the conception, commissioning, delivery, and strategic oversight of the Northern Gambling Clinic Leeds Hub through semi structured interviews.  The evaluation will also analyse key documentary data relating to the commissioning and set up of the Northern Gambling Clinic Leeds Hub. 

The interview and documentary data will be used to identify key themes and insights to capture ‘what works’ and ‘lessons learned’ from the implementation of the service.

Methods
Qualitative review and analyses of interview and documentary data

Project Leads
Dr James Woodall, Leeds Beckett University

Timeline
January – June 2020