Evaluation projects in delivery are listed below. Published evaluation reports can be found on the Evaluation Publications page.
Evaluation of the Safer Gambling Messaging Phase 2 - Behavioural Insights Team
This project focuses on developing safer gambling messaging in collaboration with gambling industry operators. New formats of messages will be trialled by operators, originally in both in online and land-based gambling contexts. However, the impact of the COVID-19 pandemic has meant that land-based gambling contexts were unavailable from the end of March 2020.
There are two key components to this piece of research. First, gambling operators will be supported to develop and trial new approaches to communicating messages about safer gambling behaviours. Second, operators will be provided with instruction and guidance on how to measure the impact of their message trials.
The aims of the evaluation are to assess the effectiveness and outcomes of the Safer Gambling Messaging Phase 2 project; and to set out the implications for the extension of the pilot project nationally.
The process evaluation will explore and report on the different management processes used by operators; these will include the co-creation process for developing the interventions, the implementation of specific interventions, and the factors affecting their effectiveness.
The impact evaluation will investigate and report on the causal impact of the messages on consumer behaviour.
Qualitative research methods, including depth interviews, will be used for the process evaluation. Secondary data analysis of management information will also be conducted.
Quantitative research methods will be used to determine the causal impact of the designed intervention(s) to the highest degree of scientific rigour. Wherever possible, randomised controlled trials (RCTs), will be used. Where RCTs are not possible, either quasi-experimental methods such as difference-in-difference, or pre-post evaluation methods will be deployed.
James Lawrence, Behavioural Insights Team
Spring 2020-Autumn 2020
Safer Gambling Campaign
Evaluation of the impact of Multi-Operator Self-Exclusion Schemes (MOSES) - Ipsos MORI
Multi-operator self-exclusion schemes are designed to allow those who gamble to choose to block their access to local gambling businesses with one request to the scheme representing that sector; for example, bookmakers, arcades, bingo or casinos. This evaluation explores whether these relatively new schemes have been implemented effectively and lessons that can be learned from their roll-out and operation.
This is a multi-stage evaluation of multiple-operator self-exclusion schemes, with the first phase focusing on conducting a process evaluation of the introduction and operation of schemes for the following sectors: arcades, betting, bingo, casinos, and online gambling.
Initially the research will investigate the execution of the schemes against the programme’s logic model and theory of change, producing insight into aspects of the delivery of the schemes that are working well, and where there are areas for improvement. These learnings will be shared with the scheme operators to ensure a collaborative approach between gambling sectors in making the schemes as effective as possible in protecting customers.
In the longer-term, the research will move onto a second phase, measuring the impacts of the schemes for users and their contribution to the overall aim of reducing gambling harms.
The first phase of the research was completed in March 2020 but publication of the findings has been delayed due to the evolving public health situation.
The evaluation entails a mixed-methods approach to data collection with a range of audiences. Depth interviews and focus groups will be conducted with those who gamble, frontline gambling operator staff and scheme leads. Quantitative surveys measuring awareness and use of the schemes amongst the general population will also be conducted.
Nicola Moss, Ipsos MORI
Phase One: Spring 2019 – Spring 2020
Phase Two: To be confirmed
Treatment and support
Evaluation of the Gambling Support Service (England and Wales) - KantarPublic
Gambling Support Service (England and Wales) is run and managed by Citizens Advice (England and Wales). The programme aims to raise awareness of gambling harms and provide advice to the public about the risks of gambling and what support is available. It provides education and training for frontline service providers, and delivers support for individuals experiencing gambling harms, referring them to specialist services where appropriate.
Following a successful pilot in Newport, a new programme was commissioned to run between October 2018 and December 2020. The service runs across 12 regions within the Citizens Advice network in England and Wales. A similar programme has been commissioned with Citizens Advice Scotland, commencing in April 2020..
The aims of the evaluation are to report on the effectiveness and early outcomes of Gambling Support Service (England and Wales); and to identify lessons learned and recommendations for service delivery improvement in the remainder of the England and Wales programme and for the new programme in Scotland.
The process evaluation will explore and report on the management processes used to create and deliver the programme across the 12 regions. The impact evaluation will investigate and report on the early achieved outcomes of the service, both at a preliminary stage and then on the close of the programme.
Qualitative and quantitative research methods will be used to create primary data for the evaluation, including depth interviews, case studies, impact reflection workshops and an online survey. Secondary data analysis of management information and survey findings will also be conducted.
Ben Collins, KantarPublic
Summer 2020-Spring 2021
Citizens Advice England & Wales Project
Evaluation of the Scottish Gambling Education Hub - IFF
The Scottish Gambling Education Hub is a national gambling education and prevention programme which works in a variety of settings across Scotland. The programme is delivered by Fast Forward, and offers free training, support and resources for professionals working with young people and families, as well as for young people themselves. The Hub encompasses seven different activities including CPD training, policy guidance, a professional network, education toolkit and advice booklets, online gambling harm messages for Further and Higher Education institutions and the delivery of theatrical performances to secondary school pupils.
The aims of the evaluation are to assess the effectiveness and early outcomes of the Scottish Gambling Education Hub programme; to inform decision making on improvements or extensions to the programme; and to create an evaluation legacy by strengthening monitoring and evaluation capacity and capabilities.
The process evaluation will provide formative and summative feedback on the implementation of the Hub and its seven activities. The impact evaluation will explore the added value of the Hub.
Qualitative and quantitative research methods will be used to create primary data for the evaluation, including depth interviews and an online survey. Secondary data analysis of management information, survey findings and website statistics will also be conducted.
Kelsey Beninger, IFF
Summer 2020- Spring 2022
Scottish Gambling Education Hub Project, Fast Forward
Evaluation of the GambleAware Funded Treatment System - Phase 1 - Leeds Beckett University
This phase entails the development of a framework and methodology for conducting an evaluation of the GambleAware funded treatment system which will be implemented in Phase 2.
Evaluation is key to the delivery of an effective and efficient gambling treatment system. This project builds on previous literature and learning from existing treatment systems in other sectors to create an evaluation framework which will be implemented as part of Phase 2 of the project. Phase 1 will begin with a rapid review of academic and grey literature on use and effectiveness of existing evaluation frameworks. Secondly, the research team will engage with stakeholders across the GambleAware funded treatment system, including commissioners and service provider managers to build relationships and to find out “what works well and why”. Finally, the current treatment system will be mapped using network analysis in order to understand user journeys and to assess how elements of the system work together.
The resulting evaluation framework will be implemented in Phase 2 to provide clear, practical, evidence-based recommendations and identify opportunities for increased system effectiveness, potential gaps in and/or improvements that could be made to the current national treatment system.
A mix of qualitative and quantitative methodologies, rapid evidence review, interviews and network analysis.
Dr Jim Morgan, Leeds Beckett University
Spring 2019 - Spring 2020