evaluation
Evidence type: Evaluation i
Information about the programme design and rationale
Evidence about Financial Capability outcomes for programme participants
Evidence that the Financial Capability outcomes were caused by the programme
Evidence about programme implementation, feasibility, and piloting
Evidence about relative costs and benefits of the programme
[This is an extract from the Executive Summary of the evaluation report. Further amendments may be made to this Summary, pending review by the Evidence Hub partner]
Leicester Ageing Together is a Big Lottery Funded project working in Leicester city to reduce loneliness and isolation. Poverty was highlighted locally as a key cause of loneliness and isolation, so this What Works project aimed to offer an additional resource within the city, complementing the Leicester Ageing Together programme, by exploring how to improve older people’s financial capability.
The project aimed to address this by identifying whether more strongly grounding people’s financial decision making within their wider life context, family and social connections leads to greater and longer lasting changes than more traditional information-based financial capability support, particularly in relation to mindset, behaviour and seeking advice. There were three partners in the project, Vista, who are the lead body of the Leicester Ageing Together programme, CALS, who provide social welfare law and support, and the WEA, who provide educational opportunities including to older people.
The original project design was to run two strands of workshops, one covering “traditional” financial capability skills and knowledge (the “financial capability” strand) and another that delivered the same financial capability skills and knowledge but within the context of what people wanted to achieve for their retirement as a whole (the “holistic” strand). This was designed to be delivered as two workshops, a week or two apart, in community venues across the city. Participants ranged from 60 to over 90 years old, were three quarters women and a quarter men, and just under half came from an ethnic minority background.
The full project did not run as planned, as early delays with set up, predominantly difficulties recruiting staff, impacted on the initial recruitment of participants and so the Money Advice Service stopped the project early having delivered to 163 participants against a target of 300. This means that sample sizes were more limited than had been originally intended, which impacted statistical analysis.
The evaluation was undertaken by local consultancy Ideas to Impact, and used pre- and post-surveys, workshop observation, staff and participant focus groups, and interviews with delivery partners and community partners. It was intended to carry out three-month follow up telephone interviews with participants to track changes against outcomes and to seek their views on process, but with the project cessation these interviews did not happen.
Key outcome findings: Findings reported are limited to clients’ reporting in the baseline surveys, and the survey at the end of workshops two, which measured changes in confidence in relation to what they had learned. This showed:
Process evaluation and implications and recommendations for policy and practice
This project was not successful as a research project, which was the main aim of the What Works Fund, in fully answering our research question and we do not know the impact on the clients because the project was stopped. However, the evaluation indicates that delivery of the workshops was successful in many ways as evidenced by input from providers, community organisations and the participants.
It was initially perceived that there were problems with engagement of participants, however evaluation indicates that there were some initial set up problems, and that it was these, along with unrealistic timescales that impacted on engagement rather than the engagement methods themselves, which can be seen as successful towards the end of the project by the range and diversity of organisations involved.
Other project successes included that it:
The main limitation of the evaluation was the lack of input from participants because the project finished early, both in terms of impact and process, although the two participant focus groups, and focus groups and interviews with delivery partners and community organisations provided good quality information and insights. Smaller sample sizes than originally intended were also a limitation, reducing the ability to draw statistically significant conclusions. There were problems with the data collection surveys, particularly the baseline survey at the beginning of workshop one. Because of language difficulties and sensory disabilities, finding other ways to measure changes is recommended for future research. Evaluation also affected recruitment in trying to involve participants who were the right age, had the ability to make changes that were identified by the programme, for example they were not already too skilled, and who had enough control over their money to take some action. Some of these decisions sat uncomfortably with the project team in relation to equality and diversity.
Delivering community financial advice workshops in Leicester full report
Delivering community financial advice workshops in Leicester full report
www.ideastoimpact.co.uk