4 Out of 10 IAPT Workers Pressured to Alter Results

that is the finding of a survey of 550 current and past IAPT staff , https://survivingwork.org/5241-2/. The credibility of IAPT’s claims are in doubt, a referendum of its’ staff is needed.

NHS England is guilty of breathtaking naivety and laziness when it asserted on Radio 5 Live on Wednesday, November 13th, that 7 out of 10 IAPT clients move to recovery and 5 out of 10 recover. They did so without appeal to any independent audit. My own findings published in the Journal of Health Psychology last year suggested that actually the tip of the iceberg recover https://journals.sagepub.com/doi/10.1177/1359105318755264.

Clinical Commisioning Groups (CCG’s) should no longer see NHS England as a compelling source of persuasion in this matter, rather they need to listen to patients and the workers at the coalface. CCG’s should challenge IAPT to have a referendum of its staff at a local and national level, asking:

‘Do you want IAPT to move towards face to face assessment and treatment, as the norm?’ 

with simple ‘Yes’ or ‘No’ response options. The collective experience of IAPT workers has to be taken seriously. Judging by the stress levels reported by staff in the survey, IAPT cannot seriously maintain that it is  discharging its’ duty of care to its’ staff. 

Dr Mike Scott

When IAPT Clients and Therapists Speak It Is Totally Different To The Powerholders

this morning Vicky, a victim of the Manchester bombing was interviewed on Radio 5 Live she managed to say live how crap she had found the IAPT service. But in the actual recordings she had said how the therapist wanted to persist with trauma focussed CBT/EMDR whilst she wanted to talk about how devastated her child, who accompanied her, was. Not content with this the therapist was constantly looking at the clock and door. On the same programme IAPT clinicians spoke incognito about pressure to fiddle results on the psychometric tests used to assess outcome.  Earlier in the day the public had their say, see link below:

https://mobile.twitter.com/bbc5live/status/1194542289663746048

for those directly involved the response was uniformly negative.

Contrast the above with the comments of Prof Paul Salkovskis, President of BABCP,  a prime mover in the genesis of IAPT, who described it as ‘marvellous’ but that ‘there are inevitably a few bad apples amongst the IAPT staff’.  NHS England waded in, in similar vein  and reiterated IAPT’s claim that 5 out of 10 recover and 7 out of 10 at least move to recovery. See Radio 5 Live podcast, the pertinent section is from 10.43 to 10.55am

https://www.bbc.co.uk/programmes/m000b5wk

I had recorded for the BBC an interview in which I said that it was criminal that over £3 billion had been spent on IAPT without independent audit. It has not been broadcast. I presented data on 90 consecutive clients going through IAPT, some before and others after a personal injury (PI) with a 10% recovery rate overall and no difference as to whether before or after. I had no axe to grind over IAPT, I simply discovered that it was failing people. This study was eventually published last year, together with 3 commentary papers and my rebuttal in a Special Issue of the Journal of Health Psychology https://doi.org/10.1177%2F1359105318781872.

Interestingly an earlier version of the paper was rejected by the Editor of Behavioural and Cognitive Psychotherapy, Prof Paul Salkovskis. To date the BBC seems to have preferred to broadcast his comments, which are without direct and systematic contact with IAPT clients rather than mine.

The powerholders have it, it seems, but I am not going to give up, earlier this week I saw a guy ( a non litigant), call him Dominic who, I discovered after a 1.5 hours assessment had been suffering from depression and generalised anxiety  disorder for 2 years. He had previously had a 15 minute telephone assessment with IAPT , had no more understanding of his condition than before but the assessor opined that he seemed anxious because he had listed a long list of problems.  Dominic was told that he would hear from them to attend a group, I asked him ‘a group for what?’ and he didn’t know.  He then asked me ‘how could I talk about all my problems in a group?’. Dominic said that he had got more out of our chat than in 2 years of seeing his GP and IAPT. Unfortunately most will not escape IAPT’s clutches.

Someone remind me why I am still a member of BABCP.

Dr Mike Scott

 

 

 

Radio 4 and 5 Live Put IAPT Under The Microscope

tomorrow, Wednesday, November 13th the BBC begins broadcasting its’ investigation into IAPT on the radio, with much more recorded. There is a summary below:

It really is time to talk about IAPT

 


 

Sometimes a problem shared is not a problem halved. When you really ask people what they think about something, and really listen to what they say, things can get dark and dirty. And never more the case than if you ask people about the UK’s largest mental health service, Increased Access to Psychological Therapies (IAPT). 

 

Tomorrow turns out to be a day for talking about IAPT. Really talking about it rather than rolling out another Royal or playing the neurolinguistic game of positivity ping pong.

 

There will be a number of discussions tomorrow 13 November on BBC Radio 5 Live about worker and user experiences of IAPT. You can engage with the debate by going to the links below.

The conversation begins on Radio 5 Live in the early hours tomorrow, and will include a discussion on the Emma Barnett Show at 10am. 
Also tomorrow BBC Radio 4’s You and Yours will be looking into IAPT – the show goes out live at 12.18-12.57 including Surviving Work, well me,  talking about our current IAPT survey and thinking about whether its possible to reclaim the mental health turf and establish a genuinely decent model of care. 
 

This is not a one trick pony kind of a discussion. It’s complex and attempts to walk the thin line between protecting decent therapy and making sure we’re not defending the indefensible. From the gaming of data to the heroic efforts of counsellors tucked away in the IAPT system and the many political and financial interests involved. It’s a story of performance data and the impact of performance management on the people delivering IAPT.

It’s about unpacking the data asking why 71% of people working in the service reported burnout, and 67% live with depression or anxiety.

 

Here’s the information you need to get involved:

 

BBC Radio 5 Live  https://www.bbc.co.uk/5live

The Emma Barnett Show https://www.bbc.co.uk/programmes/m000b5wk

SMS: 85058

Telephone: 08085909693

Useful Twitter contacts: @EmmaBarnett @cave_rob @BBC5Live @survivingwk

 

BBC Radio 4 Live https://www.bbc.co.uk/radio4 

You & Yours https://www.bbc.co.uk/programmes/b006qps9

Useful Twitter contacts: @BBCRadio4 #youandyours @cave_rob @survivingwk 

 

Tomorrow the Labour Party announces its health strategy. Let them know what you think about IAPT and send your thoughts to:

@labour_MH

@jonAshworth

@johnmcdonnellMP

@disabilityLab

@jeremycorbyn

 

And here are some reliably vocal folks who you might find interesting to follow on the day:

@UK_Counsellors

@PCSRuk

@MarkOneinFour

@Glennademeter

@aclientfirst

@clareslaney

@alliance4CP

@MHResist

@NSUNnews

@Mental_Elf

@DrTonyOSullivan

@pcu_union

@Paulananke

@IanBFAWU

@Skourkos1

@davidamunday

@keepnhspublic

@NHSCampaign

Dr Mike Scott

IAPT’s Training Fails But CBT Can Make a Real World Difference

three papers just published in the journal Cognitive Therapy and Research, tell contrasting stories: two are by leading lights in IAPT assessing the competence of trainees, in neither study did they demonstrate any real world outcome. By contrast in a study by Perrin et al (2019) of individual CBT for children (aged 10 to 18) suffering from generalised anxiety disorder 80% no longer had GAD by the end of 10 sessions of treatment compared to 0% in the waiting list.   These impressive results were maintained at 3 month follow up.

IAPT could learn from the Perrin et al (2019) study in that client’s diagnostic status was assessed using  a standardised diagnostic interview  and again at the end of treatment using blind assessors, further therapists followed an evidence based protocol for the identified disorder. Whilst it is costly to make such rigorous assessments and IAPT might fear having to explain to Clinical Commissioning Groups the necessary change in modus operandi, IAPT might then at last make a socially significant difference.

IAPT has been provisionally scheduled to be the focus of presentations on BBC TV and Radio on Wednesday, November 13th. 

Perrin et al (2019) Cognitive Therapy and Research (2019) 43:1051–1064
https://doi.org/10.1007/s10608-019-10020-3

Liness et al (2019) Cognitive Therapy and Research (2019) 43:959–970
https://doi.org/10.1007/s10608-019-10024-z

Liness et al (2019) Cognitive Therapy and Research (2019) 43:631–641
https://doi.org/10.1007/s10608-018-9987-5

Dr Mike Scott

National Audit Office Failed To Audit Improving Access To Psychological Therapies Service

 

because it was ‘too busy’. In response to a freedom of information request, from Liverpool, Consultant Psychologist, Dr Mike Scott, the NAO said on November 1st 2019 that amongst its’ reasons for curtailment of its’ investigation were Brexit, the collapse of Carillion and spending increases on generic medicines.  Further the cost of its’ incomplete investigation in 2017-2018 was £74,000. But Dr Scott comments that the reasons that prompted the investigation still remain. He adds that the IAPT service has cost the taxpayer over £3 billion in the last decade with no independent audit of outcome. Clinical Commissioning Groups have simply taken at face value IAPT’s marking of its’ own homework – whither accountability? The NAO response is a yet further illustration that despite official assurances mental health is at the bottom of the agenda. Is it beyond the political parties to go beyond the rhetoric on mental health at the forthcoming general election and commit to an independent inquiry as to how IAPT client’s actually fare? 

In his submission to the NAO Dr Scott pointed out that IAPT had never been subjected to independent audit using the ‘gold standard’ methodology that has been used to assess the effectiveness of a drug. His own published research see link https://journals.sagepub.com/doi/10.1177/1359105318755264 has suggested that only the tip of the iceberg of IAPT client’s recover much less than the 50% claimed by the Organisation. The Journal of Health Psychology also published 3  commentary papers and a rebuttal paper by Dr Scott.  He suggests  that Clinical Commissioning Groups should in the short term refuse to fund the low intensity interventions (guided self- help, computerised cognitive behaviour therapy and educational classes)  that the majority of IAPT clients receive and for which the evidence base is particularly weak, in favour of funding the face to face psychological therapies and for the long term insist that they will be guided by an appropriate independent audit.

Dr Mike Scott

 

 

 

 

 

Expansion Into Long Term Conditions By IAPT Is Quackery

so challenge Clinical Commissioning Groups on the value for money – no better than homeopathy. Studies of CBT  for long term conditions (LTCs) show either no effect, see Serfaty et al study (2019) on cancer https://www.cambridge.org/core/journals/the-british-journal-of-psychiatry/article/effectiveness-of-cognitivebehavioural-therapy-for-depression-in-advanced-cancer-cantalk-randomised-controlled-trial/E9264C516634EC7BC3FF9E80B551A8C5

and/or rely on a self report measure of questionable real world significance, see the Everitt et al  (2019) study of irritable bowel syndrome https://www.thelancet.com/journals/langas/article/PIIS2468-1253(19)30243-2/fulltext In the Everitt et al (2019) study outcome was assessed primarily by the patient’s completion of a 5 item measure of the severity of IBS (IBS-SSS) rather than a clinician independent of the study asking the IBS-Adequate Relief  question ‘ since… have you had adequate relief of your IBS’. Usually the IBS-AR uses the time frame of the past seven days but in the context of assessing CBT it could be since entering the study for a control group or since cbt for those having cbt.  The correlation between the IBS-AR and IBS-SSS though significant is small see Passos et al (2009) http://nrs.harvard.edu/urn-3:HUL.InstRepos:35859644

The authors of the Everitt et al (2019) study appear not to realise  that use of a self-report measure as the primary outcome measure introduces a demand effect for clients undergoing cbt, they don’t want to feel that they have wasted their time. Further the Passos et al (2009) study showed that the IBS-AR is much less subject to fluctuation than the IBS-SSS. Arguably the IBS-AR is of much greater social significance, addressing whether an intervention makes a real world difference. 

It is worrying that Everitt et al (2019) opine:

‘Offering both web-CBT and telephone-CBT in NHS services such as Improving Access to Psychological Therapy could allow many patients to gain substantial benefits with web-CBT with minimal therapist input while allowing a step-up approach to telephone-CBT for those needing additional
support’

IAPT will surely jump on this to justify empire building and likely ignore the caution of Serfaty et al (2019) 

‘our results suggest that resources for a relatively costly therapy such as IAPT-delivered CBT should not be considered as a first-line treatment for depression in advanced cancer. Indeed, these  findings raise important questions about the need to further evaluate the use of IAPT for people with comorbid severe illness’

If as seems likely Clinical Commisioning Groups fund IAPT’s expansion into LTCs they should be asked to justify this expenditure in the abscence of any empirical base.  

Dr Mike Scott

‘Go To Hell, If You Don’t Jump Through Our Hoops’

that’s the take home message absorbed by a partner of an ex-soldier with PTSD, broadcast on BBC Radio 4’s Woman’s Hour yesterday, available as a podcast . Her partner was referred by his GP several times for psychological treatment, but he didn’t go though the ‘opt in’ procedure (ringing up and agreeing a telephone assessment) so in the words of the agency the referral was not ‘activated’.  He then developed a psychosis when she developed cancer and there was a further episode of psychosis before treatment got underway. But it doesn’t stop there she was never involved in the treatment despite that they could no longer sleep in the same bed because of his nightmares and his response. The treating clinicians it seems are unaware that social support is the biggest predictor of recovery from PTSD and that the disorder has a devastating impact on relationships.   Fortunately she got some help for herself from an online forum for partners of those with PTSD run by combat stress.

Clinical Commissioning Groups need to be made aware of what goes on in the mental health services they fund to the tune of £6-7 billion a year, with over £300 million being spent on IAPT each year, this amounts to billions of £’s being spent on IAPT since its’ inception, it is surely criminal that this has taken place without any independent evaluation of outcome.  

The ‘go to hell approach’ is unfortunately not confined to the process of engagement with the services, it also features in treatment – a client of mine with PTSD was told in an IAPT service the focus of the session was trauma focussed CBT/EMDR but he was concerned to talk about the devastating impact the Manchester bombing had had on his niece and he was given no such opportunity to discuss these concerns, the trauma focussed treatment proceeded relentlessly, all to no avail. 

I think it would be excellent if people sent the Radio 4 broadcast to their Clinical Commissioning Groups, the links can be accessed below, asking that they critically appraise the operation of IAPT.  Both Radio 4 and Radio 5 Live are making more broadcasts on these matters in the coming weeks and it would be great if people could disseminate the material as far as possible

https://www.england.nhs.uk/ccg-details/

Dr Mike Scott

 

 

IAPT’s Unreliable Assessment of Competence, Incompetence and Spin

the competence of trainee CBT therapists is routinely assessed using the Cognitive Therapy Rating Scale-Revised (CTRS-R), but a just published study by Roth et al (2019) has shown poor  levels of agreement on the performance of IAPT trainees, using this measure.  The levels of agreement were no better when an alternative measure of competence the University College London CBT Scale was used. On both measures of competence the intra-class correlation coefficients were less than 0.5, indicating poor reliability (on a scale poor, moderate, good, excellent). The UCL Scale is rooted in the competence framework developed by Roth and Pilling (2008) as part of the IAPT programme.

The chaos is underlined by a study conducted by Liness et al (2019), published in Cognitive Therapy and Research which assessed the competence  of IAPT trainees using the CTRS-R with client outcome assessed, mainly with the PHQ9 and GAD7, and no relationship was found, either at the end of training or 12 months later, see link below:

https://www.dropbox.com/s/e26n191ie09sngs/Competence%20and%20Outcome%20IAPT%20no%20relation%202019.pdf?dl=0

But the same set of authors as in the Liness et al (2019) study, have published a further paper in Behavioural and Cognitive Psychotherapy, again of IAPT trainees, evaluated using the CTRS-R. But this time, in the abstract, they reported that ‘CBT competence predicted a small variance in clinical outcome for depression cases’ with no reference to the findings of their other paper!  In the body of their Behavioural and Cognitive Psychotherapy report one discovers that for depression cases the CTRS-R explained 1.3% of the variance in outcome, it is extremely doubtful if this is of any social or clinical significance. There is also a failure to mention in the abstract that CTRS-R did not at all relate to anxiety.  The abstract is dominated by the message that training helped trainees score highly on the CTRS-R, without acknowledging that this might be without meaning. Three of the 6 authors have links to IAPT  and spin is not therefore unexpected. 

Liness et al  Behavioural and Cognitive Psychotherapy (2019), 47, 672–685
doi:10.1017/S1352465819000201

Roth et al  Behavioural and Cognitive Psychotherapy (2019), 47, 736–744 doi:10.1017/S1352465819000316

Roth, A. D. and Pilling, S. (2008). Using an evidence-based methodology to identify the competences required to deliver effective cognitive and behavioural therapy for depression and anxiety disorders. Behavioural and Cognitive Psychotherapy, 36, 129–147. doi: 10.1017/S1352465808004141

 

Dr Mike Scott

 

 

IAPT No Better Than Treatment As Usual

that is the conclusion of a just published study in the British Journal of Psychiatry by Serfaty et al, (2019).  In the study manualised IAPT-delivered CBT was compared to treatment as usual in treating depressive symptoms in people with advanced cancer. These authors concluded: 

‘our results suggest that resources for a relatively costly therapy such as IAPT-delivered CBT should not be considered as a first-line treatment for depression in advanced cancer. Indeed, these  findings raise important questions about the need to further evaluate the use of IAPT for people with comorbid severe illness’

Interestingly the IAPT therapists were all High Intensity Therapists  with mean Cognitive Therapy Rating Scale Score of 47.6  “at the upper end of the ‘proficient range’.” The primary outcome measure was the Beck Depression Inventory II and both the treatment as usual and the CBT group showed a mean reduction of 5 points. Curiously the MINI diagnostic interview was used to assess whether people were in fact depressed and would thereby qualify for the study but it was not re-administered at the end to determine how many were no longer depressed. Nevertheless even using a diagnostic interview trying to determine whether symptoms such as sleep disturbance and fatigue should count as part of a depression or as a feature of the illness   is realistically probably an impossible task.  The appropriate model with severe illnesses is probably support ( both tangible e.g heating allowance and emotional) rather than psychological therapy.

Serfaty et al Effectiveness of cognitive-behavioural therapy for depression in advanced cancer: CanTalk randomised controlled trial British Journal of Psychiatry (2019) Page 1 of 9. doi: 10.1192/bjp.2019.207

Dr Mike Scott