Categories
l

The Mismatch Between Clients Global Judgements and Changes on Psychometric Test

casts doubt on the wisdom of the Improving Access to Psychological Therapies IAPT) services sole reliance on test results.  A recent study by Hobbs et al (2020) https://doi.org/10.1017/S0033291719003878 compared subjects global judgements on improvement/deterioration with changes on the PHQ9 and found poor agreement. For those who reported ‘feeling worse’ PHQ9 scores showed no change or improvement for 76% of them.  Further for those who reported ‘feeling a lot worse’  for 81% of them the PHQ9 showed no change or an improvement.  

Hobbs et al (2020) conclude that test results tell only part of the client’s story and there is a need for clinical assessment.

The interview assessments in IAPT go no further than the open ended interviews that are the first part of all standardised diagnostic interviews. Open-ended interviews furnish at most differential diagnoses and highlight candidate disorders for further investigation.  Further inquiry is then made of all of the symptoms in a diagnostic set ( controlling for information variance) and thresholds are used to determine whether a symptom is present  at a level that would constitute functional impairment (controlling for criterion variance).  Reliable diagnosis makes it possible to determine which evidence based treatments are likely to be appropriate in a particular case, bearing in mind the client’s social context and cognitive capacities.

Ultimately global judgements have a more real world feel than changes on psychometric test. A client knows whether they are back to their old selves post treatment and whether they would regard this as enduring. Similarly a client with a lifelong history will now whether they are back to their ‘best functioning’ post treatment and whether it is just one more ‘flash in the pan’. Similarly an independent assessor of a Service can make g global judgement (using a standardised diagnostic interview) whether the person has lost their diagnostic status post treatment and whether there is evidence of permanence. Psychometric tests have been grossly overvalued by IAPT for quality control purposes, but they are fantastic for marketing to the unwary.

Tests Misleading for Diagnostic Acccuracy

It is common for advocates of psychometric tests to quote high sensitivities/ specificities of the order off 80% for instruments such as the PHQ9. But this does not mean that using the PHQ9 on all clients coming through the IAPT door that using its 10 or greater cut off 4 out of 5 clients will be correctly classed.  Tests are validated in a particular context, thus if the proportion of clients with diagnosed disorder (using a diagnostic interview)  differs  by context then so to will the appropriate cut offs and sensitivities/specificities.  Further a psychometric test does not indicate what other disorders are present nor which is the primary disorder. Treatment that fails to address comorbidity is likely to fall short and comorbidity is the norm not the exception. 

Dr Mike Scott

187 replies on “The Mismatch Between Clients Global Judgements and Changes on Psychometric Test”

I used to have to use the “problem descriptors” in PCMIS for everyone I saw. Many came under “mixed anxiety and depression” descriptor, however we were stopped from using this as it messed up the figures elsewhere, due to there being no NICE guidelines for mixed anxiety and depression.

Presumably also the PHQ9 is designed to be accurate when someone is rating the frequency of symptoms over the previous fortnight (?) and it is standard in IAPT that people will be rating over the past week only as therapy sessions are normally weekly.

IAPT’s sole reliance on the PHQ9 means that 50% of those found to be positive on the test (greater or equal to 10) are actually false positives.[ see Brooke Levis et al (2019) BMJ] Thus half of those IAPT would deem need treatment for depression are actually incorrectly treated. IAPTs results must therefore fall far short of the results of randomised controlled trials in which all patients were known to have depression initially with regard to a standardised diagnostic interview, yet the recovery rate in the acts was only 50% thus the recovery rate at the very most in IAPT for depression cases can only be 25% and this is probably an overestimate as it assumes IAPT therapists are as good as the highly trained therapists in rcts!
As Kojay rightly points out the PHQ9 is inappropriate for weekly assessment as in IAPT because the test specifies previous 2 weeks.
Mike

My developer is trying to convince me to move to .net from PHP.
I have always disliked the idea because of the expenses. But he’s tryiong none the less.
I’ve been using WordPress on numerous websites for about a year and am worried about switching to another platform.
I have heard very good things about blogengine.net. Is there a way I
can transfer all my wordpress content into it? Any help would be
really appreciated!

You’re so cool! I don’t suppose I have read through something like that before.
So good to find someone with original thoughts on this subject.
Really.. thanks for starting this up. This website is something that is required on the internet, someone
with a little originality!

Thanks a bunch for sharing this with all of us you really recognise what you’re talking approximately!
Bookmarked. Please additionally consult with my web
site =). We could have a link trade arrangement between us

I was recommended this blog by means of my cousin. I’m not sure
whether or not this put up is written by means of him
as no one else understand such distinct about my trouble.

You’re wonderful! Thank you!

Howdy! This is my first comment here so I just wanted to give a quick shout out and tell you I
genuinely enjoy reading through your blog posts. Can you recommend any other blogs/websites/forums that cover the same subjects?
Thank you!

It’s really a nice and useful piece of info. I am happy that you shared this useful information with us.

Please stay us informed like this. Thanks for
sharing.

I’ve been surfing online more than 3 hours these days, but I never found any interesting article like
yours. It’s pretty worth sufficient for me. In my opinion, if
all site owners and bloggers made just right content material as
you probably did, the web will be a lot more helpful than ever before.

Thanks for every other fantastic article. The place
else may anybody get that type of information in such a perfect approach of writing?
I have a presentation next week, and I’m on the search for such information.

I’m not that much of a online reader to be honest but your
blogs really nice, keep it up! I’ll go ahead and bookmark your website
to come back in the future. Many thanks

I must thank you for the efforts you’ve put in writing
this blog. I really hope to view the same high-grade blog posts by you in the
future as well. In fact, your creative writing abilities has inspired me to get my own site now ;
)

of course like your web site however you need to
take a look at the spelling on several of your posts. Many
of them are rife with spelling problems and I
find it very bothersome to tell the reality nevertheless
I will certainly come back again.

With havin so much content and articles do you ever run into any
problems of plagorism or copyright violation? My blog has a lot of exclusive content I’ve either authored myself or
outsourced but it seems a lot of it is popping it up all over the web
without my authorization. Do you know any techniques to help protect against content from being ripped
off? I’d certainly appreciate it.

Hi, i feel that i noticed you visited my blog thus i got here to go back the choose?.I’m attempting
to find issues to improve my web site!I guess its good enough to make use of some of your concepts!!

Hello! This is kind of off topic but I need some help from
an established blog. Is it very difficult to set
up your own blog? I’m not very techincal but I can figure things
out pretty quick. I’m thinking about setting
up my own but I’m not sure where to begin. Do you have any tips
or suggestions? Thanks

We are a group of volunteers and opening a new scheme in our community.

Your website offered us with valuable information to work on. You’ve done a formidable job and our entire community will be thankful to you.

Thanks for your marvelous posting! I seriously enjoyed reading
it, you are a great author.I will remember to bookmark your
blog and definitely will come back later in life.

I want to encourage one to continue your great job, have a
nice morning!

Hi! This is my 1st comment here so I just wanted to give a
quick shout out and tell you I truly enjoy reading through your blog posts.

Can you recommend any other blogs/websites/forums that go over the same topics?
Many thanks!

Excellent post. I was checking constantly this blog and I’m impressed!
Very helpful information specifically the last part 🙂
I care for such info a lot. I was looking for this certain info for a long time.
Thank you and best of luck.

With havin so much written content do you ever run into any issues of
plagorism or copyright infringement? My website has
a lot of completely unique content I’ve either written myself or
outsourced but it seems a lot of it is popping it up all over the web without my authorization. Do you know any ways
to help reduce content from being ripped
off? I’d really appreciate it.

Admiring the persistence you put into your blog and detailed information you offer.
It’s awesome to come across a blog every once in a while that isn’t the same out of date
rehashed information. Wonderful read! I’ve bookmarked
your site and I’m including your RSS feeds to my Google account.

Hey there! This post couldn’t be written any better! Reading this post reminds me of my previous room mate!
He always kept talking about this. I will forward this post to him.
Fairly certain he will have a good read. Many thanks for sharing!

I really love your website.. Excellent colors & theme.

Did you make this website yourself? Please reply back
as I’m planning to create my very own site and want to find out where you got this from or exactly what the theme is called.

Thank you!

A fascinating discussion is worth comment. I believe that you ought
to publish more about this topic, it might not
be a taboo matter but generally folks don’t talk about these issues.
To the next! Best wishes!!

Heya i am for the first time here. I came across this board and I find It
truly useful & it helped me out much. I hope to give something back and aid others like you aided me.

Its like you read my mind! You seem to know so much about this, like you wrote the book in it or something.
I think that you can do with a few pics to drive the message home a bit, but instead of that, this is excellent blog.
A fantastic read. I’ll definitely be back.

Wonderful work! That is the type of info that are meant to be shared across the web.
Shame on Google for not positioning this submit upper!
Come on over and discuss with my web site . Thank you =)

Cool blog! Is your theme custom made or did you download it from
somewhere? A theme like yours with a few simple
adjustements would really make my blog shine.
Please let me know where you got your design. Thanks

Howdy I am so glad I found your webpage, I really found you by accident, while I was searching on Google for something else, Anyways I am here now and would just like to say kudos for a remarkable post and a all round interesting blog (I also
love the theme/design), I don’t have time
to read it all at the minute but I have book-marked
it and also added in your RSS feeds, so when I have time I will be
back to read much more, Please do keep up the superb work.

Usually I don’t learn article on blogs, but I would like to say that this write-up very pressured me
to check out and do it! Your writing taste has been amazed me.
Thank you, quite great post.

Great blog here! Also your web site loads up very fast! What web host are you using?
Can I get your affiliate link to your host? I wish my site loaded
up as fast as yours lol

Just want to say your article is as astonishing.

The clarity to your submit is just nice and that i can suppose you are an expert in this subject.
Fine along with your permission allow me to clutch
your feed to keep up to date with drawing close post.

Thanks a million and please continue the rewarding work.

I was suggested this blog by way of my cousin. I am now not sure whether
or not this put up is written via him as nobody else realize such
distinctive approximately my difficulty. You’re amazing!
Thanks!

Yesterday, while I was at work, my cousin stole my iphone and
tested to see if it can survive a forty foot drop, just so she can be a
youtube sensation. My apple ipad is now destroyed and she has 83
views. I know this is completely off topic but I had to share it with someone!

What’s Taking place i am new to this, I stumbled upon this I’ve found
It positively helpful and it has helped me out loads.
I’m hoping to contribute & aid different users like its
aided me. Great job.

When someone writes an paragraph he/she maintains the plan of a user in his/her mind
that how a user can understand it. Therefore that’s why this
post is great. Thanks!

Heya i’m for the primary time here. I came across this board and I in finding It really useful & it helped
me out much. I am hoping to present something again and help
others like you helped me.

Write more, thats all I have to say. Literally, it seems as
though you relied on the video to make your point.
You obviously know what youre talking about, why throw away
your intelligence on just posting videos to your site when you could
be giving us something informative to read?

We are a group of volunteers and opening a new scheme in our community.
Your website offered us with valuable info to work on. You’ve done an impressive process and our whole community
shall be thankful to you.

Have you ever thought about publishing an ebook or guest authoring on other sites?

I have a blog based on the same information you discuss and would really like to have
you share some stories/information. I know my readers would appreciate your work.
If you’re even remotely interested, feel free to send me
an email.

I do consider all the ideas you’ve introduced for your post.
They’re really convincing and will definitely work.
Still, the posts are too quick for beginners. May just you please lengthen them a bit from subsequent
time? Thank you for the post.

I’m pretty pleased to find this web site.
I want to to thank you for your time for this wonderful read!!

I definitely loved every bit of it and i also have you book-marked to check out new information in your website.

My spouse and I stumbled over here coming from a different
web page and thought I might check things out. I like what I see so now i’m following you.
Look forward to checking out your web page for a second time.

I was curious if you ever thought of changing the layout of your site?
Its very well written; I love what youve got to say.
But maybe you could a little more in the way of content so people could connect with it better.

Youve got an awful lot of text for only having 1 or two images.

Maybe you could space it out better?

Hi would you mind letting me know which web host you’re utilizing?

I’ve loaded your blog in 3 completely different browsers and
I must say this blog loads a lot quicker then most. Can you recommend a good
hosting provider at a reasonable price? Thank you,
I appreciate it!

Thanks for a marvelous posting! I truly enjoyed reading it, you could be a great author.

I will be sure to bookmark your blog and will come back at some point.
I want to encourage you continue your great posts, have a nice day!

I do not even know how I ended up here, but I thought
this post was great. I don’t know who you are but certainly you are going to a famous blogger if you aren’t already 😉 Cheers!

I’ve been browsing online more than 3 hours nowadays,
yet I by no means found any interesting article like yours.
It is pretty price enough for me. In my view, if all website owners and bloggers made
good content as you probably did, the internet will likely be
a lot more helpful than ever before.

Great post. I used to be checking continuously this weblog and I’m inspired!
Extremely useful information particularly the ultimate part 🙂 I care for
such information much. I used to be seeking this particular
info for a long time. Thank you and good luck.

Today, while I was at work, my cousin stole my iphone and tested to see if it can survive a 25 foot drop, just so she can be
a youtube sensation. My iPad is now destroyed and she has 83
views. I know this is totally off topic but I had to share it with
someone!

fantastic post, very informative. I wonder why the other experts of this sector don’t realize this.
You must continue your writing. I am confident, you’ve a
huge readers’ base already!

Have you ever thought about publishing an e-book or guest authoring on other websites?
I have a blog based upon on the same topics you discuss and
would love to have you share some stories/information.
I know my visitors would value your work. If
you’re even remotely interested, feel free
to send me an email.

That is really fascinating, You are an excessively skilled blogger.
I have joined your feed and look ahead to in the hunt for more of your excellent post.
Also, I’ve shared your website in my social networks

Hi there just wanted to give you a brief heads up and let
you know a few of the images aren’t loading correctly. I’m not sure why but I think
its a linking issue. I’ve tried it in two different internet browsers
and both show the same outcome.

When I initially commented I clicked the “Notify me when new comments are added” checkbox and
now each time a comment is added I get three emails with the same
comment. Is there any way you can remove me from that service?
Appreciate it!

Have you ever thought about adding a little bit more than just your articles?
I mean, what you say is valuable and everything. However
think about if you added some great visuals or videos to give your posts more, “pop”!

Your content is excellent but with images and videos,
this blog could definitely be one of the best in its niche.
Excellent blog!

Greetings! This is my first comment here so I just wanted to give a
quick shout out and tell you I really enjoy reading through
your blog posts. Can you suggest any other blogs/websites/forums that cover the same topics?
Thanks a ton!

The other day, while I was at work, my cousin stole my apple
ipad and tested to see if it can survive a forty foot drop, just
so she can be a youtube sensation. My iPad is now broken and she has 83 views.
I know this is totally off topic but I had to share it with someone!

Its like you learn my thoughts! You seem to understand so much approximately this, such as you wrote the ebook in it
or something. I think that you just could do with a few p.c.
to force the message home a little bit, however other than that, that is wonderful blog.
A great read. I will definitely be back.

Hey just wanted to give you a quick heads
up. The text in your content seem to be running off the
screen in Internet explorer. I’m not sure if this is a formatting issue or something to do with web browser compatibility
but I thought I’d post to let you know. The design look great though!
Hope you get the issue solved soon. Kudos

Amazing blog! Do you have any helpful hints for aspiring writers?
I’m hoping to start my own site soon but
I’m a little lost on everything. Would you propose starting with a free
platform like WordPress or go for a paid option? There
are so many options out there that I’m completely overwhelmed ..

Any tips? Thanks a lot!

I’m not sure why but this blog is loading extremely slow for
me. Is anyone else having this problem or is it a issue on my end?
I’ll check back later and see if the problem still exists.

Hi great website! Does running a blog similar to this require
a lot of work? I’ve no understanding of programming
however I had been hoping to start my own blog soon. Anyhow, should you have
any ideas or techniques for new blog owners please share. I understand
this is off subject but I just wanted to ask. Many thanks!

I think this is one of the most important information for me.
And i am glad reading your article. But should remark on few general things, The web site style
is wonderful, the articles is really great : D. Good job, cheers

Hi! I understand this is kind of off-topic however I needed to ask.
Does managing a well-established website such as yours take a lot of work?
I’m completely new to blogging however I do write in my diary
daily. I’d like to start a blog so I will be able to share my own experience and views online.

Please let me know if you have any suggestions or tips for brand new aspiring bloggers.
Thankyou!

I will right away grab your rss as I can’t to find your e-mail subscription hyperlink or
newsletter service. Do you have any? Kindly permit me know in order that I could
subscribe. Thanks.

Howdy, There’s no doubt that your blog may be having internet browser compatibility issues.

When I look at your web site in Safari, it looks fine but when opening in I.E., it has
some overlapping issues. I merely wanted to give you a quick heads up!
Aside from that, great blog!

It’s the best time to make a few plans for the future
and it’s time to be happy. I have read this post and if I could I desire to counsel you few
fascinating issues or advice. Perhaps you can write next articles regarding
this article. I want to read even more things approximately it!

The other day, while I was at work, my cousin stole my iPad and tested to
see if it can survive a thirty foot drop, just so she can be a youtube sensation. My iPad
is now broken and she has 83 views. I know this is completely
off topic but I had to share it with someone!

Cool blog! Is your theme custom made or did you download it from somewhere?
A design like yours with a few simple tweeks would really make my blog jump out.
Please let me know where you got your design.
Thank you

Leave a Reply

Your email address will not be published. Required fields are marked *