Preparing our panel on measuring what matters, revisiting this gem:
https://academic.oup.com/schizophreniabulletin/article-abstract/39/1/226/1889747?login=false
In 10k trials on the Cochrane Schizophrenia Group’s Register, 2194 different scales were employed with every fifth trial introducing a new rating instrument.
Roughly 2 weeks left to submit to JPRO's #SpecialIssue
"Patient and Public Involvement and Engagement"
https://www.springeropen.com/collections/PPIE
#PPIE
The aim is to capture the use of Patient and Public Involvement and Engagement (#PPIE) in Patient-Reported Outcome-related research, such as the development of PRO measures and electronic PRO (ePRO) systems, as well as the implementation of PRO measures for healthcare research and clinical practice.
Our guideline on how to report assessments where experts review several sources of (longitudinal) information for a more accurate result has been available as a #PrePrint for a while and is now available at a journal:
https://www.sciencedirect.com/science/article/pii/S0010440X25000318
Led by @oscarkjell and team, the guideline aims to support researchers in planning, reporting, and evaluating research that aims to achieve best-estimate assessments.
#PsychologicalAssessment #Diagnosis #Psychometrics #ClinicalPsychology #Psychiatry
I was informally (mis)diagnosed as "probably psychopathic" by my supervisor when I did my Social Psychology postgraduate at the University of Leicester psychiatric teaching hospital back in 1989. Now I realise that I was really diagnosed with adult autism by a psychologist who didn't have the tools to differentiate.
It's interesting because it started me on my path to computerising the psychiatric investigation part of the DSM (well, initially Hare PCL) evaluation for my Master's degree. The psychometric question-and-answer model and demo I came up with had me firmly psychopathic in PCL's diagnostic terms, whereas these days it would be easily diagnosed as autism.
I went on to expand the idea from psychometrics, to behaviour analysis in virtual worlds, which I figured would be a better capture than psychometric questions - Would the person co-operate to attain a goal, would they show altruism, would they be quick to anger - There's a lot you can measure in the virtual world as we know very well now, but didn't in 1991. Sadly, the lack of modern technology and the need to feed myself brought this PhD to an end without a write-up - But it's no wonder I ended up working for OkCupid, I guess :D
The sad thing about that is that although it didn't impact my life at all, other than having an interesting topic to discuss at parties, the PCL is used as a tool by US prisons in their parole calculations. A PCL diagnosis is a heavy weighting against parole, even though Hare himself has said that isn't the way this should be used. I dread to think how many autistic people are stuck in prisons for evermore because of misdiagnosed psychopathy.
The psychopathy test puts a lot more emphasis on masking and social interactions than on kidnapping people and putting them in wells to skin them later, I feel.
I can't be bothered to write a blog post about this, so I will scream into the #Mastodon #Void instead - Except now I have to think of some other #Hashtags which is always the hard part, I get carried away, autism you see!
#Medicine #Psychology #Psychiatry #MentalHealth #Education #Diagnosis #Psychopathy #HarePCL #DSM #Psychometrics #Statistics #Autism #ADHD #RetroComputing #Gaming #Online #Worlds #MUD #Leicester #UniversityofLeicester #Prison #Parole #HannibalLecter #SilenceoftheLambs #OkCupid #Tinder #Hinge #MatchGroup #Algorithms #BigData
Large language models are proficient in solving and creating emotional intelligence tests
https://www.nature.com/articles/s44271-025-00258-x
Research examined whether LLMs can solve and generate performance-based emotional intelligence tests. Results showed that ChatGPT-4, ChatGPT-o1, Gemini 1.5 flash, Copilot 365, Claude 3.5 Haiku, and DeepSeek V3 outperformed humans on five standard emotional intelligence tests, achieving an average accuracy of 81%, compared to the 56% human average reported in the original validation studies.
"Notably, all LLMs performed more than one standard deviation above the human mean, with ChatGPT-o1 and DeepSeek V3 exceeding two standard deviations above the human mean. The LLMs also exceeded human performance in each of the five EI tests individually, with large effect sizes"
#psychology #psychometrics #socialScience #LLM #AI #Chatbots
The development of an interactive platform for applying tree-based IRT models for detection of differential item functioning is summarised in a recent #ISOQOL letter:
https://www.isoqol.org/bridging-the-gap-a-user-friendly-tool-for-evaluating-differential-item-functioning-in-patient-reported-outcome-measures/
A related methods paper by the team:
https://link.springer.com/article/10.1007/s11136-023-03560-5
The first paper of the EQ-DAPHNIE project describes its rationale, design and data collection methods:
https://link.springer.com/article/10.1007/s11136-025-03983-2
Online survey quota (age, sex, household income, area of residence & per official language where relevant) samples from 15 countries with a range of #HRQOL data collected using the same methodology to support progress toward an international research infrastructure in this area.
Getting ready for @beccajackson.bsky.social 's talk at our School. Activating all the brain cells ☕😅
#Cofaidh #Coffee #Philosophy #PhilosophyOfScience #Psychometrics #Measurement
I look forward to hosting Rebecca Jackson at the School of #HealthSciences next week. In addition to exploring potential for collaboration, she will give a talk 👇
Find out more about her excellent work:
https://measuring-well.com/
I want to plug two papers in particular:
"Cervical measurements were taken primarily to influence the female body and control labor outcomes"
https://www.sciencedirect.com/science/article/abs/pii/S0263224123012162?via%3Dihub
and
https://www.sciencedirect.com/science/article/abs/pii/S0039368122000954
#Psychometrics #Measurement #Clinimetrics #Midwifery
#Gynecology #DundeeUni
Really happy to be in York once again for the annual in-person meeting of our grant to develop a better approach to long-term modelling of intervention effects on adolescent mental health and wellbeing:
https://gtr.ukri.org/projects?ref=MR%2FX002837%2F1#/tabOverview
You can delve into an earlier version of the model in this paper:
https://microsimulation.pub/articles/00228
#Microsimulation #Epidemiology #Psychometrics #HealthEconomics
A post by Julia Rohrer on 🟦 had me revisit one of my earlier studies in which we used Mixed #Rasch Models to identify response styles in a personality questionnaire and then investigate differential item functioning across gender* groups.
https://econtent.hogrefe.com/doi/10.1027/1614-0001/a000102
Overall, the DIF results were consistent and gender-DIF and response styles likely independently influenced item responses.
*Published 2013, i.e. we would probably approach that part with a bit more nuance today.
The March* issue of Quality of Life Research includes the call for papers
"Quality of life dimensions in people living with mental disorders: moving beyond global scores"
https://rdcu.be/ehPIy
We encourage submissions of research and practice using nuanced approaches to #HRQL & #QOL, adopting the term “mental disorder” broadly, e.g., based on standard diagnoses or using transdiagnostic perspectives.
#SMI #HRQL #PatientCentered #Psychometrics #ClinicalPsychology #PsychotherapyResearch
* 👇
Given that surveys tend to overestimate belief in #conspiracyTheories (https://osf.io/preprints/psyarxiv/zsncr_v1) and support for #politicalViolence (https://doi.org/10.1073/pnas.2116870119), I wonder how much of the correlation between such variables remains after accounting for such measurement error.
A paper that we've been working on for quite a while just got published! Check it out our if you're into #physicsed and #measurement #psychometrics
"Is the Force Concept Inventory biased across the intersections of gender and race?"
https://www.researchgate.net/publication/390567150_Is_the_Force_Concept_Inventory_biased_across_the_intersections_of_gender_and_race
Hence population rates of suicidality, harms and deaths, are a core metric
#SocioMetrics
#PsychoMetrics
#EnergyNetworkScience
RE: https://bsky.app/profile/did:plc:clqb4ibi4zknabjrssg272zb/post/3lltxycxlps2x
🔔 In Religious Studies: Analytic #Atheism & Analytic Apostasy...
Steve Stich, Justin Sytsma, and I studied >70k people across the globe.
Apostates were more reflective thinkers.
That explained links between reflection and #religion.
#Preprint + audio: https://byrdnick.com/archives/28471/upon-reflection-ep-14-analytic-atheism-analytic-apostasy-across-cultures
The final typeset version is also freely available (#openAccess) via #CambridgeUP; https://doi.org/10.1017/S0034412525000198
Pleased to see our latest open-access #GamblingDisorder study published in Psychological Assessment: https://psycnet.apa.org/doi/10.1037/pas0001374
Our research developed the Gambling Disorder Test, an easy-to-use, convenient, and ultra-brief standardised psychometric test for Gambling Disorder that aligns with the current diagnostic criteria in the ICD-11.
My simulation study on item misfit detection in Rasch models is published. We should leave rule-of-thumb critical values for model/item fit metrics behind us and use simulation/bootstrap methods to determine cutoffs appropriate for the sample and items being analyzed.
https://pgmj.github.io/rasch_itemfit/
The paper was completely written in #rstats and #quartopub and should be easy to reproduce. Source code and data available on GitHub via the URL above.
Very interesting paper on the use of exploratory factor strategies to investigate indicators of psychopathology. The Intro and Discussion are packed with interesting literature from the field:
https://journals.sagepub.com/doi/full/10.1177/21677026241308861
Thanks for HT to our paper on some conceptual challenges when using and interpreting factor models for this work. Below one of the parts of the paper the team may have referred to.
https://rdcu.be/ed1Vd
This one time in maybe 2018 I pissed off a few uni colleagues. At a "senate" meeting (it deserves quotation marks at my school) some people with #psychometrics training & experience, including me, explained that a specific kind of #assessment was invalid--as in zero validity for intended purpose--so we should not use it. It literally provides no information about what it says, so we might as well roll dice or draw #random words from a hat.
The administration argued vehemently for keeping the assessment. They claimed it was valid (we showed them it wasn't). They claimed that a "caring" or "astute" instructor could glean valuable information (we showed them that this wasn't possible). They appealed to the other professors, implying that not using this assessment meant they didn't care about their students, and that voting to eliminate this assessment meant they (the eggheaded intellectuals) were being dunked on by the eggheaded intellectuals.
The measure failed and we still use the assessment. After the meeting I and someone else were bemoaning the result. I said something like "What happened in there was Trumpian." A colleague walking by overheard and angrily asked, "What do you mean by that?!"
I said, "The faculty heard from the experts telling them something they didn't like and they chose to go with the people who had no expertise telling them what they wanted to hear."
(I am sometimes not diplomatic; this makes a good story, but I really wish I had found a better way to say that.)
The person audibly huffed, actually turned on their heel, and walked away. They haven't spoken to me since.
#story #highered #university #uspol #expertise #trumpism #management #labor
