#decisionScience

Nick Byrd, Ph.D.ByrdNick@nerdculture.de
2025-04-10

🤔 Not what I expected!

More people preferred high diagnostic uncertainty than low, even though the higher uncertainty caused more worry.

Within- and between-subject, quant and qual results: doi.org/10.1136/jme-2024-10993

#medicine #decisionScience #probability #bioethics #openAccess

Methods and results (pages 4 and 5)
Nick Byrd, Ph.D.ByrdNick@nerdculture.de
2025-03-09

#Microsoft's viral paper about *correlations* between #AI use and #criticalThinking also has "impact" in the title (despite admitting "Our analysis does not establish #causation"). 🤦‍♂️

#Confidence in #GenAI predicted LESS critical thinking.

SELF-confidence predicted MORE critical thinking.

PREDICTED ≠ CAUSED

microsoft.com/en-us/research/p

#computerScience #LLMs #work #decisionScience #psychology #surveyResearch #management #logic

The title versus the admission on page 14.
2025-02-22

TL;DR: I think a specific kind of "backward" reasoning, common in conservative religious traditions in the US, is one of the things driving the current crisis.

Long version:.......

First, my experience is with the LDS church, which has spent a few decades trying to be Evangelical enough to be buddies with the actual Evangelicals, and my experiences so far suggest that LDS church members have a lot in common with Evangelical Christians at this point in time, in regards to the issues in this long-ass post.

I was #LDS (i.e., #Mormon) for the first mumblenumbermumble decades of my life. I was taught--expicitly, not by the also-ubiquitous methods of "read-between-the-lines", "pay attention to consequences instead of words," etc.--that the right and proper way to #reason about all things religious was thus:

  1. Find out what is true
  2. Use all resources after that to support, justify, explain, and believe that truth

The first point is a problem, of course, because it comes before any external evidence. There is #evidence of a kind, but it is 100% subjective: the results of your #spiritual promptings or feelings or inspiration. You get these by praying really hard, thinking the right thoughts, etc. Thinking "negative" thoughts (often any kind of skepticism or doubt is included in this category) will drive the Holy Spirit away and he won't be able to tell you how true all the stuff is.

There are many people--and I truly believe they are almost all sincere and well-meaning--to help you navigate this difficult process. This means to help you come to the right conclusions (i.e., that Jesus is God and died for our sins, that Joseph Smith was His prophet, that the LDS church is the only true #church etc.). Coming to the "wrong" conclusions means you aren't doing it right, hard enough, humbly enough, etc. so you will keep at it, encouraged by family, friends, and leaders, until you get the "right" answer.

See, you make up your mind about the truth of things before acquiring any outside #evidence. I was a full-time missionary in Mexico for two years; I am aware that of course evidence does get used, but not the way a scientist or other evidence-informed person would use it. We used scriptures, #logic, personal stories, empirical data, etc. as merely one of many possible tools to bring another soul to Christ. LDS doctrine is clear on this (where its notably unclear on a huge range of other things): belief/#faith/testimony does not come from empirical evidence. It comes from the Holy Spirit, and only if you ask just right.

Empirical evidence, clear reasoning, etc. are nice but they're just a garnish; they're only condiments. The main meal is promptings (i.e., feelings) from the Holy Spirit. That is where true knowledge comes from. All other #knowledge is inferior and subordinate. All of it. If the Holy Spirit tells you the moon is cheese, then by golly you now have a cheesemoon. More disturbingly, if the Holy Ghost tells you to kill your neighbors, you should presumably do that. This kind of "prepare for the worst" thinking is a lot more common in conservative Christian groups than I think some people realize.

Anyway, you get these promptings. They're probably not because you're a sleep-deprived, angsty, sincere teenager who has been bathed and baked in this culture your entire life and has no concept of any outcome other than this. You get the promptings. Now you know. You know that Jesus is your Savior, that Joseph Smith was his prophet, that the LDS Church is the only true and living church on the face of the etc. etc.

You don't believe; you know.

So the next step is... nothing specific, really. You're done learning. That step is over. As we were reminded repeatedly as young missionaries: your job is to teach others, not to be taught by them. You go through the rest of your life with this knowledge, and you share it whenever you can. Of course, some events and facts and speech might make you doubt your hard-won knowledge. What to do?

You put the knowledge first and make the #facts fit it. You arrange the facts you see or read or whatever so that they fit this knowledge you acquired on your knees late at night with tears in your eyes, or in Sacrament Meeting the morning after a drama-filled youth conference. If you can't make the facts fit your knowledge, you reject the facts.

You seriously reject facts, and pretty casually. You might decide they aren't facts, or you might get really interested in the origin of anidea so you can discredit it, etc. Some people reject the theory of evolution. Others reject a history in in which many of the founding fathers of the USA were #atheist, #agnostic, or Not Very Good People. You can reject anything, really. You can reject the evidence of your eyes and ears, as the Party demands. It's kind of easy, in fact.

Millions of people think like this: they explicitly reject information that does not fit the narrative they have acquired through a process that depended 100% on subjective experiences (and, afterward, is heavily dominated by "authority figures" and trusted friends who tell you what to believe this week).

As a psychologist, even though #DecisionScience is not my area of research, I can tell you various ways in which one's #subjective experience can be manipulated, especially with the support of a life-saturating religious worldview and community. Relegating facts to a supporting role (at best) means giving all kinds of biases free rein in influencing your views. Facts were one of the things that might have minimized that process. In fact, I think facts as correctives for human biases was a main motivation underlying the development of the #ScientificMethod.

This becomes how you live your life: find out what's true, then rearrange your worldview, your attitudes, your specific beliefs, your behavior, and potentially even how you evaluate evidence to fit that knowledge. You aren't faking it, you aren't pretending; you simply believe something different. You see the world differently. I'm guessing you'd pass a lie detector test.

Note that nowhere in this process is there ever what a #philosopher, a #scientist, or a mathematician would call an "honest, open inquiry." That would imply uncertainty about the outcome of the inquiry. It would imply a willingness to accept unexpected answers if the evidence or reasoning led there. That's not possible because there can be only one answer: what you already know. Evidence cannot be allowed to threaten knowledge.

Coincidentally, now you're a perfect member of the Trump/Musk/whoever personality cult. All you need are some trusted sources (e.g. friends, neighbors, celebrities, local church leaders) to tell you that #Trump is a Good #Christian, that #AOC is secretly a communist, that #Obama was born in Africa, that Killary is literally eating babies, that a pizza parlor has a torture basement, that Zelensky is a villain and Putin a hero, etc. Literally anything. You haven't just learned how to do this; it is how your brain works, now. This is how "reasoning" happens. This is how belief and worldview and personal commitment are formed and shifted.

Now you casually accept new concepts like "crisis actors", "alternative facts", the "deep state", and "feelings-based reality." You have no problem doing this. Conspiracy theories are a cakewalk; you could fully believe six impenetrable Qanon ravings before breakfast.

I've seen progressives casually assume that Evangelical-type Christians are hypocrites, or lying, or "virtue signaling" as they state their support for whatever value-violating thing Trump or Musk or any national GOP figure has said or done (e.g., "Hey, I now believe that god doesn't love disabled people, after all!"). I've accused conservatives of those things things myself, though I don't actually believe that's what is happening. What we're seeing is not just hypocrisy or dishonesty. What's happening, at least with many religious people, is that a trusted leader has told them they should believe a different thing, so now they do. It's that simple. Many might even die for their new belief in the right circumstances (certain Christians are a little bit obsessed with the possibility of dying for their faith, so this isn't as high a bar as you might think).

Sure, some people who flipflop overnight probably are lying or putting on an act even they don't truly believe. However, many more are simply being who they are, or who they've become by existing in this ideological/cultural system for years.

Obviously, I believe this kind of reasoning is not good and makes the world a better place. I would like to reduce it or even eliminate it. It is embedded, though, with other dynamics: ingroup/outgroup tribalism, authoritarianism (boy howdy do conservative churches train you to be an authoritarian), prejudices of various kinds, and basic cognitive biases (which run rampant in such environments).

It's also bound up with religious #AntiIntellectualism. In the LDS church, for instance, there's a scripture that gets tossed around at election time saying that being educated is good, but only up to a point (any education that leads a person to question God's words, etc. is by definition too much" learning). As a person with a graduate degree, my last decade or so in the LDS church was marked by a more or less constant social tension from the possibility that I might "know too much".

Education reliably reduces this problematic kind of thinking/believing system in many people. Specifically, "liberal arts" education (which isn't about liberalism or necessarily arts) is the special sauce; the classes many students will be forced to take for "general education" at most US universities are pretty good at teaching students different ways of thinking and helping them try on alternative worldviews. Many of the people learning multiple worldviews and getting some tools for reasoning and evidence, etc. tend to use them for the rest of their lives. Even truly exploring one or two wrong alternative worldviews or thinking patterns tends to yield big rewards over time. Notably, the GOP's attacks on higher ed have become much worse, recently.

Anyway, this is (IMO) what progressives are up against in the USA. It is not just that some people believe different things; it's that many of those people have entirely different cognitive/emotional/social structures and processes for how belief happens and what it means.

Undoing this will take generations. In the meantime, I encourage pushing back on conservative flip-flops. No matter what, not even Evangelical congressmen want to look inconsistent. Even the evangelicalest of Christians will sometimes engage with facts and reasoning to some degree, and pressure simply works, sometimes. Keep your expectations for personal change low, however.

#religion #uspol #politics #thinking #epistemology #philosophy

Nick Byrd, Ph.D.ByrdNick@nerdculture.de
2025-02-18

Df. "clinical #equipoise describes a situation of evidentiary uncertainty among experts"

Opel et al. argue such equipoise is neither necessary nor sufficient for #SharedDecisionMaking.

Rather SDM is most useful where tradeoffs between options are KNOWN.

doi.org/10.1007/s11606-025-094

#medicine #decisionScience #bioethics #epistemology #philosophyOfScience #socialPsychology #edu #SciComm

The first two pages of "Saving Shared Decision Making" by Opel et al (2025) with the excerpts most relevant to Nick Byrd's post highlighted.
Nick Byrd, Ph.D.ByrdNick@nerdculture.de
2025-01-16

What medical problem statement features help or hinder #chatGPT's #diagnosis accuracy?

- more comorbidities and historical items hurt differentials
- more examination items and use of 3-part statement format helped

doi.org/10.1016/j.jmathb.2024.

#medicine #AI #decisionScience #HCI

Results (page 3)

A former colleague and old friend just got laid off. She has an MS in ITDS (information technology and decision science) and a ton of experience with SQL, and is a very reliable and consistent worker. She's also comfortable with Python and C#. Please let me know of any opportunities you may know of in that area, and I'll pass it along!

#ITDS
#InformationTechnology
#DecisionScience
#SQL
#Python
#CSharp
#FediHire
#FediHired

Nick Byrd, Ph.D.ByrdNick@nerdculture.de
2024-12-06

Good news in our preprint about #polarization:

Demand for BIPARTISAN #news analysis was strong!

People in the #US preferred fact-checking teams that engaged in #AdversarialCollaboration at least as much as copartisan and/or professional teams.

Follow the manuscript or authors on #GoogleScholar: scholar.google.com/scholar?oi=

If you prefer a link directly to our preprint: doi.org/10.31219/osf.io/gp9w7

#journalism #socialMedia #decisionScience #collectiveIntelligence #socialPsychology #politicalPsychology #epistemology #xPhi

Figure 2Figure 4Figure 5Examples of the headline stimuli from the Knight Foundation (2018).
Nick Byrd, Ph.D.ByrdNick@nerdculture.de
2024-12-02

An adversarial collaboration reports that mathematical reflection tests assess #math ability about as much as anything else. 😬

And what is the evidence that the paper's “independent” measure of reflection actually measured reflection? 🧐

doi.org/10.1073/pnas.240919112

#psychometrics #psychology #cogPsych #JDM #decisionScience #economics #factorAnalysis #stats #rStats

The 8-item mathematical reflection test. (CRT = cognitive reflection test)An alleged measure of "reflection".Results: the allegedly independent measure of reflection shared as much latent variance with math test as that math test did with CRT (cognitive reflection test) or NUM (numeracy). I am struggling to see how this confirms that REF was measuring reflection rather than math. What am I missing?
Nick Byrd, Ph.D.ByrdNick@nerdculture.de
2024-11-23

I’m sharing talks and posters from this weekend’s Society for #JDM #conference over on #BlueSky: bsky.app/profile/byrdnick.com/

The first talk’s about the #jobMarket. By the way, I’m hiring a 3-year #postdoc who can do #quant #decisionScience#WFH or on campus: geisinger.wd5.myworkdayjobs.co

Job DescriptionQualificationsAbout GeisingerWhat to submit if you apply to the job
2024-11-18

@knutson_brain @Andrewpapale @tdverstynen

3/3 But it may also be time to incorporate #sociology studies of world-understanding and news gathering into decision theory practical consequences.

To my knowledge there isn't a strong connection between people studying these consequences of #propaganda and #news eco-systems with modern theories of #DecisionMaking and #DecisionScience.

But if anyone is interested, please reach out to me. It is something I'm very interested in pursuing. #ChangingHowWeChoose

2024-11-13

What data literacy / scientific reasoning / research-thinking / statistical-thinking organizations exist out there? If you know of one, will you reply and tell me its name?

A colleague just suggested starting a #nonprofit focused on increasing #data literacy, scientific reasoning, #criticalThinking, and "reducing general assholiness" (his words).

He and I are both psychologists who took way too many #statistics courses and have done #research for many years, in addition to #teaching these things to many generations of undergraduates. He also has a research focus on (and expertise in) #cognitiveBiases and #decisionscience

#startup #idea #recommendations #crowdsourcing

Nick Byrd, Ph.D.ByrdNick@nerdculture.de
2024-11-10

Excited to share YEARS of research about how to get people to think reflectively and how reflection impacts philosophical judgments at the 2025 #APA in #NewYorkCity (January 8 to 11): apaonline.org/mpage/2025easter

Can't make it?
- More about my talk: researchgate.net/publication/3
- More about my poster: researchgate.net/publication/3

Thanks to the #APA, James Beebe, and the Experimental Philosophy Society for the opportunity!

#decisionScience #philosophy #xPhi #epistemology #bioethics #cognitiveScience #mTurk #Prolific #UniversityParticipants #surveyMethods #DualProcessTheory

2025 APA Eastern website, with link to the programThe Experimental Philosophy Society's session with Nick Byrd's talk: "What Philosophical Tendencies Does Reflective Thinking Actually Cause (and What Did It Take to Find Out)?"Friday afternoon's poster session with Nick Byrd's poster "Reflection-Philosophy Order Effects and Correlations: Aggregating and Comparing Results from mTurk, CloudResearch, Prolific, and Undergraduate Samples"
Nick Byrd, Ph.D.ByrdNick@nerdculture.de
2024-11-10

Suppose you ask kids about their school work *while they work on it*: will it help or hurt their learning?

Asking fifth graders about their reading or math improved pre- v. post-test learning, compared to not asking (Ns > 350):

#OpenAccess paper: doi.org/10.1016/j.heliyon.2024

#edu #reflectiveThinking #consciousnessResearch #decisionScience #developmentalPsychology #metacognition

Figures 5 and 6Figures 11 and 12Example of the on-screen question (vs. control)
Nick Byrd, Ph.D.ByrdNick@nerdculture.de
2024-11-10

ICYMI: a large language model was better at diagnosis than doctors? 🧐

...and letting the doctors use the large language model didn't improve doctor's diagnoses?! 😬

#OpenAccess article in #JAMA: doi.org/10.1001/jamanetworkope

#medicine #AI #LLM #edu #HCI #UX #logic #criticalThinking #decisionScience #computerScience #psychology #epistemology

Pages 6 and 7
Nick Byrd, Ph.D.ByrdNick@nerdculture.de
2024-11-10

A #health literacy intervention reduced the perceived accuracy of inaccurate #cancer headlines ...as well as *accurate* headlines.

Cheers to the authors and the journal for publishing this less-than-encouraging result: doi.org/10.1093/abm/kaae054

Looks like prior (rather than new) beliefs about cancer were the primary predictors of discernment about cancer headlines.

#medicine #education #oncology #journalism #psychology #decisionScience #bioethics

Figure 3
Nick Byrd, Ph.D.ByrdNick@nerdculture.de
2024-11-07

Which subreddits score higher on deliberation metrics?

A new metric of deliberation (designed to overcome prior issues) found that the following subreddits had the highest deliberation scores (across 72 subreddits)
- Subreddits that are based on geographical regions
- Political subreddits
- Sports subreddits

arxiv.org/abs/2410.21996

#socialMedia #Reddit #publicDiscourse #decisionScience #corpusAnalysis #NLP #statistics

The deliberation metricDeliberation metrics by subreddit categories
Nick Byrd, Ph.D.ByrdNick@nerdculture.de
2024-11-06

Reflective thinking often improves judgment and decisions, but across three experiments reflective thinking didn't seem to predict FEELING better about one's decision: doi.org/10.1017/S1930297500009

This may help explain why we so often underrate reflective thinking.

#logic #criticalThinking #decisionScience #epistemology #xPhi #psychology

MethodsResults
Nick Byrd, Ph.D.ByrdNick@nerdculture.de
2024-11-05

Emotion can inhibit reflective thinking, but are all emotions equally inhibitory?

Reflective thinking was inhibited more by a video designed to elicit disgust than a video designed to elicit fear/thrill (among about 50 people who completed 60 reflection tests): doi.org/10.2147/PRBM.S471624

#decisionScience #psychology #criticalThinking #emotion #logic #rationality #epistemology

Figure 2, showing the different reflection test accuracy between the disgust and fear videos.

Client Info

Server: https://mastodon.social
Version: 2025.04
Repository: https://github.com/cyevgeniy/lmst