š§ šļø Iām sharing presentations from the Society for Judgment and Decision Making conference in #Denver at the URL below:
https://bsky.app/profile/byrdnick.com/post/3m6agtctbhc2b
My poster is about #argumentMapping and #learningScience. You will also find presentations about how to advance #cogSci with #AI tools, do #ProcessTracing in #Qualtrics without #coding, and avoid backfiring in #healthcare #nudges.
Follow to fight FOMO and enjoy #openAccess conferencing.
Thanks for these constructive comments, @tomstafford!
1. Sounds like I need to rethink my expectations about increasing statistical power. If you don't think the conclusion I floated follows from the data, I should learn more about such statistical inferences.
2. Regarding how well my assessments measure the skills/knowledge that #argumentMapping:
My assessments are similar to the ones that were used to detect benefits of argument map training in past research:
- tests of critical thinking (e.g., belief bias, identifying and responding to informal fallacies): https://byrdnick.com/archives/12654/evaluate-the-argument-with-one-flowchart
- persuasive/argumentative essays (that, like argument maps, prioritize clarity, cogency, and concision ā in that order): https://byrdnick.com/archives/29297/a-3-paragraph-writing-assignment
I hope to make further improvements to the manuscript before submitting the manuscript for publication. I expect strong pushback from the reviewers who (a) have published the positive results, (b) sell argument mapping software, textbooks, workshops, etc.
Today I #livestream new #education research about the alleged benefits of #teaching students #argumentMapping.
10:40 EST / 15:40 CET
People I know can message me for the #Zoom URL.
Credit to the London #Reasoning Workshop for accessible conferencing!
#ArgumentMapping is supposed to improve #argumentation, but argument map classes are often flipped (vs. lecture).
So is it #logic explanation or Socratic discussion that helps?
One experiment found that it's probably the latter.
Can #AI improve team-based #argumentation beyond the benefits of group work and #argumentMapping?
In a 6-week quasi-experiment with 67 Indonesian students, the AI-assisted group developed more well-rounded arguments and showed more "group efficacy".
Another paper fails to report that #argumentMapping causes improved #criticalThinking.
The paper reports the pre- vs. post improvement only within the treatment group (without comparing that improvement to the control group's improvement). And, of course, that is not the analysis we would need to determine if argument mapping causes benefits.
https://doi.org/10.1109/ISET61814.2024.00070
#edu #research #science #logic #teaching #assessment #replication
Can #AI help improve #argumentation courses?
Students learning English as a foreign language (#EFL) were randomly assigned to one of two #argumentMapping courses.
Both courses had the same instructor and used the same online collaborative argument mapping tool (#Kialo), but only one course trained students to prompt #OpenAIās #chatGPT for assistance.
The class that used the #chatbot achieved more?
https://doi.org/10.1007/s10639-024-12986-4
(I'm not sure I follow all of the analysis. Feel free to clarify if you understand better than I do.)
Today I present fresh results from two semesters of waitlist control trials at our 2nd annual #Teaching and #Learning Symposium. Did #argumentMapping improve individual students' critical thinking and persuasive writing (on average)?
The prior between-group research didn't control for instructor(s), teaching style (active vs. lecture), interaction (individual vs. group learning), course topic, classroom, day, etc. So I did.
The results are surprising me!
Does data visualization help people overcome mathematical biases like base rate neglect?
Not necessarily. In fact, one experiment on masterās students found that āwhen base rate information [was] presented visually, participants answered significantly more biased than when information [was] presented textually.ā
https://doi.org/10.23947/2334-8496-2024-12-1-119-132
#probability #stats #edu #dataViz #bias #debiasing #argumentMapping
If mapping arguments improves critical thinking, then argument mapping skills should correlate with critical thinking skills, right?
Alas, they didn't correlate among 115 Advanced Placement students across 4 high schools who mapped arguments for universal basic income (from a Douglas Murray article).
proquest.com/docview/2915819770/abstract/336A7C32595F4464PQ/1
#Logic #CriticalThinking #ArgumentMapping #Teaching #HighSchool #edu #Psychology #Philosophy #Politics #Economics #Debate
Does learning how to map the logic of arguments improve reasoning skills? š¬
In a paper about a different pedagogical technique, Javier Hidalgo reports that his Argument Mapping course didnāt result in significantly better post-test reasoning test performance (compared to pre-test)!
Free accepted manuscript: https://philpapers.org/rec/HIDTCT-2
All instructors should be doing this kind #teaching #assessment!
How should #education and #science adapt in the #AI boom? My latest thoughts š
It started as a grumpy list of #academic misconceptions about #LLMs. That list largely survived, but ā thanks to questions from #AuthorityMagazine ā I considered broader and more productive points as well, like the academic job market.
More topics:
#Logic
#Psychology
#QuantMethods
#higherEd
#teaching
#writing
#argumentMapping
#jobMarket
#ethics
#risk
#quotes
[more]
Thanks to @DailyNous for posting and especially to Alex for contextualizing the initial claim about argument mapping (from the pull quote):
TLDR; there are least 4 problems with the claim that "Argument mapping is about twice as effective at improving student critical thinking as other methods".
#CriticalThinking #argumentMapping #Logic #UX #software #webDev #edu #higherEd #teaching #PhilSci #Epistemology #Philosophy
People with relevant experience, potential opinions, and/or followers therewith: @rrrichardzach, @UlrikeHahn, @consequently, @colin, @RanaldClouston, @CubeRootOfTrue, @Inquiry
Relevant topics: #CriticalThinking #edu #higherEd #teaching #learning #research #preregistration #writing #argumentMapping #visualization
Should instructors enable students to use #generativeAI on assignments?
Today Iām facilitating a collaborative workshop on #AI in #edu at
Stevens Institute of Technology.
After I introduce argument mapping and browser-based chatbots, we'll map supporting arguments, objections, and counter-objectionsāwith help from #LLMs, perhaps.
Example map: kialo.com/63741
#logic #criticalThinking #argumentMapping #edu #higherEd #writing #teamWork #collaboration
Given all of the above, if anyone is aware of or can find #ArgumentMapping based #OpenSource #forum software with a nice interface that generates outlines rather than trees, it would be nice if you could share a link.
(boosts welcome)
I'm really reluctant to suggest exploration of still *more* platforms for #discourse, but given the typical size of social.coop Loomio threads, I wonder if it would be worth looking at some form of #ArgumentMapping software as a better framework for trying to hash things out.
What kinds of interactions distinguish high- from low-performing groups (when it comes to #criticalThinking)?
56 #students were split into groups of 4 to do some #argumentMapping.
Video content analysis found the top 27% of groups
- interrupted less
- had more positive, fewer negative interactions
- joked, laughed, and smiled more (sometimes to diffuse potential conflict)
than the bottom 27% of groups.
(N = 56, 14 groups of 4)
This #flowchart-inspired poster was probably the best design I saw at the #APA2022 last night.
"Should you be a sex eliminitavist?"
We use argument visualizations in teaching and research; it can improve persuasive ability (https://cogtoolslab.github.io/pdf/cullen_npjsol_2018.pdf) and even depolarize people's views of arguments about polarizing policies about immigration, etc. (Cullen, Byrd, Oppenheimer, et. al., in prep.)
(Shared with permission.)
