Had a great time at the CSS workshop in Mannheim organized by Ruben Bach & Valerie Hase. You can find the slides from my presentation on "Reproducibility & Replicability in Computational Social Science Research" here: https://doi.org/10.6084/m9.figshare.29086382.v1
#reproducibility #replicability #computationalsocialscience
#replicability
New publication: Code-sharing policies are associated with increased #reproducibility potential of ecological findings, by @antica_c and others. #codesharing #replicability #reliability
https://doi.org/10.24072/pcjournal.541
"Estimating the #replicability of Brazilian #biomedical #science"
... Replication rates for these experiments varied between 15 and 45% according to five predefined criteria ...
🎉 Our method Anisotropic Specular Image-Based Lighting Based on BRDF Major Axis Sampling has received the Replicability Stamp!
🔍 Check it out here: https://www.replicabilitystamp.org/index.html#https-github-com-iota97-anisotropyeditor
🧑💻 Code & data: https://github.com/iota97/AnisotropyEditor
#ComputerGraphics #Rendering #Replicability #OpenScience #BRDF
#statstab #315 What fraction of repeat experiments will have an effect size within the 95% confidence interval of the first experiment?
Thoughts: CV is a great place to learn. We see the same answer as Cumming: 83%
#replicability #confidenceintervals #replication #metascience #estimation #research #science
The University for #HumanisticStudies/ UvH joins the NLRN as an institutional member!
At the NLRN, we want to make a range of epistemic voices heard in the discussion around #reproducibility and #replicability of #science and #scholarship. With their research portofolio focusing on #worldviews and humane societies, the UvH complements the voices of the other, more technical and generalistic institutions TU Delft, TU/e, RUG and escience Center.
Foto: Gaelle Marcel for Unsplash
Les interventions de la journée d'étude ARDoISE du 17 décembre sont en ligne et accessibles depuis le site ScienceConf : https://je2024-ardoise.sciencesconf.org/resource/page/id/1 #reproductibilté #replicability #ResearchSoftware Interventions de @zimoun @rougier @NaudetFlorian , Isabelle Blanc administratrice ministérielle des données, code source et logiciels, et d'autres encore...
Comparing the predicted #replicability of a study with its actual replicability.
https://www.nature.com/articles/s41562-024-01961-1
"Both beginners and more-experienced participants…have some ability to make better-than-chance predictions about the reliability of ‘fast science’ under conditions of high uncertainty."
For more along these lines, esp #PredictionMarkets for #replication, see the Twitter thread I started in 2020, which I plan to continue here in Mastodon. Watch this space.
https://x.com/petersuber/status/1259521012196167681
'Estimating the Replication Probability of Significant Classification Benchmark Experiments', by Daniel Berrar.
http://jmlr.org/papers/v25/24-0158.html
#classifiers #replicability #hypothesis
Très content d'avoir pu écouter - et rencontrer - @arthurperret parler d'organisation des connaissances, prise de notes et graphs de documents au @CampusDuLibre 2024 aujourd'hui !
#PKM #Zettlr #markdown #dataviz #visualthinking #openscience #replicability #campusdulibre
Do professors with less PC views self-censor?
Clark et al. reported only the linear relationship: the less PC their view, the more reluctant professors were to share it. Kudos to Clark et al. for publishing their data so Luke could detect a better-fitting non-linear, non-unified explanation: most professors were not self-censoring; they were either uncertain or else unreluctant to share.
https://doi.org/10.31234/osf.io/ab34v
#edu #higherEd #psychMethods #logic #replicability #manyAnalysts #metaScience
⚙️ Another significant step toward embracing #OpenScience in Ukraine! 🇺🇦
⌛ The Ukrainian Reproducibility Network #UARN is launching during the Ukrainian Open Science Forum on November 21-23, 2024 in Lviv!
As part of the UARN, Local Networks will be established in different regions of Ukraine to support & promote #transparency #reproducibility #replicability practices across all disciplines.
⌛ There’s still a chance to join either in person or online: https://peers.international/uarn?fbclid=IwY2xjawGUVOdleHRuA2FlbQIxMAABHfm-jkib50E54ipzyGpVOHx5BMBhGjCvG6Hh2dc4KphOv4eSO1oVTri9og_aem_alSx8dsVLaxDKdWOcn9f6Q
#UOSF2024
The state of scientific #replicability in AI for large models is quite depressing. It seems to be currently well-accepted that, given that very few actors in the world can afford to replicate model training (which is certainly true), then it is OK to not release training code for your experiments to reviewers and the broader scientific community. I vehemently disagree and, frankly, consider this a mire in how much we can trust associated "scientific" results.
Research integrity irony:
"A high-profile paper about ways to improve the rigor of research papers has been retracted after critics attacked its own rigor." 🤦
#PreRegistration #ResearchIntegrity #PublicationEthics #Retractions #Reproducibility #Replicability #RIirony
Interesting presentation on #Reproducible #DataScience: https://www.youtube.com/watch?v=wK3vPbcSoFE
One point that was made at the beginning is about that "reproducibility" might not be well defined. I think that it will be good to read the 2019 NASEM report: "Reproducibility and Replicability in #Science" https://nap.nationalacademies.org/catalog/25303/reproducibility-and-replicability-in-science -- Reproducibiliy and #Replicability are clearly defined and delimited.
New publication: Are comparable studies really comparable? Suggestions from a problem-solving experiment on urban and rural #greattits. #cognitiveability #biodiversity #replicability
https://doi.org/10.1007/s10071-024-01885-3
Will a religious #mindfulness practice improve #wellbeing?
Among more than 700 self-identifying #Christians, "we found no differences on well-being between a religiously framed #meditation practice (experimental condition), a nonreligious framed meditation practice (active control), or a condition that asked participants to notice their daily life (passive control)."
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11218060/
#religion #cogSci #psychology #psychiatry #replicability #philosophyOfReligion #xPhi
If you wish to learn about best practices in #reproducibility, but are NOT on the west coast of North America in July: you can find me on the west coast of #Norway in September! https://www.nhh.no/kalender/economics/h-2023/morning-sessions-lars-vilhuber-2024/ #dataeditortips @aeadata.bsky.social #replicability #EALE2024
I’m part of the #EEGManyLabs project testing the #replicability of influential #EEG studies. We are using #PredictionMarkets as a tool in this effort and you are invited to take part, especially if you have some expertise in EEG research, no matter how little. See below for details.
You may well know about the success of “prediction markets” in forecasting the likelihood of replication (e.g., Dreber et al., PNAS 2015). We are delighted to announce that we have partnered with economists who led these seminal studies to test the wisdom of the EEG community.
From today (as we near the end of recruitment for this project - please see last calls below), we are opening a survey to ask you to vote on the likelihood of some hypotheses studied in the #EEGManyLabs project. Subsequently, you will be invited to bet on the likelihood of success through a stock market platform, where you will earn real money for you or a selected charity.
The success of this effort will become clear when we complete the full project in a few years time. But the results will immediately tell us about the degree of optimism/pessimism amongst our community.
So, please share this widely and place your bets now...
How can I sign up for the prediction markets? Registrations to participate in the prediction markets are administered via the sign-up form linked below. You must have experience of working with EEG (for example, through collecting and/or analysing EEG data, which may be evidenced by having published peer-reviewed articles or preprints with EEG or equivalent experience e.g. designing, collecting and analysing data from EEG experiments).
#neuroscience #psychology #replication #replicationcrisis #reproducibility #metascience
@ALLEA No time to read the full framework, but is there any mention of enforcing best scientific practices and ensuring scientific integrity?
#scientists #replicability #scientificmisconduct #reproducibilityofresearch #reproducibilitea #publishorperish #phacking
Client Info
Server: https://mastodon.social
Version: 2025.04
Repository: https://github.com/cyevgeniy/lmst