Lmst

Today at my alma mater, I spoke about how research evaluation is quietly shifting from citations to ChatGPT-style predictions.

👉 https://doi.org/10.13140/RG.2.2.30585.12642

AI can already “detect quality” from text alone, and sometimes performs better than classic metrics. But it doesn’t evaluate science: it rewards what sounds like good science. We may be heading from “publish or perish” to the new absurdity: “write ChatGPT-friendly or perish.”

#AI #ChatGPT #ResearchEvaluation #Scientometrics #LLM #OpenScience

Interestingly, one archival witness remembered Zinaida Mulchenko as a "PhD student from #Kyiv" – an unconfirmed but intriguing Ukrainian thread in the story of a scholar who helped shape global scientometrics.

👉 https://doi.org/10.1162/QSS.a.397

@QSS_ISSI #Scientometrics #MatildaEffect #HistoryOfScience #WomenInScience #Bibliometrics #Ukraine

#Scientometrics is a direct translation of the Soviet term naukometriya, introduced through the 1969 monograph by Vasily Nalimov and Zinaida Mulchenko. A new paper in @QSS_ISSI reveals that around 15% of that monograph consists of fragments from Mulchenko’s PhD thesis on information flows in science — meaning that many core ideas of Soviet scientometrics were actually hers. Yet she almost disappeared from the historical record = #MatildaEffect

📄 https://doi.org/10.1162/QSS.a.397

#WomenInScience

Zinaida Mulchenko

Ivan Kislenko, Emanuel Kulczycki; The Matilda Effect in Soviet scientometrics? Nalimov, Mulchenko, and the origins of Naukometriya. Quantitative Science Studies 2025; doi: https://doi.org/10.1162/QSS.a.397

“In my opinion, metric-based recognition without integrity screening can inadvertently legitimize problematic practices. That risk is particularly acute in environments where publication is tied to career progression but where research funding, infrastructure, and oversight remain weak. These conditions can – and often do – fuel paper mills, coercive citation policies, and other unethical behaviors.”

Maryam Sayab spoke to Frederik Joelving for Retraction Watch on Clarivate's involvement in Iraqi research awards being granted to individuals with known integrity concerns.

https://retractionwatch.com/2025/10/31/exclusive-clarivate-web-of-science-involved-dubious-awards-iraq/

#Bibliometrics #Scientometrics #Citations #Retractions #ResearchIntegrity #PublicationEthics #Iraq #MENA #RetractionWatch

It is 2025. And still it seems to be okay to publish about #OpenResearchInformation (ORI) behind a paywall?

That is only a tiny bitt less ironic than a closed access publication about open access.

Current example: https://doi.org/10.1007/s11192-025-05347-6

Really, I do not understand why #Scientometrics does not flip. OpenAlex finds 121 articles there with #OpenAccess in abstract or title!

https://openalex.org/works?page=1&filter=primary_location.source.id:s148561398,title_and_abstract.search:%22open+access%22

It's a pity, they even have a CfP on ORI, and in another journal I would love to submit.

"¿En qué se diferencia la #pseudociencia de la ciencia? Un análisis bibliométrico por pares" ya está aceptado para su publicación en la revista #Scientometrics. Consulta este hilo para más información

RE: https://bsky.app/profile/did:plc:kb4zazjdnakotspqkgzakmim/post/3lz4pnvtjtk2q

OA.Works is shutting down Open Access Button and InstantILL in November.
They recommend switching to Unpaywall as a replacement for OpenAccessButton.

https://blog.oa.works/sunsetting-the-open-access-button-instantill/
#Scientometrics

"OpenAlex Analytics alpha is paused." https://openalex.org/analytics

@OpenAlex has paused their Analytics Dashboard alpha because it's too expensive and they want to focus on the backend rewrite.
Hopefully, they'll continue their work in the future! I really liked their interactive query writing interface.

#bibliometrics #scientometrics #openscience

Screenshot of Openalex' statement. The most important part:

We’re pausing the alpha, effective now; you’ll no longer be able to use or query the Analytics.

We’re doing this for two reasons:

We’ve learned how expensive it is to answer these complex ad-hoc queries. Our current numbers suggest we’d need to charge you and other users about $50k/yr, and our research indicates there’s no market at this price point (that said, if we’re wrong and you’ve got $50k/yr for this, let us know…our minds can be changed 😁). I think we need to figure out a way to do Analytics more cheaply to make it viable—either use a cheaper technology or support less flexibility. We’ve got some ideas on both counts, but we need time to look into it. Which brings us to…
We need to focus on the new OpenAlex rewrite launch over the next few months. This is the biggest project we’ve ever done and we need to really zone in or it’s not going to work. So we’re saying “no” to everything we possibly can in Q4, so that we can say a great big “yes” to making OpenAlex faster, more accurate, and more comprehensive (we’re passing 400M works!).

We’ll return to Analytics in 2026 with a new approach, probably one integrated more tightly with the existing UI and definitely one taking advantage of our turbocharged new backend architecture.

[Veille] "Sorbonne Université : retrait du classement THE en 2026 ; « privilégier les bases de données ouvertes »" =>https://education.newstank.fr/article/view/411437/sorbonne-universite-retrait-classement-the-2026-privilegier-bases-donnees.html
#ESR #openscience #bibliometrics #scientometrics #opencitations #ranking #research #universities #opendata

[Veille] : Booster la visibilité des publications scientifiques lorraines dans OpenAlex : mission accomplie => https://factuel.univ-lorraine.fr/article/booster-la-visibilite-des-publications-scientifiques-lorraines-dans-openalex-mission-accomplie/
#openscience #opencitations #opendata #bibliometrics #scientometrics

We were at the first Swiss Open Academic Data (SOAD) day! Our presentation evaluated differences between our institutional repository DORA and #OpenAlex. One conclusion for us: #collaboration is the key!

Find our and more presentations here:
https://zenodo.org/communities/soad/

#bibliometrics #researchassessment #scientometrics

Just arrived in Granada for #ESSS2025.
Excited to learn more about #Scientometrics the next few days.
https://esss.info/

Looking forward to the conference - and to discuss the importance and implications of open research information for the STI community! #scientometrics #bibliometrics #researchassessment

[Veille] #OpenAlex refond son socle technique ➡️ plus de cohérence Unpaywall/OpenAlex, curation possible, nouvel algo pr topics, nouveaux keywords, etc. : https://blog.ourresearch.org/were-rebuilding-openalex-while-its-running-heres-whats-changing/
#search #bibliometrics #scientometrics #opencitation #research #openscience #searchengines

📣 Starting today: Science Maps. Bibliometrics between understanding and visualization

Together with Marcus John, I organize a small series on science mapping for our workgroup "WG Visualization" at Competence Network Bibliometrics. We hop to gether traditional, current, and critical perspectives on one of the most established and iconic forms of visualizing data in #Bibliometrics and #NetworkAnalysis.

More talks will be announced soon!

Today, Katy Börner will kickoff our series with a presentation about "Mapping and Modeling Science, Technology, and Education". You can find further info and registration under the following link:

https://www.linkedin.com/pulse/kb-open-research-seminar-mapping-modeling-science-bibliometrie-s0ore

#vosviewer #Scientometrics #Gephi #DataVisualization #DataViz #Informetrics #STI2025 #Bibliometrie #ResearchAssessment

"Comparing university rankings" Isidro F. Aguillo 2014 Journal: #Scientometrics www.academia.edu/6303533/Comp... Annual rankings of world universities are published by QS for the Times Higher Education Supplement, the Shanghai Jiao Tong University,

Comparing university rankings

📊 Donner & Korytkowski (2025): In mathematics, authors are often listed alphabetically to signal equal work. But 🇵🇱 data show that in 20% of cases contributions differ, and habilitation candidates overstate their input by ~11%.

👉 https://doi.org/10.1007/s11192-025-05369-0

🇺🇦 In Ukraine, “guest authorship” to boost CVs is common. #Scientometrics can spot such patterns - if only systems cared about fairness.

#ResearchEthics #AcademicIntegrity #HigherEducation

Scatterplot of empirical contribution claims and expected values under equal contribution

Donner, P., Korytkowski, P. Alphabetical author order and co-author contributions in mathematics. Scientometrics (2025). https://doi.org/10.1007/s11192-025-05369-0

Generative AI and the future of scientometrics: current topics and future questions

https://microblogging.infodocs.eu/2025/07/02/generative-ai-and-the-future-of-scientometrics-current-topics-and-future-questions/

#BenedettoLepori #GenerativeArtificialIntelligence #JensPeterAndersen #KarstenDonnay #ScientificCommunication #Scientometrics

At #ISSI2025, Mike Thelwall suggested that the Leiden Manifesto should be updated to reflect the rise of large language models (LLMs) in research assessment.

👉 https://issi2025.iiap.sci.am/proceedings/ (P. 71-80)

He proposed four new principles — calling for transparent prompts, awareness of #LLM instability, cost-benefit considerations, and a reminder that LLM scores are not evidence of scientific contribution.

#Scientometrics #ResponsibleMetrics #OpenScience #ImpactFactor

At ISSI 2025, Mike Thelwall made waves: LLMs like ChatGPT now outperform citations in predicting expert evaluations of scientific papers. Instead of counting who cited whom, AI reads your abstract — and scores it. Often more accurately. But beware: black-box models, unstable outputs, and no real link to actual research impact. Still, an LLM-based alternative to JIF? That’s a game-changer.

🧵1/
A russian scientometrician fled to #Germany @DZHW 🇩🇪 - but from there, he continues to promote narratives aligned with putin’s propaganda.

📄 https://doi.org/10.31219/osf.io/k8fbc_v1

His paper was accepted at #ISSI2025, and I’m deeply disappointed the conference organizers didn’t recognize the red flags. ⛔ Here's why. 👇

#Scientometrics #RussiaUkraineWar #UkraineDefends

#scientometrics

Client Info