Iris van Rooij 💭
banner
irisvanrooij.bsky.social
Iris van Rooij 💭
@irisvanrooij.bsky.social
Professor of Computational Cognitive Science | @AI_Radboud | @[email protected] on 🦣 | http://cognitionandintractability.com | she/they 🏳️‍🌈
Pinned
NEW paper! 💭🖥️

“Combining Psychology with Artificial Intelligence: What could possibly go wrong?”

— Brief review paper by @olivia.science & myself, highlighting traps to avoid when combining Psych with AI, and why this is so important. Check out our proposed way forward! 🌟💡

osf.io/preprints/ps...
Reposted by Iris van Rooij 💭
This is a good summary of many of my concerns about LLMs invading the education space. Chief among my concerns - cognitive engagement is critical for learning, but LLMs take that away, just leaving the generated product, which avoids the whole purpose of our course material and assignments
December 5, 2025 at 1:42 AM
Reposted by Iris van Rooij 💭
Table 2 especially bsky.app/profile/oliv...
New preprint 🌟 Psychology is core to cognitive science, and so it is vital we preserve it from harmful frames. @irisvanrooij.bsky.social & I use our psych and computer science expertise to analyse and craft:

Critical Artificial Intelligence Literacy for Psychologists. doi.org/10.31234/osf...

🧵 1/
December 5, 2025 at 1:09 AM
Reposted by Iris van Rooij 💭
In Greek we say "my tongue has grown hair from repeating this" but I'll keep doing it: guardrails are literally a lie.

bsky.app/profile/oliv...

3/n
cool pincer movement if you truly grasp:

AI & any concept relating to it like so-called guardrails are a scam in the deepest sense like a perpetual motion machine or a quija board — and not only a scam like a pyramid scheme which is a possible way to make money if you are first in first out

🧵

1/n
"Powered by OpenAI’s GPT-4o model by default...tests repeatedly showed that the AI toy dropped its guardrails the longer a conversation went on, until hitting rock bottom on incredibly disturbing topics."
December 5, 2025 at 6:24 AM
Reposted by Iris van Rooij 💭
The model is actually designed to output fragments of the input,the so-called training data.

bsky.app/profile/oliv...

2/n
Non-industry compromised scientists keep saying these models don't become safe, no matter what, but people keep thinking just because the concept of guardrails is mentioned it must work. By definition, it doesn't. This is not something open to discussion, unless you're a paid shill.
"Powered by OpenAI’s GPT-4o model by default...tests repeatedly showed that the AI toy dropped its guardrails the longer a conversation went on, until hitting rock bottom on incredibly disturbing topics."
December 5, 2025 at 6:23 AM
Reposted by Iris van Rooij 💭
Guardrails are a scam. It's not that they could work, it's that they cannot and never will for such models. By design. 1/n
Can't stress enough how lax Grok's guardrails are here. We didn't use any deceptive prompting -- just fed it names and asked for addresses / where someone might live. The bot readily complied, often offering up whole lists of names and addresses.

Only *once* did it decline to provide an address.
December 5, 2025 at 6:22 AM
Reposted by Iris van Rooij 💭
this also is important and directly violated when they create nonsense meanings for words bsky.app/profile/oliv...
Conceptual Clarity is the idea that terms should refer.

See section 2 here: doi.org/10.5281/zeno...

3/
December 2, 2025 at 10:36 AM
Reposted by Iris van Rooij 💭
To be clear, I think "machine learning" is as anthropomorphic as "artificial intelligence". Learning and intelligence perform the same role, they imply uniquely biological or psychological capacities to the machine or artifact through their use in the phrase.

See table 1: doi.org/10.48550/arX...
December 2, 2025 at 3:37 AM
Reposted by Iris van Rooij 💭
Open letter, led by @olivia.science, now has >1400 confirmed signatories!

If you haven’t yet signed, please consider reading & signing too.

Help us stop uncritical adoption of ‘AI’ technologies in academia.

Feel free to adapt this letter for your employers!

openletter.earth/open-letter-...
Open Letter: Stop the Uncritical Adoption of AI Technologies in Academia
openletter.earth
November 7, 2025 at 10:12 PM
Reposted by Iris van Rooij 💭
If you're not in NL, please refer to this list of similar initiatives elsewhere in the world, collected by Olivia Guest:

https://olivia.science/ai#letter

#genai #academia #academicmastodon #ai #academicchatter #highereducation #stochasticparrot
December 2, 2025 at 8:14 AM
Reposted by Iris van Rooij 💭
I'm a bit late to the party and somehow missed this, but here's an open letter to Dutch Universities (both academic and of applied sciences) and their executive boards, to ask that they stop the uncritical adoption of AI technologies in higher education […]
Original post on mathstodon.xyz
mathstodon.xyz
December 2, 2025 at 7:39 AM
Reposted by Iris van Rooij 💭
"In the midst of this nonsense, we must nourish hope in shared values" 👏👏👏
Finally, we end on:

"The future [under the sway of AI risks being] a constant rehashing of the past, wherein human creativity and communication are not only mediated by but controlled by companies. In the midst of this nonsense, we must nourish
hope in shared values"

doi.org/10.5281/zeno...

8/
December 2, 2025 at 3:41 PM
Reposted by Iris van Rooij 💭
Finally, we end on:

"The future [under the sway of AI risks being] a constant rehashing of the past, wherein human creativity and communication are not only mediated by but controlled by companies. In the midst of this nonsense, we must nourish
hope in shared values"

doi.org/10.5281/zeno...

8/
December 2, 2025 at 7:34 AM
Reposted by Iris van Rooij 💭
Slow Science is a disposition towards preferring psychologically, techno-socially, and epistemically healthy
practices.

See section 6 here: doi.org/10.5281/zeno...

7/
December 2, 2025 at 7:27 AM
Reposted by Iris van Rooij 💭
Respecting Expertise is the epistemic compact between professionals and society.

See section 5 here: doi.org/10.5281/zeno...

6/
December 2, 2025 at 7:19 AM
Reposted by Iris van Rooij 💭
Decoloniality is the process of de-centring and addressing dominant harmful views and practices.

See section 4 here: doi.org/10.5281/zeno...

5/
December 2, 2025 at 7:14 AM
Reposted by Iris van Rooij 💭
Critical Thinking is deep engagement with the relationships
between statements about the world.

See section 3 here: doi.org/10.5281/zeno...

4/
December 2, 2025 at 7:08 AM
Reposted by Iris van Rooij 💭
Conceptual Clarity is the idea that terms should refer.

See section 2 here: doi.org/10.5281/zeno...

3/
December 2, 2025 at 7:03 AM
Reposted by Iris van Rooij 💭
First off we pluralise L to accentuate there's no 1 approach. And we position ourselves in this interdisciplinary field of critically examining AI & reflecting on harms.

We give 5 non-exhaustive angles: conceptual clarity, critical thinking, decoloniality, respecting expertise, slow science.

2/
December 2, 2025 at 6:58 AM
Reposted by Iris van Rooij 💭
New preprint! @marentierra.bsky.social @irisvanrooij.bsky.social & I have been working on what CAIL means to showcase & propagate the idea of thinking very differently to tech industry norms on "artificial intelligence"

Towards Critical Artificial Intelligence Literacies doi.org/10.5281/zeno...

1/
December 2, 2025 at 6:58 AM
Reposted by Iris van Rooij 💭
This is so awesome. I think I'm going to print it out, annotate it, and give it to my admin.

#Edusky #CSed
New preprint! @marentierra.bsky.social @irisvanrooij.bsky.social & I have been working on what CAIL means to showcase & propagate the idea of thinking very differently to tech industry norms on "artificial intelligence"

Towards Critical Artificial Intelligence Literacies doi.org/10.5281/zeno...

1/
December 4, 2025 at 5:12 AM
Reposted by Iris van Rooij 💭
What are your best arguments for & against using AI, particularly LLMs, in health & social science research?

Please share, I want to do some human brainstorming of ideas for this forthcoming debate!

Cc @hetanshah.bsky.social, @olivia.science, @epidbydesign.bsky.social, @melaniemitchell.bsky.social
DEBATE: "Is AI the future of health and social science?"

For those in London on 15 Dec 2025, don't miss this fun in person debate between me and David Bann sponsored by @ncrm.ac.uk!

Will the arguments change anyone's mind? 🤔

Sign up to attend IN PERSON: www.eventbrite.co.uk/e/is-ai-the-...
December 4, 2025 at 5:02 PM
Reposted by Iris van Rooij 💭
Or my personal favourite... Against the Uncritical Adoption of 'AI' Technologies in Academia by @olivia.science. That truly covers alot of the issues.

philpapers.org/rec/GUEATU
Olivia Guest, Marcela Suarez, Barbara Müller, Edwin van Meerkerk, Arnoud Oude Groote Beverborg, Ronald de Haan, Andrea Reyes Elizondo, Mark Blokpoel, Natalia Scharfenberg, Annelies Kleinherenbrink, Il...
Under the banner of progress, products have been uncritically adopted or even imposed on users — in past centuries with tobacco and combustion engines, and in the 21st with social media. ...
philpapers.org
December 4, 2025 at 5:27 PM
Reposted by Iris van Rooij 💭
I mean the thread is a corker alone.

bsky.app/profile/oliv...
Finally! 🤩 Our position piece: Against the Uncritical Adoption of 'AI' Technologies in Academia:
doi.org/10.5281/zeno...

We unpick the tech industry’s marketing, hype, & harm; and we argue for safeguarding higher education, critical
thinking, expertise, academic freedom, & scientific integrity.
1/n
December 4, 2025 at 5:28 PM
Reposted by Iris van Rooij 💭
7. Against the Uncritical Adoption of 'AI' Technologies in Academia

AI has been met with some resistance in academia, where facts, citations and data/imagery matter more than the potential hallucinations of a chatbot.

This article dominated Bluesky over Twitter

www.altmetric.com/de...
11/14
Report for: Against the Uncritical Adoption of 'AI' Technologies in Academia
This research output is being tracked across social media, newspapers and reference managers by Altmetric.
www.altmetric.com
December 3, 2025 at 12:29 PM
Reposted by Iris van Rooij 💭
Who are the machines that write probable sentences for?

Language generators – 'conversation-shaped tools' that apparently offer the possibility of conversing even in the absence of another human being – enable a quantum leap in surveillance.

@irisvanrooij.bsky.social

zenodo.org/records/1781...
A chi servono le macchine per scrivere frasi probabili
Who are the machines that write probable sentences for?* A probable text extruder cannot write an article, a project or a thesis, but it can extrude a text 'shaped like' an article, project or thesis....
zenodo.org
December 4, 2025 at 1:38 PM