AI vs academia: Experimental study on AI text detectors’ accuracy in behavioral health academic writing

In short

How accurate are AI text detectors on behavioural health writing? The authors report problematic error rates for free and paid tools, with a free one marking a median 27.2% of academic text as AI-generated.

What it looked at

An experiment with 100 research articles from behavioural health and psychiatry journals, published 2016 to 2018, and 200 texts written by ChatGPT and Claude, 100 from each. Free and paid detection tools were run on both sets.

What it means for teaching

Detector scores on scholarly writing may call for cautious handling, on evidence limited to published behavioural health articles.

Limits

The human texts are published journal articles in one field, not student work, and the AI texts come from two chatbots only.

Cited 41 times by other papers, as counted by OpenAlex in November 2026. A count measures attention, not quality.