JOURNAL ARTICLE

Research Results from Otto-von-Guericke-University Update Knowledge of Psychology [Performance of Large Language Models on Cognitive Aptitude Testing: A Multi-Run Evaluation on the German Medical School Admission Test (TMS)].

  • Published In: Psychology & Psychiatry Journal, 2026. P. 639 1 of 2

  • Database: Psychology Source 2 of 2

Abstract

This article focuses on the evaluation of large language models (LLMs) on the Test for Medical Studies (TMS), a German medical school admission test assessing cognitive aptitude through text-based and visual-analytic items. Research from Otto-von-Guericke-University in Magdeburg, Germany, found that while LLMs perform well on knowledge-based medical exams, their accuracy on cognitive aptitude tasks relevant to medical school admission is limited and varies significantly between test modalities. Both proprietary and open-source LLMs showed inconsistent results across multiple test runs, highlighting the need for differentiated, multi-run evaluation methods when applying LLMs in medical education contexts. [Extracted from the article]

Additional Information

  • Source:Psychology & Psychiatry Journal. 2026/03, p639
  • Document Type:Article
  • Subject Area:Social Sciences and Humanities
  • Publication Date:2026
  • ISSN:1944-2718
  • Accession Number:192110560
  • Copyright Statement:Copyright of Psychology & Psychiatry Journal is the property of NewsRx and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Looking to go deeper into this topic? Look for more articles on EBSCOhost.