19–21 Nov 2026
"Alexandru Ioan Cuza" University of Iasi and "Gheorghe Asachi" Technical University of Iași
Europe/Bucharest timezone

Traceable LLM-Based Automated Anamnesis with Clinician-Guided Refinement

20 Nov 2026, 14:30
15m
Room 2

Room 2

Paper presentation Pervasive Systems and Computing Pervasive Systems and Computing & Network Management

Speaker

Mr Stefan Tanasescu (National University of Science and Technology POLITEHNICA Bucharest)

Description

Large Language Models (LLMs) can be used to automate parts of the medical history-taking process, but their use in clinical workflows requires generated information to be easy to verify and the system to follow the structure expected by medical professionals. This paper presents an LLM-based automated anamnesis pipeline that conducts a patient interview and generates clinical summaries for physician review. Each medical statement in the generated summary is linked to the patient message from which the information was extracted, allowing the physician to quickly check the source of the generated information. The traceability mechanism was evaluated on 1,634 clinical statements from 66 generated summaries, and every statement contained a valid link to a patient message. We also evaluate a clinician-guided approach for improving the system. A medical doctor reviewed the initial version and identified problems in the interview protocol and generated reports. This feedback was translated into changes to the LLM prompts and output schema, after which a revised version of the system was evaluated. For the reviewer who assessed both versions, the overall rating of the structured report increased from 1.70 to 4.27 on a five-point scale. The evaluation was performed using synthetic patients across multiple clinical scenarios and assessments from three medical doctors. The results provide preliminary evidence that explicit source linking and clinician-guided prompt and schema refinement can improve the practical use of LLM-generated anamnesis reports.

Authors

Mr Stefan Tanasescu (National University of Science and Technology POLITEHNICA Bucharest) Mr Cosmin Dumitrache (National University of Science and Technology POLITEHNICA Bucharest) Dr Valentin Radu (The University of Sheffield) Emilian Radoi (National University of Science and Technology POLITEHNICA Bucharest)

Presentation materials

There are no materials yet.