Milestones
5 February, 2025
ChatMED Sets the Stage: A “Solid” Start for Generative AI in Healthcare The ChatMED project has successfully achieved its first major milestone. This is not just a checkbox exercise. It is the construction of a robust launchpad. Over the first few months, our consortium has been tirelessly working to define how we work, what we […]
Read more »
Blog
4 February, 2025
The study, part of the IS2024 conference proceedings, evaluated ChatGPT’s performance in medical diagnostic tasks. ChatGPT was assessed by comparing medical diagnoses to a professional medical expert system, NetDoktor’s Symptom-Checker. To achieve this, a semi-automated validation procedure was developed, which uses NetDoktor as a golden model to generate sets of symptoms and corresponding diagnoses. These […]
This paper, part of the IS2024 conference proceedings, addresses the growing importance of validating Large Language Models (LLMs) in the medical domain, focusing on prompt engineering. This work proposes a structured methodology using combinatorial testing to systematically evaluate LLM responses to medical queries. The approach generates test cases by combining sets of symptoms with various […]