Blog – ChatMED

Leveraging Federated Learning for Secure Transfer and Deployment of ML Models in Healthcare.

17 February, 2025

Federated Learning: A New Era for Privacy-Preserving AI in Healthcare Scientific advancements are often born out of the need to solve pressing problems. In the world of artificial intelligence (AI) and healthcare, one major challenge has been balancing the immense potential of AI-driven insights with the critical need to protect patient data. A newly published […]

Testing ChatGPT’s Performance on Medical Diagnostic Tasks

4 February, 2025

This study evaluated ChatGPT’s performance in medical diagnostic tasks. ChatGPT was assessed by comparing medical diagnoses to a professional medical expert system, NetDoktor’s Symptom-Checker. To achieve this, a semi-automated validation procedure was developed, which uses NetDoktor as a golden model to generate sets of symptoms and corresponding diagnoses. These symptom descriptions were then used as […]

Using Combinatorial Testing for Prompt Engineering of LLMs in Medicine

4 February, 2025

This paper addresses the growing importance of validating Large Language Models (LLMs) in the medical domain, focusing on prompt engineering. This work proposes a structured methodology using combinatorial testing to systematically evaluate LLM responses to medical queries. The approach generates test cases by combining sets of symptoms with various prompt components, utilizing pairwise combinatorial testing […]