On the risks of depersonalizing consent and the safe implementation of LLMs in medical decision-making
NL-context Het gebruik van LLM’s voor patiënt‑communicatie kan in Nederland de persoonlijke zorg en vertrouwensrelatie met zorgverleners ondermijnen, waardoor besluitvorming en veiligheid van zorg onder druk komen te staan.
Samenvatting
On the risks of depersonalizing consent and the safe implementation of LLMs in medical decision-making. Zohny et al provide a proof of concept for large language model (LLM)-patient communication in medical decision-making, discussing some of the risks and potential downsides of implementing this technology. However, removing human healthcare professionals (HCPs) from medical decision-making carries further risks they do not discuss. These include risks that a conscientious HCP with appropriate training can address, including (1) diminished situational autonomy due to pressure from family members or loved ones, (2) barriers to autonomy due to the situational inflexibility of LLMs and (3) diminished comfort and trust due to lack of human empathy. While the central moral focus in the implementation of this technology should be patient consent and the process that supports it, the dehumanisation of medical decision-making risks broader negative effects on both patients and HCPs, some of which are also discussed in this article. These concerns should be addressed to minimise the harm and maximise the good that LLMs can do to enhance patient decision-making.
Waarom dit ertoe doet
De kwaliteit en veiligheid van zorg kunnen beïnvloed worden door deze ontwikkeling.
Context (AI-duiding)
Klik op “Toon context” om AI-duiding op te halen.
Scores
De mate waarin dit signaal de Nederlandse gezondheidszorg kan beïnvloeden (1 = minimaal, 5 = transformatief).
Hoe snel actie of aandacht nodig is (1 = kan wachten, 5 = onmiddellijke aandacht vereist).
De mate van onzekerheid over de uitkomst of timing (1 = zeer voorspelbaar, 5 = zeer onzeker).
Tags
Bronnen
- On the risks of depersonalizing consent and the safe implementation of LLMs in medical decision-makingJournal of Medical Ethics —
Relevant voor
Pipeline versie: 0.2.0 | Gegenereerd door: pipeline