(4 days, 6 hours ago)
Lords ChamberTo follow on from that, as my noble friend said right at the beginning, the amendment was put down in such a blunt fashion absolutely to stimulate this sort of debate. What has been really useful in this debate is finding that there is a broad degree of consensus that AI can be valuable as an input to decision-making, but it should not be used as the output: as the final decision-maker. As mentioned, AI can detect the progression of cancers and can probably do better prognosis or improve, especially over the time that we are looking at here, so that you can get better assessments of how long someone is likely to live.
On the AI in the chat box, there are very many instances where it could be very useful in terms of detecting coercion if it is talking to someone over quite a long period of time. Therefore, in all of this we see that, with inputs to the decision-making process, AI has a valuable part to play, but I think we would also absolutely agree that the final decision-maker in terms of an output clearly has to be a human; obviously they will be armed with the inputs from AI, but the human will make the final decision. I think that is what the Bill does, if I am correct, in that it is very clear that the decision-makers, the panels, the doctors and everything are those people, but at the same time—although I guess the Bill is silent on this—obviously it enables AI as an input.
I hope this debate is useful in that it shows a degree of consensus and that in this instance we probably have the right balance, but, again, I would be interested to hear from the Bill sponsor in his response whether that is the case.
Baroness Gerada (CB)
My Lords, under this amendment as it stands, we would have patients who could not have computerised records, because we have AI sitting behind every computer. The AI starts at the beginning. It starts with our telephone system, so, in fact, the patient would not even be able to use the telephone to access us; they or a relative would have to come in. They certainly would not be allowed to have computerised records, because of the digital and AI systems that we have in order to pick out diseases and to make sure that we are safely practising.
They also would not be able to have electronic prescribing, in many ways, because the pharmacy end too uses AI to make sure that patients are not being overmedicated and for drug interactions, et cetera, and, if they are using a computer system, AI is also used to digitally scribe consultations. So I understand the essence of this amendment, which I think, as many have said, is to not allow AI to decision-make somebody at the end of their life, but, as it stands, I have to warn noble Lords that it is unworkable in clinical practice.