Crime and Policing Bill Debate

Full Debate: Read Full Debate
Department: Ministry of Justice
Moved by
209: Clause 65, page 84, line 42, at end insert—
“46D Child sexual abuse image-generation risk assessment(1) A provider of an online service, including but not limited to a generative AI large language model, must risk assess the likelihood of their service being used to create or facilitate the creation of a CSA image or images as defined by section 46A. (2) If a risk is identified in a CSA image-generation risk assessment—(a) where the provider is regulated by the Online Safety Act 2023, a provider must report the risk within two working days to OFCOM, and agree to steps to reduce, mitigate and manage the risks within 14 days;(b) where the provider is not regulated by the Online Safety Act 2023, a provider must notify the National Crime Agency within two working days and agree to steps to reduce, mitigate and manage the risks of the online service being used to create or facilitate the creation of CSA images within 14 days.(3) Where a provider regulated by the Online Safety Act 2023 fails to agree to or implement steps to reduce, mitigate and manage the risks with OFCOM (see subsection (2)(a)), they can be subjected to OFCOM’s enforcement powers as set out in Part 7, Chapter 6 (enforcement powers) of that Act.(4) Where a provider not regulated by the Online Safety Act 2023 fails to agree to or implement steps to reduce, mitigate and manage the risks with the National Crime Agency (see subsection (2)(b)), they commit an offence.(5) A provider that commits an offence under this section is liable to be issued with a penalty notice by the National Crime Agency.(6) In this section a “penalty notice” means a notice requiring its recipient to pay a penalty of an amount not exceeding whichever is the greater of—(a) £18 million, or(b) 10% of a provider’s qualifying worldwide revenue for the most recent complete accounting period.(7) A penalty notice may be reissued where a provider continues to commit an offence under this section.(8) In carrying out its duties set out in this section, the National Crime Agency may consult with OFCOM.”Member’s explanatory statement
The Bill includes amendments which prohibit the creation of Gen-AI models specifically designed to create CSA images, but it is still possible for general-purpose models to be used to create CSA images. The Government has committed to allow providers of other Gen-AI services to risk assess how their services could be used for this purpose. This amendment makes that a requirement.
Baroness Kidron Portrait Baroness Kidron (CB)
- Hansard - -

My Lords, I thank the noble Baroness, Lady Morgan of Cotes, and the noble Lords, Lord Russell and Lord Clement-Jones, for adding their names. I also thank the noble Baroness, Lady Barran, for trying to add her name. Such was the enthusiasm that there was no space.

As already discussed, the Government have brought in new Clauses 92 and 93 to allow companies and responsible third parties to risk-assess the creation of CSA by gen AI models. That is an important detail. If the company is red teaming, or the regulator needs to test, it must not be guilty of an offence for doing so. But this new measure is permission, not obligation—and permission is not enough.

Amendment 209 seeks to do three things: to make risk assessment mandatory; to require mitigation within 14 days; and to hold companies not covered by the Online Safety Act to the same standard via the National Crime Agency.

A report from UNICEF last month referenced an Interpol study across 11 countries which found that at least 1.2 million children have disclosed having their images manipulated into sexually explicit images in the past year. In some countries that is equivalent to one child in every classroom being subjected to this new form of child sexual abuse. The report recommended the introduction of guardrails for AI developers at the design stage. In a meeting earlier in your Lordships’ House, we were told repeatedly and reminded graphically that AI CSAM creates appetite in offenders and that what happens online does not stay online.

We have consulted, and Ofcom has consulted—Parliament has debated this for years—and now we are consulting again. I argue that there are three reasons for accepting the amendment right now.

--- Later in debate ---
I am happy to confirm to noble Lords that this will allow us to impose duties on these services that correspond to, or are similar to, the Act’s duties on tackling child sexual exploitation and abuse content. Chatbot providers will have a legal duty to protect all users from illegal content, including non-consensual sexual deepfakes, and where chatbots continue to generate such content, the providers should expect to face the consequences of breaking the law that we hope that this House will pass.
Baroness Kidron Portrait Baroness Kidron (CB)
- View Speech - Hansard - -

If I was in the same meeting as the Minister, officials were unable to say that LLMs and generative models would be covered by that amendment. Indeed, they said that the policy of the Government was chatbots only. Chatbots are the subject of another amendment that I have tabled, which we will come to later. We have to be clear that the amendment in front of us remains only because I was told this afternoon that the new government amendment would not cover the same territory.

Lord Hanson of Flint Portrait Lord Hanson of Flint (Lab)
- View Speech - Hansard - - - Excerpts

The government amendment has been tabled. I am asking the noble Baroness—whether she does this is self-evidently a matter for her—to withdraw her amendment and look at the amendment that we have tabled today on a cross-party basis and on behalf of DSIT and the Home Office, the department that I represent. That amendment will be debated around 18 March, and she can make comments on it at that stage. I am trying to meet the needs of the House and the Government to respond to what are complex and difficult challenges. All I will say is that, by bringing more AI services into the scope of the Online Safety Act, we will ensure that there is a clear and consistent regulatory framework that will allow us to hold companies to account.

In Clause 93, we have introduced the technology testing defence that will enable persons authorised by the Secretary of State to test technology for these harms. The defence will give providers reassurance to test the robustness of their models’ safeguards, identify weaknesses and design out harmful inputs. This, in turn, will reduce the risk of their models being criminally misused, particularly to abuse women and children. This further supports all AI companies in scope of the Online Safety Act with their risk-assessment obligations.

Given those measures—the noble Baroness will have to make a judgment on this—but the Government consider that Amendment 209 is therefore unnecessary as it cuts across the approach that I have outlined to date both in the Bill, in Clause 93 and the clauses I outlined earlier, and the proposed amendment that I shared with her as best I could prior to this debate. The House has a chance to look at that now that it is published. This cuts across that duty and imposes a broad statutory duty on online services, duplicating regulatory mechanisms, and it could create legal uncertainty. The noble Lord, Clement-Jones, challenged me on that, but that is the view of Ministers, officials and our legal departments. We are worried about the similar enforcement routes outside the Online Safety Act framework.

We take this seriously. The points that the noble Baroness, Lady Benjamin, made are extremely important. I was not able to attend the briefing earlier, but I know how much that has impacted Members who have spoken today. The National Crime Agency and police will play a key role in protecting children from UK child abuse. It is warned that the scale and complexity of online child sexual abuse are resulting in tens of millions of annual referrals of suspected online sexual abuse. Policing resources are best spent on protecting children and arresting offenders, so it is appropriate that Ofcom continues to play a critical regulatory role in preventing and tackling the AI generation of child sexual abuse material.

I have tried to persuade the noble Baroness but, if I have not succeeded, there will have to be a Division. I do not want there to be one because I think this House should speak with one voice on tackling this issue. The laudable objectives of the amendment are, we believe, better addressed through both the existing legislative framework and the targeted government amendment we have tabled today to expand the scope of the Online Safety Act to bring illegal content duties in line for chatbots. This will mean that providers need to mitigate potential risks to prevent children facing such abuse.

I hope I have convinced the noble Baroness. Again, I apologise to the House for the lateness of the tabling of the amendment. We are trying to work across government on this, and that amendment will be debated on 18 March. In light of that, I hope the noble Baroness feels able to withdraw her amendment.

Baroness Kidron Portrait Baroness Kidron (CB)
- View Speech - Hansard - -

My Lords, as a point of information, I feel it would be useful to say that Clauses 64 and 65, to which the Minister refers, are in fact a narrowing of an original amendment, laid by me and other noble Lords, that the Government deliberately narrowed so that it deals only with electronic files that have been deliberately and exclusively created to create child sexual abuse. I very much welcome those clauses. However, if the Government had not narrowed that amendment, I would not be standing here today with this amendment.

I am grateful for the Minister’s time, and I am happy with the chatbot amendment as far as it goes—and inasmuch as I have seen it an hour before everyone else—but it does not deal with this issue. I rang the Minister this morning and asked for a meeting to say, “If you can tell me that this is covered by the chatbot amendment or that it’s already covered in another way, I will back down”. But I am afraid that nobody could tell me that, because it is not. That is just how it is.

I say to the noble Lord speaking for the Official Opposition, no, no, no. It is not okay to say, “We must work out how to do this”. This is an opportunity to work out how. We always do it this way. We pass an amendment; we get a power; and Ofcom and the Government do the guidance. I say to the whole House, and particularly to my friends on the Labour Benches who may be considering voting against this, have any of you seen child sexual abuse made out of your image? I have. It is not funny; it is serious and it is easily done. I think it is unacceptable to vote against an amendment that says only, “Risk assess”. It is not okay to put a product out in the world if you do not have any responsibility for the harm it causes. So, I do not expect to win, because the Government are whipping against and the Opposition are sitting on their hands, but I think it is important to say to the people who are in a vortex of this kind of abuse that at least some of us in this House have their backs.

Lord Hanson of Flint Portrait Lord Hanson of Flint (Lab)
- Hansard - - - Excerpts

When the noble Baroness says that some of us in this House are concerned about this issue, I want to say to her that all of us in this House are concerned about this issue. The noble Lord, Lord Davies of Gower, and myself have many differences in this House, but we are at one in trying to improve the position of the regulations to tackle this issue. The amendment that I have tabled is a very important step forward on behalf of the Government, on a DSIT and Home Office basis, and I am grateful for the support of the noble Lord. I do not want to have a Division in this House. The Government and the Opposition may well win that vote, but I do not want that Division to happen; I want us to go forward in a constructive way, to look at the amendments that are tabled and to make a change that really benefits people.

Baroness Kidron Portrait Baroness Kidron (CB)
- Hansard - -

I say to the noble Lord that there is only one way to prevent a Division on this issue, which is either to stand at the Dispatch Box and say that it is covered, or that we will keep it alive until Third Reading so that we can make sure that it is covered. If I have insulted anyone by suggesting that only some of us are willing to walk through the Lobby to protect children from child sexual abuse, forgive me, but unless the Minister has something to say, then as a matter of principle I shall divide the House.

--- Later in debate ---
Lord Pannick Portrait Lord Pannick (CB)
- View Speech - Hansard - - - Excerpts

My Lords, this group covers a range of human conduct, from the objectionable to the disgusting. I thank the Minister for tabling a series of amendments which will benefit women and society at large. I particularly thank the noble Baroness, Lady Owen, for all the work that she has done, which has led us to this position, and for the amendments that she has tabled. I am sure that the whole House is very grateful to her.

I will speak specifically to Amendment 273, tabled by the noble Baroness, Lady Owen, to which I have added my name. I understand that the noble Baroness may, if the Minister does not accept the amendment, wish to test the opinion of the House. This amendment simply seeks to impose a duty on a court to make a deprivation and deletion order where a person is convicted of an offence involving sharing or threatening to share intimate images without the consent of the victim.

The argument in favour of this amendment is very simple. It is necessary to give comfort to the victim who knows that the perpetrator has created or distributed the intimate images without consent. Unless there is a duty to destroy this content, the victim is inevitably going to remain extremely concerned that the content will remain in circulation and in existence.

That is the first argument. The second argument is that I can think of no justification whatever why the culprit should retain such intimate images when they have been convicted of being a wrongdoer in this respect. Those two points make this amendment unanswerable, and I strongly support it.

Baroness Kidron Portrait Baroness Kidron (CB)
- View Speech - Hansard - -

My Lords, I support all the amendments in this group—the government amendments, those in the name of the noble Baroness, Lady Owen, and the other amendment that was tabled. It was such an excellent speech, with such detail, that I do not want to go over the specifics, except to say that the noble Baroness is our leader and we will follow her through the Lobby.

I want to make one point, regarding the fantastic list of what is in the gap between what Ofcom can do and what Parliament can do. We should hesitate on that thought. Having looked a little this afternoon at the Government’s consultation, I see that there is almost nothing about what Ofcom cannot do, almost nothing about enforcement and, as I explained earlier, almost nothing about risk assessment. What happens beforehand, to prevent all this? What happens after it has all happened and we start to get enforcement? We cannot keep playing around in the middle. We have to go upstream, to the beginning, and we have to come to the end and get these things categorically dealt with in a way that interferes with business and makes it unacceptable to do it. With that, I will be supporting the noble Baroness.

--- Later in debate ---
I urge the Government to support these amendments. They are the foundation of a safer online world. If we fail to act, we risk legitimising a culture where abuse is normalised, and we cannot allow the increase of harmful online content to continue. It must be stopped because it causes harm and poisons minds, especially those of children and very young people and distorts the concept of a healthy, loving relationship. I will say it again and again and again: childhood lasts a lifetime, so let us act now to ensure that every childhood is free from abuse, victimisation and exploitation. Let us act now, sooner rather than later, to help those victims who are being victimised right at this very moment. Let us focus our minds on those young people and those children.
Baroness Kidron Portrait Baroness Kidron (CB)
- View Speech - Hansard - -

My Lords, briefly, I support the amendments in the name of the noble Baroness, Lady Bertin. It has been a very grim afternoon, I have to say, repeatedly hearing some of the most horrendous things that can happen to women and children. I say to the Minister, for whom I have a great deal of respect and who spoke passionately—a word normally associated with me—that this is still too little, too late and too long across a number of these issues. I know that the noble Baroness, Lady Levitt, is relatively new in the House, but we have been debating these things for eight years and I remember having this exact discussion during the Online Safety Bill. We have to just move on. We cannot keep on saying that it moves quickly and then allowing ourselves to move this slowly.

The noble Baroness, Lady Bertin, made a really strong case that online porn affects real life. It is real-life violence and there is this unbelievably vast overlap with child sexual abuse. It is that mess that we have to see as one and, in that sense, the noble Baroness made the case for all of her amendments. I want to quickly mention government Amendment 272, which establishes an offence if a person makes or adapts, or

“supplies or offers to supply a thing, for use as a generator of … intimate images”.

What has happened to that amendment is exactly the same as what happened to the child sexual abuse amendment that has the same form. It deals with intentionality and says: “If you absolutely intend to do this, it will be illegal. But if it happens in general, on any old piece of software that somebody hasn’t bothered to train properly or put protections in, then you’re not caught”. I believe that is what the noble Baroness has in her broader amendment about software.

I really want to make the point that there seems to be a reluctance to catch general- purpose technology in these issues of child abuse, violence against women, intimate image abuse and pornography, and I hope that the Government are listening. We cannot avoid general-purpose technology if that is what is spreading, creating and making this situation available across communities. It is in that space that so many children first see porn. It is in that space that so many women are abused and that so much child sexual abuse is present.

I urge the Minister to think about the breadth and not just the intentionality, because in my view it does not really matter whether it is accidental on the part of the company. I finish by saying that I had the privilege of meeting Yoshua Bengio last week, who is absolutely central to the development of AI and neural networks, and so on. He said, and I paraphrase: show me the incentive and I will show you the design.

Lord Russell of Liverpool Portrait Lord Russell of Liverpool (CB)
- View Speech - Hansard - - - Excerpts

My Lords, I rise very briefly, partly as a male of the species, since we are largely responsible for the situation we are describing. We are behind these business models, we are the sex that is making all the money out of it, and, in most cases, we are the abusers. It behoves us to acknowledge that and speak up about it.

I pay tribute to the noble Baroness, Lady Bertin. As a mother of young children, she has, on our behalf, subsumed herself for over two years in a world that most of us can barely imagine. That must have been an extraordinarily unpleasant and difficult experience. I pay tribute to her for doing it, because I am not sure many of us would have taken that on or lasted the course.

With that in mind, given the time and thought that she has given to this, the number of experts she has spoken to, the number of international parameters and comparators she has taken into account in looking at this, and the detailed way in which she has analysed the business models that underline this highly profitable business, it behoves all of us, and particularly the Government, to listen very carefully. The amendments that she has brought forth are not something that she dreamed up overnight; they are based on her detailed and painful knowledge of exactly how this business operates. She is identifying some gaps in the laudable approach the Government are taking to try to do something about this.

With my business experience hat on, I say that a major fault that businesses make is overpromising and underdelivering. His Majesty’s Government are in grave danger of doing exactly that in many of these areas to do with violence against women and girls. It is wonderful to have the headlines and to say, “We are taking this seriously and we are doing something about it”, but the devil is in the detail, and the detail is effective implementation. To effectively implement, you have to understand the business model, and, as people have said previously, you have to be prepared to disrupt it.

--- Later in debate ---
Baroness Levitt Portrait Baroness Levitt (Lab)
- Hansard - - - Excerpts

These are exactly the conversations that we wish to carry on having, on how to best go about this to make sure that we achieve the aim that we are all trying to get to: getting rid of these horrible things. I would like to continue the conversation with the noble Baroness in due course.

The noble Baroness, Lady Kidron, stressed that there was undue emphasis on intention and states of mind. Again, this is the problem with criminal offences: we do not create criminal offences where people who have done something accidentally end up being criminalised. That is why, on occasions, we say that regulation may be a better tool. The noble Baroness is looking outraged.

Baroness Kidron Portrait Baroness Kidron (CB)
- Hansard - -

No, I dare not tackle the noble Baroness on legal matters—what we do and do not do in the law—but, if you accidentally poison children’s food, you do not get a free pass. There are all sorts of places and spaces that have to—

Baroness Levitt Portrait Baroness Levitt (Lab)
- Hansard - - - Excerpts

We will continue this, but with the greatest of respect to the noble Baroness, the fact is that all criminal offences, pretty much, apart from those that are strict liability offences, which are pretty unpopular in the criminal law—[Interruption.] We will discuss this later, but take it from me that it is very rare to criminalise something that is done accidentally.

I turn now to incest. As I said earlier today, the Government have tabled a cluster of amendments that seek to go further than Amendment 299 by criminalising the possession and publication of pornography that depicts sexual activity between both adult and child family members. The reason for doing that is that it makes it more straightforward for law enforcement and regulators to tackle the harmful content, as pornography that portrays a family relationship will be criminalised and the prosecutor does not need to have to prove that the person concerned is under 18 or is a child. It can be very difficult to prove that the person is actually a child. We therefore consider government Amendment 297 to more robustly address the harm that the noble Baroness, Lady Bertin, seeks to address.

I turn to the noble Baroness’s Amendments 297AA, 297B, 297C and 297D. Although I understand why she wishes to extend the Government’s amendment to a wider range of relationships, it is important that your Lordships understand that such an extension would criminalise sexual relationships that are lawful between adults in real life. With her Amendment 298, the noble Baroness has specifically sought to include that. It would go further than offline regulation, where some portrayals of step-relative relationships are classified, provided they are not in any way abusive in nature.

In addition, this change proposed by the noble Baroness’s amendment would significantly increase the complexity of the offence. For example, if the pornographic image depicted sex between step-siblings, operational partners would then also have to consider whether the persons live or have lived together, or whether one person is or has been regularly involved in caring for the other. It would be challenging for the police and the CPS to determine and ultimately prosecute. The intention behind the Government’s amendments is to make it as straightforward as possible to enforce and prosecute. That said, although I appreciate what the noble Baroness is trying to achieve, I urge her not to press her amendment.

Turning now to parity, I put on record that the Government accept the principle at the heart of Amendment 298 in the name of the noble Baroness, Lady Bertin. There is a clear and urgent need for greater parity between the treatment of harmful pornography online and offline. This Government, who have prioritised tackling all forms of violence against women and girls, will show the leadership necessary to deliver it. We have, with thanks to the noble Baroness, already taken steps in the Bill to criminalise some of the most egregious forms of content that are currently mainstream online. The strangulation pornography offence added in Committee and the further changes we are bringing forward today on incest pornography have been added because of the noble Baroness. These matters are now prohibited under offline regulation.

Acknowledging that the changing online world brings new challenges that must be tackled to address emerging harms, we will also be reviewing the criminal law relating to pornography to assess its effectiveness. We will ensure that our online regulatory framework keeps pace with these changes to the criminal law. Delivery of parity in regulatory treatment has already started. Once enforced, these offences will become priority offences under the Online Safety Act, requiring platforms to have proportionate systems and processes in place to prevent UK users encountering this content. This should stop this abhorrent content circulating unchecked on online platforms, where right now it is being recommended to unwitting users.

While these measures mark a significant step forward in protecting individuals online, we acknowledge that they do not address the totality of the complex question on parity. The current offline regime relies on checks on individual pieces of content, which can consider wider context and nuance in a way that does not easily translate to the scale and speed of online content. For this reason, we cannot accept the noble Baroness’s amendment, but because we completely agree with the need for greater parity, the Government are committing our joint pornography team, which was announced as part of the VAWG strategy, to produce a delivery plan within six months of Royal Assent.

Crucially, the delivery plan will set out how, not whether, the Government can most effectively close the gap. This will include consideration of how a new approach can address other potentially harmful content, such as pornography portraying step-incest relationships or adults role-playing as children. The delivery plan will thoroughly test which approach will be most effective by testing audit and reporting functions and considering how this can be done at scale to achieve the desired impact. The plan will also consider how and which regulatory frameworks can best address the issue, noting the interactions with the BBFC’s existing remit and that of Ofcom under the Online Safety Act, and how to ensure that there is effective enforcement in any future system. It will examine the case for tools, including fines and business disruption measures. We will keep up the pace. I can commit to including clear timelines for implementation in the plan, and we will keep them as short as possible, factoring in the possible need for legislation, subject to parliamentary timing. I know that my fellow Ministers will welcome the noble Baroness, Lady Bertin, joining us as we conduct this work.