AI agents arenât legally responsible for any harm that they cause, experts say. So who is?
The law is clear, says Prof Jeannie Paterson. âIf I deploy an AI agent and it causes harm to someone else, I am responsible for
The law is clear, says Prof Jeannie Paterson. âIf I deploy an AI agent and it causes harm to someone else, I am responsible for that harm. âEven if I didnât intend for that to happen, it was foreseeable, and I should be taking responsibility.â However, the director of the University of Melbourneâs Centre for AI and Digital Ethics acknowledges there is also a good deal of scope for legal and ethical âmurkinessâ around actions perpetrated by automated agents, in the wake of Australiaâs first known agentic AI âaccidentâ. An agent is an autonomous software system that, tasked with pursuing a goal, can do it without human oversight â every step of the way. This week the ABC reported on the case of Andrew, an AI expert who went only by his first name, who asked his agentic program to book some gym classes for him. After being informed he was fourth on a waitlist for a class, Andrew asked the agent if it was possible to move him up the list. To his shock, his agent hacked his gymâs software system and booted another member off a waitlist so he could get into a class sooner. âIt could book classes months outside the intended booking window, before they were supposed to be available,â Andrew wrote. âWorse, it could cancel other membersâ reservations and bump them off the waitlist.â The agent was being helpful, he wrote, but his experience showed that if you gave an AI permission to do something for you, it would âoften discover paths you did not explicitly ask it to look forâ.
Andrew asked the agent to undo its cancellation of the other personâs reservation, but it was unable to do so. âSorry about that â I should have been more careful with the test,â the AI agent responded. He then tasked the AI with writing an email to the gymâs software provider about the software vulnerability it had exploited. A spokesperson for Victoria police said Andrewâs matter âdoes not appear to involve any criminalityâ. However, experts say there will be more dramatic cases that may cause harm â and break the law. Legal ambiguity Australian law applies only to people, not virtual beings. Experts say the person â or business â that deploys the AI agent is legally responsible. And they warn that those âdeployersâ often have very little idea about their legal liability. âWeâre going to see a lot of cases like this,â says Dr Rebecca Johnson, an AI evaluation and governance expert at the University of Sydney. Paterson says it appeared Andrew had been responsible in his case, by going public and trying to fix the problem, but elsewhere there was âa kind of gung-ho mentalityâ. âAs soon as you give people the capacity to create agents to do things for them, the likelihood is that there will be accidents like this,â she says. Paterson gives the notional example of someone having a bad experience at a rented property, so they ask their agent to write a review.
