Google is Developing AI that Can Take Over Chrome to Help You Buy Things, Do Research

This week Google-backed Anthropic announced its upgraded AI model Claude 3.5 Sonnet could 'perform tasks like navigating web browsers, filling forms, and manipulating data.'

Now Google plans something similar for Chrome, reports 9to5Linux.com:

According to The Information, Google is 'developing artificial intelligence that takes over a person's web browser to complete tasks such as gathering research, purchasing a product or booking a flight.'

'Project Jarvis' — in a nod to J.A.R.V.I.S. in Iron Man — would operate in Google Chrome and is a consumer-facing (rather than enterprise) feature to 'automate everyday, web-based tasks.' The article doesn't specify whether this would be for mobile or desktop... Given a command/action, Jarvis works by taking 'frequent screenshots of what's on their computer screen, and interpreting the shots before taking actions like clicking on a button or typing into a text field.'

The Information reports that Google 'plans to preview the product, also known as a computer-using agent, as early as December alongside the release of its next flagship Gemini large language model, which would help power the product, two of the people said.'

Read more of this story at Slashdot.