According to Cointelegraph, artificial intelligence company Anthropic has introduced a new version of its Claude AI model along with a developer’s beta for 'computer use' on October 22. This beta allows developers using the API to enable Claude to autonomously control a mouse cursor, click on buttons and fields, and insert text within a user’s computer environment.
A video demonstration highlights Claude’s ability to navigate multiple windows, open new tabs for information searches, and transfer data between windows. Traditionally, AI-powered large language models like Claude and OpenAI’s ChatGPT interact with users through a dedicated interface window, with limited external interactions. However, Anthropic’s new computer use beta aims to allow developers to automate any function a human could perform at a workstation.
In a company blog post, Anthropic stated, 'Developers can direct Claude to use computers the way people do—by looking at a screen, moving a cursor, clicking buttons, and typing text. Claude 3.5 Sonnet is the first frontier AI model to offer computer use in public beta. At this stage, it is still experimental—at times cumbersome and error-prone.' The computer use beta is currently available only for developers through the Claude API, with Anthropic seeking early feedback to improve the feature over time.
Anthropic also addresses privacy and security concerns, noting that 'because computer use may provide a new vector for more familiar threats such as spam, misinformation, or fraud,' the company is taking a proactive approach to ensure safe deployment and can identify improper use of the feature.