Anthropic releases AI to automate mouse clicks for coders

The new "computer use" feature can tell AI "where to move the mouse, where to click, what to type, in order to do quite complicated tasks," Anthropic's chief science officer Jared Kaplan said in an interview. The capability is tailored to software developers and represents a move toward AI agents, programs that require little human intervention to carry out multi-step actions.

featured-image

Anthropic , a startup backed by Alphabet and Amazon. com, released a pair of updated artificial intelligence models on Tuesday, along with a new capability to autonomously perform computer tasks and save users keystrokes. The new "computer use" feature can tell AI "where to move the mouse, where to click, what to type, in order to do quite complicated tasks," Anthropic's chief science officer Jared Kaplan said in an interview.

The capability is tailored to software developers and represents a move toward AI agents, programs that require little human intervention to carry out multi-step actions. Researchers have touted agents as a frontier for AI development beyond chatbots, which easily conjure prose or computer code though not actions. Anthropic demonstrated a use case for the feature that entailed coding a basic website, and another that used various programs including Google Search and Apple Maps to plan a sunrise outing.



Anthropic offers software developers three versions of Claude, its family of AI models, at price points that vary based on their performance. This week's updates come to Sonnet, the mid-tier model, and Haiku, the cheapest. Marketing Future of Marketing & Branding Masterclass By - Dr.

David Aaker, Professor Emeritus at the Haas School of Business, UC Berkeley, Author | Speaker | Thought Leader | Branding Consultant View Program Web Development Mastering Full Stack Development: From Frontend to Backend Excellence By - Metla Sudha Sekhar, IT Specialist and Developer View Program Marketing Digital marketing - Wordpress Website Development By - Shraddha Somani, Digital Marketing Trainer, Consultant, Strategiest and Subject Matter expert View Program Artificial Intelligence(AI) AI and Analytics based Business Strategy By - Tanusree De, Managing Director- Accenture Technology Lead, Trustworthy AI Center of Excellence: ATCI View Program Web Development A Comprehensive ASP.NET Core MVC 6 Project Guide for 2024 By - Metla Sudha Sekhar, IT Specialist and Developer View Program Marketing Modern Marketing Masterclass by Seth Godin By - Seth Godin, Former dot com Business Executive and Best Selling Author View Program Office Productivity Zero to Hero in Microsoft Excel: Complete Excel guide 2024 By - Metla Sudha Sekhar, IT Specialist and Developer View Program Artificial Intelligence(AI) AI for Everyone: Understanding and Applying the Basics on Artificial Intelligence By - Ritesh Vajariya, Generative AI Expert View Program Leadership Business Storytelling Masterclass By - Ameen Haque, Founder of Storywallahs View Program Marketing Digital Marketing Masterclass by Neil Patel By - Neil Patel, Co-Founder and Author at Neil Patel Digital Digital Marketing Guru View Program Web Development Java 21 Essentials for Beginners: Build Strong Programming Foundations By - Metla Sudha Sekhar, IT Specialist and Developer View Program Strategy Succession Planning Masterclass By - Nigel Penny, Global Strategy Advisor: NSP Strategy Facilitation Ltd. View Program Artificial Intelligence(AI) Master in Python Language Quickly Using the ChatGPT Open AI By - Metla Sudha Sekhar, IT Specialist and Developer View Program HR Human Potential and the Future of Employment By - Lynda Gratton, Prof.

at London Business School, Speaker, Author, Global Thought Leader View Program Web Development Intermediate C++ Skills: Master Pointers, Structures and File Stream By - Metla Sudha Sekhar, IT Specialist and Developer View Program Data Science SQL for Data Science along with Data Analytics and Data Visualization By - Metla Sudha Sekhar, IT Specialist and Developer View Program Office Productivity Advanced Excel Course - Financial Calculations & Excel Made Easy By - Anirudh Saraf, Founder- Saraf A & Associates, Chartered Accountant View Program Artificial Intelligence(AI) AI-Powered Python Mastery with Tabnine: Boost Your Coding Skills By - Metla Sudha Sekhar, IT Specialist and Developer View Program Artificial Intelligence(AI) Tabnine AI Masterclass: Optimize Your Coding Efficiency By - Metla Sudha Sekhar, IT Specialist and Developer View Program Artificial Intelligence(AI) Generative AI for Dynamic Java Web Applications with ChatGPT By - Metla Sudha Sekhar, IT Specialist and Developer View Program The new 3.5 Haiku can generate computer code in a manner "almost comparable" to the version of Sonnet released in June, according to Kaplan. CEO Dario Amodei told at the time that the company intended to update Opus, the most capable model, by the end of the year.

Discover the stories of your interest Blockchain 5 Stories Cyber-safety 7 Stories Fintech 9 Stories E-comm 9 Stories ML 8 Stories Edtech 6 Stories The computer use feature is currently limited to the new version of Claude 3.5 Sonnet and comes with safeguards to prevent its application toward spam, fraud and election-related misuse, Anthropic said. Kaplan said the AI still makes mistakes.

Mike Krieger, a co-founder of Instagram who joined Anthropic this spring as chief product officer, said the company wants feedback from business customers to learn where to focus development of the feature. Meanwhile, a labs team inside Anthropic is exploring how to make the capability available for consumers, something Krieger said he personally wants. "I was booking flights," he said.

"I really just want this to be completely automated." Microsoft on Monday unveiled an application for its clients to build their own agents that can handle queries, identify sales leads and manage inventory..