A computer-using assistant
Bloomberg spotted a job listing for a senior engineering manager to oversee an "AI agent that can use a computer." This agent will browse the web, work across apps, run commands, write and debug code, and call services. The posting says these agents will "plan and carry out multi-step tasks across apps, browsers, command lines, code, and APIs" and will coordinate specialized sub-agents. The engineer will work with the Siri, UI Frameworks, and Apple Foundation Models divisions to build tools that move "fluidly between tools" such as a browser, a document, a terminal, a code editor, or a service. "Imagine an AI agent that can use a computer the way a capable person does," the listing says. The agent will choose the right tool for each step and perform tasks "privately and with the polish people expect from Apple" to ensure a high-quality experience. TechCrunch reached out to Apple for more information but did not receive a response. I find it telling that Apple builds this and simultaneously makes it harder for other companies to access the same level of system control.
Competition and system restrictions
Apple is preparing to compete with Meta’s Muse, OpenAI’s Dots, Anthropic’s Duet, and Google’s Tasks. While Muse and ChatGPT can already control a computer through Mac apps, Google recently allowed Gemini to do the same. Apple rolled out an AI-upgraded Siri in September, and the upcoming iOS 27.3 developer preview lets developers integrate Siri AI into "all apps." Apple’s Siri, which users can use to ask questions about what is on their screen, will receive more agentic capabilities like rotating and cropping images in Photos or organizing Safari tabs. Bloomberg reports that Apple aims to introduce the service as soon as the end of next year, though progress on the in-house agent remains in the early stages of development. This follows an October notification to developers about new controls meant to ensure that users only grant an app extraordinary access with very explicit action. The upcoming macOS 27.3 version will deploy warnings to discourage users from granting full, direct access to third-party agents. I see this as a blunt way to discourage users from granting third-party agents full control.
