OpenAI updates Codex so it can use macOS apps in the background

In short: OpenAI has announced updates to Codex that let it control macOS desktop apps on its own, along with new image, browsing, and memory features.

What happened

OpenAI says Codex, its coding helper, can now operate apps on your Mac desktop. Think of it like asking a helpful assistant to click buttons and type into an app for you, while you do something else. OpenAI says Codex can run in the background, so it should not interrupt what you are doing.

The update is rolling out starting today to people using the Codex desktop app who are signed in with ChatGPT. At first, it is limited to macOS, which is Apple’s computer operating system. OpenAI did not say when support will come to Windows or other systems, and it said people in the European Union will get access “soon.”

OpenAI also announced several other additions. Codex can now generate and refine images using “gpt-image-1.5” (an image-making model, which means it creates pictures from instructions). It is also getting plugins, which are add-ons that connect Codex to tools such as GitLab, Atlassian Rovo, and Microsoft Suite, plus a built-in browser so you can point at web pages and leave specific instructions.

Finally, OpenAI says Codex will be better at automation. It can reuse earlier chat threads, schedule future work, and “wake up” to keep going on long tasks. It is also getting a memory feature, so it can remember things like your preferences and past corrections.

Why it matters

If Codex can reliably use everyday desktop apps, it could handle more of the boring steps around building and testing software. That can save time, but it also raises practical questions about control and safety when a tool can click around on your computer.

Source: The Verge AI