Microsoft Open Source innovation framework: can turn DeepSeek into AI Agent

On February 17th, according to Jinshi data, Microsoft released the latest version V2.0 of the visual Agent parsing framework OmniParser on its official website, which can turn models such as DeepSeek-R1, GPT-4o, and Qwen-2.5VL into AI Agents that can be used on computers. Compared with V1, V2 has higher accuracy and faster inference speed when detecting smaller interactive UI elements, and the latency has dropped by 60%. In the high-resolution AgentBenchmark test ScreenSpot Pro, the accuracy of V2+GPT-4o reached an astonishing 39.6%, while the original accuracy of GPT-4o was only 0.8%, showing a significant overall improvement. In addition to V2, Microsoft also Open Source omnitool, which is a Docker-based Windows system covering functions such as screen understanding, positioning, action planning, and execution, and it is also a key tool for turning large models into Agents.