Tsinghua University Develops New Visual Language Model CogAgent to Enhance GUI Understanding and Navigation
站长之家
91
The Tsinghua University Zhipu AI team has introduced CogAgent, a vision-language model focused on enhancing the understanding and navigation of graphical user interfaces (GUIs). Utilizing a dual-encoder system to handle complex GUI elements, the model excels in processing high-resolution inputs, navigating GUIs on both PC and Android platforms, and performing tasks involving text and visual question-answering. Potential applications of CogAgent include automating GUI operations, providing GUI assistance and guidance, and driving new GUI designs and interaction methods. Although still in its early development stages, the model is expected to bring significant changes to computer interaction methods.
© Copyright AIbase Base 2024, Click to View Source - https://www.aibase.com/news/4550