Cradle Framework

Cradle Framework: A framework for controlling multi-modal computer agents.

CommonProductProgrammingDevelopment ProgrammingMultimodal Agents
The Cradle Framework aims to enable foundation models to perform complex computer tasks through the same general interface used by humans (screen as input, keyboard and mouse actions as output). The framework has been case-studied in the video game Red Dead Redemption II, demonstrating its generalization and adaptability in complex environments.
Visit

Cradle Framework Alternatives