RULE

Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

StarVector is a foundation model for SVG generation that transforms vectorization into a code generation task. Using a vision-language modeling architecture, StarVector processes both visual and textual inputs to produce high-quality SVG code with remarkable precision.

[ICML 2024] Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs (RPG)

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

Deep Neural Networks Improve Radiologists' Performance in Breast Cancer Screening

实时语音交互数字人，支持端到端语音方案（GLM-4-Voice - THG）和级联方案（ASR-LLM-TTS-THG）。可自定义形象与音色，无须训练，支持音色克隆，首包延迟低至3s。Real-time voice interactive digital human, supporting end-to-end voice solutions (GLM-4-Voice - THG) and cascaded solutions (ASR-LLM-TTS-THG). Customizable appearance and voice, supporting voice cloning, with initial package delay as low as 3s.

Official Pytorch Code for "Medical Transformer: Gated Axial-Attention for Medical Image Segmentation" - MICCAI 2021

Speech, Language, Audio, Music Processing with Large Language Model

LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills

A collection of resources on applications of multi-modal learning in medical imaging.