MiniGemini

A multimodal large language model capable of understanding and generating images

CommonProductProgrammingMultimodalVisual Language Model

Mini-Gemini is a multimodal visual language model supporting a series of dense and MoE large language models ranging from 2B to 34B. It possesses capabilities for image understanding, reasoning, and generation. Based on LLaVA, it utilizes dual vision encoders to provide low-resolution visual embeddings and high-resolution candidate regions. It employs patch-level information mining to perform patch-level mining between high-resolution regions and low-resolution visual queries, fusing text and images for understanding and generation tasks. It supports multiple visual understanding benchmark tests, including COCO, GQA, OCR-VQA, and VisualGenome.

Best AI Websites & Tools

MiniGemini

MiniGemini Visit Over Time

MiniGemini Visit Trend

MiniGemini Visit Geography

MiniGemini Traffic Sources

MiniGemini Alternatives

mPLUG-Owl3 — A multimodal large language model that understands long image sequences.

Aquila-VL-2B-llava-qwen — A visual-language model that intelligently processes both image and text information.

Ferret-UI-Llama8b — A multimodal large language model based on Llama-3-8B, focused on UI tasks.

Stable Diffusion 3.5 Medium — A multimodal diffusion transformer model for generating images based on text.

Janus-1.3B — A Unified Model for Multimodal Understanding and Generation

MM1.5 — Optimization and analysis of multimodal large language models

NVLM 1.0 — Cutting-edge multimodal large language model

Emu3 — Next-generation multimodal intelligence model

Llama-3.2-11B-Vision — A multimodal large language model that supports image and text processing.

Phi-3.5-vision — An advanced multimodal model that supports image and text understanding.

Lumina-mGPT — A multimodal autoregressive model excelling in text-to-image generation.

MiniCPM-V 2.6 — High-performance multimodal language model suitable for image and video understanding.

lmms-finetune — A unified codebase for fine-tuning large multimodal models.

OmAgent — A multimodal intelligent agent framework for tackling complex tasks

InternLM-XComposer-2.5 — A Multifunctional Large Visual Language Model

Tencent EMMA — Multimodal Text-to-Image Generation Model

Omost — Transforms the encoding capabilities of large language models into image generation capabilities.

CogVLM2 — Second-generation multimodal pre-trained dialogue model

Grok-1.5 Vision Preview — The world's first multimodal model connecting the digital and physical worlds

MA-LMM — MA-LMM is a large-scale multimodal model for long-term video understanding.

MoMA — MoMA Personalization is a personalized image generation tool based on an open-source Multimodal Large Language Model (MLLM).

mPLUG-DocOwl — A modular multimodal large language model for document understanding

MouSi — Multimodal Visual Language Model

UNIMO-G — Unified Image Generation

Instruct-Imagen — Multimodal Image Generation Model

M2UGen — Multimodal Music Understanding and Generation System

Vary — Visual Vocabulary Expansion for Large-Scale Visual Language Models

DreamLLM — Multimodal Comprehension and Creation

Qiantuwang AI Art Generation — An AI-driven image creation platform that converts text into images.