MiniGPT-5 employs an interleaved visual language generation technology based on generative vokens. It is capable of simultaneously generating textual narratives and corresponding images. The model adopts a two-stage training strategy, where the first stage focuses on undescribed multimodal generation training and the second stage on multimodal learning. The model has achieved good results in multimodal dialogue generation tasks.