Bilibili has announced the open-source release of the Index-1.9B model, a lightweight AI language model that has garnered significant attention. The Index-1.9B model comes in multiple versions, including a base model, a control group, and a conversational model.
Index-1.9B includes: Index-1.9B base: The base model, featuring 1.9 billion non-embedding parameters, was pre-trained on a 2.8T corpus primarily in Chinese and English, and leads in multiple evaluation benchmarks compared to other models of the same level.
Index-1.9B pure: The control group of the base model, identical in parameters and training strategies to the base, with the exception of strictly filtering out all instruction-related data in this version's corpus to verify the impact of instructions on benchmarks.
Index-1.9B chat: A conversational model based on the Index-1.9B base, aligned through SFT and DPO, and notably more engaging due to the introduction of a significant amount of internet community corpus during pre-training.
Index-1.9B character: Introduces RAG on top of SFT and DPO to enable few-shot role-playing customization.
Index-1.9B Product Entry:https://top.aibase.com/tool/index-1-9b