On July 5th, at the 2024 World Artificial Intelligence Conference, Alipay launched one of the first domestic multimodal medical large models.

This model, based on the multimodal capabilities of Anting, can directly understand and train multimodal data such as audio, video, images, and text. During the testing phase, the accuracy of recognition for medical reports, pharmaceuticals, and hair conditions reached over 90%, and the Chinese and English medical exams and benchmark tests reached or exceeded the level of GPT-4.

AI Medical

Image Source Note: The image is generated by AI, and the image is provided by the authorization service provider Midjourney

Moreover, Alipay has also launched a trusted all-in-one machine and cloud solution to complement the large model, and in collaboration with 20 leading level-A hospitals and medical management institutions across the country, it has jointly initiated the AI Medical Co-construction Plan to explore innovative applications of large models.

Key Points:

- 💡 Alipay released a multimodal medical large model that can train multimodal data such as audio, video, images, and text.

- 💡 During the testing phase, the recognition accuracy for medical reports, pharmaceuticals, and hair conditions reached over 90%, and the Chinese and English medical exams and benchmark tests reached or exceeded the level of GPT-4.

- 💡 Alipay has also introduced a trusted all-in-one machine and cloud solution to complement the large model, and in collaboration with 20 leading level-A hospitals and medical management institutions across the country, it has jointly initiated the AI Medical Co-construction Plan to explore innovative applications of large models.