Ant Group's Bailing Model's Multimodal Capability Enhancement and Its Applications in Alipay Smart Assistant and Others

TapTechNews July 5th news, TapTechNews learned from Ant Group that the multimodal capability of Ant Group's self-developed Bailing large model has been comprehensively enhanced.

The multimodal capability enables the large model to "see" and "hear", and be able to "speak" and "draw", which can support multimodal understanding and generation such as audio, video, images, and text, allowing the large model to perceive and interact more like a human, and will be applied in multiple AI intelligent entities such as Alipay Smart Assistant, AI Financial Manager, and AI Medical Assistant in the future.

Alipay Smart Assistant is a brand-new life service AI product developed based on Ant Group's self-developed Bailing large model. It focuses on dozens of life scenarios such as eating, drinking, traveling, touring, handling affairs, buying tickets, and entertainment for users. Just by "asking", one can obtain more than 8,000 digital life services in the fields of travel, health, government affairs, finance, etc..

It is introduced that the "AI Ordering" function has currently started testing in Alipay Smart Assistant, and the first batch supports the Alipay mini-programs of 11 tea beverage brands such as Starbucks, Luckin Coffee, Ba Wang Cha Ji, and Mixue Bingcheng.

In addition, the AI Financial Manager provides personalized services such as market analysis and position diagnosis for users, and has currently served 43 million users; the AI Medical Assistant helps medical institutions provide full-process services for patients before, during, and after medical treatment.