Microsoft Research Asia and Shanghai Mental Health Center Jointly Develop Personalized Cognitive Training Framework
TapTechNews September 22nd news, according to the official disclosure of Microsoft Research Asia, the institute and Shanghai Mental Health Center have jointly carried out research and developed a personalized cognitive training framework using multiple modal data (such as information like voice, text, pictures, music, etc.) based on the multi-modal large model in Microsoft AzureOpenAI service, bringing new possibilities to the cognitive training of cognitive impairment patients.
TapTechNews learned from Microsoft Research Asia that considering the suggestions of experts from Shanghai Mental Health Center and the needs of patients, the researchers of Microsoft Research Asia developed the personalized cognitive training framework Remember Me (ReMe) from multiple dimensions such as usability, interface friendliness, functional professionalism, and ease of entry. This tool is based on the Microsoft AzureOpenAI service as the base model and has the function of immediate interactive response, supporting input and output of multiple modalities such as text, image, and voice, providing users with a new cognitive training experience in the form of a chatbot.
From the perspective of the usage process and functions, the personalized cognitive training framework Remember Me first uploads personal memory content through mobile phones or wearable devices, and then conducts individualized episodic memory or open memory training of world knowledge in a way closer to life. The researchers also provided a training framework for doctors and other researchers in this field to quickly create personalized training games by using the built-in cognitive game templates. In addition to this, the tool also includes interactive evaluations to track the cognitive level of patients and adjust the training tasks as needed.
Not only that, Microsoft Research Asia and Shanghai Mental Health Center are also continuously expanding more training functions and tasks to this training framework. In addition to open and individualized training tasks, through the natural interactive experience of voice dialogue, it also accommodates and implements the proven and effective mature cognitive training tasks. Such as color recognition for exercising thinking flexibility, mathematical operations for exercising working memory, etc.. At the same time, Microsoft Research Asia is also trying to record important nodes and events in daily life through wearable devices in an opportunistic sensing way based on sensor technology to promote more convenient personalized personal memory training.