TWM524965U - Augmentation reality cognitive training system - Google Patents

Description

Augmented reality cognitive training system

This creation is about a brain training system, especially about a cognitive training system that uses augmented reality.

In an aging society, cognitive deterioration and dementia can lead to care problems and increase social costs. Since dementia cannot be cured, the only countermeasure is to prevent/mitigate its deterioration as much as possible.

Engaging in mental activities that stimulate brain function can reduce the risk of dementia. For cognitive function training, scholars put forward the theory of "brain plasticity", which believes that the brain can change at different ages, including physical state and chemistry. Changes in nature and function, and changes in the brain can be achieved in a non-pharmaceutical manner, for example by repetitive and challenging training.

Brain plasticity is the basis of all cognitive function training. Many studies have found that even the brains of older people still have the ability to adapt to stimuli, so the brain's adaptability does not decline due to aging of the brain structure. Although some brain functions are degraded, other functions can be compensated for by performing appropriate training. Therefore, general healthy elderly or elderly people with mild cognitive decline can benefit from cognitive function training.

TW M491920 provides a cognitive function training evaluation device and system, which has a plurality of pressing modules for a user to press to generate a pressing signal, and the pressing modules are individually matched with the light emitting unit, whereby when the user presses the pressing indicated by the light emitting unit In the case of a module, a control signal can be generated to identify that the user has completed the specified action. Such a cognitive function training evaluation device and system can provide both tactile and visual feedback functions and is easy to operate, but the development cost is high, and the hardware variability is low, and there is still room for improvement.

In view of this, the purpose of this creation is to provide a cognitive training system with higher contextual scalability.

In order to achieve the above and other objects, the present invention provides an augmented reality cognitive training system including a head mounted display, an image capture module, at least one pressure sensor, and a processor. The head mounted display is for the user to wear on the head and has a screen located in front of the eyes. The image capturing module is disposed on the head mounted display and is used to capture a scene in front of the user to generate an image signal. The pressure sensor is worn by the user's hand and is used to send a pressing signal when the user's hand presses the environmental object. The processor is respectively connected to the screen of the head-mounted display, the image capturing module and the pressure sensor, and the processor is configured to display the image signal generated by the image capturing module on the head-mounted display after being processed by the image. Screen, and process and / or record the pressure signal from the pressure sensor.

With the above design, the training situation scene and picture are easy to update, the development and update costs can be greatly reduced, and the interactive entertainment is also improved, so it is very suitable for use in cognitive function training.

10‧‧‧ head mounted display

11‧‧‧ screen

12‧‧‧ wearing an inspector

20‧‧‧Image capture module

30‧‧‧pressure sensor

40‧‧‧ processor

50‧‧‧Smart mobile device

60‧‧‧ gloves

Figure 1 is a system architecture diagram of an augmented reality cognitive training system of the preferred embodiment of the present invention.

Please refer to FIG. 1, which is a preferred embodiment of the present invention. The augmented reality cognitive training system includes a head mounted display 10, an image capturing module 20, a plurality of pressure sensors 30, and a processor 40.

The head-mounted display 10 is provided on the head of the user and has a screen 11 located in front of the eye. The image capturing module 20 is disposed on the head-mounted display and captures a scene in front of the user to generate an image signal. The pressure sensor 30 is for the user's hand to wear and is used to press the environment object when the user's hand presses the environment object, and the processor 40 is respectively connected to the screen 11 of the head mounted display 10 and the image capturing module 20 The signal connection is connected to the pressure sensor 30. The signal connection can be implemented in a wired or wireless manner. The processor 40 can be used to display the image signal generated by the image capturing module 20 on the head mounted display. The screen 11 of 10 processes and/or records the pressing signal from the pressure sensor 30. The picture processing may be, but not limited to, removing the background and superimposing the image.

In this embodiment, the screen 11 of the head mounted display 10, the image capturing module 20, and the processor are disposed in a smart mobile device 50. The smart mobile device 50 can be, but not limited to, a smart phone and a tablet. The computer capture module 20 can be the rear lens of the smart mobile device 50.

At this time, in order to hang the smart mobile device 50 is provided in front of the eye, may be used Google Cardboard ^TM or other similar view wearing frame 12, this time wearing a viewing frame 12 constituting a part of the head mounted display 10. In use, the smart mobile device 50 is placed in the headgear 12, the screen 11 of the smart mobile device 50 is directed toward the eye, and the rear lens (ie, the image capturing module 20) is exposed and can be captured by the user. The scene, in turn, has the ability to augment the reality.

On the other hand, in order to facilitate the placement of the pressure sensor 30 on the hand, the augmented reality cognitive training system of the present embodiment further includes a pair of gloves 60, and the glove 60 is provided with a plurality of the pressure sensors 30. When the user presses the environmental object, the pressure sensor 30 can generate the pressing signal, and the pressing signal is usually wirelessly transmitted to the processor 40. At this time, the processor 40 can adjust the manner of the screen processing according to the pressing signal, for example, changing. The superimposed image; or the processor 40 can simply record the pressing signal for subsequent evaluation and analysis of the cognitive function of the user; or, the processor 40 can perform the foregoing two functions simultaneously.

In a preferred use case, the smart mobile device 50 is installed with an application program that can simulate the use situation, and the user can execute the augmented reality experience by using the application, and respectively use the screen 11 of the head mounted display 10. The pressure sensor 30 provides visual and tactile feedback to the user. After the situation is over, the application can also display the recorded pressing signal so that the user can understand the performance of the cognitive function.

Based on the above, the training situation scene and picture of the augmented reality cognitive training system of this creation are easy to update, the development and update costs can be greatly reduced, and the interactive entertainment is also improved, so it is very suitable for use in cognitive function training. occasion.

Although the structural configuration of the present invention is exemplified by the above embodiments, it is not limited thereto, and other structural replacements or retouchings that are not beyond the spirit of the present invention should still belong to the scope of the creative protection.

10‧‧‧ head mounted display

11‧‧‧ screen

12‧‧‧ wearing an inspector

20‧‧‧Image capture module

30‧‧‧pressure sensor

40‧‧‧ processor

50‧‧‧Smart mobile device

60‧‧‧ gloves

Claims (4)

An augmented reality cognitive training system, comprising: a head mounted display for a user to wear on the head and having a screen located in front of the eye; an image capturing module disposed on the head mounted display and used for capturing An image signal is generated by the user in front of the scene; at least one pressure sensor is provided for the user's hand and is used to emit a pressing signal when the user's hand presses the environmental object; and a processor is respectively associated with the wearing The screen of the display, the image capturing module and the pressure sensor signal are connected, and the processor is configured to display the image signal generated by the image capturing module on the screen of the head mounted display after being processed by the image. And processing and/or recording the pressing signal sent by the pressure sensor. The augmented reality cognitive training system of claim 1, wherein the screen of the head mounted display, the image capturing module, and the processor are disposed in a smart mobile device. The augmented reality cognitive training system of claim 2, wherein the head mounted display further comprises a head mounted viewing frame for carrying the smart mobile device. The augmented reality cognitive training system of claim 1, further comprising a pair of gloves, each of the gloves being provided with a plurality of the pressure sensors.