TWM626037U - Smart interactive augmented reality hand fine movement rehabilitation system - Google Patents

Abstract

A smart interactive augmented reality hand fine motor rehabilitation system includes a head-mounted smart display, a substrate unit, and an operation unit. The substrate unit includes a board body defining a plurality of placement slots, and a plurality of sensors respectively corresponding to the placement slots and connected to the head-mounted smart display. The operating unit includes a plurality of operating blocks which are placed in the placing slots and can be stacked on each other. Each operating block has a body, an identification module disposed on the body, and a trigger module informationally connected to the identification module. The trigger module is used to make the head-mounted smart display recognize the operation block when the main body is placed in any of the placement slots, or stacked on the operation block already placed in any of the placement slots, and The augmented image corresponding to the operation block is displayed.

Description

Smart interactive augmented reality hand fine motor rehabilitation system

The present invention relates to a rehabilitation system, especially a smart interactive augmented reality hand fine motor rehabilitation system.

Referring to FIG. 1 , it is a conventional rehabilitation device 1 for hand rehabilitation, comprising a body 11 surrounding and defining a plurality of placement grooves 110 with different shapes, and a plurality of The operation blocks 12 are placed in the placement slots 110 according to the shape. When the user performs hand rehabilitation, he must integrate the hand-brain coordination, determine the shape of each operation block 12 and the corresponding placement slot 110 , and then hold the operation block 12 and place it in the correct placement slot 110 . Repeatedly performing the aforementioned actions can help the user to perform rehabilitation for hand movements in a relatively targeted manner.

However, even though the rehabilitation effect for hand movements can be achieved by using the rehabilitation device 1 , apart from the differences in the various shapes of the operation blocks 12 , it is still limited to the monotonous operation of “shape correspondence” without change, which is relatively lacking. Due to the diversity of operations, other operations such as stacking the operation blocks 12 cannot be derived additionally, and it is difficult to meet more diverse rehabilitation needs.

In addition, in recent years, more diversified multimedia such as virtual reality and augmented reality have developed vigorously. Under the circumstance that most people have contacted and have their impressions, users are relatively more able to accept the experience mode that cooperates with multimedia, and even It is a gamified rehabilitation process. Therefore, if a complete rehabilitation system can be properly integrated according to this, in addition to providing more diverse operation modes, it can also provide more diverse additional experiences. It is expected to improve the willingness of users to perform rehabilitation, and further Optimize the actual rehabilitation effect.

Therefore, the purpose of the present invention is to provide an intelligent interactive augmented reality hand fine motor rehabilitation system that can provide diversified operations in conjunction with augmented reality.

Therefore, the novel smart interactive augmented reality hand fine motor rehabilitation system includes a head-mounted smart display, a substrate unit, and an operation unit.

The substrate unit includes a board body defining a plurality of placement slots, and a plurality of sensors disposed on the board body and corresponding to the placement slots respectively and connected to the head-mounted smart display information.

The operation unit includes a plurality of operation blocks which are placed in the placing slots for operation and can be stacked on each other. Each operation block has a main body, an identification module disposed on the main body and used for identification by the head-mounted smart display, and a trigger module information connected to the identification module.

The trigger module is used for triggering the corresponding sensor to sense the respective identification module when the body is placed in any of the placement slots, thereby enabling the head-mounted smart display to identify the operation block, and Displaying the augmented image corresponding to the operation block; when the body is stacked on the operation block that has been placed in any of the placement slots, it is used to connect with the identification module information of the other operation block, thereby The head-mounted smart display is made to recognize the operation blocks that are superimposed on each other, and display the augmented images corresponding to the operation blocks.

The effect of the present invention is that the operation blocks can be used by the user to perform operations placed in the placement slots and stacked on the operation blocks that have been placed on any of the placement slots, and the performed operations can be performed through the The head-mounted smart display presents an augmented image corresponding to any one of the operation blocks, or two or more of the operation blocks are superimposed on each other. In addition to providing diversified operations, users can perform more actions. In addition to the rehabilitation, the multimedia effect of augmented reality can also be provided at the same time, thereby improving the user's interest in operation, optimizing the overall operation experience of rehabilitation, so that the user can have a multiplicative effect when performing rehabilitation.

Referring to FIG. 2, it is an embodiment of a new smart interactive augmented reality hand fine motor rehabilitation system, which includes a head-mounted smart display 2 suitable for a user to wear, an information The substrate unit 3 connected to the head-mounted smart display 2, and an operation unit 4 suitable for the user to operate and perform rehabilitation actions. Among them, the head-mounted smart display 2 used in this embodiment can preferably use the HoloLens of Microsoft Corporation, but as long as the effect of receiving information and presenting augmented reality and virtual reality can be truly exerted, other equivalent equipment.

The substrate unit 3 includes a board body 31 defining a plurality of placement slots 310 , a plurality of sensors 32 respectively disposed in the placement slots 310 and connected to the smart head-mounted display 2 , and a sensor 32 connected to the A wireless communication module 33 that waits for the sensor 32 and is connected to the head-mounted smart display 2 for information. Specifically, the plate body 31 is preferably made of plastic material that is generally easy to shape, or wood that is easier to process, thereby simplifying the forming operation of the placement grooves 310 that may have various shapes. In addition, each of the sensors 32 can preferably be in the form of a proximity switch, a connector, an induction coil, etc., as long as it can generate a specific signal when triggered, and transmit it to the head-mounted device through the wireless communication module 33 Smart Display 2 is enough. The wireless communication module 33 is connected to the head-mounted smart display 2 through wireless network or bluetooth, so that the user can wear the head-mounted smart display 2 without the limitation of wires. Perform rehab movements freely.

It should be noted that, in order to make the smart head-mounted display 2 recognize the position of the substrate unit 3 in space, thereby ensuring the accuracy of the relative position between the displayed image and the actual board 31, in this implementation In the example, an exclusive identification code, preferably a two-dimensional barcode, is used for the head-mounted smart display 2 to read, thereby achieving mutual positioning of the initial relative positions.

Referring to FIG. 3 in conjunction with FIG. 2 , the operation unit 4 includes a plurality of operation blocks 41 placed in the placing slots 310 for operation and can be stacked on each other. Specifically, the operation blocks 41 can be manufactured as A variety of different shapes, thereby making the operation more diverse. Each operation block 41 has a main body 411 , an identification module 412 disposed on the main body 411 and used for identification by the head-mounted smart display 2 , and a trigger module 413 information connected to the identification module 412 . The identification module 412 is an ID (Identifier) chip, so that the operation blocks 41 of different shapes can correspond to different identification codes respectively.

As shown in FIG. 3 , the trigger module 413 has a first contact portion 416 for electrically connecting with any one of the sensors 32 , a first contact portion 416 electrically connected to the first contact portion 416 and the respective identification module the first circuit portion 417 of the group 412 , a second contact portion 418 disposed on a side opposite to the first contact portion 416 and used for electrical connection with the first contact portion 416 of the other operating block 41 , and A second circuit portion 419 electrically connected to the second contact portion 418 and the respective identification module 412 . The identification module 412 of each operation block 41 , and the first circuit portion 417 and the second circuit portion 419 of the trigger module 413 are embedded in the respective main body 411 to avoid influence The design of the shape of the body 411 also reduces the possibility of circuit wear due to operation. Wherein, the first contact portion 416 and the second contact portion 418 are substantially only arranged in different orientations, and through the first circuit portion 417 and the second circuit portion 419, respectively, It is interconnected with the corresponding identification module 412 . Thereby, any one of the operation blocks 41 and the other of the operation blocks 41 can be in contact with each other through the first contact portion 416 and the second contact portion 418, and then through the The first circuit portion 417 and the second circuit portion 419 connect the identification modules 412 of the operation blocks 41 to each other.

Referring to FIG. 4 in conjunction with FIGS. 2 and 3 , the trigger module 413 is used to trigger the corresponding sensor 32 to sense the individual identification module 412 when the main body 411 is placed in any of the placement slots 310 , so that the head-mounted smart display 2 recognizes the operation block 41 and displays the augmented image corresponding to the operation block 41 . Therefore, when performing the rehabilitation action of the hand, the hand is used to hold any of the operation blocks 41 to operate. If the operation block 41 is placed in any of the placement slots as shown in FIG. 4 , At 310 , the first contact portion 416 of the trigger module 413 of the operation block 41 is electrically connected to the sensor 32 in the placement slot 310 , thereby triggering the sensor 32 . At the same time, the identification code representing the operation block 41 in the identification module 412 of the operation block 41 will be transmitted to the head-mounted smart display through the wireless communication module 33 together with the information corresponding to the position of the placement slot 310 . 2. That is to say, the information transmitted to the head-mounted smart display 2 includes not only "the position of the placement slot 310 where the operation block 41 is placed", but also "which operation block 41 is placed in the placement slot 310" ". Accordingly, as long as the corresponding image data is preset in the head-mounted smart display 2 , the augmented image corresponding to the placed operation block 41 can be displayed at the position corresponding to the placement slot 310 .

For the aforementioned action of placing one of the operation blocks 41 in any of the placement slots 310, if the operation block 41 in a square shape is placed, the smart head-mounted display 2 can cooperate with the operation The shape of the block 41 presents, for example, an augmented image of a protruding wall of a city wall, or an augmented image of a brick of a city wall, and with the augmented image of the environment, the theme of building a building can be presented as a whole. Of course, if the operation blocks 41 of other shapes are placed, a more suitable augmented image can be designed according to the respective shapes. It should be noted that the augmented images and even the subject of building construction are only one form of implementation, and the specific implementation can match the shape of the operation blocks 41 and the plate body 31 . It is not limited to the type of the device, the surrounding environment when it is used, and even the preferences and needs of the rehabilitated person.

Referring to FIG. 5 in conjunction with FIGS. 2 and 3 , the trigger module 413 can also be used to interact with the other operation block when the main body 411 is stacked on the operation block 41 placed in any of the placement slots 310 . The identification module 412 of 41 is connected with information, thereby enabling the head-mounted smart display 2 to identify the operation blocks 41 that are superimposed on each other, and to display an augmented image corresponding to the operation blocks 41 . When the user stacks one of the operating blocks 41 on the operating block 41 already placed in any of the placing slots 310 , the first contact portion 416 of the operating block 41 located above , will contact with the second contact portion 418 of the already placed operation block 41 and generate electrical connection. Thereby, the identification modules 412 of the operation blocks 41 can be connected to each other, so that the information transmitted to the head-mounted smart display 2 through the wireless communication module 33 corresponds to the operation blocks 41 overlapping each other. information to be placed in the placement slot 310 .

If FIG. 5 continues the theme of building a building as shown in FIG. 4 as an example, assuming that the operating block 41 that is superimposed on the operating block 41 that presents a square is an operating block 41 that presents a quadrangular pyramid, in addition to the original square In addition to transforming the operation block 41 into an augmented image of the city wall image, an augmented image similar to a roof decoration can also be displayed on the operation block 41 corresponding to a quadrangular pyramid. In the case where the augmented images of the operation blocks 41 cooperate with each other, the user can perform a construction process similar to gradually constructing a complete building while performing the rehabilitation action, so that the rehabilitation process can be like a game. Richer and more fulfilling. Of course, it should be emphasized again that when the operation blocks 41 are stacked, the augmented image displayed in the head-mounted smart display 2 is also not limited to this.

It should be noted that, in this embodiment, the identification modules 412 of the operation blocks 41 are connected in series through the electrical connection generated after the operation blocks 41 are superimposed, and the corresponding The signal transmitted by the sensor 32 to the head-mounted smart display 2 achieves the purpose of identifying the operation blocks 41 arranged on the corresponding placement slot 310, so that the corresponding operation blocks 41 can be displayed according to the placement state of the operation blocks 41. augmented image. Therefore, through such an operation mechanism, in addition to stacking two of the operation blocks 41 as shown in FIG. 5 , even if three operation blocks 41 are stacked, the same principle and mechanism can be used. Especially in the case where the image recognition principle is not used to identify the operation blocks 41 in this embodiment, the situation that when the operation blocks 41 are superimposed at a high level, the relative rear is obscured and the identification is affected is avoided, which is more beneficial. Multiplexing the operation blocks 41 on the placement slots 310 according to the instructions of the therapist, or freely stacking the operation blocks 41 according to the user's creativity and thinking, in addition to optimizing the use experience, it is more beneficial for the therapist to follow the user's requirements. The rehabilitation process needs to be designed to fulfill the fundamental demands of effective rehabilitation.

To sum up, in the novel smart interactive augmented reality hand fine motor rehabilitation system, the operating blocks 41 are placed on the Any of the placement slots 310, or the action of stacking the operation blocks 41, can display the corresponding augmented image through the head-mounted smart display 2, and provide augmentation while the user actually performs the rehabilitation action. The multimedia effect of augmented reality improves the user's interest in operation through a game-like mechanism, optimizes the overall operation experience of rehabilitation, and enables the user to have a multiplicative effect when performing rehabilitation. Therefore, the purpose of this new model can indeed be achieved.

However, the above are only examples of the present invention, which should not limit the scope of the present invention. Any simple equivalent changes and modifications made in accordance with the scope of the patent application for this new model and the contents of the patent specification are still within the scope of the present invention. within the scope of this new patent.

2: Head-mounted smart display 3: Substrate unit 31: Board body 310: Placement slot 32: Sensor 33: Wireless communication module 4: Operation unit 41: Operation block 411: Ontology 412: Identify the module 413: Trigger Module 416: First Contact 417: First Circuit Department 418: Second Contact 419: Second Circuit Department

Other features and effects of the present invention will be clearly presented in the embodiments with reference to the drawings, wherein: 1 is an exploded perspective view illustrating a conventional rehabilitation device for hand rehabilitation; FIG. 2 is a system configuration diagram illustrating an embodiment of the novel intelligent interactive augmented reality hand fine motor rehabilitation system; 3 is a schematic diagram illustrating any operation block of an operation unit of the present embodiment, and a situation in which the operation block is disposed on a substrate unit of the embodiment; FIG. 4 is a schematic diagram illustrating a situation in which any operation block is placed on a plate body of the base plate unit; and FIG. 5 is a schematic diagram illustrating a situation in which any operation block is placed on another operation block.

2: Head-mounted smart display

3: Substrate unit

31: Board body

310: Placement slot

32: Sensor

33: Wireless communication module

4: Operation unit

41: Operation block

Claims (9)

A smart interactive augmented reality hand fine motor rehabilitation system, including: A head-mounted smart display; a substrate unit, comprising a board body defining a plurality of placement slots, and a plurality of sensors disposed on the board body and corresponding to the placement slots respectively and connected to the head-mounted smart display information; and An operation unit, comprising a plurality of operation blocks placed in the placing slots for operation and can be stacked on each other, each operation block has a body, an identification module disposed on the body and used for identification by the head-mounted smart display, a trigger module, the information is connected to the identification module, and is used to trigger the corresponding sensor to sense the respective identification module when the main body is placed in any of the placement slots, so as to make the head wear The smart display recognizes the operation block and displays the augmented image corresponding to the operation block; it is also used to compare the operation block with the other operation block when the body is stacked on the operation block that has been placed in any of the placement slots. The information connection of the identification module enables the head-mounted smart display to identify the operation blocks that are superimposed on each other, and to display an augmented image corresponding to the operation blocks. The smart interactive augmented reality hand fine motor rehabilitation system according to claim 1, wherein the sensors of the substrate unit are respectively disposed in the placement slots. The intelligent interactive augmented reality hand fine motor rehabilitation system according to claim 1, wherein the trigger module of each operation block of the operation unit has an electrical circuit for connecting with any one of the sensors. A first contact portion connected, a first circuit portion electrically connected to the first contact portion and the respective identification module, a side disposed opposite to the first contact portion and used for operation with another The first contact portion of the block is electrically connected to a second contact portion, and a second circuit portion is electrically connected to the second contact portion and the respective identification module. The smart interactive augmented reality hand fine motor rehabilitation system according to claim 3, wherein the first circuit part and the second circuit part of the trigger module of each of the operation blocks are embedded in in the individual said ontology. The intelligent interactive augmented reality hand fine motor rehabilitation system according to claim 1, wherein the identification module of each operation block of the operation unit is embedded in the individual body. The intelligent interactive augmented reality hand fine motor rehabilitation system according to claim 1, wherein the identification module of each operation block of the operation unit is an ID chip. The smart interactive augmented reality hand fine motor rehabilitation system according to claim 1, wherein the operation blocks of the operation unit have different shapes, and the recognition modules of the operation blocks correspond to in the shape described. The smart interactive augmented reality hand fine motor rehabilitation system according to claim 1, wherein the substrate unit further comprises a wireless communication module connected to the sensors and informationally connected to the head-mounted smart display Group. The smart interactive augmented reality hand fine motor rehabilitation system according to claim 8, wherein the wireless communication module of the base unit communicates with the head-mounted smart display information through a wireless network or bluetooth connect.

Images