TWI759000B - Method for testing and training concentration and memory utilizing augmented reality equipment - Google Patents

Abstract

The present invention provides a method for testing and training concentration and memory utilizing augmented reality equipment. The augmented reality equipment includes a memory, a display, and a camera that are controlled by a processor. The method includes: Step S1: displaying a question picture by the augmented reality equipment, the question picture corresponding to an answer picture; Step S2: taking a real time environment image by the camera of the augmented reality equipment; Step S3: aligning the camera of the augmented reality equipment with and capturing a selected picture from the real time environment image; Step S4: determining if the selected picture is the same as the answer picture by the processor of the augmented reality equipment; and Step S5: calculating scores based on a determination result of step S4.

Description

Methods of using augmented reality equipment to test and train concentration and memory

The present invention relates to a method for training concentration and memory, especially a method for training concentration and memory by using augmented reality equipment combined with interactive picture cards.

Augmented Reality (AR), sometimes corresponding to the term "Virtual Reality" (VR), is translated as "Virtual Reality". Specifically, augmented reality technology refers to a technology that allows the virtual world on the screen to be combined and interacted with the real world scene through the calculation of the position and angle of the camera image and the addition of image analysis technology. Such a technique was first proposed in 1990. With the improvement of the computing power of portable electronic products, the use of augmented reality has become more and more extensive.

Augmented reality can achieve the feeling of unity of human, machine, and environment (environment), and readers will no longer be limited to virtual operations. Therefore, applications such as designing situational games and conducting activity tours using augmented reality technology have received great attention. On the other hand, video games (especially puzzle games) can train people's brains and limbs, and make people dexterous.

However, so far, people's application of video games is often only focused on the game itself, and there is no video game, especially an augmented reality situational game, which aims to develop a systematic evaluation of people's intelligence or health status. test or train. Also, there are no testing or training programs, After testing or training, the test data can be uploaded to the cloud platform, and the elderly or patients can be restored to their previous ingenuity through Big Data analysis, combined with rehabilitation science and statistics. Therefore, video games do have a lot of room for development in this regard.

In view of this, according to an aspect of the present invention, a method for testing and training concentration and memory by using an augmented reality device is proposed. The augmented reality device includes a memory and a display controlled by a processor. , and a camera, the method comprising: step S1 : displaying a question graph by the display of the augmented reality device, the question graph corresponding to a positive solution graph; step S2 : by the camera of the augmented reality device to shoot a real-time environment image; Step S3: align the camera of the augmented reality device to capture a response graphic of the real-time environment image; Step S4: determine the image by the processor of the augmented reality device Whether the answer pattern is equal to the correct answer pattern; and Step S5: Scoring based on the judgment result of Step S4.

Optionally, or preferably, in the method of the present invention, the augmented reality device is a smart phone, a tablet computer, or a notebook computer.

Optionally, or preferably, in the method of the present invention, in step S1, the display only displays the title graphic within a first time interval, and the first time interval is greater than 0 seconds and less than 24 seconds; or, In step S2, the camera only captures the real-time environment image within a second time interval, and the first time interval is greater than 0 seconds and less than 180 seconds.

Optionally, or preferably, in the method of the present invention, the processor of the augmented reality device includes an image correction module, the image correction module is configured to respond to the real-time environmental image Graphics are geometrically corrected.

Optionally, or preferably, in the method of the present invention, the camera of the augmented reality device is disposed on a photographing plane, and the camera of the augmented reality device is configured to capture the real-time environment A reference plane on which the answering figure is placed in the image, and the image correction module is configured to perform geometric correction on the answering figure according to the included angle between the photographing plane and the reference plane.

Optionally, or preferably, in the method of the present invention, the processor of the augmented reality device is configured to store a problem graph group, including a plurality of problem graphs, and a positive solution graph group, including a plurality of problem graphs. There are positive solution graphics, and the positive solution graphics are made into a plurality of graphics cards as candidates for a plurality of answer graphics.

Optionally, or preferably, in the method of the present invention, the positive solution graphics of the positive solution graphics group are generally recognized by users to belong to a real object category, and the real object category is a sports event category or a food category.

Optionally, or preferably, in the method of the present invention, the color and/or brightness of each image card is similar to or compared with the color and/or brightness of the real-time environmental image; the method further includes: Step S6: adding the points, the color and/or brightness of the picture card as the answering graphic, and the color and/or brightness of the real-time environmental image are recorded as a test result data set.

Optionally, or preferably, in the method of the present invention, in step S1, the display of the augmented reality device further displays a plurality of question graphics in time sequence or spatial arrangement, and the questions The graph corresponds to a plurality of correct solution graphs; in step S3, the camera of the augmented reality device is made to sequentially align and capture a plurality of answering graphs, or align and capture a plurality of arranged answering graphs for answering .

Optionally, or preferably, in the method of the present invention, in step S4, the processor of the augmented reality device judges whether the response graphics are arranged in time sequence or spatial arrangement is equivalent to the Some correct graphs.

The accompanying drawings and detailed descriptions will hereinafter make other objects, advantages, and novel features of the present invention more apparent.

S1~S5: Steps

U1~U8: Steps

W1~W8: Steps

T1: Judgmental

FIG. 1 shows a flow chart of a method of a first embodiment of the present invention.

FIG. 2 shows a chart of golf equipment in a second embodiment of the present invention.

3A to 3J show the screen of the mobile phone in the second embodiment of the present invention.

FIG. 4 shows a schematic diagram of levels of different colors in the second embodiment of the present invention.

FIG. 5 shows a flow chart of operations in the second embodiment of the present invention.

FIG. 6 shows a fruit and vegetable image card in a third embodiment of the present invention.

7A to 7L show the screen of the mobile phone in the third embodiment of the present invention.

FIG. 8 shows a schematic diagram of levels of different colors in the third embodiment of the present invention.

FIG. 9 shows a flow chart of operations in the third embodiment of the present invention.

Various embodiments of the present invention are provided below. These embodiments are used to illustrate the technical content of the present invention, but not to limit the scope of the right of the present invention. A feature of one embodiment can be applied to other embodiments by suitable modification, substitution, combination, isolation.

It should be noted that, in this document, unless otherwise specified, having "a" element is not limited to having a single such element, but may include one or more such elements.

In addition, in this document, unless otherwise specified, ordinal numbers such as "first" and "second" are only used to distinguish multiple elements with the same name, and do not mean that there is a rank, hierarchy, or execution order among them , or process sequence. A "first" element and a "second" element may appear together in the same component or separately in different components. The presence of an element with a higher ordinal number does not necessarily imply the presence of another element with a lower ordinal number.

In this article, unless otherwise specified, the so-called feature A "or" (or) or "and/or" (and/or) feature B, refers to the existence of nail alone, the existence of B alone, or the coexistence of A and B ; The so-called feature A "and" (and) or "and" (and) or "and" (and) feature B, is that nail and B exist at the same time; the so-called "include", "include", "have", " "Contain" means including but not limited to.

In addition, in this document, the so-called "upper", "lower", "left", "right", "front", "rear", or "between" and other terms are only used to describe the relationship between multiple elements. Relative position, and can be generalized to include translation, rotation, or mirroring.

Furthermore, herein, unless specifically stated otherwise, "an element is on another element" or the like does not necessarily mean that the element is in contact with the other element.

Furthermore, herein, "preferred" or "better" is used to describe optional or additional elements or features, ie, those elements or features are not required and may be omitted.

In addition, unless otherwise specified herein, the so-called "adapted" or "suitable" for another element means that the other element is not part of the subject matter of the application, but is exemplified or referred to nature helps to envisage the nature or application of the element; similarly, in this paper, except in particular Unless otherwise specified, the so-called "suitable" or "suitable" for a configuration or an action of an element describes the characteristics of the element, and does not mean that the configuration has been set or the action has been performed.

In addition, in this document, terms such as "system", "equipment", "device", "module", or "unit" refer to an electronic component or a digital circuit composed of a plurality of electronic components, an analog circuits, or other broader circuits, and they do not necessarily have a hierarchical or hierarchical relationship unless otherwise specified.

In addition, in this document, unless otherwise specified, the electrical connection of the two elements may include direct connection or indirect connection. In an indirect connection, one or more other elements, such as resistors, capacitors, or inductors, may exist between the two elements. Electrical connections are used to transmit one or more signals, such as DC or AC current or voltage, depending on the application.

In addition, both the terminal or the server may include the above-mentioned components, or be implemented in the above-mentioned manner.

Furthermore, herein, unless otherwise specified, a numerical value may encompass a range of ±10% of the numerical value, particularly a range of ±5% of the numerical value. Unless otherwise specified, a numerical range is composed of subranges defined by the lower endpoint, lower quartile, median, higher quartile, and higher endpoint .

Additionally, certain drawings of the present invention are drawn in color to more clearly present the general disclosure, as color is a factor of analysis in the present invention.

The method for testing and training concentration and memory by using an augmented reality device of the present invention can be implemented as computer software, the development environment of which is Microsoft Windows 10, and the development tool is Unity, but not limited to this, other development environments or Tools are developed to implement the present invention. The present invention can be further realized In order to read the recording medium or computer program product, it is loaded into a computer, such as a personal computer, tablet computer, or mobile phone, and is executed with an operating system such as Windows, Android, and iOS as an application platform.

first embodiment

FIG. 1 shows the flow of the first embodiment of the present invention. The augmented reality device used in the first embodiment includes a memory, a display, and a camera controlled by a processor. In addition, the augmented reality device of the present invention may be a smart phone (such as the second embodiment and the third embodiment), a tablet computer, or a notebook computer, but is not limited thereto.

The processor of the augmented reality device stores a problem graph group, which includes a plurality of problem graphs, for example: in the second embodiment described below, it is a spherical graph; and a positive solution graph group includes a plurality of positive solution graphs. These positive solution graphs are made into a plurality of graph cards, which are candidates for a plurality of answer graphs. For example, in the second embodiment described below, the specific graph cards are ball equipment.

In addition, the processor of the augmented reality device of the present invention may include an image correction module. In step S3, the camera of the augmented reality device is aligned to capture the response graph of the real-time environment image, if the response graph is offset , rotation, or distortion occurs, the image correction module can perform geometric correction on the response graphics of the real-time environmental image. As an example, the camera is set on a photographing plane, the camera of the augmented reality device is configured to capture the reference plane on which the response figure is placed in the real-time environmental image, and the calibration module is based on the angle between the photographing plane and the reference plane. Geometric correction of the answer graph.

The first embodiment is a method for testing and training concentration and memory by using an augmented reality device, which mainly includes the following steps: Step S1: Display a question graph on the display of the augmented reality device, and the question graph corresponds to A positive solution graph; in one embodiment, step S1 can define a first time interval, and the display only displays the question graph in the first time interval, and the first time interval is greater than 0 seconds and less than 24 seconds; Step S2: a real-time environmental image is captured by the camera of the augmented reality device; in one embodiment, a second time interval may be defined in step S2, and the camera only captures the real-time environmental image within the second time interval, and the first 2. The time interval is greater than 0 seconds and less than 180 seconds; Step S3: align the camera of the augmented reality device to capture a response graphic of the real-time environmental image; Step S4: determine whether the response graphic is by the processor of the augmented reality device It is equivalent to the positive solution figure; the answer figure is equivalent to the positive solution figure, which is "correct answer", otherwise it is "wrong answer"; and step S5: Scoring based on the judgment result of step S4.

On the other hand, medical research believes that color and/or brightness matching the user's environment is an important visual stimulus for the user, so the impact of color and/or brightness changes on the user's response will also be an analytical factor that can be explored in subsequent studies. Accordingly, the method of the present invention may further include step S6 : recording the score, the color and/or brightness of the image card as the answering graphic, and the color and/or brightness of the real-time environmental image into a test result data set.

Second embodiment (test training on sustained concentration)

The second embodiment specifically describes the method described in the first embodiment of the present invention through the "ball pairing" test. The following will explain in detail how the steps of the first embodiment of the present invention are applied to the aspect of "ball pairing". It should be noted that the second embodiment is described in conjunction with the method of the first embodiment, which is essentially a method of operating an application program for testing or training. For the convenience of description, the term "test program" will be used below. The application, and the participants participating in the test program are denoted by the term "user".

FIG. 2 shows a golf equipment chart of the second embodiment of the present invention. As shown in FIG. 2 , the user's scene first prepares picture cards of various ball sports equipment. In one embodiment, baseball, basketball Cards for ball, bowling, soccer, badminton, and billiards. Of course, more other balls can also be prepared. In addition, each type of card is prepared in four different colors: gray, red, blue, and green. These golf equipment picture cards are candidates for the answering pattern, and the user can select a picture card as the answering pattern.

Next, FIG. 3A to FIG. 3J show the screen of the mobile phone according to the second embodiment of the present invention, as the description of different operation steps in the test program. In the second embodiment, the augmented reality device is a smart phone (as shown in FIG. 3A ). When the user starts the test program, the screen of the mobile phone is as shown in FIG. 3A .

After selecting to enter the program, as shown in Figure 3B, there is a teaching animation of the test program in the test program to provide user operation instructions. Hereinafter, FIGS. 3C to 3J will also describe the operation of the second embodiment in detail.

As shown in FIG. 3C, the second embodiment may have four levels, a general level, a red level, a blue level, and a green level. Among them, only red question graphics are provided in the red level, and the corresponding answer graphics that users need to provide are also red graphics cards. Similarly, only blue question graphics are provided in the blue level, and the corresponding answer graphics that the user needs to provide are also blue graphics cards. Response graphics are also green graphics cards. In general levels, gray, red, blue, and green question graphics will appear randomly. Users need to provide corresponding answer graphics according to the color of the question graphics. Among them, FIG. 4 is a schematic diagram of different color levels in the second embodiment. Provides levels of different colors, allowing users to train under different color stimuli. Figures 3D to 3J are examples of general levels.

In addition, each level can further include: easy level, medium level, and difficult level. In one embodiment, the easy level, the medium level, and the hard level are performed sequentially.

Easy Level 10 Questions

In the simple level, the main types of balls that appear in the test program will be mainly balls with large differences in appearance, such as: badminton, football, and baseball. After starting, one of the balls of "Badminton, Soccer, Baseball" will appear randomly on the screen. This step corresponds to step S1 of the first embodiment.

The user selects the corresponding picture card for the balls that appear, and takes pictures with the mobile phone for scanning and pairing. Referring to the examples in FIGS. 3D to 3E , the screen of the mobile phone displays the question graphic "Badminton", and the user selects the answer graphic "Badminton Racket" in the graphic card for pairing. The above-described steps correspond to steps S2 to S3 of the first embodiment.

After the pairing is completed, the mobile phone will make a graphic judgment of the answer. If the scanning pairing is correct, one point (+1) will be added to the "correct score", and you will go directly to the next question, as shown in Figure 3F. If the scanning pairing is wrong, one point (+1) will be added to the "Error Score", and you will go directly to the next question, as shown in Figure 3G. It is worth mentioning that no matter whether the answer is correct or not, the corresponding message will be displayed on the mobile phone screen, and the instruction message "Please put down the card at hand" is displayed, as shown in Figure 3H, so that the user has time to clear the action at hand to carry out. next topic. The above-mentioned steps correspond to steps S4 to S5 of the first embodiment.

There are 10 questions in the simple level, and the time is 3 minutes. After the 10 questions are answered or the 3 minutes is over, the rest page will be followed, as shown in Figure 3I. On the rest page, the user can adjust and then proceed to the intermediate level. The 3 minutes here is the time setting of the test program for the level, that is, the second time interval in the first embodiment.

Intermediate level 10 questions

In the intermediate level, the main types of balls in the test program will be balls with small differences in appearance (or similar colors), such as bowling, billiards, basketball. After entering the intermediate level, one of the balls "Bowling, Billiards, Basketball" will appear randomly on the screen of the mobile phone.

For the balls that appear, the user selects the corresponding image card for scanning and pairing, and the mobile phone takes pictures for scanning and pairing.

After the pairing is completed, the mobile phone will make a graphic judgment of the answer. If the scanning pairing is correct, one point (+1) will be added to the "correct score", and one point will be added to the next question; Go directly to the next question, 10 questions in total. Regardless of whether the answer is correct or not, the corresponding message will be displayed on the screen of the mobile phone, and the instruction message "Please put down the picture card at hand" will be displayed, so that the user has time to free the action at hand to proceed to the next question.

There are 10 questions in the intermediate level, and the time is 3 minutes. After completing the answers to the 10 questions or finishing the 3 minutes, it will proceed to the break page, as shown in Figure 3J. On the rest page, the user can adjust by himself and then proceed to the difficulty level.

10 difficult levels

In the hard level, the test program will randomly appear all kinds of balls. For example: badminton, football, baseball, bowling, billiards, basketball one of the balls.

For the balls that appear, the user selects the corresponding image card for scanning and pairing, and the mobile phone takes pictures for scanning and pairing.

After the pairing is completed, the mobile phone will make a graphic judgment of the answer. If the scanning pairing is correct, one point (+1) will be added to the "correct score", and one point will be added to the next question; Go directly to the next question, 10 questions in total. Regardless of whether the answer is correct or not, the corresponding message will be displayed on the mobile phone screen.

Next, please refer to FIG. 5 . Corresponding to the above, FIG. 5 shows an operation flowchart of the second embodiment of the present invention. Fig. 5 summarizes the flow of the above-mentioned second embodiment and describes it as follows: Step W1: enter from the home page, and start the test; Step W2: Play the test program teaching video; Step W3: Select any level among the general level, red level, blue level, and green level; Step W4: Start the test; Step W5: The simple level lasts for 3 minutes, with a short break; W6: Moderate level lasts 3 minutes with a short break; Step W7: Hard level lasts 3 minutes; and Step W8: After the test is over, the scores are uploaded to the cloud platform.

When the test is over, optionally, the screen jumps directly back to the home page to start a new test.

The third embodiment (test training on memory)

The third embodiment specifically describes the method described in the first embodiment of the present invention through the "remembering fruits and vegetables" test. The following will explain in detail how the steps of the first embodiment of the present invention are applied to "remembering fruits and vegetables". It should be noted that the third embodiment is a description of the method in conjunction with the first embodiment, which is essentially a method of operating an application program for testing or training. For the convenience of description, the term "test program" will be used below. The application, and the participants participating in the test program are denoted by the term "user".

FIG. 6 shows a fruit and vegetable image card according to a third embodiment of the present invention. As shown in Fig. 6, the user's scene first prepares picture cards with various fruits and vegetables. As shown in Figure 6, in one embodiment, red apples, strawberries, cherries, lotus mist, lychees, and wolfberry are prepared; purple onions, grapes, cabbage, blueberries, mulberries, and cauliflower; , guava, cantaloupe, watermelon, green pepper and other picture cards. In addition, the prepared picture cards are divided into three colors: red, purple, and green according to the actual color of each vegetable and fruit. (Of course, if the number of samples of any kind is small, the color categories of some fruits and vegetables can also be changed if necessary. Example: changing cabbage from green to purple). These fruit and vegetable picture cards are candidates for the answering pattern, and the user can select a picture card as the answering pattern.

Next, FIG. 7A to FIG. 7L show the screen of the mobile phone according to the third embodiment of the present invention, as an illustration of different steps in the test. In the third embodiment, the augmented reality device is a smart phone (as shown in FIG. 7A ). When the user starts the test program, the screen of the mobile phone is as shown in FIG. 7A .

After selecting to enter the test, as shown in FIG. 7B , there is a teaching animation of the test program in the test program to provide the user with an explanation of how to operate the test. Hereinafter, FIGS. 7C to 7L will also describe the operation of the third embodiment in detail.

As shown in FIG. 7C , the third embodiment may have four levels, a general level, a red level, a purple level, and a green level. Among them, the general level is that three colors of fruits and vegetables appear randomly, the red level only appears red vegetables and fruits, the green level only appears green vegetables and fruits, and the purple level only appears purple vegetables and fruits. 8 is a schematic diagram of levels of different colors in the third embodiment. Provides levels of different colors, allowing users to train under different color stimuli. FIG. 7D to FIG. 7L take a general level as an example.

In addition, each level can further include: easy level, medium level, and difficult level. In one embodiment, the easy level, the medium level, and the hard level are performed sequentially.

Easy Level 5 Questions

After entering the level, first go to the simple level. The simple level has only one fruit and vegetable to memorize, and the user has 4 seconds of memory time. That is, the question graphic is displayed in the circle in the center of FIG. 7D for 4 seconds. 7D and 7E, the question image in Fig. 7D is an onion. After the memory time expires, the vegetable and fruit image on the screen disappears, and the user scans the corresponding answer image, such as the onion vegetable and fruit image card in Fig. 7E. After scanning is completed, click the position where the question graphic appears on the screen to perform pairing, as shown in Figure 7F. The above steps are corresponding to the steps S1 to S3 of the first embodiment, and the above-mentioned memory time is the first time interval.

After the pairing is completed, the mobile phone will make a graphic judgment of the answer. If the scanning pairing is correct, one point (+1) will be added to the "correct score", and you will go directly to the next question, as shown in Figure 7G. If the scan is incorrectly matched, one point (+1) will be added to the "Error Score", and you will go directly to the next question. It is worth mentioning that no matter whether the answer is correct or not, the corresponding message will be displayed on the mobile phone screen, and the instruction message "Please put down the card at hand" is displayed, as shown in Figure 7H, so that the user has time to clear the action at hand to carry out. next topic. The above-mentioned steps correspond to steps S4 to S5 of the first embodiment.

There are 5 questions in the simple level, and each question has 4 seconds of memory time. After completing the answers to the 5 questions, the rest page will be followed, as shown in Figure 7I. On the rest page, the user can adjust and then proceed to the intermediate level.

Intermediate Level 5 Questions

The medium level has three fruits and vegetables and three different positions to memorize, and the user has 12 seconds of memorization time. That is, the three circles in Fig. 7J respectively display the topic graphics for 12 seconds. The topic graphs in Figure 7J are, from top to bottom, watermelon, cauliflower, and green pepper. When the memory time expires, the vegetable and fruit graphics on the screen disappear, and the user scans the corresponding answering graphics. After scanning, click on the corresponding position of the question graphic on the screen to match.

After the pairing is completed, the mobile phone will make a graphic judgment of the answer. If the scanning pairing is correct, one point (+1) will be added to the "correct score", and you will go directly to the next question. If the scan is incorrectly matched, one point (+1) will be added to the "Error Score", and you will go directly to the next question.

There are 5 questions in the intermediate level, and each question has 12 seconds of memory time. After completing the answers to the 5 questions, the rest page will be followed, as shown in Figure 7K. On the rest page, the user can adjust by himself and then proceed to the difficulty level.

Difficult level 5 questions

The difficult level has six fruits and vegetables and six different positions to memorize, and the user has 24 seconds to memorize. That is, the six circles in FIG. 7L each display the title graphic for 24 seconds. The six topic graphics in FIG. 7L are, from left to right and top to bottom, apple, onion, strawberry, cantaloupe, and kiwi (the last figure is not shown). When the memory time expires, the vegetable and fruit graphics on the screen disappear, and the user scans the corresponding answering graphics. After the scan is completed, click the corresponding position of the question graphic on the screen to perform a paired scan.

After the pairing is completed, the mobile phone will make a graphic judgment of the answer. If the scanning pairing is correct, one point (+1) will be added to the "correct score", and you will go directly to the next question. If the scan is incorrectly matched, one point (+1) will be added to the "Error Score", and you will go directly to the next question.

There are 5 questions in the difficulty level, and each question has a memory time of 24 seconds. After completing the answers at the difficulty level, the test is completed.

In the third embodiment, when the question graph does not match the answer graph, an error will be displayed on the screen, and the question graph will reappear for 2 seconds, allowing the user to re-memorize and then re-answer.

Next, please refer to FIG. 9 . FIG. 9 shows an operation flow chart of the third embodiment of the present invention. Corresponding to the description of the above-mentioned third embodiment, FIG. 9 summarizes the above-mentioned process and describes it as follows: Step U1: enter from the home page, start the test; Step U2: play the test teaching video; Step U3: select the general level, the red level, and the purple level , any of the green levels; Step U4: Start the test; Step U5: Perform the simple level, in which the user has a memory time of 4 seconds; Step U6: Perform the medium level, in which the user has a memory time of 12 seconds; Step U7: Perform the difficult level , the user in the difficulty level has 24 seconds of memory time; and Step U8: After the test is over, the score is uploaded to the cloud platform.

When the test is over, optionally, the screen jumps directly back to the home page to start a new test.

In addition, the in-level judgment mechanism of the third embodiment is shown in the lower part of FIG. 9 . After answering the first question, the judgment formula T1 is performed: image card scanning. Wherein, if the judgment result is correct, the second question will be performed. If the judgment result is wrong, the screen will display the question graph for 2 seconds, and the user will answer the first question again.

In addition, the development of the test program in the second embodiment and the third embodiment may have different considerations according to different objects of use. For example, based on human factors engineering considerations, you can consider the contrast of the screen, the size of the text, the size of the pattern screen (as shown in Figure 3D or Figure 7E), the feedback after touch (such as the screen and sound effects when the answer is correct or incorrect), intuitive Operation and other aspects have been adjusted. In addition, in the above-mentioned second embodiment and third embodiment, the straight screen is used as an example, according to which the user is easier to operate, and it is not easy to block the lens during the operation. Of course, if done properly, it can also be done in landscape mode.

Through the specific description of the second embodiment and the third embodiment above, it should be further explained that, in step S1 of the first embodiment, the displays of the augmented reality device are arranged in time sequence or spatially to display multiple topic graphics. For example, in the second embodiment, badminton (FIG. 3D) is displayed first, and baseball (not shown) may be displayed next time, which is in chronological order. For another example, FIG. 7J of the third embodiment shows watermelon, cauliflower, and green pepper from top to bottom, which is a spatially arranged display.

According to the above, in step S3 of the first embodiment, the camera of the augmented reality device sequentially aligns and captures a plurality of answering patterns, or aligns and captures a plurality of arranged answering patterns for answering; and step In S4 , the processor of the augmented reality device determines whether the answering graphs are arranged in time sequence or spatially, and are equal to the correct solution graphs. In the second embodiment and the third embodiment, the camera may be fixed and the answer pattern may be moved for scanning, but it is not limited to this, and the answer pattern may be fixed and the camera may be moved for scanning. .

To sum up, the present invention provides a method for testing and training concentration and memory by using an augmented reality device through various embodiments, which can use the augmented reality device to allow users to experience the integration of human, machine and environment feeling. Through testing and training with augmented reality equipment, users can improve their concentration and memory. The augmented reality device of the present invention can be combined with a big data platform to analyze the information obtained by the user after testing, so that it can not only provide researchers with in-depth research, but also combine rehabilitation science and statistics to further help Patients with concentration and memory impairments recovered.

Although this invention has been described in terms of several embodiments, it should be understood that many other possible modifications and changes can be made without departing from the spirit of the invention and the claimed scope of the invention.

S1~S5: Steps

Claims (9)

A method for testing and training concentration and memory by using an augmented reality device, the augmented reality device comprising a memory, a display, and a camera controlled by a processor, the method comprising: Step S1: A problem graph is displayed by the display of the augmented reality device, and the problem graph corresponds to a positive solution graph, wherein the display of the augmented reality device further displays a plurality of time sequence or spatial arrangement problem graphs, the problem graphs correspond to a plurality of positive solution graphs; step S2: shoot a real-time environment image by the camera of the augmented reality device; step S3: align the camera of the augmented reality device and Capturing an answering graphic of the real-time environmental image, and aligning the camera of the augmented reality device sequentially and capturing a plurality of answering graphics, or aligning and capturing a plurality of answering graphics arranged in sequence, to answer; step S4: Determine by the processor of the augmented reality device whether the answering graph is equal to the correct solution graph; and Step S5: Scoring based on the judging result of Step S4. The method of claim 1, wherein the augmented reality device is a smart phone, a tablet computer, or a notebook computer. The method according to claim 1, wherein, in step S1, the display only displays the title graphic within a first time interval, and the first time interval is greater than 0 seconds and less than 24 seconds; or, in step S2, the The camera only captures the real-time environmental image within a second time interval, and the first time interval is greater than 0 seconds and less than 180 seconds. The method of claim 1, wherein the processor of the augmented reality device includes an image correction module, and the image correction module is configured to perform geometric correction on the response graphic of the real-time environmental image. The method of claim 4, wherein the camera of the augmented reality device is disposed on a photographic plane, and the camera of the augmented reality device is configured to capture placing the response in the real-time environmental image A reference plane of the figure, the image correction module is configured to perform geometric correction on the response figure according to the included angle between the photographing plane and the reference plane. The method of claim 1, wherein the processor of the augmented reality device is configured to store a problem graph group, including a plurality of problem graphs, and a positive solution graph group, including a plurality of positive solution graphs, the These positive solution graphs are made into multiple graph cards as candidates for multiple answer graphs. The method according to claim 6, wherein the correct solution graphics of the correct solution graphics group belong to a real object category in general users' cognition, and the real object category is a sports event category or a food category. The method according to claim 7, wherein the color and/or brightness of each image card is similar to or compared with the color and/or brightness of the real-time environmental image; the method further comprises: step S6: scoring as the answer The color and/or brightness of the graphic card, and the color and/or brightness of the real-time ambient image of the graphics are recorded as a test result data set. The method according to claim 1, wherein, in step S4, the processor of the augmented reality device determines whether the answering graphs are temporally or spatially arranged to be equal to the correct solution graphs.

Images