JP2021108068A - Device, method, and program for processing information - Google Patents

Abstract

To provide an information processing device which assess a cognitive function of a user using a measurement result of movement made by a user to search for a second point without a mark from a first point.SOLUTION: An information processing device comprises reception means configured to acknowledge motion of a user, presentation means configured to present the user with a three-dimensional image according to the motion, and determination means configured to assess a cognitive function of the user by measuring movement made by the user to search for a second point without a mark from a first point.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing device, an information processing method, and an information processing program.

Patent Document 1 includes an application execution unit that executes a stereoscopic vision program for generating a left-eye image and a right-eye image corresponding to the left and right eyes of the observer, and the application execution unit. An information processing terminal provided with a display unit that displays the left-eye image and the right-eye image generated by the stereoscopic vision program at locations corresponding to the left and right eyes, and a user interface that accepts user operations. It is an early detection / prevention program for early detection or prevention of mild dementia by using the early detection / prevention program, in which the information processing terminal is connected to the left eye image and the right eye image. A stereoscopic image generation step for generating a stereoscopic image area for displaying a stereoscopic image configured by generating a convergence angle and a parallax between them, and a stereoscopic image generation step.
A plurality of objects whose positions or orientations change in the virtual space constructed in the stereoscopic image area are displayed, and the plurality of objects can be arbitrarily arranged around an arbitrary center of gravity position installed in the virtual space. The time difference between the object operation step that rotates at a speed and changes the color of the object at an arbitrary timing and time length, the timing and time length that the color of the object changes, and the user operation with respect to the user interface, and the user. It discloses an early detection / prevention program for mild dementia characterized by performing a process including a cognitive ability measurement step that records the accuracy of the operation as a test result of spatial cognitive ability and situational judgment ability. ..

Patent Document 2 describes an image display means for presenting a virtual space to the observer's eyes, a viewpoint detection means for detecting the viewpoint position of the observer in a real space, and the virtual space displayed on the image display means. It has a virtual space image generation means for generating an image, and the virtual space image generation means has a first reference position in the real space and the first reference position corresponding to the position of a display object in the virtual space. The defined range is between the second reference position set to the predetermined reference distance from the above, and the display in the virtual space according to the distance between the viewpoint position and the first reference position within the defined range. The size of the object is changed by a predetermined function, and the function is a monotonous increase in a broad sense with respect to the decrease in the distance, and is a section within the defined range, and the change in the size in the section is the said. The display object is a horizontally arranged map having a section larger than the change of the inverse number of the distances, and the virtual space image generation means is said to have a section corresponding to the vertical movement distance of the viewpoint position. A virtual space display device characterized by changing the size of the map formed in the virtual space is disclosed.

Patent Document 3 has an object of providing a computer-generated 3D virtual environment for improving memory (for example, spatial memory, temporal memory, space-time memory, work memory, and short-term memory), and within a searchable 3D environment. A step of executing at least one VR memory training module containing one or more memory training tasks performed in, a step of displaying a 3D environment via output to a display, and a step of receiving input from an interactive search controller. The method can further include performing one or more scans of brain activity, thereby increasing the effectiveness of at least one VR memory training module targeting a region of the brain. The determination of which VR memory training module can be elicited and executed can be based on the measured effectiveness of previous VR memory training module training sessions targeting selected areas of the brain. It is disclosed that it can be done.

Patent Document 4 enables users, medical personnel, teachers, and parents to target, personalize, and manage cognitive skill development, targeting cognitive skills underlying executive functions. Featuring a game-based virtual learning curriculum for development, methods and systems include cognitive skills (eg, attention concentration, attention retention, cognitive suppression, behavioral suppression, selective attention, convertible attention, distributiveness). It provides an effective and rapid video game-based training curriculum that improves attention, interference control, novelty suppression, satisfaction delay tolerance, inner voice, motivation suppression, and self-control). ) Each cognitive process underlying attention control and impulse suppression, (ii) identifying measurable and trainable cognitive skills, (iii) a game design that effectively trains and sustains these skills And using game mechanics, game-based systems provide healthcare professionals, healthcare professionals, parents, teachers, and users with the ability to measure and manage targeted cognitive skill training to reach their desired performance goals. It is disclosed to do.

Patent Document 5 aims to provide a technique capable of reducing the risk of dementia by simultaneously training motor function and higher cognitive function, and to reduce the risk of dementia by utilizing augmented reality. Of the virtual objects that meet the conditions and the virtual objects that do not meet the conditions in a predetermined three-dimensional space according to the training menu, the instruction unit that instructs the user the conditions related to the virtual object that the user should touch. Using a display unit that displays at least one of the virtual objects, a shooting unit that shoots a predetermined three-dimensional space, and an image taken by the shooting unit, a user's hand is used as a condition in the predetermined three-dimensional space. It is disclosed that an AR device having a determination unit for determining whether or not a corresponding virtual object has been touched is provided.

Patent Document 6 has an object of providing an HMD device capable of organizing information to be added by a user and improving the recognition of the information, and includes predetermined information for the user by superimposing it on a landscape. It is a head-mounted display device that allows the displayed image to be visually recognized, and the control unit virtually sets multiple display zones with different positions in the depth direction in front of the user, and the gaze position information from the gaze position detection unit and the brain measurement unit. The display zone that the user is gazing at is specified based on at least one of the gaze position estimation information from, and image information indicating the information associated with the specified display zone is acquired from the cloud server via the communication unit. Then, the image formation position adjusting unit is driven and displayed so that the depth position of the specified display zone and at least the image formation position of the information associated with the specified display zone of the display image coincide with each other. It is disclosed that the display image is displayed according to the image information acquired in the vessel.

Patent Document 7 has an object of providing an HMD device capable of organizing information to be added by a user and improving the recognition of the information, and includes predetermined information for the user by superimposing it on a landscape. It is a head-mounted display device that allows the displayed image to be visually recognized, and the control unit virtually sets multiple display zones with different positions in the depth direction in front of the user, and uses it based on the gaze position information from the gaze position detection unit. The display zone that the person is gazing at is specified, and image information indicating the information associated with the specified display zone is acquired from the cloud server via the communication unit, and the depth position of the specified display zone and the display are obtained. The image formation position adjusting unit is driven so as to match at least the image formation position of the information associated with the specified display zone in the image, and the display image is displayed according to the image information acquired by the display. It is disclosed to display.

Patent Document 8 has an object of providing an HMD device capable of organizing information to be added by a user and improving the recognition of the information, and includes predetermined information for the user by superimposing it on a landscape. It is a head-mounted display device that allows the displayed image to be visually recognized, and the control unit virtually sets multiple display zones with different positions in the depth direction in front of the user, and the gaze position information from the gaze position detection unit and the brain measurement unit. The display zone that the user is intentionally gazing at is specified based on the intention determination information from, and the image information indicating the information associated with the specified display zone is acquired from the cloud server via the communication unit. Then, the image formation position adjusting unit is driven so that the depth position of the specified display zone and the image formation position of the information associated with the specified display zone of the display image coincide with each other, and the display device is displayed. It is disclosed that the display image is displayed according to the image information acquired in the above.

Non-Patent Document 1 discloses the following. Alzheimer's disease (AD) is a disease that begins with memory loss and presents with dementia. AD pathology begins in the entorhinal cortex about 30 years before the onset of dementia and spreads to the hippocampus, limbic system, and neocortex, causing dementia. Decades before the onset of dementia, spatial navigation, especially grid cell function, is likely to be impaired. Grid cell-like neural activity in humans was measured using functional magnetic resonance imaging, and in a group of subjects at genetic risk of AD (APOE-ε4 carrier), grid cell-like neural activity was observed in a virtual arena at an early age. It was reduced and navigation behavior was reduced compared to the control (APOE-ε4 non-carrier) subject group. There was no change in spatial memory performance for hippocampal function in either group, and increased hippocampal activity was observed in subjects at genetic risk for AD. APOE-ε4 carriers may compensate for spatial memory by increased hippocampal activity, and behavior-related entorhinal cortex function in humans at genetic risk for AD decades before the onset of potential disease. Evidence of failure is provided.

Japanese Patent No. 6229867 Japanese Patent No. 6290754 JP-A-2018-189966 Special Table 2018-533044 Japanese Unexamined Patent Publication No. 2019-07632 JP-A-2018-041009 Japanese Unexamined Patent Publication No. 2018-041362 Japanese Unexamined Patent Publication No. 2018-042166

"Reduced grid-cell-like representations in adults at genetic risk for Alzheimer's disease", Kunz L, Schroder TN, Lee H, Montag C, Lachmann B, Sariyska R, Reuter M, Stirnberg R, Stocker T, Messing-Floeter PC, Fell J, Doeller CF, Axmacher N, Science 23 Oct 2015: Vol. 350, Issue 6259, pp. 430-433 DOI: 10.1126 / science.aac8128.

Information processing device, information processing method, and information that use the result of measuring the movement of the user to search for a second point without a mark from the first point when judging the cognitive function of the user. The purpose is to provide a processing program.

The gist of the present invention for achieving such an object lies in the inventions of the following items.
The invention of claim 1 comprises a receiving means for accepting a user's action, a presenting means for presenting a three-dimensional image to the user according to the action, and a second point where the user has no mark from the first point. It is an information processing device having a determination means for determining a cognitive function of the user by measuring the movement when performing a movement for searching.

The invention of claim 2 is the information processing apparatus according to claim 1, wherein when the user reaches the second point, the presenting means presents indicating that the user has reached the second point.

According to a third aspect of the present invention, when the user approaches the second point, the presenting means makes a presentation indicating that the second point is near the user. The information processing apparatus according to the above.

The invention of claim 4 provides a time limit for movement from the first point to the second point, and the determination means is a point where the user is present at the time when the time limit elapses and the second point. The information processing device according to claim 1, wherein the cognitive function of the user is determined by using the difference from the point.

According to the fifth aspect of the present invention, when the second point is reached, the determination means uses the time from the first point to the second point to reach the user's cognitive function. The information processing apparatus according to claim 1.

In the invention of claim 6, the determination means uses the sum of the distances between the second point and the moving point during the movement of the user from the first point to the second point. The information processing device according to claim 1, which determines the cognitive function of the user.

In the invention of claim 7, the user repeats the movement from the first point to the second point a plurality of times, and at that time, the second point is not changed, but the first point is changed. The determination means is a cognitive function of the user when the difference according to claim 4 gradually decreases, when the time according to claim 5 gradually decreases, or when the sum according to claim 6 gradually decreases. Is the information processing apparatus according to any one of claims 4 to 6, which is determined to have a high possibility of being normal.

In the invention of claim 8, when the first point is changed, the distance between the first point and the second point before the change is the same as or the difference between the distances is within a predetermined range. The information processing apparatus according to claim 7, wherein the first point is changed.

The invention of claim 9 is described in any one of claims 1 to 8, which allows only forward or backward movement in the direction in which the user is viewing or the direction of the stereoscopic image presenting device. It is an information processing device.

The invention according to claim 10 is the information processing apparatus according to any one of claims 1 to 9, wherein the presentation means presents the three-dimensional image using a head-mounted display worn by the user. be.

The invention of claim 11 is a reception step for accepting a user's action, a presentation step for presenting a three-dimensional image to the user according to the action, and a second point where the user has no mark from the first point. It is an information processing method having a determination step of determining a cognitive function of the user by measuring the movement when performing a movement for searching.

The invention of claim 12 comprises a receiving means for receiving a user's operation, a presenting means for presenting a three-dimensional image to the user according to the operation, and a second method in which the user has no mark from the first point. It is an information processing program that functions as a judgment means for judging the cognitive function of the user by measuring the movement when performing the movement for searching the point.

According to the information processing device of claim 1, when determining the cognitive function of the user, the result of measuring the movement for the user to search for the second point without a mark from the first point is used. Can be done.

According to the information processing device of claim 2, when the user reaches the second point, the user can know that the second point has been reached.

According to the information processing device of claim 3, when the user approaches the second point, the user can know that the second point is nearby.

According to the information processing apparatus of claim 4, the cognitive function of the user can be determined by using the difference between the point where the user is present and the second point when the time limit elapses.

According to the information processing device of claim 5, when the second point is reached, the cognitive function of the user can be determined by using the time from the first point to the second point. can.

According to the information processing device of claim 6, the user's cognitive function is performed by using the sum of the distances between the second point and the moving point during the user's movement from the first point to the second point. Can be judged.

According to the information processing device of claim 7, when the measured value gradually decreases, it can be determined that the cognitive function of the user is likely to be normal.

According to the information processing apparatus of claim 8, the distance between the first point and the second point in the previous time and the distance between the first point and the second point in this time can be made the same. can.

According to the information processing device of claim 9, it is possible to reduce the user's VR sickness.

According to the information processing device of claim 10, the cognitive function of the user can be determined by using the head-mounted display.

According to the information processing method of claim 11, when determining the cognitive function of the user, the result of measuring the movement for the user to search for the second point without a mark from the first point is used. Can be done.

According to the information processing program of claim 12, when determining the cognitive function of the user, the result of measuring the movement for the user to search for the second point without a mark from the first point is used. Can be done.

It is a conceptual module configuration diagram about the configuration example of this embodiment. It is explanatory drawing which shows the stand-alone type system configuration example using this embodiment. It is explanatory drawing which shows the network type system configuration example using this embodiment. It is explanatory drawing which shows an example of the 3D image by this embodiment. It is explanatory drawing which shows an example of the start point, the waypoint, and the goal point in the 3D image by this embodiment. It is a flowchart which shows the processing example by this embodiment. It is explanatory drawing which shows the data structure example of the arena management table. It is explanatory drawing which shows the presentation example by this Embodiment. It is explanatory drawing which shows the presentation example by this Embodiment. It is explanatory drawing which shows the presentation example by this Embodiment. It is a flowchart which shows the processing example by this embodiment. It is explanatory drawing which shows the data structure example of the user information table. It is a flowchart which shows the processing example by this embodiment. It is a flowchart which shows the processing example by this embodiment. It is a flowchart which shows the processing example by this embodiment. It is explanatory drawing which shows the data structure example of the management table for test A. It is explanatory drawing which shows the presentation example by this Embodiment. It is explanatory drawing which shows the presentation example by this Embodiment. It is explanatory drawing which shows the presentation example by this Embodiment. It is explanatory drawing which shows the data structure example of the position information table. It is explanatory drawing which shows the data structure example of the result table for test A. It is a flowchart which shows the processing example by this embodiment. It is explanatory drawing which shows the data structure example of the management table for test B. It is explanatory drawing which shows the presentation example by this Embodiment. It is explanatory drawing which shows the presentation example by this Embodiment. It is explanatory drawing which shows the data structure example of the position information table. It is explanatory drawing which shows the data structure example of the result table for test B. It is a block diagram which shows the hardware configuration example of the computer which realizes this embodiment.

Hereinafter, an example of a preferred embodiment for realizing the present invention will be described with reference to the drawings.
FIG. 1 shows a conceptual module configuration diagram for a configuration example of the present embodiment.
Note that a module generally refers to parts such as software (including a computer program as an interpretation of "software") and hardware that are logically separable. Therefore, the module in this embodiment refers not only to the module in the computer program but also to the module in the hardware configuration. Therefore, in this embodiment, a computer program for functioning as those modules (for example, a program for causing the computer to perform each procedure, a program for causing the computer to function as each means, and a computer for each of them. It also serves as an explanation of the program), system, and method for realizing the functions of. However, for convenience of explanation, words equivalent to "remember" and "remember" are used, but these words are stored in a storage device or stored when the embodiment is a computer program. It means that it is controlled so that it is stored in the device. Further, the modules may have a one-to-one correspondence with the functions, but in the implementation, one module may be configured by one program, a plurality of modules may be configured by one program, and conversely, one module may be configured. May be composed of a plurality of programs. Further, the plurality of modules may be executed by one computer, or one module may be executed by a plurality of computers by a computer in a distributed or parallel environment. In addition, one module may include another module. In addition, hereinafter, "connection" is used not only for physical connection but also for logical connection (for example, data transfer, instruction, reference relationship between data, login, etc.). "Predetermined" means that it is determined before the target process, not only before the process according to the present embodiment starts, but also after the process according to the present embodiment starts. However, if it is before the target process, it is used with the intention that it is determined according to the situation / state at that time or according to the situation / state up to that point. When there are a plurality of "predetermined values", they may be different values, and two or more values ("two or more values" include, of course, all values). It may be the same. Further, the description "if A, do B" is used to mean "determine whether or not it is A, and if it is determined to be A, do B". However, this excludes cases where it is not necessary to determine whether or not it is A. Further, when a thing is listed such as "A, B, C", it is an example list unless otherwise specified, and includes a case where only one of them is selected (for example, only A).
In addition, a system or device is configured by connecting a plurality of computers, hardware, devices, etc. by communication means such as a network (the "network" includes a one-to-one correspondence communication connection), and one. It also includes cases where it is realized by computers, hardware, devices, and the like. "Device" and "system" are used as synonymous terms. Of course, the "system" does not include anything that is nothing more than a social "mechanism" (that is, a social system) that is an artificial arrangement.
In addition, for each process by each module or when multiple processes are performed in the module, the target information is read from the storage device, and after the processes are performed, the process results are written to the storage device. be. Therefore, the description of reading from the storage device before processing and writing to the storage device after processing may be omitted.

The information processing device 100 according to the present embodiment has a function of determining a user's cognitive function, and has a presentation module 105, a reception module 110, and a test module 115 as shown in the example of FIG. There is.
The purpose of using the information processing device 100 may be to improve the cognitive function of the user in addition to determining the cognitive function of the user. In other words, the former is used as a test (also called a test), and the latter is used as training.
The "user" who uses the information processing device 100 is a subject whose cognitive function is judged or a person who trains for the purpose of improving the cognitive function.

The presentation module 105 is connected to the test module 115. The presentation module 105 presents a three-dimensional image to the user according to the operation received by the reception module 110. For example, as will be described later with reference to FIG. 2, a three-dimensional image is presented using a head-mounted display 200 worn by the user.
Here, "three-dimensional image" is also called VR (Virtual Reality, Virtual Space), and is an artificial environment that is a world created by a computer. Further, the "presentation" may be an output that is a combination of audio, music output, vibration, and the like that stimulate the user's five senses, in addition to mainly displaying an image. .. Note that the user "moves" means that the user moves within the three-dimensional image, and the physical movement (realistic movement) of the user does not matter. That is, it suffices if the user's movement can be detected and moved in the three-dimensional image, and the user's movement may be an operation that does not involve physical movement such as the operation of the controller 250 or the like, or a sensor described later. May be used to detect physical movement as an action.
The presentation module 105 may include the presentation device itself, or may be a module that controls the presentation device. The presenting device may be any device capable of presenting a three-dimensional image to the user. As the presenting device, for example, a head-mounted display (HMD: Head Mounted Display) is applicable. It is preferably a "non-transparent type" that completely covers both eyes.
Further, the presentation module 105 presents an item for facilitating the recognition of the space among the items presented in the three-dimensional image. The "item for facilitating the recognition of space" is generated by the environment generation module 125, and the presentation module 105 presents it in the three-dimensional image.

Further, the presentation module 105 sets an item for facilitating the recognition of the space as an extension of the first point and the second point according to the past judgment result by the test A module 130 or the test B module 135. You may arrange it.
Since it says "according to past judgment results" here, at least this test is the second and subsequent tests. For example, if the previous judgment result has a high possibility of dementia, the processing by the present presentation module 105 may be performed. On the contrary, when the previous judgment result shows that the possibility of dementia is low, the processing by the presentation module 105 may not be performed.
"Arrange so that it is an extension of the first point and the second point" means to make the destination "first point or second point" easier to understand from the point where the user is. , It may be placed at a position outside the fence and on the extension from the point where the user is located to the first point or the second point. This makes it possible to move toward an item that indicates the direction of the goal point (an item that makes it easier to recognize the space) when viewed from the starting point where the user is. If "moving from the first point to the second point" is an issue, it is necessary to make it easier to recognize the space so that it is an extension from the first point to the second point. Items will be placed. Then, when the task is to "move from the first point to the second point and return from the second point to the original first point", as described above, the second point to the second point. To make it easier to recognize the space so that it is an extension to the point, and to make it easier to recognize the space so that it is an extension from the second point to the first point. Items will be placed.
The arrangement in this way may be limited to the use of the information processing apparatus 100 for the purpose of training. Specifically, when using the information processing device 100, the user is allowed to select whether (1) measurement of cognitive function or (2) training for improvement of cognitive function, and (2) cognition. When training for improving the function is selected, the processing by the present presentation module 105 may be performed.

The reception module 110 is connected to the test module 115. The reception module 110 receives the user's operation.
Here, "accepting the user's action" includes detecting the user's action. Specifically, the head by detecting the operation of the controller 250 by the user, recognizing the user's voice, recognizing the user's line of sight, and the user turning the neck or body, tilting, walking, etc. It includes detecting a change or movement of the state of the mount display 200 by using a sensor such as a speed sensor, an acceleration sensor, an angular velocity sensor, a rotation sensor, or a gyroscope.

The test module 115 has a control module 120, an environment generation module 125, a test A module 130, and a test B module 135, and is connected to the presentation module 105 and the reception module 110. The test module 115 includes a module for determining the cognitive function of the user.

The control module 120 is connected to the environment generation module 125, the test A module 130, and the test B module 135. The control module 120 controls the environment generation module 125, the test A module 130, and the test B module 135.
The control module 120 controls the test A module 130 and the test B module 135 so that necessary measurements are performed. That is, the cognitive function of the user is judged by the combination of the test results of the test A module 130 and the test B module 135. Further, the measurement required for the test A module 130 and the measurement required for the test B module 135 may be performed in order. Here, as "in order", the measurement required for the test A module 130 may be performed first, then the measurement required for the test B module 135, the measurement required for the test B module 135 first, and then the test. The measurement may be necessary for the A module 130. It is desirable to control so that the measurement required for the test A module 130 is performed first, and then the measurement required for the test B module 135. In the description described later, an example of the measurement required for the test A module 130 and then the measurement required for the test B module 135 will be described first.

Further, the control module 120 may allow the user to enforceably control the movement in the space composed of the three-dimensional image. The user is asked to make a trial so that he / she can become accustomed to the operation of the information processing apparatus 100.
Then, in that case, the control module 120 may be controlled to perform the above-mentioned trial before performing the necessary measurements on the test A module 130 and the test B module 135. That is, before the test, the user is made accustomed to the operation of the information processing apparatus 100.

Further, the control module 120 may allow only forward or backward movement in the direction in which the user is viewing or the direction of the stereoscopic image presenting device. It may be applied to the movement of the user required for the processing of both the test A module 130 and the test B module 135. This is to reduce VR sickness.
Here, as the "direction the user is looking at", for example, the line of sight of the user may be detected. As the "direction of the three-dimensional image presenting device", for example, the direction of the head-mounted display 200 may be detected. Only forward or backward movements are allowed in these directions. Therefore, it is not allowed to move diagonally forward or diagonally backward. Specifically, when moving, it is necessary that (1) when moving forward, the direction of travel is facing, and (2) when moving backward, the direction of travel is opposite to that of the direction of travel. become.

The environment generation module 125 is connected to the control module 120. The environment generation module 125 generates a three-dimensional image presented by the presentation module 105 to the user.
The three-dimensional image here is an image in which the user is surrounded by a fence and items are arranged outside the fence. Then, the user can move in the space surrounded by this wall. The space surrounded by walls is also generally called an arena. The movement is performed according to the operation of the user received by the reception module 110.
Further, the environment generation module 125 may generate a floor surface that is not unpatterned as the floor surface in the three-dimensional image. For example, the floor surface may be patterned with tiles or the like. This is so that the user can know that he / she is moving.

The environment generation module 125 generates an item in the stereoscopic image. Items to be generated include, for example, a flag indicating a start point, a goal point, a waypoint, etc. inside the fence. Also, on the outside of the fence, items are placed so that the user can recognize his / her position. Items to be placed outside the fence include, for example, mountains and trees. As items to be placed outside the fence, there are "items to make the space easier to recognize".
The environment generation module 125 is, as an "item for making it easier to recognize the space" presented by the presentation module 105, (1) an item having a different form from other items of the same type as the item, and (2). One or more of the arrangement is different from other items of the same type as the item, or (3) the item is of a different type from other items.
Here, as the "form", the shape, pattern, color, size, dynamically changing (for example, flash, animation, etc.), blinking (the change target in blinking is whether or not blinking is performed, and blinking is performed. There is a period of time, blinking interval, etc.), or a combination of these.
"Other items of the same type as the item" means items that are in the same category as the target item. For example, when the item for making it easier to recognize the space is a tree, it means that it is a wooden item. In this case, two or more trees will be presented in the three-dimensional image. That is, at least one tree and the other trees to make the space easier to recognize.
As "an item that has a different form from other items of the same type as the item", for example, when the item is a mountain, other mountains (green mountain, brown mountain, etc.) such as a red mountain. It corresponds to the case where the mountain has a different color from. When the item is a tree, it corresponds to the case where it is a tree whose size is different from other trees such as a large tree. Of course, when the item is a tree, it also applies to a tree whose color is different from other trees (green tree, etc.) such as a yellow tree. In addition, "other items" are items that are likely to exist in the real world and should not be uncomfortable for the user, and "items with different forms (items that make it easier to recognize the space)" are Items that are unlikely to exist in the real world (including "impossible to exist") are preferred.
"The arrangement is different from other items of the same type as the item", when the item is a tree, and when multiple trees that are "other items" are clustered, the target item This is the case when only one is isolated.
In addition, as "an item of a different type from other items", when the "other item" is a still life such as a tree or a mountain in a general environment, a creature such as a cat corresponds to it. ..

The test A module 130 and the test B module 135 determine the cognitive function of the user by measuring the movement when the user moves from the first point to the second point.
Here, the "first point" and the "second point" are points in the space composed of the three-dimensional image presented by the presentation module 105. Then, the user can move in the space. The first point is, for example, the start point, and the second point is, for example, the goal point. The user is given the task of "go from the first point (which may be the current point) to the second point", and operate the controller 250 to move to the second point. It does, but measures the movement according to the operation. Specifically, the locus of movement in the three-dimensional image is recorded, and the movement distance, the time required to reach the second point, the speed, and the like are measured. The above-mentioned problem may be notified to the user before the head-mounted display 200 is attached, or the presentation module 105 may be presented to the user in the three-dimensional image.
"Cognitive function" is mainly a spatial cognitive function. Spatial cognitive function is the ability to analyze visual information in the brain to grasp the direction, distance, position, and so on. In particular, functions related to the entorhinal cortex and hippocampus may be targeted.

The test A module 130 is connected to the control module 120. Test A module 130 measures the movement of the user from the first point to the second point and then back from the second point to the first point, thereby measuring the user's entorhinal cortex. Judge the function of. The object of measurement here is "movement when returning from the second point to the first point". The test A module 130 also measures the movement of the user from one point to another to determine the cognitive function of the user for a first site in the brain (particularly the entorhinal field).
In the test in the test A module 130, the user first moves from the start point (an example of the first point) to the goal point (an example of the second point). The user then moves back from the goal point to the start point. The movement from this goal point to the start point is the target of measurement, and the cognitive function of the user is judged.

When the processing by the test A module 130 is performed, the presentation module 105 provides a third point between the first point and the second point, and the user passes through the third point and the third point is provided. Instructions may be presented to move from one point to the second point.
By passing through a waypoint (an example of a third point), the user can see both the start point and the goal point. In other words, by being at the waypoint, the positional relationship between the start point and the goal point can be confirmed.
The third point should not be arranged on a straight line between the first point and the second point.
This is because if the waypoints are placed on a straight line between the start point and the goal point, other than the grid cell function of the entorhinal cortex is involved. Specifically, it is set to form a triangle by connecting three points, a start point, a waypoint, and a goal point.

(Judgment A1) A time limit is set for the movement when returning from the second point to the first point, and the test A module 130 sets a time limit between the point where the user is present and the first point when the time limit elapses. The difference may be used to determine the cognitive function of the user.
(Judgment A2) When the user's action indicating that the user has returned to the first point is accepted by the reception module 110, the test A module 130 is the difference between the point where the user is and the first point, or , The time from the second point to the point where the user is located may be used to judge the cognitive function of the user.
(Judgment A3) The cognitive function of the user is judged by using the sum of the distances between the first point and the moving point while the user is moving from the second point to the first point. You may. As the "sum of distances" here, for example, the distance between the first point, which is the destination, and the current point of the user is calculated at a predetermined time interval, and the time limit elapses or the first point. It suffices to calculate the sum of the distances up to the time when the user's action indicating that the user has returned to the point of is accepted. The more trial and error, the greater this "sum of distances". Conversely, if you remember the starting point accurately, this "sum of distances" will be smaller.

In the test A module 130, "when the difference in (judgment A1) is less than or equal to the predetermined threshold value A", "when the difference in (judgment A2) is less than or equal to the predetermined threshold value B", "When the time of (judgment A2) is less than or equal to the predetermined threshold value C" or "when the total sum of (judgment A3) is less than or equal to the predetermined threshold value D" is the recognition of the user. You may decide that the function is likely to be normal. These thresholds (thresholds A to D) are determined in advance by experiments by young normal subjects (20s) and users with dementia. If all of these judgment results are true, it may be judged that the user's cognitive function is likely to be normal, or if more than half of these judgment results are true. , The user's cognitive function is likely to be normal, and if any one of these judgments is true, the user's cognitive function is likely to be normal. You may decide that.
Of course, the opposite judgment may be made. In the test A module 130, "when the difference of (judgment A1) is greater than or equal to the predetermined threshold value A'" and "when the difference of (judgment A2) is greater than or equal to the predetermined threshold value B'". "When there is", "when the time of (judgment A2) is greater than or equal to the predetermined threshold C'", or "when the sum of (judgment A3) is greater than or greater than the predetermined threshold D'". In some cases, it may be determined that the user's cognitive function is likely to be abnormal (including dementia). These thresholds (thresholds A'to D') are determined in advance by experiments by young normal subjects (20s) and users with dementia.

Further, the test A module 130 may repeat the movement when the user moves from the first point to the second point and returns from the second point to the first point a plurality of times.
Then, after being repeated a plurality of times, the test A module 130 determines that "when the difference in (judgment A1) gradually decreases", "when the difference in (judgment A2) gradually decreases", and "when the difference in (judgment A2) gradually decreases". When "time gradually decreases" or "when the sum of (judgment A3) gradually decreases", it may be determined that the cognitive function of the user is likely to be normal. The gradual decrease includes a gradual decrease from the previous time (monotonous decrease) each time, and the regression equation is a decreasing function.
Of course, the opposite judgment may be made. After being repeated a plurality of times, the test A module 130 determines that "when the difference in (judgment A1) is invariant, indefinite, or gradually increases" and "when the difference in (judgment A2) is invariant, indefinite, or gradually increases". In the case of "when the time of (judgment A2) is invariant, indefinite, or gradually increases", or "when the sum of (judgment A3) is invariant, indefinite, or gradually increases", the user's cognitive function is It may be judged that there is a high possibility that it is not normal (including dementia). Invariant refers to a case in which it cannot be determined that the amount is gradually decreasing, gradually increasing, or unchanged.

In the test by the test A module 130, the presentation module 105 presents in a three-dimensional image as shown below.
(1) When the user moves from the first point to the second point, the mark of the second point is presented.
(2) When the user moves from the first point to the second point, the mark of the third point to be passed is presented.
(3) When the user returns from the second point to the first point, the mark presented at the third point is deleted. That is, after reaching the second point, the third point is made invisible.
(4) No mark is presented at the first point in the first place. Specifically, when the user moves from the first point to the second point and when the user returns from the second point to the first point, the mark is not presented at the first point. However, when returning to the first point, a presentation indicating that the return has been made will be made.
(5) When the user has set a time limit for returning from the second point to the first point, when the user has not returned to the first point within the time limit, or has returned to the first point. When the user's action indicating is accepted, the mark is presented at the original first point (the first point set by the information processing apparatus 100). In other words, it lets users know where they should have returned.
(6) When the user returns from the second point to the first point, the mark presented at the second point may be deleted or presented at the second point. You may continue to present the mark as it is.
(7) A mark may be presented at the first point before the start. In that case, when the user starts from the first point (that is, when the user moves away from the first point), the mark may be deleted.

The test B module 135 is connected to the control module 120. Test B module 135 determines the hippocampal-dependent spatial cognitive function of the user by measuring the movement when the user makes a movement to search for a second point without a mark from the first point. do. Further, the test B module 135 measures the movement of the user when the user moves from one point to another, thereby measuring the cognitive function of the second part (particularly, the hippocampus) in the user's brain. To judge.
In the test in the test B module 135, the user moves from the start point (an example of the first point) to the goal point (an example of the second point). However, there is no mark at the goal point, and the user needs to search.
When performing the processing by the test B module 135, the presentation module 105 may make a presentation indicating that the user has reached the second point when the user reaches the second point.
Here, in order to detect that "the user has reached the second point", the distance between the user's point and the second point is measured, and the distance is less than or less than a predetermined threshold value X1. You just have to judge if there is. Further, it may be determined whether or not there is a user within a circle having a radius X2 predetermined from the second point.
Further, when the processing by the test B module 135 is performed, the presentation module 105 makes a presentation indicating that the second point is near the user when the user approaches the second point. You may.
Here, in order to detect that "the user has approached the second point", the distance between the user's point and the second point is measured, and the distance is less than or equal to the predetermined threshold value Y1. You just have to decide if there is one. Further, it may be determined whether or not the user is within a circle having a radius Y2 predetermined from the second point. The threshold value Y1 is larger than the threshold value X1, and the threshold value Y2 is larger than the threshold value X2.
In addition, as "presentation indicating that the second point has been reached" and "presentation indicating that there is a second point nearby", for example, displaying a mark indicating that, notifying by voice, a controller. The 250 or the head-mounted display 200 may be vibrated to notify the user.

(Judgment B1) A time limit is set for the movement from the first point to the second point, and the test B module 135 determines the difference between the point where the user is and the second point when the time limit elapses. It may be used to determine the cognitive function of the user. If the user reaches the second point within the time limit, the difference is 0.
(Judgment B2) When the user reaches the second point, the test B module 135 judges the cognitive function of the user by using the time from the first point to the second point. You may do so. A time limit is set for the movement from the first point to the second point, and if the user does not reach the second point within the time limit, the time limit is set to "time to reach". May be.
(Judgment B3) Test B module 135 uses the sum of the distances between the second point and the moving point during the user's movement from the first point to the second point to recognize the user. You may try to judge the function. As the "sum of distances" here, for example, the distance between the second point, which is the destination, and the current point of the user is calculated at a predetermined time interval, and the time limit elapses or the second point. It suffices to calculate the sum of the distances up to the time when the user's action indicating that the user has returned to the point of is accepted. The more trial and error, the greater this "sum of distances". Conversely, in the second and subsequent tests, if you remember the goal point accurately, this "sum of distances" will be small.

The test B module 135 "when the difference of (judgment B1) is less than or equal to the predetermined threshold value E", "when the time of (judgment B2) is less than or equal to the predetermined threshold value F", Alternatively, if "the sum of (judgment B3) is less than or equal to a predetermined threshold value G", it may be determined that the cognitive function of the user is likely to be normal. These thresholds (thresholds E to G) are determined in advance by experiments by young normal subjects (20s) and users with dementia. If all of these judgment results are true, it may be judged that the user's cognitive function is likely to be normal, or if more than half of these judgment results are true. , The user's cognitive function is likely to be normal, and if any one of these judgments is true, the user's cognitive function is likely to be normal. You may decide that.
Of course, the opposite judgment may be made. In the test B module 135, "when the difference of (judgment B1) is greater than or equal to the predetermined threshold value E'" and "when the time of (judgment B2) is greater than or equal to the predetermined threshold value F'". If there is, or if the sum of (judgment B3) is greater than or equal to the predetermined threshold G', the user's cognitive function is likely to be abnormal (dementia). (Including) may be determined. These thresholds (thresholds E'to G') are determined in advance by experiments by young normal subjects (20's) and users with dementia.

Test B module 135 may allow the user to repeat the movement from the first point to the second point a plurality of times. At that time, the second point is not changed, but the first point may be changed.
Then, after the repetition is performed a plurality of times, the test B module 135 determines "when the difference of (judgment B1) gradually decreases", "when the time of (judgment B2) gradually decreases", or "(judgment B3). ) When the sum is gradually reduced, it may be judged that the user's cognitive function is likely to be normal. If all of these judgment results are true (all values gradually decrease), it may be judged that the user's cognitive function is likely to be normal, or the judgment results of these judgment results may be judged. If more than half of them are true, it may be judged that the user's cognitive function is likely to be normal, and if any one of these judgment results is true, the user's cognition may be judged. You may decide that the function is likely to be normal.
Of course, the opposite judgment may be made. After being repeated a plurality of times, the test B module 135 "when the difference of (judgment B1) is invariant, indefinite, or gradually increases", "when the time of (judgment B2) is invariant, indefinite, or gradually increases". If "does" or "when the sum of (judgment B3) does not change, is indefinite, or gradually increases", it is judged that the user's cognitive function is likely to be abnormal (including dementia). You may do so.
When "changing the first point", the first point is the same as the distance between the first point and the second point before the change, or the difference in distance is within a predetermined range. The point 1 may be changed. That is, the "distance between the first point and the second point in the previous time" and the "distance between the first point and the second point in this time" are made to be almost the same. .. This is so that the time required for the movement can be compared.

FIG. 2 is an explanatory diagram showing an example of a stand-alone system configuration using the present embodiment.
The user 290 wears a head-mounted display 200 (also called VR goggles) and possesses a controller 250. The sensor and controller 250 in the head-mounted display 200 are an example of the reception module 110. That is, "the operation of the user 290 detected by the sensor" and "the operation of the user 290 with respect to the controller 250" are examples of the operation of the user 290. The controller 250 has a start button for starting the test, an end button for ending the test, a joystick for determining the moving speed and the moving direction, and the like.
The head-mounted display 200 includes an information processing device 100 and a microphone / recognition means 210. The microphone / recognition means 210 is an example of the reception module 110, receives the voice of the user 290, recognizes the voice, and receives the user's instruction. "Voice instruction of user 290" is also an example of the operation of user 290.
The information processing device 100 of the head-mounted display 200 and the controller 250 are connected by a wireless or wired communication line. The controller 250, which is an instruction device, gives an instruction such as a traveling direction in the virtual space.
The user 290 operates the voice or the controller 250 to move from the start point to the destination in the virtual space presented by the head-mounted display 200. As the user interface of the controller 250, for example, a physical button (for example, a start button for starting the test, an end button for ending the test) may be used, and the direction input and the direction input by the lever may be used. A joystick or the like that can determine the moving speed may be used, or a touch pad or the like may be used.
A three-dimensional image is an image that looks three-dimensional to the user 290.
As a device for presenting a three-dimensional image, in addition to the head-mounted display 200, a flat display using polarized glasses or the like may be used.

FIG. 3 is an explanatory diagram showing an example of a network type system configuration using the present embodiment.
The brain function observation support device 300, the head-mounted display 200B, and the head-mounted display 200A are each connected via a communication line 390. The communication line 390 may be wireless, wired, or a combination thereof, and may be, for example, the Internet as a communication infrastructure, an intranet, or the like.
The brain function observation support device 300 manages a three-dimensional image of the virtual space (an image seen from the position where the user is in the virtual space) and personal information (age, judgment result, etc.) of the user 290, and each head-mounted display. Send to 200. In addition, information such as a determination result is received from each head-mounted display 200 and managed. The information processing device 100 may be provided in the brain function observation support device 300, and the function of the information processing device 100 may be realized as a cloud service.
In the facility 350A, there is a user 290A wearing a head-mounted display 200A. In the facility 350B, there is a user 290B wearing a head-mounted display 200B. For example, the facility 350 may be a medical institution such as a health examination center, a hospital, or a dental clinic, a company, or the home of a user 290.
The user 290 regularly (for example, once every three months) takes a test using the head-mounted display 200 at the facility 350 to determine his / her risk of developing dementia. We will support the continuation of dementia onset prevention activities for users 290 who are early-detected dementia reserve forces.

FIG. 4 is an explanatory diagram showing an example of a three-dimensional image according to the present embodiment.
The arena space 400 is, for example, a space surrounded by a circular fence 410. The user 290 feels as if he / she is in the arena space 400 by wearing the head-mounted display 200. For example, if the user 290 looks up, he can see the image above the fence 410, and if the user 290 looks down, he can see the floor. Then, by operating the controller 250, the player can freely move (at his / her own will) in the arena space 400. The arena space 400 may have a circular shape, an elliptical shape, or another shape such as a rectangle.

FIG. 5 is an explanatory diagram showing an example of a start point 510, a waypoint 520, and a goal point 530 in the three-dimensional image according to the present embodiment.
For example, suppose user 290 is at the start point 510 in the arena space 400 and is given the task of moving to the goal point 530. The user 290 operates the controller 250 to move from the start point 510 to the goal point 530. The movement in the present embodiment is a movement in the virtual space, and the user 290 itself does not need to make a physical movement. However, it does not prevent the user 290 from detecting the physical movement of the user himself / herself and moving within the arena space 400.

In the test in test A module 130, the user 290 is tasked with going from the start point 510 to the goal point 530 via the waypoint 520 and then returning from the goal point 530 to the start point 510. In this test, when the user 290 is at the start point 510, a flag is set as a mark at the waypoint 520 and the goal point 530. When the user 290 is at the start point 510, a flag may be set as a mark at the start point 510 as well. However, when the movement from the goal point 530 to the start point 510 is started, the flags set at the goal point 530 and the waypoint 520 are erased. That is, the user 290 is tested for whether or not he / she can return to the original position (starting point 510).
Then, this test is repeated. The goal point 530 is fixed, and the start point 510 is changed to random (including pseudo-random numbers). The position of the waypoint 520 is also changed according to the positional relationship between the start point 510 and the goal point 530.

In the test with test B module 135, the user 290 is tasked with going from the start point 510 to the goal point 530. However, in this test, no flag was set at the goal point 530. That is, the user 290 searches for the goal point 530. However, with no hint that the position of the goal point 530 is perfect, the user 290 is likely to be unable to reach the goal point 530, so if the user 290 is close to the goal point 530, that (in the vicinity of the current user 290). A hint indicating that there is a goal point 530) may be displayed.
Then, this test is repeated. The goal point 530 is fixed, and the start point 510 is changed to random (including pseudo-random numbers).

When creating a virtual space for measuring the spatial cognitive function on the head-mounted display 200, it is important that the space is capable of spatial cognition. However, if the space is too easy to understand, it can be easily identified and is not useful as a measure of spatial cognitive ability. On the contrary, in a space where it is difficult to identify the position, the position cannot be specified, which also makes it impossible to measure the spatial cognitive ability.
Therefore, the information processing device 100 arranges the items arranged in the virtual space by mixing the items for facilitating the recognition of the space in addition to the general items.

<Item generation process>
FIG. 6 is a flowchart showing a processing example according to the present embodiment.
In step S602, the item type is selected. Types of items include, for example, mountains, trees, animals, and the like. From these, select the item to be placed in the VR space. The selection may be made by a user operation, or a predetermined item may be selected. Here, "items of a different type from other items" may be included as selection targets. Then, at least one may be forced to select "an item of a different type from other items". In addition, as "other items", "mountains", "trees", etc., which are common items for scenery, correspond, and as "items different from other items", animals such as cats, clocks, etc. It may be an artificial object of. Further, it may be said that a plurality of types of "other items" must be selected, and only one "item of a different type from other items" must be selected. In other words, it cannot be said that "items that are different in type from other items" cannot be selected, and it may not be possible to select multiple items.

In step S604, the number of each item is selected. The selection here may also be selected by a user operation, or a predetermined number may be selected.

In step S606, it is determined whether or not to make a special item, and if it is made into a special item, the process proceeds to step S610, and if not, the process proceeds to step S608. The special item here corresponds to an example of "an item for making the space easier to recognize".

In step S608, an item is generated within a predetermined range. The "predetermined range" here is defined by the type of item, and means a range in which attributes related to the form of the item can be taken. For example, if the item is "mountain", the color of the mountain as an attribute is green or brown. Therefore, as the mountain where the process of step S608 is performed, a green mountain and a brown mountain are generated.

In step S610, the item is generated out of the predetermined range. Since the "predetermined range" is excluded, when the item is "mountain", the color of the mountain as an attribute is a color other than green and brown in the above example. Therefore, as the mountain where the process of step S610 is performed, a red mountain or the like is generated.

In step S612, it is determined whether or not to make the special arrangement, and if the special arrangement is to be made, the process proceeds to step S616, and if not, the process proceeds to step S614. The specially arranged items here correspond to an example of "items for making the space easier to recognize".

In step S614, the item is placed in a predetermined area. For example, the “predetermined area” corresponds to an area outside the fence within a predetermined range. Therefore, if the item is a tree and there are a plurality of trees, the multiple trees are arranged so as to be clustered.

In step S616, the item is placed outside the predetermined area. Since the "predetermined area" is excluded, in the above-mentioned example, the area is arranged outside the predetermined range outside the fence. Therefore, if the item is a "tree", an isolated tree will be placed. For example, something that is recognized as a single pine is applicable.

In step S618, it is determined whether or not the number of the items is generated and arranged, and if the number of the items is generated and arranged, the process proceeds to step S620, and if not, the process returns to step S606.
In step S620, it is determined whether or not all the selected item types have been generated and placed, and if all the selected item types have been generated and placed, the process ends (step S699), and in other cases. Returns to step S604.
Items generated and placed according to this flowchart will be visible above the arena space 400.

Further, the environment generation module 125 generates a three-dimensional image by the arena management table 700. The values in the arena ID column 705 to the size column 715 are predetermined values, and the values in the item type number column 720 to the attribute column 745 are generated by the flowchart of FIG.
FIG. 7 is an explanatory diagram showing an example of a data structure of the arena management table 700. The arena management table 700 has an arena ID column 705, a shape column 710, a size column 715, an item type number column 720, an item type column 725, an item number column 730, an item ID column 735, an item arrangement column 740, and an attribute column 745. The attribute column 745 has a color column 747 and a size column 749. The arena ID column 705 stores information for uniquely identifying the arena (specifically, an abbreviation for arena ID: IDentification) in the present embodiment. The shape column 710 stores the shape of the arena. Specifically, it corresponds to a circle, an ellipse, a square, or the like. The size column 715 remembers the size of the arena. For example, when the arena is circular, a radius of 50 m or the like is applicable. The item type number column 720 stores the number of item types. The number of item types selected in step S602. The item type column 725 stores the item type. The type of item selected in step S602. The item number column 730 stores the number of items. The number of items selected in step S604. The item ID column 735 stores information (specifically, an item ID) for uniquely identifying an item in the present embodiment. The item arrangement column 740 stores the arrangement position of the item. For example, the coordinates (X coordinate, Y coordinate, Z coordinate) in the three-dimensional image are stored. The attribute column 745 stores the attribute of the item. The color column 747 stores the color of the item. The size column 749 stores the size of the item.

8 to 10 show an example in which items and special items are generated and arranged in the flowchart shown in the example of FIG.
FIG. 8 is an explanatory diagram showing an example of presentation according to the present embodiment.
The VR spatial image 800 is an example of an image that the user 290 is watching when the user 290 wears the head-mounted display 200. In this three-dimensional space, the user 290 is in a space surrounded by a circular fence 810.
In the VR space image 800, a fence 810, a ground 820, a flag 830a, a tree 850a, a tree 850b, a tree 850c, a tree 850d, a mountain 860a, and a sky 880 are displayed. For example, a flag 830a indicating a goal point 530 is erected in the fence 810. A tree 850 (tree 850a, tree 850b, tree 850c, tree 850d) and a mountain 860 (mountain 860a) are arranged on the outside of the wall 810. There are four trees 850. Among them, the trees 850a, 850c, and 850d are almost the same size and are green trees, but the tree 850b is a special item in the flowchart shown in the example of FIG. It is a tree that is larger than other trees such as 850a and has a red color. The tree 850b facilitates the user 290 to perform spatial cognition.

FIG. 9 is an explanatory diagram showing an example of presentation according to the present embodiment.
The VR space image 900 displays a fence 810, a ground 820, a flag 830b, a flag 830c, a flag 830d, a treasure chest 840a, a tree 850e, a tree 850f, a tree 850g, a tree 850h, a mountain 860b, a mountain 860c, a mountain 860d, and a sky 880. Has been done. For example, in the fence 810, a treasure chest 840a indicating a goal point 530 is placed, and a flag 830b is erected. In addition, a flag 830d indicating a waypoint 520 is erected. Tree 850 (tree 850e, tree 850f, tree 850g, tree 850h) and mountain 860 (mountain 860b, mountain 860c, mountain 860d) are arranged on the outside of the fence 810. These are general items (not special items) and arrangements (not special arrangements). If it is not possible to return to the starting point 510 within the time limit, a flag 830 indicating the starting point 510 may be set up.

FIG. 10 is an explanatory diagram showing an example of presentation according to the present embodiment.
In the VR space image 1000, a fence 810, a ground 820, a tree 850i, a tree 850j, a tree 850k, a mountain 860e, and a sky 880 are displayed. For example, trees 850 (trees 850i, trees 850j, trees 850k) and mountains 860 (mountains 860e) are arranged outside the fence 810. There are three trees 850. Among them, the tree 850i and the tree 850j are almost the same size and are green trees, but the tree 850k is generated as a special item in the flowchart shown in the example of FIG. It is a tree larger than other trees such as 850i. The tree 850i facilitates the user 290 to perform spatial cognition.

<Overall test flow>
FIG. 11 is a flowchart showing a processing example according to the present embodiment.
In step S1102, a free stage is carried out. The free stage here is an example of a step that enables the movement of the user 290 in a space composed of a three-dimensional image. The purpose is to familiarize the user with the use of the head-mounted display 200 and the controller 250. The detailed processing of step S1102 will be described later with reference to the flowchart shown in the example of FIG. 13 or FIG.
In step S1104, a test is performed in which the player goes from the start point to the goal point and returns to the start point. Test A This is a test by module 130. The detailed processing of step S1104 will be described later using the flowchart shown in the example of FIG.
In step S1106, a test for finding and reaching the goal point is performed. Test B This is a test by module 135. The detailed processing of step S1106 will be described later using the flowchart shown in the example of FIG.

The test in step S1104 is a test of cognitive function for the olfactory infield in the brain, and the test in step S1106 is a test of cognitive function for the hippocampus in the brain. By these two tests, the spatial cognitive function of the user 290 can be judged. The entorhinal field is known as a region where Alzheimer's disease lesions are observed from an early stage, and information processing related to spatial information is performed. The hippocampus is also known to be the center of spatial memory.
The test may be performed in the order of step S1102, step S1106, and step S1104, but it is desirable that the test is in the order of step S1102, step S1104, and step S1106.

Using the user information table 1200, the flowchart shown in the example of FIG. 11 is processed, and the processing result is stored in the user information table 1200.
FIG. 12 is an explanatory diagram showing an example of a data structure of the user information table 1200. The user information table 1200 has a user ID column 1205, a name column 1210, a date of birth column 1215, a gender column 1220, a medical history column 1225, a past test number of times column 1230, a date column 1235, a result column 1240, and the like. In the present embodiment, the user ID column 1205 stores information (specifically, a user ID) for uniquely identifying a user. The name field 1210 stores the user's name. The date of birth column 1215 stores the date of birth of the user. The gender column 1220 stores the gender of the user. The medical history column 1225 stores the medical history of the user. The past test execution number column 1230 stores the number of times the user has performed the test in the past. The combination of the date column 1235 and the result column 1240 continues as many times as the number of times in the past test execution number column 1230. The date field 1235 stores the date when the test was performed. The result column 1240 stores the result of the test.

FIG. 13 is a flowchart showing a processing example according to the present embodiment. It is an example of step S1102 of the flowchart which shows the example of FIG. This is a process for the user 290 to become accustomed to the operation of the head-mounted display 200 and the controller 250. Under the environment generated by the flowchart shown in the example of FIG. 6, the user sees the three-dimensional image and experiences the movement. NS.

In step S1302, the selection of the start button by the user 290 is detected.
In step S1304, the movement is performed according to the operation of the controller 250 by the user 290.
In step S1306, the selection of the end button by the user 290 is detected.

FIG. 14 is a flowchart showing a processing example according to the present embodiment. It is an example of step S1102 of the flowchart which shows the example of FIG. The flowchart shown in the example of FIG. 14 is obtained by adding the process of step S1408 to the flowchart shown in the example of FIG. 13, and depending on the moving speed in the free stage, the start point 510, the goal point 530, and the passage in the later test. The point 520 is determined. As the process of step S1102, either the flowchart shown in FIG. 13 or the flowchart shown in FIG. 14 may be adopted, but the start point 510, the goal point 530, and the waypoint 520 are determined with reference to the moving speed of the user 290. In that case, the flowchart shown in FIG. 14 may be adopted.

In step S1402, the selection of the start button by the user 290 is detected.
In step S1404, the movement is performed according to the operation of the controller 250 by the user 290.

In step S1406, the selection of the end button by the user 290 is detected.
In step S1408, the moving speed of the user 290 is measured. As the moving speed, for example, the distance traveled may be divided by the time from the selection of the start button to the selection of the end button, or a predetermined period until the end button is selected ( That is, the distance traveled may be divided by (after being operated), or it may be the average travel speed of the travel speeds from the start button selection to the end button selection. ..

<Test A: A test that returns from the goal point to the start point after reaching the goal point from the start point>
FIG. 15 is a flowchart showing a processing example according to the present embodiment (mainly, test A module 130). This process is an example of step S1104 of the flowchart showing the example of FIG. The test by Test A module 130 is mainly related to the test of the entorhinal field. In other words, the function of the entorhinal infield is measured by measuring the movement from the goal point, which is the destination, to the original start point.

In step S1502, the selection of the start button by the user 290 is detected.
In step S1504, each point via the start, the goal, and the route is automatically set.
For example, the goal point is fixed and the start point is changed randomly. In other words, the goal point is not changed in the tests until the specified number of times is reached, and the start point is different in each test. Then, the appearance position of the waypoint is also changed depending on the start point and the goal point. The process may not be performed so that the distance between the start point and the goal point becomes constant.
In addition, processing may be performed so that the distance between the start point and the goal point is constant. Therefore, it may be performed as follows. The time-out time (time limit) is predetermined. First, the goal point may be determined, the movable distance may be calculated from the time-out time and the average speed, and the position within that distance from the goal point may be determined as the start point. As the average speed, a predetermined speed may be used, or the average speed of the user 290 may be used when the processing according to the flowchart shown in the example of FIG. 14 is performed.
The start point may be fixed and the goal point may be changed at random, or the start point and goal point may be changed at random.
Also, as described above, the waypoints should be placed at positions where both the start point and the goal point can be seen, and should not be placed on the straight line between the start point and the goal point.

In step S1504, for example, the management table 1600 for test A is generated. FIG. 16 is an explanatory diagram showing an example of a data structure of the test A management table 1600. The test A management table 1600 has a test ID column 1605, a start point column 1610, a goal point column 1615, and a waypoint column 1620. The test ID column 1605 stores information (specifically, a test ID) for uniquely identifying a test in the present embodiment. The start point column 1610 stores information indicating the start point. The goal point column 1615 stores information indicating the goal point. The waypoint column 1620 stores information indicating the waypoint. The information indicating each point is, for example, coordinates in a three-dimensional space. The test A management table 1600 will be generated for the specified number of times.

In step S1506, the goal point and the waypoint are displayed. Specifically, flags are set at goal points and waypoints in three-dimensional space. No flag is set at the starting point. Therefore, when away from the start point, the user 290 can clearly see the flag at the goal point and the waypoint, and since there is no flag at the start point, it is the position in the virtual space memorized by the user 290.
In step S1508, the user moves to the waypoint according to the operation of the controller 250 by the user 290. When the waypoint is reached, the user 290 may be informed that the start point and the goal point are confirmed.

In step S1510, after reaching the waypoint, the user moves to the goal point according to the operation of the controller 250 by the user 290.
In step S1512, it is displayed that the player is near the goal point. Specifically, the distance between the position of the user 290 and the goal point is calculated, and if it is within the predetermined distance A from the goal point, it is determined that the user is "close to the goal point", and a display indicating that is displayed. Perform in a 3D image. FIG. 17 is an explanatory diagram showing an example of presentation in step S1512 according to the present embodiment. In the VR space image 1700, a fence 810, a ground 820, a tree 850l, a tree 850m, a mountain 860f, a mountain 860g, a sky 880, and a goal neighborhood mark 1710 are displayed. For example, the goal neighborhood mark 1710 is displayed as a display indicating that the player is "close to the goal point". As "within a predetermined distance A from the goal point", for example, it may be within 2 m. It should be noted that the notification may be made by voice, vibration, or the like instead of the visual display. Further, the notification may be made by a combination of display, voice, vibration and the like.
Since the flag is set at the goal point, it is not always necessary to perform the process of step S1512.

In step S1514, it is displayed that the goal point has been reached. Specifically, the distance between the position of the user 290 and the goal point is calculated, and if it is within a predetermined distance B from the goal point, it is determined that "the goal point has been reached", and a display indicating that is displayed in three dimensions. Do it in the video. FIG. 18 is an explanatory diagram showing an example of presentation in step S1514 according to the present embodiment. In the VR space image 1800, a fence 810, a ground 820, a tree 850l, a tree 850m, a mountain 860g, a goal neighborhood mark 1710, a flag 1810, a message display area 1820, and a treasure box 1830 are displayed. For example, the message display area 1820 is displayed as a display indicating that the goal point has been reached. In the message display area 1820, for example, "Arrive at the treasure chest (goal point). Did you find it within the time limit? 9 seconds until the start of the next scene" is displayed. As “within a predetermined distance B from the goal point”, the distance may be closer than the distance A in step S1512, and may be, for example, within 1 m.

In step S1516, the selection of the start button by the user 290 is detected. Start moving from the current goal point back to the original starting point. At this point, the flag set at the goal point and the flag set at the waypoint will be erased. The flag was not originally set at the starting point.

In step S1518, according to the operation of the controller 250 by the user 290, the user moves to a point considered to be the start point (a point memorized by the user 290 as the start point). When the player moves near the original start point, for example, the goal neighborhood mark 1710 shown in the example of FIG. 17 may be displayed as a display indicating that the player is "close to the start point". As "within a predetermined distance from the starting point", for example, it may be within 2 m.
In step S1520, the position information in the VR space is recorded once every 0.5 seconds. Note that this "0.5 second" is an example, and may be another number of seconds as long as it is a constant number of seconds.

In step S1522, it is determined whether or not the time-out has occurred (whether or not the time limit has been reached), and if the time-out has occurred, the process proceeds to step S1524, and if not, the process returns to step S1518. When the time-out occurs, the point where the user 290 is located becomes the final arrival point, and it is determined that the goal point is considered by the user 290.

In step S1524, the starting point is displayed. FIG. 19 is an explanatory diagram showing an example of presentation in step S1524 according to the present embodiment. The VR space image 1900 displays a fence 810, a ground 820, a tree 850i, a tree 850j, a tree 850k, a mountain 860e, a start point 1910, a start presentation light 1915, and a message display area 1920. For example, the start presentation light 1915 and the message display area 1920 are displayed as displays indicating the "start point". The start presentation light 1915 is a blue light radiated from the start point to the heavens. In the message display area 1920, for example, "Ended. The position displayed in blue is the start point. Did you return to the correct position? 10 seconds until the start of the next scene" is displayed.

In step S1526, the recording of the position information is finished. For example, the position information table 2000 is generated. FIG. 20 is an explanatory diagram showing an example of a data structure of the position information table 2000. The position information table 2000 stores the log ID column 2005, the start date and time column 2010, the point column 2015, the date and time column 2020, the point column 2025, the goal date and time column 2090, and the point column 2095. The log ID column 2005 stores information (specifically, a log ID) for uniquely identifying a log that is a movement record in the present embodiment. The start date and time column 2010 indicates the start date and time of the test (the date and time when the test started from the goal point to the start point (year, month, day, hour, minute, second, second or less, or a combination thereof)). I remember. The point column 2015 stores information indicating a point at the start date and time. The date and time column 2020 stores the date and time after the start of the test. The date and time in step S1520. The point column 2025 stores information indicating a point at that date and time. The goal date and time column 2090 stores the date and time when the goal was reached (the date and time when the player returned to the starting point). The point column 2095 stores information indicating a point at the goal date and time. The date and time in the start date and time column 2010 is the date and time in step S1516 of the flowchart illustrated in FIG. The position of the point column 2015 is information indicating the position in step S1516. In addition to the date and time when the goal was reached, the date and time in the goal date and time column 2090 may be the date and time when "Y" was set in step S1522. In that case, the point column 2095 is information indicating the position at the point where “Y” is set in step S1522.
In this embodiment, the log of the movement from the start point to the waypoint and from the waypoint to the goal point is not collected. In other words, only the log of the movement from the goal point to the start point is collected. However, a log of movement from the start point to the waypoint and from the waypoint to the goal point may be collected and used as a material for judging the cognitive function by using the arrival time at each point, the error score, and the like.

In step S1528, it is determined whether or not the specified number of times has been executed, and if the specified number of times has been executed, the process ends (step S1599), and if not, the process returns to step S1502.
It should be noted that it is not necessary to impose as a rule of the user 290 that the user always goes through the waypoint when moving from the start point to the goal point.

Then, as a test result, for example, a result table 2100 for test A is generated.
FIG. 21 is an explanatory diagram showing an example of a data structure of the test A result table 2100. The test A result table 2100 has a test ID column 2105, a user ID column 2110, a date and time column 2115, a deviation column 2120, and an error score column 2125. The test ID column 2105 stores the test ID. The user ID column 2110 stores the user ID for which the test was performed. The date and time column 2115 stores the date and time when the test was performed. The deviation column 2120 stores the deviation between the original start point and the start point where the user has returned. This deviation corresponds to the difference in the above-mentioned (judgment A1). The error score column 2125 stores the error score. This error score corresponds to the sum in the above-mentioned (judgment A3).

Then, as described above, when the value in the deviation column 2120 is less than or equal to the predetermined threshold value A, or when the value in the error score column 2125 is less than or equal to the predetermined threshold value D. , The user's cognitive function may be judged to be likely to be normal.
In addition, if the value in the deviation column 2120 gradually decreases or the value in the error score column 2125 gradually decreases due to the repetition of the specified number of times, it is judged that the cognitive function of the user is likely to be normal. You may do it.

The test A result table 2100 is generated by setting the point of the user 290 at the time of “Y” in step S1522 of the flowchart shown in the example of FIG. 15 as the goal point considered by the user 290.
When the user's action indicating that the user has returned to the start point is accepted, that point may be set as the goal point considered by the user 290. In that case, the arrival time column may be provided in the test A result table 2100. That is, in the arrival time column, the period from the time of step S1516 of the flowchart shown in the example of FIG. 15 to the time when the user's action indicating that the user has returned to the start point is accepted is stored. .. That is, the value in the arrival time column corresponds to the "time from the second point to the point where the user is present" in the above-mentioned (judgment A2). As a matter of course, the deviation column 2120 stores the deviation, which is the distance between the point where the user's action indicating that the user has returned to the start point is accepted and the original start point.
Then, as described above, when the value in the deviation column 2120 is less than or equal to the predetermined threshold value B, or when the value in the arrival time column is less than or equal to the predetermined threshold value C. , The user's cognitive function may be judged to be likely to be normal.
In addition, if the value in the deviation column 2120 gradually decreases or the value in the arrival time column gradually decreases due to the repetition of the specified number of times, it is judged that the user's cognitive function is likely to be normal. It may be.

Further, the position information table 2000 may be used to reproduce the locus of movement from the goal point to the start point. For example, by showing the locus of movement to the user 290 who is the subject, it may be used as a reference for the next test, or when it is performed as training, it may be used as a material for reflection. In addition, it may be used as a judgment material for cognitive function by showing it to a researcher or a judge.
Further, when the remaining time in the time limit is displayed in the three-dimensional image viewed by the user 290, when the user 290 raises the controller 250 (or when the user 290 looks down at the controller 250), The remaining time may be displayed at the position of the controller 250. That is, the controller 250 can be imitated as a wristwatch, and the remaining time can be displayed as if looking at the wristwatch.

<Test B: Test to search for goal point>
FIG. 22 is a flowchart showing a processing example according to the present embodiment (mainly, test B module 135). This process is an example of step S1106 of the flowchart showing the example of FIG. The test by Test B Module 135 is mainly related to the hippocampal test. It is said that the hippocampus is the fastest to decline due to dementia. A test is conducted to find the destination goal point in order to measure the function of the hippocampus.

Specifically, the test B performs the following processing.
The user discovers the goal point, which is the destination, without any hint, and performs a test to reach the goal point from a different starting point from the previous test, and judges the result. In addition, "no hint" means not to raise a flag at the goal point.
Since it may not be possible to reach the goal with a complete no hint, a display indicating that the goal point has been approached may be displayed. For example, if the user approaches within 2 meters from the goal point, the display may be displayed at the top of the screen being viewed.
In addition, although the goal point is not changed, the start point is changed randomly, and the memory ability of the hippocampus is measured by the time and route (specifically, the deviation from the goal point and the error score) to reach the goal point.
In addition, in order to be able to reproduce the trajectory of movement, position information from the start position of each time to the goal position (or until the time limit is reached) is collected.

In step S2202, the selection of the start button by the user 290 is detected.
In step S2204, the starting point is automatically set.
For example, the starting point is changed randomly. In other words, the starting point is different for each test (each test until the specified number of times is reached). Note that processing may not be performed so that the distance between the start point and the goal point becomes constant. In addition, processing may be performed so that the distance between the start point and the goal point is constant. For detailed processing, the same processing as in test A may be performed.
The goal point is set in advance, and the same goal point is used in the processing (each test) according to this flowchart.

In step S2204, for example, the test B management table 2300 is generated. FIG. 23 is an explanatory diagram showing an example of a data structure of the test B management table 2300. The test B management table 2300 has a test ID column 2305, a start point column 2310, and a goal point column 2315. The test ID column 2305 stores the test ID. The start point column 2310 stores information indicating the start point. The goal point column 2315 stores information indicating the goal point. The values in the goal point column 2315 are the same in each test in this flowchart.

In step S2206, the movement is performed according to the operation of the controller 250 by the user 290. Since this is a test to find a goal point, no flag is set at the goal point. Also, do not set a flag at the starting point.
In step S2208, the position information in the VR space is recorded once every 0.5 seconds. Note that this "0.5 second" is an example, and may be another number of seconds as long as it is a constant number of seconds.

In step S2210, it is determined whether or not the goal points are close, and if they are close, the process proceeds to step S2212, and if not, the process proceeds to step S2214.
In step S2212, it is displayed that the player is near the goal point. Specifically, the distance between the position of the user 290 and the goal point is calculated, and if it is within the predetermined distance A from the goal point, it is determined that the user is "close to the goal point", and a display indicating that is displayed. Perform in a 3D image. FIG. 24 is an explanatory diagram showing an example of presentation in step S2212 according to the present embodiment. In the VR space image 2400, a fence 810, a ground 820, a tree 850l, a tree 850m, a mountain 860f, a mountain 860g, a sky 880, and a goal neighborhood mark 2410 are displayed. For example, the goal neighborhood mark 2410 is displayed as a display indicating that the player is "close to the goal point". As "within a predetermined distance A from the goal point", for example, it may be within 2 m. It should be noted that the notification may be made by voice, vibration, or the like instead of the visual display. Further, the notification may be made by a combination of display, voice, vibration and the like.

In step S2214, it is determined whether or not a time-out has occurred (whether or not the time limit has been reached), and if the time-out has occurred, the process proceeds to step S2220, and if not, the process proceeds to step S2216.
In step S2216, it is determined whether or not the goal has been reached, and if it has been reached, the process proceeds to step S2218, and if not, the process returns to step S2206. Specifically, the distance between the position of the user 290 and the goal point is calculated, and if the distance is within the predetermined distance B from the goal point, it is determined that the user has reached the goal point. As “within a predetermined distance B from the goal point”, the distance may be closer than the distance A in step S2212, and may be, for example, within 1 m.

In step S2218, it is displayed that the goal point has been reached. FIG. 25 is an explanatory diagram showing an example of presentation in step S2218 according to the present embodiment. In the VR space image 2500, a fence 810, a ground 820, a tree 850l, a tree 850m, a mountain 860g, a goal neighborhood mark 2410, a flag 2510, a message display area 2520, and a treasure box 2530 are displayed. For example, a flag 2510, a treasure chest 2530, and a message display area 2520 are displayed as indications indicating that the goal point has been reached. In the message display area 2520, for example, "Arrive at the treasure chest (goal point). Did you find it within the time limit? 9 seconds until the start of the next scene" is displayed.
In step S2220, the goal point is displayed. The same presentation as in the example of FIG. 25 is made. For example, in the message display area 2520, for example, "This is a treasure chest (goal point). Did you find it within the time limit? 9 seconds until the start of the next scene" may be displayed. When the process of step S2218 is performed, the process of step S2220 may be omitted.

In step S2222, the recording of the position information is finished. For example, the position information table 2600 is generated. FIG. 26 is an explanatory diagram showing an example of a data structure of the position information table 2600. The position information table 2600 stores the log ID column 2605, the start date and time column 2610, the point column 2615, the date and time column 2620, the point column 2625, the goal date and time column 2690, and the point column 2695. The log ID column 2605 stores the log ID. The start date and time column 2610 stores the start date and time of the test. The point column 2615 stores information indicating a point at the start date and time. The date and time column 2620 stores the date and time after the start of the test. The date and time in step S2208. The point column 2625 stores information indicating a point at that date and time. The goal date and time column 2690 stores the goal date and time. The point column 2695 stores information indicating a point at the goal date and time. In addition to the date and time when the goal was reached, the date and time in the goal date and time column 2690 may be the date and time when "Y" was set in step S2214. In that case, the point column 2695 is information indicating the position at the point where "Y" is set in step S2214.

In step S2224, it is determined whether or not the specified number of times has been executed, and if the specified number of times has been executed, the process ends (step S2299), otherwise the process returns to step S2202.
When the goal point is reached, a waiting time may be provided until the start of the next test so that the location of the goal point can be grasped, that is, the surroundings can be confirmed. During that waiting time, the user may be able to move. A time limit may be set for the waiting time. By setting this time limit, it is possible to reduce the variation among users. In addition, the next test may be advanced by the user's operation instead of the waiting time.

Then, as a test result, for example, a test B result table 2700 is generated.
FIG. 27 is an explanatory diagram showing an example of a data structure of the test B result table 2700. The test B result table 2700 has a test ID column 2705, a user ID column 2710, a date and time column 2715, a deviation column 2720, an arrival time column 2725, and an error score column 2730. The test ID column 2705 stores the test ID. The user ID column 2710 stores the user ID for which the test was performed. The date and time column 2715 stores the date and time when the test was performed. The deviation column 2720 remembers the deviation between the original goal point and the point where the user arrives within the time limit. This deviation corresponds to the difference in the above-mentioned (judgment B1). If the user reaches the goal point within the time limit, the difference is 0. The arrival time column 2725 stores the arrival time. This arrival time corresponds to the time in the above-mentioned (judgment B2). If the user does not reach the goal point within the time limit, this arrival time may be set as the time limit. The error score column 2730 stores the error score. This error score corresponds to the sum in the above-mentioned (judgment B3).

Then, as described above, when the value in the deviation column 2720 is less than or equal to the predetermined threshold value E, when the value in the arrival time column 2725 is less than or equal to the predetermined threshold value F, or If the value in the error score column 2125 is less than or equal to the predetermined threshold value G, it may be determined that the user's cognitive function is likely to be normal.
In addition, when the value in the deviation column 2720 gradually decreases, the value in the arrival time column 2725 gradually decreases, or the value in the error score column 2730 gradually decreases due to the repetition of the specified number of times, the user's cognitive function May be determined to be likely to be normal.

The hardware configuration of the computer on which the program as the present embodiment is executed is, as illustrated in FIG. 28, a general computer, specifically, an embedded computer in the head mount display 200. Alternatively, it is a personal computer that serves as a brain function observation support device 300, a computer that can serve as a server, or the like. That is, as a specific example, the CPU 2801 is used as the processing unit (calculation unit), and the RAM 2802, ROM 2803, and HDD 2804 are used as the storage device. As the HDD 2804, for example, an HDD (abbreviation for Hard Disk Drive), an SSD (abbreviation for Solid State Drive) which is a flash memory, or the like may be used. A CPU 2801 that executes programs such as a presentation module 105, a reception module 110, a test module 115, a control module 120, an environment generation module 125, a test A module 130, and a test B module 135, a RAM 2802 that stores the programs and data, and a book. ROM2803 that stores programs for starting a computer, HDD2804 that is an auxiliary storage device that stores three-dimensional images, items, etc., controller 250, microphone, camera (including line-of-sight detection camera, etc.), etc. Connects to a reception device 2806 that accepts data based on the user's operation (including operation, voice, line of sight, etc.), an output device 2805 such as a liquid crystal display, an organic EL display, and a speaker, and a communication network such as a network interface card. It is composed of a communication line interface 2807 for connecting them and a bus 2808 for exchanging data by connecting them. A plurality of these computers may be connected to each other by a network.

Among the above-described embodiments, in the case of a computer program, the system of the present hardware configuration is made to read the computer program which is software, and the software and the hardware resources cooperate with each other to carry out the above-described embodiment. Is realized.
The hardware configuration shown in FIG. 28 shows one configuration example, and the present embodiment is not limited to the configuration shown in FIG. 28, and the module described in the present embodiment can be executed. All you need is. For example, as a processor, a GPU (abbreviation of Graphics Processing Unit, including GPGPU (abbreviation of General-Purpose computing on Graphics Processing Units)) may be used, or some modules may be used with dedicated hardware (for example, for a specific application). It is composed of an integrated circuit (specific example, there is an ASIC (abbreviation of Application Specific Integrated Circuit), etc.) and a reconfigurable integrated circuit (specific example, there is an FPGA (abbreviation of Field-Programmable Gate Array), etc.). In some cases, some modules may be in an external system and connected by a communication line, and a plurality of systems shown in FIG. 28 may be connected to each other by a communication line so as to cooperate with each other. In particular, in addition to personal computers, it may be incorporated in mobile information communication devices (including mobile phones, smartphones, mobile devices, wearable computers, etc.), information appliances, robots, and the like.

Although the distances of 1 m, 2 m, etc. are exemplified, these are not the distances in the real world (physical world) but the distances in the virtual space. However, it shows the distance in the virtual space so that it can be regarded as almost the same feeling as the distance in the real world.

The described program may be stored in a recording medium and provided, or the program may be provided by a communication means. In that case, for example, the program described above may be regarded as an invention of "a computer-readable recording medium on which the program is recorded".
The "computer-readable recording medium on which a program is recorded" means a computer-readable recording medium on which a program is recorded, which is used for program installation, execution, program distribution, and the like.
The recording medium is, for example, a digital versatile disc (DVD), which is a standard established by the DVD Forum "DVD-R, DVD-RW, DVD-RAM, etc." and DVD + RW. Standards such as "DVD + R, DVD + RW, etc.", compact discs (CD), read-only memory (CD-ROM), CD recordable (CD-R), CD rewritable (CD-RW), etc., Blu-ray discs (CD-RW) Blu-ray (registered trademark) Disc), optical magnetic disk (MO), flexible disk (FD), magnetic tape, hard disk, read-only memory (ROM), electrically erasable and rewritable read-only memory (EEPROM (registered trademark)) )), Flash memory, random access memory (RAM), SD (abbreviation of Secure Digital) memory card and the like.
Then, the whole or a part of the program may be recorded on the recording medium and stored, distributed, or the like. Further, by communication, for example, a wired network used for a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), the Internet, an intranet, an extranet, or wireless communication. It may be transmitted using a transmission medium such as a network or a combination thereof, or may be carried on a carrier.
Further, the program may be a part or all of other programs, or may be recorded on a recording medium together with a separate program. Further, the recording may be divided into a plurality of recording media. Further, it may be recorded in any mode as long as it can be restored, such as compression and encryption.

The above-described embodiment may be grasped as follows.
For example, there are the following issues.
When judging a user's cognitive function using a three-dimensional image, it is important that the three-dimensional image that the user sees is a cognitive space. However, if the space is too easy to understand, it will be easily identified and it will not be useful for measuring cognitive function. It will not be suitable.
Therefore, the present embodiment provides an information processing device, an information processing method, and an information processing program that present items for facilitating the recognition of space among the items presented in the three-dimensional image. I am aiming.

[A1]
A reception means that accepts user actions and
A presentation means for presenting a three-dimensional image to the user according to the operation, and
It has a judgment means for judging the cognitive function of the user by measuring the movement when the user moves from the first point to the second point.
The presenting means presents an item for facilitating recognition of the space among the items presented in the three-dimensional image.
Information processing device.
[A2]
The three-dimensional image is an image in which the user is surrounded by a fence and the item is arranged on the outside of the fence.
The user can move in the space surrounded by the wall,
As the item for making the space easier to recognize, the item has a different form from other items of the same type as the item, the arrangement is different from other items of the same type as the item, or , One or more of items that are different in type from other items,
The information processing device according to [A1].
[A3]
The presenting means arranges the item for facilitating the recognition of the space so as to be an extension of the first point and the second point according to the past judgment result by the judgment means.
The information processing device according to [A1] or [A2].
[A4]
Only forward or backward movement is permitted in the direction in which the user is viewing or in the direction of the stereoscopic image presenting device.
The information processing device according to any one of [A1] to [A3].
[A5]
The presentation means presents the three-dimensional image using a head-mounted display worn by the user.
The information processing device according to any one of [A1] to [A4].
[A6]
A reception step that accepts user actions and
A presentation step of presenting a three-dimensional image to the user according to the operation,
It has a judgment step of determining the cognitive function of the user by measuring the movement when the user moves from the first point to the second point.
The presentation step presents an item for facilitating recognition of the space among the items presented in the three-dimensional image.
Information processing method.
[A7]
Computer,
A reception means that accepts user actions and
A presentation means for presenting a three-dimensional image to the user according to the operation, and
When the user moves from the first point to the second point, the movement is measured to function as a judgment means for judging the cognitive function of the user.
The presenting means presents an item for facilitating recognition of the space among the items presented in the three-dimensional image.
Information processing program.

The above-mentioned invention has the following effects.
According to the information processing device of [A1], among the items presented in the three-dimensional image, the item for facilitating the recognition of the space can be presented.
According to the information processing device of [A2], as an item for making it easier to recognize the space, the item must have a different form from other items of the same type as the item, and other items of the same type as the item. It is possible to use one or more of items having a different arrangement from the item or items having a different type from other items.
According to the information processing device of [A3], items for facilitating the recognition of space are arranged so as to be an extension of the first point and the second point according to the judgment result of the past cognitive function. be able to.
According to the information processing device of [A4], it is possible to reduce the user's VR sickness.
According to the information processing device of [A5], the cognitive function of the user can be determined by using the head-mounted display.
According to the information processing method of [A6], among the items presented in the three-dimensional image, the item for facilitating the recognition of the space can be presented.
According to the information processing program of [A7], among the items presented in the three-dimensional image, the item for facilitating the recognition of the space can be presented.

Further, the above-described embodiment may be grasped as follows.
For example, there are the following issues.
When judging the cognitive function of the user, use the result of measuring the movement when the user returns from the second point to the first point after moving from the first point to the second point. It is an object of the present invention to provide an information processing device, an information processing method, and an information processing program.

[B1]
A reception means that accepts user actions and
A presentation means for presenting a three-dimensional image to the user according to the operation, and
A determination means for determining the cognitive function of the user by measuring the movement of the user from the first point to the second point and then returning from the second point to the first point. Information processing device to have.
[B2]
The presenting means presents a mark at the second point and does not present a mark at the first point in the three-dimensional image.
The information processing device according to [B1].
[B3]
The presenting means provides a third point with a mark between the first point and the second point, and the user passes through the third point and starts from the first point. Present instructions to move to a second point,
The information processing device according to [B1] or [B2].
[B4]
The third point is not arranged on a straight line between the first point and the second point.
The information processing device according to [B3].
[B5]
When the user returns from the second point to the first point, the mark of the third point is deleted.
The information processing device according to [B3] or [B4].
[B6]
A time limit is set for the movement when returning from the second point to the first point, and the determination means determines the difference between the point where the user is present and the first point when the time limit elapses. To determine the cognitive function of the user,
The information processing device according to [B1].
[B7]
If the user has not returned to the first point when the time limit has elapsed, the presenting means presents a mark at the first point.
The information processing device according to [B6].
[B8]
When the user's action indicating that the user has returned to the first point is received by the reception means, the determination means is the difference between the point where the user is and the first point, or the second. The time from the point to the return to the first point is used to judge the cognitive function of the user.
The information processing device according to [B1].
[B9]
When the user's action indicating that the user has returned to the first point is accepted, the presenting means presents a mark at the original first point.
The information processing device according to [B8].
[B10]
The determination means determines the cognitive function of the user by using the sum of the distances between the first point and the moving point during the movement of the user returning from the second point to the first point. do,
The information processing device according to [B1].
[B11]
The movement when the user moves from the first point to the second point and returns from the second point to the first point is repeated a plurality of times.
The determination means recognizes the user when the difference described in [B6] gradually decreases, when the difference or time described in [B8] gradually decreases, or when the total sum described in [B10] gradually decreases. Judge that the function is likely to be normal,
The information processing device according to any one of [B6] to [B10].
[B12]
Only forward or backward movement is permitted in the direction in which the user is viewing or in the direction of the stereoscopic image presenting device.
The information processing device according to any one of [B1] to [B11].
[B13]
The presentation means presents the three-dimensional image using a head-mounted display worn by the user.
The information processing apparatus according to any one of [B1] to [B12].
[B14]
A reception step that accepts user actions and
A presentation step of presenting a three-dimensional image to the user according to the operation,
A determination step for determining the cognitive function of the user by measuring the movement of the user from the first point to the second point and then returning from the second point to the first point. Information processing method to have.
[B15]
Computer,
A reception means that accepts user actions and
A presentation means for presenting a three-dimensional image to the user according to the operation, and
As a judgment means for judging the cognitive function of the user by measuring the movement when the user returns from the second point to the first point after moving from the first point to the second point. An information processing program that works.

The above-mentioned invention has the following effects.
According to the information processing device of [B1], in determining the cognitive function of the user, after the user moves from the first point to the second point, the user returns from the second point to the first point. The result of measuring the movement at the time can be used.
According to the information processing device of [B2], the user can visually confirm the second point by the mark, but cannot confirm the first point by the mark.
According to the information processing device of [B3], a third point is provided between the first point and the second point, and the third point is passed through to move from the first point to the second point. You can move the user.
According to the information processing device of [B4], at the third point, the user can confirm both the first point and the second point.
According to the information processing device of [B5], when the user returns to the first point, the third point can be prevented from being confirmed by the mark.
According to the information processing device of [B6], the cognitive function of the user can be determined by using the difference between the point where the user is present and the first point when the time limit elapses.
According to the information processing device of [B7], if the user has not returned to the first point when the time limit has elapsed, the user can confirm the location of the first point.
According to the information processing device of [B8], when there is an action of the user indicating that the user has returned to the first point, the difference between the point where the user is and the first point, or from the second point. The time it takes to return to the first point can be used to determine the cognitive function of the user.
According to the information processing device of [B9], when the user's action indicating that the user has returned to the first point is accepted, the user can confirm the original location of the first point.
According to the information processing device of [B10], the user's cognitive function is performed by using the sum of the distances between the first point and the moving point while the user is moving from the second point to the first point. Can be judged.
According to the information processing device of [B11], when the measured value gradually decreases, it can be determined that the cognitive function of the user is likely to be normal.
According to the information processing device of [B12], it is possible to reduce the user's VR sickness.
According to the information processing device of [B13], the cognitive function of the user can be determined by using the head-mounted display.
According to the information processing method of [B14], in determining the cognitive function of the user, after the user moves from the first point to the second point, the user returns from the second point to the first point. The result of measuring the movement at the time can be used.
According to the information processing program of [B15], in determining the cognitive function of the user, after the user moves from the first point to the second point, the user returns from the second point to the first point. The result of measuring the movement at the time can be used.

Further, the above-described embodiment may be grasped as follows.
For example, there are the following issues.
An information processing device that measures spatial cognitive function by conducting a test on the first part and a test on the second part in order to measure the function of parts in the user's brain (for example, the entorhinal field and the hippocampus). , Information processing methods and information processing programs.

[D1]
A reception means that accepts user actions and
A presentation means for presenting a three-dimensional image to the user according to the operation, and
A first determination means for determining the cognitive function of a first part of the user's brain by measuring the movement of the user from one point to another.
A second judgment means for determining the cognitive function of a second part of the user's brain by measuring the movement of the user from one point to another.
An information processing device having a control means for controlling the first determination means and the measurement required for the second determination means.
[D2]
The first determination means of the user by measuring the movement of the user after moving from the first point to the second point and then returning from the second point to the first point. Judging cognitive function related to the olfactory infield,
The second determination means determines the user's cognitive function with respect to the hippocampus by measuring the movement of the user to search for an unmarked second point from the first point.
The information processing device according to [D1].
[D3]
The control means controls to perform the measurement required for the second determination means after the measurement required for the first determination means.
The information processing apparatus according to [D1] or [D2].
[D4]
The user further has a trial means that enables the user to move in a space composed of a three-dimensional image.
The control means controls to perform a trial by the trial means before performing the measurement necessary for the first determination means and the second determination means.
The information processing apparatus according to any one of [D1] to [D3].
[D5]
Only forward or backward movement is permitted in the direction in which the user is viewing or in the direction of the stereoscopic image presenting device.
The information processing apparatus according to any one of [D1] to [D4].
[D6]
The presentation means presents the three-dimensional image using a head-mounted display worn by the user.
The information processing apparatus according to any one of [D1] to [D5].
[D7]
A reception step that accepts user actions and
A presentation step of presenting a three-dimensional image to the user according to the operation, and
A first decision step to determine the cognitive function of a first part of the user's brain by measuring the movement of the user from one point to another.
A second judgment step of determining the cognitive function of a second part of the user's brain by measuring the movement of the user from one point to another.
An information processing method having a control step for controlling the measurement required for the first determination step and the second determination step.
[D8]
Computer,
A reception means that accepts user actions and
A presentation means for presenting a three-dimensional image to the user according to the operation, and
A first determination means for determining the cognitive function of a first part of the user's brain by measuring the movement of the user from one point to another.
A second judgment means for determining the cognitive function of a second part of the user's brain by measuring the movement of the user from one point to another.
An information processing program that functions as a control means for controlling the first determination means and the second determination means to perform necessary measurements.

The above-mentioned invention has the following effects.
According to the information processing device of [D1], in order to measure the functions of the first part and the second part in the user's brain, a test on the first part and a test on the second part are performed respectively, and the space is Cognitive function can be measured.
According to the information processing device of [D2], as a test related to the olfactory infield, the movement when the user moves from the first point to the second point and then returns from the second point to the first point is performed. As a test for measuring and hippocampus, it can be used to measure the movement of the user from the first point to search for an unmarked second point.
According to the information processing apparatus of [D3], the measurement required for the second determination means can be performed after the measurement required for the first determination means.
According to the information processing device of [D4], after the user performs the movement in the space composed of the three-dimensional image, the measurement necessary for the first determination means and the second determination means can be performed.
According to the information processing device of [D5], it is possible to reduce the user's VR sickness.
According to the information processing device of [D6], the cognitive function of the user can be determined by using the head-mounted display.
According to the information processing method of [D7], in order to measure the functions of the first part and the second part in the user's brain, a test on the first part and a test on the second part are performed respectively, and the space is Cognitive function can be measured.
According to the information processing program of [D8], in order to measure the functions of the first part and the second part in the user's brain, a test on the first part and a test on the second part are performed respectively, and the space is Cognitive function can be measured.

100 ... Information processing device 105 ... Presentation module 110 ... Reception module 115 ... Test module 120 ... Control module 125 ... Environment generation module 130 ... Test A module 135 ... Test B module 200 ... Head mount display 210 ... Microphone / recognition means 250 ... Controller 290 ... User 300 ... Brain function observation support device 350 ... Facility 390 ... Communication line

The gist of the present invention for achieving such an object lies in the inventions of the following items.
The invention of claim 1 is to provide a receiving means for accepting a user's action, a presenting means for presenting a three-dimensional image to the user according to the action, and a movement in a space composed of the three-dimensional image to the user. The cognitive function of the user is determined by measuring the trial means for making the trial possible and the movement when the user moves from the first point to search for a second point without a mark. a determining unit, before performing measurement required for the determination means to have a control means for controlling to perform trial by the trial unit, the moving speed of the user in attempt by the trial unit, the first It is an information processing device that determines a point and the second point.

The invention of claim 11 is an information processing method performed by a computer, which includes a reception step for accepting a user's action, a presentation step for presenting a three-dimensional image to the user according to the action , and 3 for the user. A trial step that enables trial movement in a space composed of a stereoscopic image and a movement for the user to search for a second point without a mark from the first point are measured. by, before making a determination step of determining cognitive function of the user, the necessary measurements on the determination step, have a control step of controlling to perform trial by the trial step, the trial by the trial step This is an information processing method in which the first point and the second point are determined by the moving speed of the user.

The invention of claim 12 is a space in which a computer is composed of a receiving means for receiving an action of a user, a presenting means for presenting a three-dimensional image to the user according to the operation, and a three-dimensional image for the user. The cognitive function of the user by measuring the movement when the user makes a movement to search for a second point without a mark from the first point and a trial means for enabling the movement of the user. It functions as a determination means for determining the above and a control means for controlling the trial means to perform a trial before performing the measurement required for the determination means, and the movement speed of the user in the trial by the trial means determines the above. It is an information processing program that determines a first point and the second point.

Further, the control module 120 may allow the user to trially control the movement in the space composed of the three-dimensional image. The user is asked to make a trial so that he / she can become accustomed to the operation of the information processing apparatus 100.
Then, in that case, the control module 120 may be controlled to perform the above-mentioned trial before performing the necessary measurements on the test A module 130 and the test B module 135. That is, before the test, the user is made accustomed to the operation of the information processing apparatus 100.

<Overall test flow>
FIG. 11 is a flowchart showing a processing example according to the present embodiment.
In step S1102, a free stage is carried out. The free stage here is an example of a step that enables the user to try moving the 290 in a space composed of a three-dimensional image. The purpose is to familiarize the user with the use of the head-mounted display 200 and the controller 250. The detailed processing of step S1102 will be described later with reference to the flowchart shown in the example of FIG. 13 or FIG.
In step S1104, a test is performed in which the player goes from the start point to the goal point and returns to the start point. Test A This is a test by module 130. The detailed processing of step S1104 will be described later using the flowchart shown in the example of FIG.
In step S1106, a test for finding and reaching the goal point is performed. Test B This is a test by module 135. The detailed processing of step S1106 will be described later using the flowchart shown in the example of FIG.

[D1]
A reception means that accepts user actions and
A presentation means for presenting a three-dimensional image to the user according to the operation, and
A first determination means for determining the cognitive function of a first part of the user's brain by measuring the movement of the user from one point to another.
A second judgment means for determining the cognitive function of a second part of the user's brain by measuring the movement of the user from one point to another.
An information processing device having a control means for controlling the first determination means and the measurement required for the second determination means.
[D2]
The first determination means of the user by measuring the movement of the user after moving from the first point to the second point and then returning from the second point to the first point. Judging cognitive function related to the olfactory infield,
The second determination means determines the user's cognitive function with respect to the hippocampus by measuring the movement of the user to search for an unmarked second point from the first point.
The information processing device according to [D1].
[D3]
The control means controls to perform the measurement required for the second determination means after the measurement required for the first determination means.
The information processing apparatus according to [D1] or [D2].
[D4]
The user further has a trial means that enables the user to try moving in a space composed of a three-dimensional image.
The control means controls to perform a trial by the trial means before performing the measurement necessary for the first determination means and the second determination means.
The information processing apparatus according to any one of [D1] to [D3].
[D5]
Only forward or backward movement is permitted in the direction in which the user is viewing or in the direction of the stereoscopic image presenting device.
The information processing apparatus according to any one of [D1] to [D4].
[D6]
The presentation means presents the three-dimensional image using a head-mounted display worn by the user.
The information processing apparatus according to any one of [D1] to [D5].
[D7]
A reception step that accepts user actions and
A presentation step of presenting a three-dimensional image to the user according to the operation, and
A first decision step to determine the cognitive function of a first part of the user's brain by measuring the movement of the user from one point to another.
A second judgment step of determining the cognitive function of a second part of the user's brain by measuring the movement of the user from one point to another.
An information processing method having a control step for controlling the measurement required for the first determination step and the second determination step.
[D8]
Computer,
A reception means that accepts user actions and
A presentation means for presenting a three-dimensional image to the user according to the operation, and
A first determination means for determining the cognitive function of a first part of the user's brain by measuring the movement of the user from one point to another.
A second judgment means for determining the cognitive function of a second part of the user's brain by measuring the movement of the user from one point to another.
An information processing program that functions as a control means for controlling the first determination means and the second determination means to perform necessary measurements.

The above-mentioned invention has the following effects.
According to the information processing device of [D1], in order to measure the functions of the first part and the second part in the user's brain, a test on the first part and a test on the second part are performed respectively, and the space is Cognitive function can be measured.
According to the information processing device of [D2], as a test related to the olfactory infield, the movement when the user moves from the first point to the second point and then returns from the second point to the first point is performed. As a test for measuring and hippocampus, it can be used to measure the movement of the user from the first point to search for an unmarked second point.
According to the information processing apparatus of [D3], the measurement required for the second determination means can be performed after the measurement required for the first determination means.
According to the information processing device of [D4], after the user tries to move in the space composed of the three-dimensional image, the measurement necessary for the first determination means and the second determination means can be performed.
According to the information processing device of [D5], it is possible to reduce the user's VR sickness.
According to the information processing device of [D6], the cognitive function of the user can be determined by using the head-mounted display.
According to the information processing method of [D7], in order to measure the functions of the first part and the second part in the user's brain, a test on the first part and a test on the second part are performed respectively, and the space is Cognitive function can be measured.
According to the information processing program of [D8], in order to measure the functions of the first part and the second part in the user's brain, a test on the first part and a test on the second part are performed respectively, and the space is Cognitive function can be measured.

Claims (12)

A reception means that accepts user actions and
A presentation means for presenting a three-dimensional image to the user according to the operation, and
An information processing device having a determination means for determining a cognitive function of a user by measuring the movement when the user makes a movement to search for a second point without a mark from the first point. When the user reaches the second point, the presenting means makes a presentation indicating that the user has reached the second point.
The information processing device according to claim 1. When the user approaches the second point, the presenting means presents indicating that the second point is near the user.
The information processing device according to claim 1 or 2. A time limit is set for the movement from the first point to the second point, and the determination means uses the difference between the point where the user is present and the second point when the time limit elapses. , Judging the cognitive function of the user,
The information processing device according to claim 1. When the second point is reached, the determination means determines the cognitive function of the user by using the time from the first point to the arrival at the second point.
The information processing device according to claim 1. The determination means determines the cognitive function of the user by using the sum of the distances between the second point and the moving point during the movement of the user from the first point to the second point. do,
The information processing device according to claim 1. The user repeats the movement from the first point to the second point a plurality of times, and at that time, the second point is not changed, but the first point is changed.
When the difference according to claim 4 gradually decreases, the time according to claim 5 gradually decreases, or the sum according to claim 6 gradually decreases, the user's cognitive function Judge that it is likely to be normal,
The information processing device according to any one of claims 4 to 6. When changing the first point, the first point is the same as the distance between the first point and the second point before the change, or the difference in distance is within a predetermined range. To change,
The information processing device according to claim 7. Only forward or backward movement is permitted in the direction in which the user is viewing or in the direction of the stereoscopic image presenting device.
The information processing device according to any one of claims 1 to 8. The presentation means presents the three-dimensional image using a head-mounted display worn by the user.
The information processing device according to any one of claims 1 to 9. A reception step that accepts user actions and
A presentation step of presenting a three-dimensional image to the user according to the operation, and
An information processing method having a determination step of determining a cognitive function of a user by measuring the movement when the user makes a movement to search for a second point without a mark from the first point. Computer,
A reception means that accepts user actions and
A presentation means for presenting a three-dimensional image to the user according to the operation, and
An information processing program that functions as a judgment means for judging the cognitive function of the user by measuring the movement when the user moves from the first point to search for a second point without a mark. ..

Images