WO2020195164A1

WO2020195164A1 - Cognitive function testing method, program, and cognitive function testing system

Info

Publication number: WO2020195164A1
Application number: PCT/JP2020/003858
Authority: WO
Inventors: 亮佑南雲; 満春細川; 祐輝小川; 角　貞幸
Original assignee: パナソニックＩｐマネジメント株式会社
Priority date: 2019-03-26
Filing date: 2020-02-03
Publication date: 2020-10-01
Also published as: TW202034852A; JPWO2020195164A1; JP7241321B2

Abstract

The present invention achieves improvement in accuracy of assessment of a cognitive function. This cognitive function testing method is for, while a first image (I1) is displayed in a display unit (121), causing a subject (102) to perform an utterance regarding the first image (I1). In the cognitive function testing method, a partially blanked sentence (S1) in which a blank space is provided to a part of a sentence regarding the first image (I1) is displayed in the display unit (121), along with the first image (I1).

Description

Cognitive function test methods, programs, and cognitive function test systems

This disclosure relates to cognitive function test methods, programs, and cognitive function test systems. More specifically, the present disclosure relates to cognitive function testing methods, programs, and cognitive function testing systems for testing cognitive function.

Patent Document 1 describes a dementia diagnosis system (cognitive function test system) used for diagnosing a subject's dementia. The dementia diagnosis system described in Patent Document 1 includes a dementia diagnosis device and a terminal device. The terminal device records the conversation between the subject and the questioner. The dementia diagnostic device calculates the dementia level of the subject from the voice data recorded by the terminal device.

Japanese Patent No. 6263308

In the dementia diagnosis system as described in Patent Document 1, it is desired to improve the evaluation accuracy of cognitive function.

The purpose of the present disclosure is to provide a cognitive function test method, a program, and a cognitive function test system capable of improving the evaluation accuracy of cognitive function.

The cognitive function test method according to one aspect of the present disclosure is a cognitive function test method in which a subject is made to make an utterance related to the image while displaying an image on a display unit. In the cognitive function test method, along with the image, a perforated sentence in which a part of the sentence related to the image is left blank is displayed on the display unit.

The program according to one aspect of the present disclosure is a program for causing one or more processors to execute the above-mentioned cognitive function test method.

The cognitive function test system according to one aspect of the present disclosure includes a display unit, an examination unit, and a control unit. The inspection unit causes the subject to make an utterance related to the image while displaying the image on the display unit. The control unit causes the display unit to display a perforated sentence in which a part of the sentence related to the image is blank together with the image.

FIG. 1 is an explanatory diagram for explaining an examination situation by a cognitive function examination system according to an embodiment of the present disclosure. FIG. 2 is a block diagram showing the configuration of the same cognitive function test system. FIG. 3A is a schematic view showing a display example in the first test of the cognitive function test system of the same. FIG. 3B is a schematic view showing a display example in the first test of the cognitive function test system of the same. FIG. 4A is a schematic view showing a display example in the second test of the cognitive function test system of the same. FIG. 4B is a schematic view showing a display example in the second test of the cognitive function test system of the same. FIG. 5 is a schematic view showing a display example of an image to be displayed on the display unit between the first test and the second test of the cognitive function test system. FIG. 6 is a flowchart showing a series of operations of the cognitive function test system described above.

(Embodiment)
(1) Overview As shown in FIG. 1, the cognitive function test method according to the present embodiment is a method for testing cognitive function between the examiner 101 and the subject 102 using the cognitive function test system 1. , Realized by cognitive function test system 1. The cognitive function test system 1 is, for example, a mobile terminal such as a tablet or a smartphone, a personal computer (PC), or the like. As an example in this embodiment, the cognitive function test system 1 is a tablet as shown in FIG. As shown in FIG. 2, the cognitive function test system 1 includes a display unit 121, an inspection unit 112, and a control unit 11.

The display unit 121 is, for example, a tablet screen and displays at least the first image (image) I1. The inspection unit 112 causes the subject 102 (see FIG. 1) to make an utterance related to the first image I1 while displaying the first image I1 on the display unit 121. Subject 102 is, for example, an elderly person. The control unit 11 causes the display unit 121 to display the perforated sentence S1 in which a part of the sentence related to the first image I1 is blank together with the first image I1.

The "cognitive function" referred to in the present disclosure refers to a function for correctly understanding and appropriately executing things, and is classified into, for example, a memory function, an attention function, an information processing function, and an execution function. "Memory function" refers to the function of keeping past experiences in mind and recalling and using them from time to time. "Attention function" refers to the function of consciousness to selectively react and pay attention to surrounding things, specific parts of events, and specific aspects of complex mental activities. The "information processing function" refers to a function of processing information input from the outside world (for example, visual information, auditory information, etc.). "Executive function" means a function necessary to effectively accomplish a series of activities with a purpose.

In recent years, with the advent of an aging society, the increase in dementia patients has become a problem. In addition, since no specific drug for dementia has been discovered yet, attention is focused on mild cognitive impairment (MCI), which is the pre-stage of dementia. Mild cognitive impairment is an intermediate state between normal (healthy) and dementia.

Examples of a simple method for examining cognitive function include the revised Hasegawa simple function evaluation scale (HDS-R), MMSE (Mini-Mental State Examination), and MoCA (Montreal Cognitive Assessment). These test methods are interactive tests and are performed by trained medical professionals and the like. Therefore, people other than medical professionals cannot easily perform the examination, and the examination opportunity cannot be expanded. In the cognitive function test method according to the present embodiment, the following configuration is adopted so that even a person other than a medical worker can perform a test related to cognitive function, thereby expanding test opportunities. are doing.

The cognitive function test method according to the present embodiment is a cognitive function test method in which the subject 102 is made to make an utterance related to the first image I1 while displaying the first image (image) I1 on the display unit 121. In this cognitive function test method, along with the first image I1, a perforated sentence S1 in which a part of the sentence related to the first image I1 is left blank is displayed on the display unit 121.

In the cognitive function test method according to the present embodiment, the subject 102 is made to utter the perforated sentence S1 while filling the perforated portion, and the subject 102 is given a heavier load than simply speaking while looking at the first image I1. It can be given, and the evaluation accuracy of cognitive function can be improved. In addition, it is only necessary to have the subject 102 make an utterance related to the first image I1, and even a person other than a medical worker can easily perform the examination, so that the examination opportunity can be expanded.

(2) Configuration Hereinafter, the configuration of the cognitive function test system 1 according to the present embodiment will be described with reference to FIGS. 1 and 2.

As shown in FIG. 2, the cognitive function test system 1 according to the present embodiment includes a control unit 11, a presentation unit 12, a storage unit 13, an operation unit 14, and a setting unit 15. As shown in FIG. 1, the cognitive function test system 1 is, for example, a tablet.

The control unit 11 is composed of, for example, a microcomputer having a processor and a memory. That is, the control unit 11 is realized by a computer system having a processor and a memory. Then, when the processor executes an appropriate program, the computer system functions as the control unit 11 (including the evaluation unit 111, the inspection unit 112, and the analysis unit 113). The program may be pre-recorded in a memory, may be recorded through a telecommunication line such as the Internet, or may be recorded and provided on a non-temporary recording medium such as a memory card.

The control unit 11 has an evaluation unit 111, an inspection unit 112, and an analysis unit 113.

The evaluation unit 111 evaluates the subject 102 based on the first test result, which is the test result of the first test, and the second test result, which is the test result of the second test. In other words, the evaluation unit 111 determines the state of the cognitive function of the subject 102, that is, whether or not the cognitive function of the subject 102 is deteriorated based on the two test results.

The evaluation unit 111 uses, for example, the vocabulary of the subject 102 in the first examination, the task performance time, and the like as feature quantities, and evaluates the cognitive function (attention function and performance function) of the subject 102 based on these feature quantities. .. The vocabulary of the subject 102 includes a selection of words for the perforated portion of the perforated sentence S1 described later. The task execution time is, for example, the time from displaying the first image I1 and the perforated sentence S1 on the display unit 121 to the end of the utterance of the subject 102. Further, the evaluation unit 111 uses, for example, the vocabulary ability of the subject 102 in the second examination, the ability to compose a sentence, the length of one sentence, and the like as feature quantities, and the cognitive function (memory function) of the subject 102 based on these feature quantities. ) Is evaluated. In the second examination, the evaluation unit 111 may evaluate the cognitive function of the subject 102 from the change in the voice power (volume) of the subject 102. For example, in the subject 102 whose cognitive function is deteriorated, the voice power is large because the subject 102 can speak smoothly at first, but the voice power becomes small as the words disappear with the passage of time. From such a change in voice power, it can be determined that the cognitive function of the subject 102 is deteriorated. The "volume" in the present specification may be a so-called loudness level (unit: phon) or a sound pressure level (unit: decibel). You may.

The inspection unit 112 is configured to perform the first inspection and the second inspection. Specifically, in the first inspection, the inspection unit 112 outputs the first control signal for displaying the first image I1 and the perforated sentence S1 to the display unit 121, so that the first image I1 and the hole are displayed. The space sentence S1 is displayed on the display unit 121. Further, in the second inspection, the inspection unit 112 outputs the guide information G1 to the display unit 121 by outputting the second control signal for displaying the guide information G1 to the display unit 121. The guide information G1 is, for example, at least one of the second image I2 and the sentence S2. The second image I2 is, for example, a partial image of the first image I1 (see FIG. 4A). The sentence S2 is, for example, a sentence that gives a suggestion about utterance to the subject 102. In the second inspection, when the guide information G1 is displayed on the display unit 121, only the second image I2 may be displayed, only the sentence S2 may be displayed, or the second image I2 and the sentence S2 may be displayed. You may display both. Further, the second image I2 and the sentence S2 may be displayed in order. In this case, the sentence S2 may be displayed after the second image I2 is displayed, or the second image I2 may be displayed after the sentence S2 is displayed.

The analysis unit 113 performs voice recognition for the voice input via the voice input / output unit 122. The "speech recognition" referred to in the present disclosure includes not only the process of converting the above speech into a character string, but also natural language processing such as semantic analysis and context analysis. The analysis unit 113 recognizes the voice (speech recognition) by using the acoustic model, the recognition dictionary, and the like stored in the storage unit 13. That is, the analysis unit 113 extracts the acoustic feature amount by analyzing the voice with reference to the acoustic model, and performs voice recognition with reference to the recognition dictionary.

The presentation unit 12 has a display unit 121 and an audio input / output unit 122. The presentation unit 12 is configured to present information to the subject 102. The information presented by the presentation unit 12 is, for example, image information (first image I1, second image I2, third image I3), audio information, and the like.

The display unit 121 is, for example, a liquid crystal display. The display unit 121 is configured to display the first image I1 and the perforated sentence S1 in the first inspection. Further, the display unit 121 is configured to display at least one of the second image I2 and the sentence S2 as the guide information G1 in the second inspection. Further, the display unit 121 is configured to display the third image I3 in the interval period between the first inspection and the second inspection. When the cognitive function test system 1 includes a touch panel display, the touch panel display may also serve as the display unit 121 and the operation unit 14.

The voice input / output unit 122 has, for example, a microphone and a speaker. The voice input / output unit 122 is input with the voice of the subject 102 during the first examination, the second examination, and the interval period via the microphone. Further, the voice input / output unit 122 outputs the voice (for example, the guidance voice of the test) from the cognitive function test system 1 during the first test, the second test, and the interval period via the speaker. The audio input / output unit 122 converts an analog audio signal input via a microphone into a digital audio signal, and outputs the converted audio data to the control unit 11.

The storage unit 13 is composed of a readable and writable memory. The storage unit 13 is, for example, a flash memory. The storage unit 13 stores the first image I1, the second image I2, and the third image I3 to be displayed on the display unit 121 during the first inspection, the second inspection, and the interval period. Here, a plurality of perforated sentences S1 related to the first image I1 are set in the first image I1, and the storage unit 13 associates the first image I1 with the plurality of perforated sentences S1. Remember. Further, a plurality of second images I2 are set as the guide information G1 in the second inspection in the first image I1, and the storage unit 13 associates the first image I1 with the plurality of second images I2. And remember. Further, a plurality of sentences S2 as guide information G1 in the second inspection are set in the first image I1, and the storage unit 13 stores the first image I1 and the plurality of sentences S2 in association with each other. That is, in the cognitive function test system 1 according to the present embodiment, a plurality of perforated sentences S1, a plurality of second images I2, and a plurality of sentences S2 are associated with one first image I1.

Further, the storage unit 13 stores the attribute information of the subject 102. The attribute information of the subject 102 includes, for example, the age, gender, hobby, birthplace, etc. of the subject 102. These attribute information may be input by the examiner 101 or the subject 102 in the operation unit 14, for example, and when the past examination data of the subject 102 is stored in the storage unit 13, past utterances It may be set automatically based on data or the like. In addition, the storage unit 13 stores the utterance data of the subject 102 during the first examination, the second examination, and the interval period, the conversation data between the examiner 101 and the subject 102, and the like. Further, the storage unit 13 stores an acoustic model, a recognition dictionary, and the like that the analysis unit 113 refers to when performing voice recognition.

The operation unit 14 is configured to receive operations of the inspector 101 and the subject 102. The operation unit 14 has, for example, a plurality of push buttons including a numeric keypad. Then, by pressing at least one push button among the plurality of push buttons, the attribute information of the subject 102 can be registered, and the content (third image I3) to be displayed on the display unit 121 during the interval period can be selected. Can be done. The plurality of push buttons may be mechanical switches, or may be touch pads constituting the touch panel if the display unit 121 is a touch panel. The position of the perforated portion of the perforated sentence S1 may be changed by the operation unit 14.

The setting unit 15 is configured to set the guide information G1 for each area of the first image I1. For example, the setting unit 15 sets the guide information G1 for prompting the subject 102 to speak about the father in the area including the father. Further, the setting unit 15 sets, for example, guide information G1 for prompting the subject 102 to speak about the mother in the area including the mother.

(3) Test contents The test contents of the cognitive function test system 1 will be described below.

(3.1) First Test The first test is a test in which the subject 102 is made to speak about the first image I1 while displaying the first image I1 on the display unit 121 of the cognitive function test system 1. The first inspection is, for example, a perforated inspection, as shown in FIGS. 1, 3A, and 3B. The perforated test is a test in which the perforated sentence S1 related to the first image I1 and the first image I1 is displayed on the display unit 121, and the perforated sentence S1 is spoken to the subject 102. The perforated sentence S1 is a sentence in which a part thereof is left blank. In other words, the first inspection includes a perforation inspection by a perforation sentence S1 displayed on the display unit 121 together with the first image I1 and leaving a part of the sentence related to the first image I1 blank. In the example shown in FIG. 3A, the perforated portion in the perforated sentence S1 is at the beginning of the sentence, and the subject of, for example, "dad" is entered in the perforated portion. In the example shown in FIG. 3B, the perforated portion of the perforated sentence S1 is at the end of the sentence, and the predicate "drinking" is entered in the perforated portion, for example. When the end of the perforated sentence S1 is used as a trigger for shifting to the next perforated sentence S1, the position of the perforated portion in the perforated sentence S1 is preferably the beginning or the middle of the sentence, but FIG. 3B shows. As shown, it may be at the end of the sentence. In the example shown in Fig. 3A, "Father is smoking a cigarette" is the correct answer, and in the example shown in Fig. 3B, "Mother is drinking". tea) ”is the correct answer.

In the first examination, the subject 102 utters the perforated sentence S1 while filling the perforated portion while comparing the first image I1 with the perforated sentence S1. The first test can mainly evaluate the attention function and the executive function among the above-mentioned four functions included in the cognitive function. Further, in the first inspection, since it is necessary to compare the first image I1 displayed on the display unit 121 with the perforated sentence S1, the selective attention function is particularly required among the attention functions. As a result, it is possible to give the subject 102 a larger load than simply speaking about the first image I1 while looking at the first image I1 displayed on the display unit 121, and as a result, the prediction accuracy for predicting the deterioration of the cognitive function is high. It leads to improvement.

By the way, in the first inspection, a plurality of (for example, about 10) perforated sentences S1 are prepared for one first image I1, and when the utterance of one perforated sentence S1 is completed, the next It is necessary to perform an operation to shift to the perforated sentence S1. For example, when the cognitive function test system 1 includes the operation unit 14, as in the present embodiment, the examiner 101 or the subject 102 can shift to the next perforated sentence S1 at the operation unit 14. .. However, in this case, there is a possibility that one or more perforated sentences S1 may be skipped due to an operation error. It is also possible to set the response time for one perforated sentence S1 in advance and automatically shift to the next perforated sentence S1 when this answer time elapses. However, in this case, there is a possibility that the subject 102 may move to the next perforated sentence S1 even though the subject 102 has not finished speaking to the perforated sentence S1. In addition, the utterance time of the subject 102 is shorter than the response time, and unnecessary noise may be recorded in the remaining time after the utterance is completed, which may hinder the voice analysis.

In the cognitive function test system 1 according to the present embodiment, in order to reduce the operation burden, operation error, and test error of the inspector 101 or the subject 102, the following perforated sentence S1 is used by using the voice recognition by the analysis unit 113. It is configured to automatically migrate to. Hereinafter, a specific description will be given.

First, as shown in FIG. 3A, it is assumed that the perforated sentence S1 stating "() is smoking" is displayed on the display unit 121. In this case, since the perforated part is at the beginning of the sentence, the end of the sentence is a predetermined wording (here, "sucking"). Therefore, when the word "sucking" at the end of the sentence is detected by the voice recognition of the analysis unit 113, it can be determined that the utterance of the subject 102 is completed, and it is used as a trigger for shifting to the next perforated sentence S1. be able to. In other words, in the cognitive function test method according to the present embodiment, the presence or absence of a response to the perforated sentence S1 is detected based on the partial voice (voice of "sucking") included in the utterance of the subject 102. Then, in the example shown in FIG. 3A, the partial voice is the utterance voice at the end of the perforated sentence S1 (the voice saying "sucking"). When there is a reply from the subject 102, the display unit 121 displays the first image I1 and the next perforated sentence S1. In other words, when there is a reply from the subject 102, the first image I1 and the next perforated sentence S1 are displayed on the display unit 121. In this way, by using the partial voice included in the utterance of the subject 102, particularly the utterance voice at the end of the perforated sentence S1, as a trigger for shifting to the next perforated sentence S1, the next perforated sentence S1 can be obtained. The migration can be done reliably. Moreover, since the transition is automatically performed based on the utterance voice of the subject 102, the operation burden, the operation error, and the examination error of the inspector 101 or the subject 102 can be reduced. Further, by stopping the recording when the spoken voice at the end of the perforated sentence S1 is detected, there is an advantage that unnecessary noise that may hinder the voice analysis is less likely to be recorded.

Next, as shown in FIG. 3B, it is assumed that the perforated sentence S1 saying "Mother has tea ()" is displayed on the display unit 121. In this case, the end of the perforated sentence S1, that is, the end of the perforated sentence S1 is the perforated part, and in this perforated part, "drinking", "sipping", etc. Multiple words can be entered. That is, in this case, the partial voice included in the utterance of the subject 102 is the utterance voice of the perforated portion in the perforated sentence S1. For example, when the wording "drinking" is set as the answer to the perforated part, the trigger for shifting to the next perforated sentence S1 is the wording "drinking". Therefore, for example, when the subject 102 utters "I'm sipping", it is not possible to move to the next perforated sentence S1. However, even in such a case, it is possible to deal with it by setting a threshold value for the number of characters of the wording that can enter the perforated portion. For example, in the example shown in FIG. 3B, it is assumed that the number of characters of the wording that can be contained in the perforated portion of the perforated sentence S1 is six. In this case, the wording that can enter the perforated part is the same 6 letters regardless of whether it is "drinking" or "slurping", and any wording can be a trigger. .. Further, in this case, it is effective in evaluating the cognitive function (particularly the executive function), which is the original purpose, by selecting the wording that can enter the perforated portion and the time until the perforated portion is spoken. In this way, by setting a threshold value for the number of characters in the wording that can enter the perforated part, even if it takes time to answer the perforated part, for example, "Drink ... I ...". , Can be a trigger for the next perforated sentence S1.

By the way, in the first examination, the subject 102 may not be able to answer depending on the content of the perforated sentence S1. In this case, the problem is that the examination time becomes longer by continuing to display the same perforated sentence S1 until the subject 102 can answer. There is. Therefore, in such a case, it is preferable to shift to the next perforated sentence S1 by the specific word (skip word) issued by the subject 102. In other words, in the cognitive function test method according to the present embodiment, it is preferable that the first image I1 and the next perforated sentence S1 are displayed on the display unit 121 when the subject 102 issues a specific word. The specific word includes, for example, "path", "next", "don't know", and the like. As a result, it is possible to shift to the next perforated sentence S1 regardless of whether or not the subject 102 responds, and it is possible to suppress a long examination time.

Further, if there is no response from the subject 102 even after a lapse of a predetermined time after displaying the first image I1 and the perforated sentence S1 on the display unit 121, it is preferable to shift to the next perforated sentence S1 ( time out). In other words, in the cognitive function test method according to the present embodiment, it is preferable that the first image I1 and the next perforated sentence S1 are displayed on the display unit 121 when a preset predetermined time has elapsed. The specified time is preferably set to, for example, about 30 seconds. As a result, it is possible to shift to the next perforated sentence S1 regardless of whether or not the subject 102 responds, and it is possible to suppress a long examination time.

Further, it is preferable that the next perforated sentence S1 to be displayed on the display unit 121 is changed according to the answer to the previous perforated sentence S1. For example, if the answer in the perforated sentence S1 is incorrect, or if it takes a long time to answer the perforated sentence, the difficulty level of the perforated sentence S1 is lower than that in the previous perforated sentence S1. Is preferably the following perforated sentence S1. On the other hand, if the answer of the perforated part in the perforated sentence S1 is correct and the time required for answering the perforated part is short, the perforated sentence S1 having a higher difficulty level than the previous perforated sentence S1 is next. It is preferable to use the perforated sentence S1. In this way, by changing the next perforated sentence S1 displayed on the display unit 121 according to the response of the subject 102 to the previous perforated sentence S1, the state of the cognitive function of the subject 102 can be discriminated in more stages. can do.

(3.2) Second Examination The second examination is an examination in which the subject 102 is made to make an utterance related to the first image I1 after an interval period has elapsed since the first examination was performed. In the second examination, basically, the first image I1 displayed on the display unit 121 in the first examination is not displayed on the display unit 121 (without showing the first image I1 to the subject 102), and the first image I1 This is a test in which the subject 102 is made to make an utterance related to. That is, the second test is a delayed reproduction test in which the subject 102 remembers the content of the first image I1 and the subject 102 speaks about the content of the first image I1 after the interval period elapses. The interval period is preferably set to, for example, several minutes to several tens of minutes, and in this embodiment, it is 5 minutes as an example. In the second examination, the inspector 101 gives the subject 102 a task such as "Please talk about the first image I1". Subject 102 speaks about the first image I1 without looking at the first image I1. Here, the subject 102 whose cognitive function (particularly memory function) is not deteriorated speaks smoothly about the contents of the first image I1 (the father is smoking, the mother is drinking tea, etc.). Can be done. On the other hand, the subject 102 whose cognitive function is deteriorated can speak smoothly immediately after the start of the utterance of the first image I1 (for example, several tens of seconds), but the utterance stops after a certain period of examination time. It has been known. The second test can mainly evaluate the memory function (short-term memory function) among the four functions included in the cognitive function.

According to such a delayed regeneration test, it is possible to accurately evaluate the deterioration of cognitive function including MCI, but it is very difficult for the subject 102 who has significantly deteriorated cognitive function, and a situation occurs in which no answer can be given. It has also been reported. Therefore, in the current delayed reproduction inspection, there are two choices as to whether or not delayed reproduction was possible, and it is not possible to evaluate how much the memory function has deteriorated. The cognitive function test method according to the present embodiment is configured to present guide information G1 to the subject 102 in the second test so that it can be evaluated to what extent the memory function of the subject 102 has deteriorated. Hereinafter, a specific description will be given.

It is assumed that the utterance of the subject 102 is stopped during the second examination. For example, if the utterance of the subject 102 so far does not say "dad" or a similar phrase, it is possible that the information about the father cannot be remembered. In this case, the guide information G1 about the father is presented to the subject 102 in order to promote the utterance about the father. For example, as shown in FIG. 4A, the second image I2 including a part of the father (face in FIG. 4A) may be displayed on the display unit 121, or as shown in FIG. 4B, the subject may give suggestions for utterance. Character information (sentence S2) such as that given to 102 may be displayed on the display unit 121. The second image I2 is a partial image based on the first image I1. In other words, the second image I2 is an image in which at least a part of the first image I1 is hidden. Further, the guide information G1 includes information (second image I2, sentence S2) that gives the subject 102 a suggestion about the utterance. Further, as the guide information G1, both the second image I2 and the sentence S2 may be displayed on the display unit 121, or the second image I2 and the sentence S2 may be displayed on the display unit 121 in order. The order of displaying the second image I2 and the sentence S2 may be such that the second image I2 comes first or the sentence S2 comes first. In FIG. 4A, the remaining part of the first image I1 excluding the second image I2 is visible, but in reality, only the second image I2 is visible and the remaining portion is not visible. To do.

Here, regarding the content spoken by the subject 102 during the second examination, the analysis unit 113 performs voice recognition in real time based on the voice input to the voice input / output unit 122, and the voice data is character data (character string). It can be converted to. Further, regarding the fluctuation of word notation (for example, father, father, husband, etc.), a dictionary or the like may be created in advance and stored in the storage unit 13. Thereby, the utterance content of the subject 102 can be memorized while corresponding to various expression formats, and the guide information G1 can be presented only for the event that the subject 102 has not uttered.

By the way, it is preferable that the guide information G1 is determined by whether or not the utterance of the subject 102 includes a keyword. Here, the keywords in the first image I1 are, for example, "dad", "mother", "sister", "younger brother", "cigarette", "tea", "sucking", and "drinking". And so on. For example, if none of the keywords "dad", "cigarette", and "smoking" related to the father is included in the utterance of the subject 102, the second image I2 and the sentence S2 are used to encourage the utterance about the father. At least one of the above is displayed on the display unit 121. As a result, even when the subject 102 does not remember the father, the subject 102 can be prompted to speak about the father by presenting the guide information G1.

Further, the guide information G1 is preferably determined for each area of the first image I1. For example, the area of the first image I1 is divided into a first area including a father, a second area including a mother, a third area including an older sister, and a fourth area including a younger brother, and guide information G1 is provided for each area. Determine (set). In this case, the keywords in the first image I1 are preferably grouped by area. For example, the first area including the father is associated with the keywords related to the father, "dad", "cigarette", and "smoking". Also, for the second area including the mother, the keywords "mother", "tea", and "drinking" related to the mother are linked. In this case, it may be determined that there is no problem in the cognitive function if even one keyword appears in each area, or it may be determined that there is a problem in the cognitive function if all the keywords appear.

Further, it is preferable that the guide information G1 is displayed hierarchically (stepwise) so that the cognitive function (particularly the memory function) of the subject 102 can be evaluated in multiple stages. For example, assume that the subject 102 is prompted to speak about his father. In the first stage, for example, the guide information G1 such as "Who was in the lower left of the first image I1?" Is displayed on the display unit 121. At this time, if the subject 102 replies "there was a father", the guide information G1 of the next stage is displayed on the display unit 121. The guide information G1 of the second stage is, for example, "What was your father doing in the lower left of the first image I1?" By presenting the guide information G1 hierarchically (stepwise) in this way, it is possible to evaluate the state of the cognitive function of the subject 102, that is, how much the cognitive function of the subject 102 is deteriorated stepwise. .. When the second image I2 is displayed on the display unit 121 as the guide information G1, the size of the second image I2 may be increased stepwise, or the position of the second image I2 in the first image I1 may be increased. That is, the area displayed by the second image I2 may be changed.

(3.3) Interval Period During the interval period between the first inspection and the second inspection, it is preferable to display the third image I3 on the display unit 121 as shown in FIG. In other words, it is preferable to present the content to the subject 102 during the interval period. The third image I3 is, for example, an advertisement for cat food. That is, the content presented by the cognitive function test system 1 is an advertisement. The content is not limited to images, but may be moving images. In this case, it is possible to present a commercial moving image, and it is preferable that the commercial moving image is a moving image optimized for the subject 102 by the recommendation function. As a result, income from commercials is expected, and the cost required for inspection can be reduced. As a result, it is expected that inspection opportunities will be expanded. As the content presented during the interval period, the subject 102 may listen to the content of interest in advance.

Here, it is preferable that the content presented during the interval period is selected according to the subject 102. For example, a plurality of contents that can be displayed during the interval period are displayed on the display unit 121, and the subject 102 is made to select from the plurality of contents. In other words, the content is manually selected by the subject 102. As a result, the content that the subject 102 is interested in can be displayed on the display unit 121. Further, the content selected by the subject 102 during the interval period may be used for the next second examination, or at least one of the first examination and the second examination thereafter. This allows the subject 102 to be focused on subsequent examinations.

Further, for example, the content to be displayed on the display unit 121 may be selected according to the attribute information of the subject 102. For example, if the subject 102 likes a cat from the attribute information of the subject 102, a third image I3 that is related to the cat is displayed on the display unit 121 as shown in FIG.

Further, the content may be automatically switched according to the degree of interest of the subject 102 in the content. For example, it is assumed that the subject 102 continues to talk about the third image I3 displayed on the display unit 121 for 40 seconds. If the threshold value in this case is set to 30 seconds, it can be determined that the subject 102 has a high degree of interest in the third image I3 because the subject 102 continues to speak beyond this threshold value. On the other hand, when the subject 102 speaks about the third image I3 for only 20 seconds, it can be determined that the subject 102 has a low degree of interest in the third image I3 because it is below the above threshold value. Then, when the subject 102 has a high degree of interest in the third image I3, the third image I3 may be continuously displayed, or the same type of image as the third image I3 may be continuously displayed. Further, when the subject 102 has a low degree of interest in the third image I3, an image of a type different from that of the third image I3 may be displayed.

The threshold value for determining the degree of interest of the subject 102 in the content is not limited to one, and may be plural. That is, the degree of interest of the subject 102 in the content may be divided into a plurality of stages. Even in this case, by displaying the content according to the degree of interest of the subject 102 on the display unit 121, the subject 102 can be concentrated on the subsequent examination.

Here, it is possible to construct a recommendation system by machine learning using the attribute information of the subject 102 as an explanatory variable (independent variable) and the degree of interest of the subject 102 as an objective variable (dependent variable). For example, when a new subject is registered, by predicting the degree of interest in the image (content) from the attribute information of the subject, an image that is likely to be of high interest in the subject can be displayed on the display unit 121. This makes it possible to encourage the subject to speak to the image.

(4) Operation Next, a series of operations of the cognitive function test system 1 according to the present embodiment will be described with reference to FIG.

The inspection unit 112 of the control unit 11 outputs the first control signal to the display unit 121, and causes the display unit 121 to display the first image I1 and the perforated sentence S1. The subject 102 speaks about the perforated sentence S1 while looking at the first image I1 and the perforated sentence S1 displayed on the display unit 121 (step ST1). When the first inspection is completed, the control unit 11 starts measuring the interval period (step ST2). The control unit 11 causes the display unit 121 to display (present) the third image I3 (content) until the interval period elapses (step ST2: No) (step ST3).

If the interval period has elapsed (step ST2: Yes), the control unit 11 causes the inspection unit 112 to perform the second inspection (step ST4). At this time, for example, a sentence such as "Please talk about the first image I1" may be displayed on the display unit 121. Here, when the utterance of the subject 102 is stopped in the middle, the inspection unit 112 of the control unit 11 outputs a second control signal to the display unit 121 and displays the guide information G1 for prompting the utterance. It is displayed on 121.

When the second inspection is completed, the evaluation unit 111 of the control unit 11 recognizes the subject 102 based on the first inspection result which is the inspection result of the first inspection and the second inspection result which is the inspection result of the second inspection. The state of function, that is, whether or not the cognitive function of the subject 102 is deteriorated is evaluated (step ST5). Then, the control unit 11 causes the display unit 121 to display the evaluation result of the evaluation unit 111 (step ST6).

In the cognitive function test method and the cognitive function test system 1 according to the present embodiment, as described above, the state of the cognitive function of the subject 102 is evaluated based on the two test results. Therefore, it is possible to improve the evaluation accuracy of the cognitive function as compared with the case of evaluating the state of the cognitive function of the subject 102 based on one test result. In addition, in each of the first examination and the second examination, it is only necessary to have the subject 102 make an utterance related to the first image I1, and no specialized training is required. Therefore, even a person other than a medical worker can perform the examination. It can be done, and inspection opportunities can be expanded.

In the present embodiment, step ST1 is the first inspection step, step ST4 is the second inspection step, and step ST5 is the evaluation step.

(5) Effect In the cognitive function test method and the cognitive function test system 1 according to the present embodiment, the subject 102 is made to speak a perforated sentence S1 related to the first image I1. Therefore, it is possible to give the subject 102 a larger load than simply speaking while looking at the first image I1, and as a result, it is possible to improve the evaluation accuracy of the cognitive function. In addition, it is only necessary to have the subject 102 make an utterance related to the first image I1, and even a person other than a medical worker can easily perform the examination, so that the examination opportunity can be expanded.

Furthermore, when the cognitive function test system 1 is a mobile terminal, the place where the test is performed is not restricted, so that it is possible to lead from early detection of MCI to improvement. Further, in the case of a conversational test in which the correct answer has not been determined, such as the cognitive function test method and the cognitive function test system 1 according to the present embodiment, the test cannot be performed accurately because the subject 102 memorizes the test contents. Problems can be reduced.

Further, in the cognitive function test method according to the present embodiment, the presence or absence of a response to the perforated sentence S1 is detected based on the partial voice included in the utterance of the subject 102. Therefore, it is possible to automatically shift to the next perforated sentence S1 according to the detection result of the presence or absence of the answer.

Further, in the cognitive function test method according to the present embodiment, the partial voice is the last spoken voice in the perforated sentence S1. In this case, it is possible to detect that the utterance of the subject 102 is completed by the utterance voice.

Further, in the cognitive function test method according to the present embodiment, the partial voice is the utterance voice of the perforated portion in the perforated sentence S1. In this case, it is possible to detect that there is a reply to the perforated sentence S1 by the above-mentioned utterance voice.

Further, in the cognitive function test method according to the present embodiment, when there is a reply to the perforated sentence S1, the first image I1 and the next perforated sentence S1 are displayed on the display unit 121. Therefore, the examiner 101 or the subject 102 can automatically move to the next perforated sentence S1 without any operation. That is, the answer to the perforated sentence S1 can be used as a trigger for displaying the next perforated sentence S1.

Further, in the cognitive function test method according to the present embodiment, the next perforated sentence (S1) is changed according to the answer to the perforated sentence S1. Therefore, a different perforated sentence S1 can be displayed on the display unit 121 as the next perforated sentence S1 according to the answer to the perforated sentence S1.

Further, in the cognitive function test method according to the present embodiment, the first image I1 and the next perforated sentence S1 are displayed on the display unit 121 when a preset predetermined time has elapsed. Therefore, when the specified time has elapsed, it is possible to shift to the next perforated sentence S1 regardless of whether or not there is an answer.

Further, in the cognitive function test method according to the present embodiment, when the subject 102 issues a specific word, the first image I1 and the next perforated sentence S1 are displayed on the display unit 121. Therefore, when the subject 102 issues a specific word, it is possible to shift to the next perforated sentence S1 regardless of whether or not there is an answer.

(6) Modified Example The above-described embodiment is only one of the various embodiments of the present disclosure. The above-described embodiment can be changed in various ways depending on the design and the like as long as the object of the present disclosure can be achieved. Further, the cognitive function test method according to the above-described embodiment and the same function as the cognitive function test system 1 may be embodied in a computer program, a non-temporary recording medium on which the computer program is recorded, or the like. The program according to one aspect is a program for causing one or more processors to execute the above-mentioned cognitive function test method.

Hereinafter, modified examples of the above-described embodiment are listed. The modifications described below can be applied in combination as appropriate.

In the cognitive function test system 1 in the present disclosure, the control unit 11 includes a computer system. The main configuration of a computer system is a processor and memory as hardware. When the processor executes the program recorded in the memory of the computer system, the function as the control unit 11 in the present disclosure is realized. The program may be pre-recorded in the memory of the computer system, may be provided through a telecommunications line, and may be recorded on a non-temporary recording medium such as a memory card, optical disk, or hard disk drive that can be read by the computer system. May be provided. A processor in a computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large scale integrated circuit (LSI). The integrated circuit such as IC or LSI referred to here has a different name depending on the degree of integration, and includes an integrated circuit called a system LSI, a VLSI (Very Large Scale Integration), or a ULSI (Ultra Large Scale Integration). Further, an FPGA (Field-Programmable Gate Array) programmed after the LSI is manufactured, or a logical device capable of reconfiguring the junction relationship inside the LSI or reconfiguring the circuit partition inside the LSI should also be adopted as a processor. Can be done. A plurality of electronic circuits may be integrated on one chip, or may be distributed on a plurality of chips. The plurality of chips may be integrated in one device, or may be distributed in a plurality of devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Therefore, the microcontroller is also composed of one or more electronic circuits including a semiconductor integrated circuit or a large-scale integrated circuit.

Further, it is not an essential configuration for the cognitive function test system 1 that a plurality of functions in the cognitive function test system 1 are integrated in one housing. That is, the components of the cognitive function test system 1 may be distributed in a plurality of housings. Further, at least a part of the functions of the cognitive function test system 1, for example, the function of the control unit 11 may be realized by a cloud (cloud computing) or the like.

In the above-described embodiment, the tester 101 and the subject 102 perform the test using the cognitive function test system 1, but the tester 101 may be omitted. Since the cognitive function test system 1 has a structure in which the contents of the first test and the second test are displayed on the display unit 121, it is sufficient that the subject 102 is present, and the subject 102 is tested alone using the cognitive function test system 1. May be done.

In the above-described embodiment, the third image I3 related to the advertisement is displayed as the content to be displayed on the display unit 121 during the interval period, but for example, the recommendation information for the subject 102 may be displayed on the display unit 121. For example, the recommendation information is information based on the purchase history of the Internet shop purchased by the subject 102 in the past. For example, if the subject 102 purchases a car tire at an internet shop, information about the car is displayed on the display unit 121 as recommendation information. This recommendation information may be used for the subsequent second inspection, or at least one of the first inspection and the second inspection from the next time onward. As a result, the first examination or the second examination specialized for the subject 102 can be performed.

Further, the content to be displayed on the display unit 121 during the interval period may be an image or a moving image to be displayed on the display unit 121 in the first inspection, or may be recent news, old events, or the like. Then, with these contents displayed on the display unit 121, the subject may talk about the contents. That is, the content to be displayed on the display unit 121 during the interval period is not limited to the advertisement, and various variations can be considered.

In the above-described embodiment, the perforated portion of the perforated sentence S1 is the subject located at the beginning of the sentence or the compound word located at the end of the sentence, but for example, the perforated portion may be an object located in the sentence. In this case, in the example shown in FIG. 3A, the object "tobacco" is a perforated portion.

In the above-described embodiment, the task execution time is the time from displaying the first image I1 and the perforated sentence S1 on the display unit 121 to the completion of the utterance of the subject 102. On the other hand, the task execution time may be, for example, the time from displaying the first image I1 and the perforated sentence S1 on the display unit 121 until the subject 102 starts speaking, or the subject 102 may start speaking. It may be the time from the start of the utterance to the end of the utterance.

In the above-described embodiment, the guide information G1 is determined for each area of the first image I1, but for example, the guide information G1 is determined for each subject (father, mother, older sister, younger brother) included in the first image I1. May be determined. In this case, the keywords in the first image I1 are preferably grouped by subject. For example, if the subject is a father, the keywords "dad", "cigarette", and "smoking" are used by the father. Link to. If the subject is a mother, the keywords "mother", "tea", and "drinking" are linked to the mother. According to this configuration, since the guide information G1 is changed for each subject, it is possible to prompt the subject 102 to speak for any subject.

In the above-described embodiment, the degree of interest of the subject 102 is determined from the speech time of the subject 102 with respect to the content, but for example, the degree of interest of the subject 102 may be determined from the result of the sentiment analysis of the voice of the subject 102. In this case, for example, if the feeling of "happy" continues for 30 seconds or more from the result of the sentiment analysis, it is determined that the subject 102 has a high degree of interest.

In the above-described embodiment, the analysis unit 113 of the control unit 11 performs voice recognition. For example, if the cognitive function test system 1 can communicate with a server device provided externally, the server device can perform voice recognition. Recognition may be performed. In this case, the cognitive function test system 1 transmits the voice data of the subject 102 input via the voice input / output unit 122 to the server device. The server device performs voice recognition on the voice data from the cognitive function test system 1 and transmits the result of the voice recognition to the cognitive function test system 1. According to this configuration, the processing load of the control unit 11 can be reduced by performing voice recognition on the server device. Further, it is not necessary to store the acoustic model, the recognition dictionary, and the like in the storage unit 13, and the memory capacity of the storage unit 13 can be reduced.

In the above-described embodiment, the second image I2 is a partial image of the first image I1, but the second image I2 may be, for example, a mosaic image obtained by applying a mosaic to the first image I1. In this case, the entire first image I1 may be mosaicked, or only the portion of the first image I1 that is desired to be presented as the guide information G1 may be mosaicked.

The words and phrases in the perforated portion described in the above-described embodiment are examples, and may be, for example, colors, numbers, and the like.

In the above-described embodiment, the subject included in the first image I1 is a person, but the subject is not limited to the person, and may be, for example, a wall clock included in the first image I1 and a bay window. ..

In the above-described embodiment, the test results of the first test and the second test are used for the evaluation of the cognitive function, but for example, the voice data of the subject during the interval period may be used for the evaluation of the cognitive function. This has the advantage that the evaluation accuracy of cognitive function is expected to improve.

(Summary)
As described above, the cognitive function test method according to the first aspect is a cognitive function in which the subject (102) is made to make an utterance related to the image (I1) while displaying the image (I1) on the display unit (121). It is an inspection method. In the cognitive function test method, a perforated sentence (S1) in which a part of the sentence related to the image (I1) is left blank is displayed on the display unit (121) together with the image (I1).

According to this aspect, it is possible to improve the evaluation accuracy of the attention function and the executive function among the cognitive functions including the memory function, the attention function, the information processing function, and the executive function.

In the cognitive function test method according to the second aspect, in the first aspect, the presence or absence of an answer to the perforated sentence (S1) is detected based on the partial voice included in the utterance.

According to this aspect, it is possible to automatically shift to the next perforated sentence (S1) according to the detection result of the presence or absence of an answer.

In the cognitive function test method according to the third aspect, in the second aspect, the partial voice is the last spoken voice in the perforated sentence (S1).

According to this aspect, it is possible to detect that the utterance of the subject (102) is completed by the utterance voice.

In the cognitive function test method according to the fourth aspect, in the second aspect, the partial voice is the utterance voice of the perforated portion in the perforated sentence (S1).

According to this aspect, it is possible to detect that there is a reply to the perforated sentence (S1) by the above utterance voice.

In the cognitive function test method according to the fifth aspect, when there is an answer in any of the second to fourth aspects, the image (I1) and the next perforated sentence (S1) are displayed on the display unit (121). To display.

According to this aspect, the answer to the perforated sentence (S1) can be used as a trigger for displaying the next perforated sentence (S1).

In the cognitive function test method according to the sixth aspect, in the fifth aspect, the next perforated sentence (S1) changes according to the answer.

According to this aspect, different perforated sentences (S1) can be displayed on the display unit (121) depending on the answer.

In the cognitive function test method according to the seventh aspect, in any one of the first to sixth aspects, when a preset predetermined time has elapsed, the image (I1) and the next perforated sentence (S1) are displayed. It is displayed on the display unit (121).

According to this aspect, when the specified time has passed, it is possible to move to the next perforated sentence (S1) regardless of whether or not there is a reply.

In the cognitive function test method according to the eighth aspect, in any one of the first to seventh aspects, when the subject (121) issues a specific word, the image (I1) and the next perforated sentence (S1) are displayed. Is displayed on the display unit (121).

According to this aspect, when the subject (102) issues a specific word, it is possible to shift to the next perforated sentence (S1) regardless of whether or not there is an answer.

The program according to the ninth aspect is a program for causing one or more processors to execute the cognitive function test method according to any one of the first to eighth aspects.

According to this aspect, it is possible to improve the evaluation accuracy of the attention / executive function among the cognitive functions including the memory function, the attention function, the information processing function, and the executive function.

The cognitive function test system (1) according to the tenth aspect includes a display unit (121), an inspection unit (112), and a control unit (11). The inspection unit (112) causes the subject (102) to make an utterance related to the image (I1) while displaying the image (I1) on the display unit (121). The control unit (11) causes the display unit (121) to display a perforated sentence (S1) in which a part of the sentence related to the image (I1) is blank together with the image (I1).

The configurations according to the second to eighth aspects are not essential configurations for the cognitive function test method and can be omitted as appropriate.

1 Cognitive function test system 11 Control unit 112 Inspection unit 121 Display unit I1 First image (image)
S1 perforated sentence

Claims

It is a cognitive function test method in which a subject is made to make an utterance related to the image while displaying an image on the display unit.
Along with the image, a perforated sentence in which a part of the sentence related to the image is left blank is displayed on the display unit.
Cognitive function test method.
Detects the presence or absence of an answer to the perforated sentence based on the partial voice included in the utterance.
The cognitive function test method according to claim 1.
The partial voice is the utterance voice at the end of the perforated sentence.
The cognitive function test method according to claim 2.
The partial voice is an utterance voice of a perforated portion in the perforated sentence.
The cognitive function test method according to claim 2.
When the answer is received, the image and the next perforated sentence are displayed on the display unit.
The cognitive function test method according to any one of claims 2 to 4.
The following perforated sentence changes according to the answer.
The cognitive function test method according to claim 5.
When the preset specified time has elapsed, the image and the next perforated sentence are displayed on the display unit.
The cognitive function test method according to any one of claims 1 to 6.
When the subject utters a specific word, the image and the next perforated sentence are displayed on the display unit.
The cognitive function test method according to any one of claims 1 to 7.
A program for causing one or more processors to execute the cognitive function test method according to any one of claims 1 to 8.
Display and
An examination unit that allows a subject to make an utterance related to the image while displaying an image on the display unit.
Along with the image, a control unit for displaying a perforated sentence in which a part of the sentence related to the image is blank is displayed on the display unit.
Cognitive function test system.