WO2023145386A1

WO2023145386A1 - Decision-making ability evaluation device, system, and program

Info

Publication number: WO2023145386A1
Application number: PCT/JP2022/048639
Authority: WO
Inventors: 雄介朝田; 迅成本
Original assignee: 京都府公立大学法人
Priority date: 2022-01-27
Filing date: 2022-12-28
Publication date: 2023-08-03
Also published as: JP7116515B1; JP2023109310A

Abstract

A decision-making ability evaluation device 20 for use in evaluating the decision-making ability of a test subject regarding the use of a product or a service is provided with: a voice data acquisition unit 230 that acquires voice data of a test subject from an interaction related to the use of a product or a service; a conversion unit 231 that converts the voice data of the test subject acquired by the voice data acquisition unit 230 into text data; and a determination unit 233 that determines the decision-making ability of the test subject regarding the use of the product or the service on the basis of the text data obtained by the conversion performed by the conversion unit 231.

Description

Decision-making ability evaluation device, system, and program

The present invention relates to a decision-making ability evaluation device, system, and program for evaluating the decision-making ability of test subjects.

With the progress of the aging population, problems related to the economic activities of the elderly are emerging. Economic capacity is the most important ability for the elderly to carry out their daily lives. Economic capacity includes daily activities such as purchasing food and daily necessities, using financial institutions, buying and selling real estate, making loans and making insurance contracts, etc. However, due to this decline in economic capacity, the risk of elderly people being involved in troubles such as fraud and unfair contracts is increasing.

On the other hand, after an elderly person purchased a financial product, the bank explained that there was no problem with mental capacity and made the transaction. There are also problems such as being submitted.

For example, Patent Literature 1 acquires examination data of an examination subject based on a two-way video and voice dialogue between an examiner and an examination subject via a video conference system, and uses the examination data to determine mental capacity. A system that creates data and remotely evaluates the decision-making ability in economic activities of the test subject based on both the data for judging mental capacity in economic activities of the test subject and the financial literacy score of the test subject; It discloses how.

Patent No. 6253573

The test data of the test subject in Patent Document 1 is created by recording the content of the test subject's answers in the two-way video and voice dialogue between the test subject and the test subject. There is. In addition, the financial literacy score is required separately from the data for judging mental capacity in order to evaluate whether or not the test subject has financial literacy.

The problem to be solved by the present invention is to obtain, in real time, voice data of a test subject uttered in response to a question about the use of a product or service, and use the voice data to explain the use of the test subject's product or service. An object of the present invention is to provide a decision-making ability evaluation device, system, and program for determining decision-making ability.

Section 1. A decision-making ability evaluation device used to evaluate a person's decision-making ability in the use of goods or services,
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In a decision-making ability evaluation device comprising
The voice data of the person to be inspected is
the test subject's answers to questions for evaluating the test subject's understanding;
the test subject's responses to questions to assess the test subject's cognition; and the test subject's responses to questions to assess the test subject's reasoning;
including at least two of
When the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding, the determination of the decision-making ability by the decision-making ability determination unit includes the test subject's Including determining the understanding of the test subject based on the text data converted from the test subject's answers to the questions for evaluating the understanding of
When the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's recognition, the determination of the decision-making ability by the decision-making ability determination unit includes the test subject's Determining the recognition of the test subject based on text data converted from the test subject's answers to questions for evaluating the recognition of the test subject, and When the test subject's answers to questions for evaluating logical thinking are included, the determination of decision-making ability by the decision-making ability determination unit is based on the examination of questions for evaluating the logical thinking of the test subject. A decision-making ability evaluation device including determining the logical thinking of a test subject based on text data obtained by converting the subject's answer.
Section 2. the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's expression of choice;
Judgment of decision-making ability by the decision-making ability judgment unit,
2. Decision-making according to paragraph 1, comprising determining the test subject's statement of choice based on text data obtained by converting the test subject's answer to a question for evaluating the test subject's statement of choice. Ability evaluation device.
Item 3. The determination of decision-making ability by the decision-making ability determination unit is performed by combining words with high frequency of co-occurrence in the text obtained by converting the voice data of the test subject's utterances in the dialogue related to the use of the product or service. Item 3. The apparatus for evaluating decision-making ability according to

Item

1 or 2, including determining that the test subject understands if the test subject is awakened.
Section 4. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
The questions for evaluating the test subject's comprehension include a first expression in a specific field and the frequency of occurrence with the expression, created using a machine learning model trained on text data related to current events. Item 3. The apparatus for evaluating decision-making ability according to

Item

1 or 2, which is a fill-in-the-blank question of the second expression in the sentence including the second expression with a high value.
Item 5. The voice data acquisition unit includes a question for evaluating the recognition of the person being examined, and the person's answer to the question for evaluating the person's recognition,
The decision-making ability determination unit,
At least one same word appears in common between the text obtained by converting the voice data of the question for evaluating the recognition of the test subject and the text obtained by converting the voice data of the answer of the test subject. matter,
A combination of co-occurrences of the commonly appearing word and another word in the text obtained by converting the voice data of the test subject's answer is a question for evaluating the recognition of the test subject. and that the word related to the test subject appears in the text obtained by converting the test subject's answer. Item 5. The decision-making ability evaluation device according to any one of items 1 to 4, which determines that the
Item 6. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's logical thinking,
The text data obtained by converting the test subject's answers to the questions for evaluating the test subject's logical thinking includes words representing comparison, or words representing presentation, paralleling, or enumeration of similar items. 5. The decision-making ability evaluation device according to any one of 1 to 4.
Item 7. Judgment of decision-making ability by the decision-making ability judgment unit,
Based on whether the contents of the text data converted from the question for evaluating the understanding of the test subject and the text data converted from the test subject's answer to it are positive or negative, Item 5. The decision-making ability evaluation device according to any one of items 1 to 4, including determining logical thinking.
Item 8. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
questions for assessing the subject's comprehension include instructions for the subject to read a document related to the use of goods or services;
The decision-making ability evaluation device,
an image acquisition unit that acquires image data of a person to be inspected;
further comprising a line-of-sight measurement unit that analyzes the image data of the face of the inspection subject acquired by the image acquisition unit and measures the trajectory of the line of sight;
2. The decision-making ability evaluation device according to item 1, wherein the decision-making ability determination unit determines the understanding of the person being examined based on the measurement result of the line-of-sight trajectory received from the line-of-sight measurement unit.
Item 9. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
questions for assessing the subject's comprehension include instructions for the subject to read a document related to the use of goods or services;
The decision-making ability evaluation device,
an image acquisition unit that acquires image data of a person to be inspected;
further comprising a face orientation measurement unit that analyzes the image data of the face of the person to be inspected acquired by the image acquisition unit and measures the orientation of the face;
2. The apparatus for evaluating decision-making ability according to Item 1, wherein the decision-making ability determination unit determines the understanding of the person being examined based on the face orientation measurement result received from the face orientation measurement unit.
Item 10. Item 10. A decision-making ability evaluation system for evaluating the decision-making ability of a person to be tested in using a product or service, comprising: an inspection terminal; with a decision-making ability evaluation device of
The decision-making ability evaluation system, wherein the speech data acquisition unit of the decision-making ability evaluation device acquires the examination subject's speech data from a dialogue related to use of the product or service received from the examination terminal.

Item 11. A decision-making ability evaluation program used to evaluate a person's decision-making ability in the use of goods or services, the computer comprising:
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In the decision-making ability evaluation program that functions as
The voice data of the person to be inspected is
the test subject's answers to questions for evaluating the test subject's understanding;
the test subject's responses to questions to assess the test subject's cognition; and the test subject's responses to questions to assess the test subject's reasoning;
including at least two of
When the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding, the determination of the decision-making ability by the decision-making ability determination unit includes the test subject's Including determining the understanding of the test subject based on the text data converted from the test subject's answers to the questions for evaluating the understanding of
When the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's recognition, the determination of the decision-making ability by the decision-making ability determination unit includes the test subject's Including determining the recognition of the test subject based on the text data converted from the test subject's answer to the question for evaluating the recognition of
and when the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's logical thinking, the determination of the decision-making ability by the decision-making ability determination unit A program for evaluating decision-making ability, including judging the logical thinking of an inspected person based on text data obtained by converting the responses of the inspected person to questions for evaluating the logical thinking of the inspected person.
Item 12. the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's expression of choice;
The judgment of decision-making ability by the decision-making ability judging unit is based on text data obtained by converting the test subject's answers to questions for evaluating the test subject's expression of selection. 12. The program for evaluating decision-making ability according to Item 11, comprising determining the.
Item 13. The determination of decision-making ability by the decision-making ability determination unit is performed by combining words with high frequency of co-occurrence in the text obtained by converting the voice data of the test subject's utterances in the dialogue related to the use of the product or service. 13. A decision-making ability assessment program according to

clause

11 or 12, comprising determining that the test subject understands if aroused.
Item 14. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
The questions for evaluating the test subject's comprehension include a first expression in a specific field and the frequency of occurrence with the expression, created using a machine learning model trained on text data related to current events. 13. The program for assessing decision-making ability according to

Item

11 or 12, wherein the program is a fill-in-the-blank question of the second expression in the sentence containing the second expression with a high .
Item 15. The voice data acquisition unit includes a question for evaluating the recognition of the person being examined, and the person's answer to the question for evaluating the person's recognition,
The decision-making ability determination unit,
At least one same word appears in common between the text obtained by converting the voice data of the question for evaluating the recognition of the test subject and the text obtained by converting the voice data of the answer of the test subject. matter,
A combination of co-occurrences of the commonly appearing word and another word in the text obtained by converting the voice data of the test subject's answer is a question for evaluating the recognition of the test subject. and that the word related to the test subject appears in the text obtained by converting the test subject's answer. 15. The decision-making ability evaluation program according to any one of items 11 to 14, which determines that the decision-making ability evaluation program.
Item 16. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's logical thinking,
The text data obtained by converting the test subject's answers to the questions for evaluating the test subject's logical thinking includes words representing comparison, or words representing presentation, paralleling, or enumeration of similar items. The decision-making ability evaluation program according to any one of 11 to 14.
Item 17. The determination of decision-making ability by the decision-making ability determination unit is based on the content of the text data converted from the question for evaluating the understanding of the test subject and the text data converted from the test subject's answer to the question, 15. The decision-making ability evaluation program according to any one of items 11 to 14, comprising determining the logical thinking of the test subject based on whether it is positive or negative.
Item 18. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
questions for assessing the subject's comprehension include instructions for the subject to read a document related to the use of goods or services;
The decision-making ability evaluation program causes the computer to:
an image acquisition unit that acquires image data of a person to be inspected;
further functions as a line-of-sight measurement unit that analyzes the image data of the face of the inspection subject acquired by the image acquisition unit and measures the trajectory of the line of sight;
12. The decision-making ability evaluation program according to item 11, wherein the decision-making ability determination unit determines the comprehension of the test subject based on the measurement result of the line-of-sight trajectory received from the line-of-sight measurement unit.
Item 19. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
questions for assessing the subject's comprehension include instructions for the subject to read a document related to the use of goods or services;
The decision-making ability evaluation program causes the computer to:
an image acquisition unit that acquires image data of a person to be inspected;
analyzing the image data of the face of the person to be inspected acquired by the image acquisition unit and further functioning as a face orientation measurement unit for measuring the orientation of the face;
12. The decision-making ability evaluation program according to item 11, wherein the decision-making ability determination unit determines the comprehension of the test subject based on the face orientation measurement result received from the face orientation measurement unit.
Item 20. A recording medium for recording the decision-making ability evaluation program according to any one of items 11 to 19.

According to the present invention, it is possible to quickly and highly accurately evaluate the decision-making ability of an inspected person by a computer based on the voice data of the inspected person acquired in response to questions regarding the use of goods or services. .

Explanatory drawing of the decision-making ability evaluation system of this embodiment. Explanatory drawing of a decision-making ability evaluation apparatus. Explanatory diagram of evaluation items for evaluation of financial product trading ability. Explanatory diagram of memory and association based on the relationship between words in a sentence. (A) Representative examples of nouns with a high appearance frequency among the words obtained by decomposing the sentence. (B) An example of an economic policy article posted on a website, (C) A graph of each word and its frequency of occurrence. (A) A network diagram showing the relationship of co-occurring words in economic policy articles, (B) a set of co-occurring words and a list of their appearance frequencies. An example of vectorization of text. An example of sentence vector clustering using machine learning. An example of a conversation between an inspector and an inspection subject. An example of text analysis to assess the 'perception' of a test subject. (A) A sentence in which the speech data of the test subject's utterance is converted into text, (B) A list of the texts of FIG. Estimation by BERT if there is. An example of analysis for evaluating the test subject's ability to "think logically about results." (A) sentences in which the voice data of the test subject's utterances are converted into text; (B) a list of the texts of FIG. 11A decomposed by morphological analysis; An example of analysis for evaluating the examinee's ability of "comparative logical thinking". (A) Speech of inspector, (B) Speech of inspection subject, (C) Implementation example. Examples of utterances used to assess a test subject's ability to be "logically coherent." An example of a document used to assess a test subject's ability to be "logically coherent." (A) The trajectory of the gaze of a healthy person, (B) The trajectory of the gaze of a person with cognitive decline. (A) An example of morphological analysis of a question sentence, (B) a schematic graph showing changes in gaze position over time of a healthy subject, (C) a schematic graph showing changes in cognitive function over time in gaze position. 4 is a flowchart showing the flow of processing executed by the inspection terminal 10; 4 is a flow chart showing the flow of processing executed by the decision-making ability evaluation device 20 of the present embodiment. Explanatory drawing of another example of decision-making ability evaluation. Explanatory drawing of another example of a decision-making ability evaluation system.

1. Evaluation of the test subject by the tester We will record and explain an example in which the inspector directly evaluates the financial transaction ability as the decision-making ability of the person being inspected.

In evaluating financial transaction ability, it is possible to apply the evaluation method of medical consent ability (consent for surgery, etc.) in the medical field. According to the structured interview method MacArthur Competence. Assessment Tool for Treatment (MacCAT-T), Appelbaum PS et al: Professional Resource Press; , ``logical thinking'' and ``expression of choice''.

"Understanding" is the ability to "remember" presented information and "associate" from that memory. It doesn't matter if the information presented is relevant to you or not. It is desirable for the learner to be able to generate sentences by himself/herself using the information, but if the learner can repeat the presented information in the same words, it may be evaluated as "understanding". As this comprehension decline progresses, expressions become vague and difficult to remember.

“Awareness” means knowing that all or part of the information presented “relates to you” and/or you “make a choice out of the information presented to you.” indicate that it is "associating". As this cognitive function declines, expressions become ambiguous.

"Logical thinking" includes (1) logical thinking and guessing about results, (2) logical thinking for comparison, and (3) logical consistency.

(1) ``Logical thinking and speculation about the result'' is the ability to associate the result you have selected within the ``range of the information presented'' (the logic that leads to the result). It also includes associating beyond the scope of information (developing associations based on logic that leads to results).
(2) "Comparative logical thinking" refers to the ability to compare multiple options.
(3) "Logical Consistency" is the process leading to the conclusion of the comparison in (2), without any disconnection of associations within or between speakers, until the choice is made.

"Expression of choice" is to prove which one was selected as a result of comparison based on logical thinking, for example, by explicit declaration of intention.

In order to evaluate the decision-making ability in the financial field based on the above four evaluation indicators of MacCAT-T, questions should be set to include the contents of the financial field for the test subject. In addition, by evaluating "understanding" of financial questions, it is possible to evaluate not only "understanding" but also "financial literacy".

Generally, if you have all the "understanding", "reasoning" and "statement of choice" (or "understanding", "recognition", "reasoning" and "statement of choice") for financial questions is evaluated as having sufficient financial transaction ability of the person being inspected. In addition, at least one of “understanding”, “logical thinking” and “statement of choice” (or “understanding”, “recognition”, “logical thinking” and “statement of choice”) for questions in the financial field If not, the financial transaction ability of the inspected person is evaluated as insufficient. However, the criteria for judging whether the financial transaction capacity is sufficient or insufficient can be changed according to the financial transaction capacity required for individual financial transactions.

Table 1 shows the two-way video and voice dialogue between the inspector and the person being inspected. This is an example of evaluating decision-making ability, specifically decision-making ability for purchasing financial products.

The four elements were evaluated as Positive when doctors and other specialists judged that they had the ability, Negative when they judged they had no ability, and Neutral when they could not distinguish between the two.

Mr. A is 72 years old, and he is worried that he is becoming more "forgetful" due to his age, but he is trying not to let people around him know about it. They have one son and one daughter, but now they live independently and far away. Ms. A has been living alone since her husband died three years ago. As for Mr. A's assets, he has 10 million yen in our bank and 10 million yen in other banks. Until now, I managed about 2 million yen in investment trusts and stocks at a securities company. The other day, I received a notice of maturity of the regular deposit that I had deposited, so last month I visited Bank X, received a proposal for investment in an "investment trust", and decided to consider it until the maturity date. This is my second visit to the bank.

"No. in Table 1." During conversations 1 to 10, based on Mr. A's answers, employee Y evaluates Mr. A's "understanding", "recognition", "logical thinking", and "expression of choice".

　No. 2 Mr. A's answer is No. In response to the explanation of employee Y in 3, he knows that the question is related to himself in light of his own asset status, and is able to associate it with a transaction. Therefore, the recognition is determined as Positive.

　No. 4 Mr. A's answer is No. "Memorize" the explanation of staff Y in 3, and "associate" from that memory. Therefore, comprehension is judged as Positive.

　No. The answer of Mr. A in 6 is that the options of depositing and not depositing are organized in consideration of the advantages and disadvantages, and the result is that both are the same. Therefore, logical thinking is judged as Positive.

　No. Mr. A's reply from 8 asks him to sort out the disadvantages of those without risks and those with risks, and to present the good ones to employee Y. Therefore, logical thinking is judged as Positive.

　No. At 10, as a result of comparison based on logical thinking, Mr. A expresses an explicit intention to positively consider the introduction of a new financial product, and the declaration of selection is determined as Positive.

"No. in Table 1." From exchanges 1 to 10 (especially Nos. 2, 4, 6, 8, and 10), Mr. A is fully equipped with the ability to "understand," "recognise," "logically think," and "express choices" regarding financial transactions. is determined to be Therefore, the inspector can decide that Mr. A may be introduced to a new financial product.

Table 2 shows the two-way video and audio dialogue between the inspector and the person being inspected. This is an example of evaluating decision-making ability, specifically decision-making ability for purchasing financial products.

Mr. B is 72 years old, and the child is now living independently and far away. Ms. B has been living alone since her husband passed away. As for Mr. B's assets, he has 10 million yen in our bank and 10 million yen in other banks. Until now, I managed about 2 million yen in investment trusts and stocks at a securities company. The other day, I received a notice of maturity of the regular deposit that I had deposited, so last month I visited Bank X, received a proposal for investment in an "investment trust", and decided to consider it until the maturity date. This is my second visit to the bank.

No. in Table 2. During conversations 1 to 10, based on Mr. B's answers, employee Y evaluates Mr. B's "understanding", "recognition", "logical thinking", and "expression of choice".

　No. Mr. B's answer in 2 is that despite having sufficient savings, he is worried about lack of funds for living. is judged to be Neutral.

　No. 4 Mr. B's reply is No. Regarding the explanation of Employee Y in 3, it is difficult to judge whether the explanation is understood or not, so the understanding is judged as Neutral.

　No. Mr. B's reply in 6 indicates that he cannot guess the outcome of the transaction from his own financial situation, and is judged as Negative for understanding and Negative for logical thinking.

　No. Mr. B of 8 replied, "I will leave it to you", which is often seen by people with dementia. , logical thinking is judged as Negative.

　No. At 10, Mr. B chooses to proceed with the transaction without comparing his living situation and asset situation, so his logical thinking is determined as Negative.

No. in Table 2. From exchanges 1 to 10 (especially No. 2, 4, 6, 8, 10), Mr. B has "understanding", "recognition", and "logical thinking" regarding financial transactions (hoping to introduce new financial products). is determined to be inadequate. For this reason, even if a positive "expression of choice" was made at the end, it cannot be determined that Mr. B has other abilities, so the examiner decides to stop introducing Mr. B to a new financial product. be able to.

As described above, it is necessary to train inspectors in order to determine whether the person being inspected has financial decision-making ability, and it takes time to train inspectors who can sufficiently perform inspections. Furthermore, the contents of the inspection are also complicated, and there is a possibility that the inspection results may vary depending on the inspector.

The present invention overcomes the disadvantages of face-to-face evaluation of decision-making ability by an inspector by supporting decision-making ability evaluation by a decision-making ability evaluation device or a decision-making ability evaluation system. It is to be resolved.

2. Evaluation of test subject by decision-making ability evaluation device or decision-making ability evaluation system (1) Evaluation of decision-making ability using text data Hereinafter, with reference to the drawings, a decision-making ability evaluation device, a decision-making ability evaluation system, and an embodiment of the present invention embodying a decision-making ability evaluation program.

As shown in FIG. 1, the decision-making ability evaluation system of this embodiment includes a test terminal 10 and a decision-making ability evaluation device 20.

In this specification, "dialogue regarding use of goods or services" includes "questions for evaluating decision-making ability of test subjects".
In this specification, "questions related to the use of goods or services" refer to terms of use, user manuals, instruction manuals, usage instructions, etc. that the test subject must contact with his eyes, ears, fingers, etc. when using goods or services. Licensing agreements, warranties, prospectuses, agreements, and other documents that accompany contracts, or part of these documents in question format, or electronic data in the same field as the product or service (for example, extracted from online content (Electronic data, electronic data extracted from a local database or electronic dictionary) refers to questions created for decision-making ability evaluation.

For example, when a person to be inspected wants to purchase a certain financial product, the questions are not limited to those using documents related to the financial product itself, but also questions created from electronic data of financial or economic news or articles, such as questions about interest rates. Included in "Questions about the use of goods or services."

At least one of the questions to evaluate the decision-making ability of the test subject should be a question about the use of goods or services. It may be a question about usage. Among the questions for evaluating the decision-making ability of the test subject, questions other than questions about the use of goods or services may be any questions as long as they can evaluate the decision-making ability of the test subject. It can be a problem, etc.

Questions for evaluating the decision-making ability of the test subject include questions for evaluating the test subject's "understanding", "recognition", "logical thinking", and "expression of choice". In addition, the questions for evaluating the test subject's "understanding", "recognition", "logical thinking", and "expression of choice" are intended to acquire the test subject's answers to the questions. If so, it does not necessarily have to be in the form of an interrogative sentence to ask the person to be examined, and includes voice utterances that are not in the form of questions, and questions displayed on paper or on a display device.

In this embodiment, the test subject may be any person who needs evaluation of decision-making ability, for example, an elderly person aged 65 or over. In addition, test subjects include, for example, those subjectively or objectively having a decline in cognitive function and having doubts about their decision-making ability.

In this embodiment, the tester is not particularly limited, and experts such as doctors and clinical psychologists, other people who have received specialized training in cognitive function testing, or employees of providers who provide products or services include but are not limited to. Alternatively, when the decision-making ability evaluation of the present invention is performed by a computer, the test can be performed by the control unit of the test terminal 10 or the decision-making ability evaluation device 20 .

The inspection terminal 10 is a terminal that acquires and records biological information such as the voice and images of the person to be inspected. Examples of the inspection terminal 10 include a smart phone, a mobile phone, a tablet terminal, a personal computer, and the like.

The inspection terminal 10 may be owned by the person to be inspected, or may be installed in a medical institution, a financial institution, or a building where products or services are provided, but is not limited to these.

The inspection terminal 10 includes an operation unit 11, a communication connection unit 12, a control unit 13, a storage unit 14, a display device 15 such as a display, a speaker 16, a microphone 17, and an imaging device 18.

The operation unit 11 includes a keyboard, mouse, pointing device, and the like.

The communication connection unit 12 is an interface for connecting the inspection terminal 10 to other external devices for communication, and may be wireless or wired, and includes LAN, the Internet, and the like.

The control unit 13 includes control means such as a CPU, memories such as RAM and ROM, and performs various processes in the subject terminal 10 .

The storage unit 14 is a storage medium for recording various data in the inspection terminal 10, and includes, for example, a hard disk drive and a solid state drive. The storage unit 14 can be used to record data of a program executed by the control unit 13, data transmitted/received between the inspection terminal 10 and an external device, and the like.

The display device 15 is, for example, a liquid crystal monitor, and displays various data output according to commands from the control unit 13 .

The speaker 16 is a device that outputs utterances from the examiner and questions regarding the use of products or services as voice. Speech from the examiner received by the testing terminal 10 from an external device such as the decision-making ability evaluation device 20, or an external device such as the decision-making ability evaluation device 20 or the memory or storage unit 14 of the control unit 13 of the testing terminal 10 A question about use of the product or service received from the storage unit is converted into voice by the control unit 13 and output from the speaker 16 .

The microphone 17 is a device for inputting the voice spoken by the person to be examined. Speech of the person to be examined is input through the microphone 17 and analog-digital converted into voice data by the control unit 13 . This audio data is recorded in the memory of the control unit 13 or a storage unit such as the storage unit 14 . Also, the speech data is transmitted to the decision-making ability evaluation device 20 via the communication connection unit 12 by the processing executed by the control unit 13 .

The imaging device 18 is, for example, a camera built into the inspection terminal 10, and acquires time-series image data. The image data is data including at least the face image of the person to be inspected. This image data is recorded in the memory of the control unit 13 or a storage unit such as the storage unit 14 . Further, the image data is transmitted to the decision-making ability evaluation device 20 via the communication connection unit 12 by the processing executed by the control unit 13 .

A decision-making ability evaluation device 20 is connected to the testing terminal 10 via the Internet or the like. Examples of the decision-making ability evaluation device 20 include smartphones, mobile phones, tablet terminals, personal computers, servers, and the like.

As shown in FIG. 2, the decision-making ability evaluation device 20 includes a communication connection unit 22, a control unit 23, a storage unit 24, and a display unit 25.

The decision-making ability evaluation device 20 may be owned by an inspector or an organization to which the inspector belongs, or may be installed in a medical institution, a financial institution, a real estate company, or a building where products or services are provided. However, it is not limited to these.

The communication connection unit 22 is an interface for communication connection of the decision-making ability evaluation device 20 with other external devices, and may be wireless or wired, and includes a LAN, the Internet, and the like. The test terminal 10 and the decision-making ability evaluation device 20 are connected for communication with each other via the

communication connection units

12 and 22 .

The storage unit 24 is a storage medium for recording various data in the decision-making ability evaluation device 20, and includes, for example, a hard disk drive and a solid state drive. The storage unit 24 can be used to record data of programs executed by the control unit 23, data transmitted and received by the decision-making ability evaluation device 20 to and from external devices, and the like.

The control unit 23 includes control means such as a CPU, memories such as RAM and ROM, and performs various processes in the decision-making ability evaluation device 20 .

The control unit 23 includes a voice data acquisition unit 230 that acquires voice data of the subject, a conversion unit 231 that converts the voice data acquired by the voice data acquisition unit 230 into text data, and text data converted by the conversion means. A text analysis unit 232 for analyzing data and a judgment unit 233 for judging the decision-making ability of the person to be examined for use of products or services based on the data analyzed by the text analysis unit 232 are provided. The determination unit 233 , a portion of the text analysis unit 232 that functions to determine the decision-making ability of the test subject to use products or services, and the decision-making ability determination unit 238 are configured.

The acquisition unit 230 acquires the audio data of the inspector's utterance and the audio data of the inspection subject's utterance. Speech recognition is performed on the voice data of a person's utterance, and the data is converted into text data in a form that allows individual utterances to be identified. A text analysis unit 232 analyzes the text data generated by the conversion unit 231 . Examples of analysis include morphological analysis that breaks sentences into words. Next, based on the text data converted by the conversion unit 231, the determination unit 233 determines the decision-making ability of the person to be examined regarding the use of products or services.

In this embodiment, the control unit 23 further includes a data management unit 234, an image acquisition unit 235 that acquires image data of the person to be inspected, and an image data of the face of the person to be inspected acquired by the image acquisition unit 235. Then, a line-of-sight measurement unit 236 that measures the trajectory of the line of sight, and a face orientation measurement unit 237 that analyzes the image data of the face of the inspection subject acquired by the image acquisition unit 235 and measures the orientation of the face are further provided. I have.

Examples of biometric information acquired from the test subject while receiving questions about the use of products or services include A) voice, B) eye movement (line of sight), C) face orientation, or A) the voice is acquired as voice data by the voice data acquisition unit 230, and B) the eye movement (line of sight trajectory) and C) the face direction are obtained by combining two or three of them. is obtained by the image obtaining unit 234 as the image data of the face of the child, and is analyzed later.

Here, the method of evaluating each of the test subject's "understanding", "recognition", "logical thinking", and "expression of choice" by the decision-making ability determination unit 238 of the decision-making ability evaluation device 20 will be described.

First, I will explain the evaluation of "understanding".

For example, Figure 3 shows the evaluation of financial product trading ability by applying MacCAT-T and CANDy (Oda et al., Conversational assessment of cognitive dysfunction among residents living in long-term care facilities Published online by Cambridge University Press: 21 September 2017). shows the evaluation items for

The evaluation of literacy in a certain field of transactions (financial literacy in this case) is based on whether or not the test subject understands (memorizes and associates) appropriate words and co-occurring words related to that field (here in the financial field). It can be evaluated by determining whether

In one embodiment, in the case of a scene in which a financial product is recommended to a person to be inspected, the question to evaluate the person's "understanding" is, "If interest rates in the United States rise, will the yen depreciate? Will the yen appreciate?" Will it be?” in the financial or economic field. As answer candidates for this question, data of answers including "yen depreciation" including "yen depreciation" are stored in the data management unit 234 or the storage unit 24 as answer candidates indicating that "understanding" is possible. In addition to storing, the data management unit 234 stores the data of answers including "strong yen" such as "strong yen" and data of answers "I don't know" as answer candidates indicating that "understanding" is not possible. Alternatively, it is stored in the storage unit 24 . Then, the text analysis unit 232 analyzes the text obtained by converting the speech data of the person to be examined acquired from the dialogue related to the use of the product or service. Next, the text analysis unit 232 or the determination unit 233 analyzes the test subject's answers to the questions for evaluating the test subject's understanding and the answer candidates stored in the data management unit 234 or the storage unit 24. In comparison, if the test subject's answer matches the answer that includes "yen depreciation", it is determined that the test subject has "understanding" and includes "strong yen" and "don't know". If it matches the answer given, it can be determined that the person to be examined does not "understand".

Instead, the question "Will the yen depreciate or appreciate if interest rates in the United States rise?" may be asked to answer by voice.

Alternatively, instead of having the examiner, who is a natural person, issue questions for evaluating the “understanding” of the person being inspected, voice data of such questions stored in the data management unit 234 or the storage unit 24 may be issued. good.

In this way, by evaluating understanding (memory, association) in the financial field, it is possible not only to evaluate the presence or absence of financial literacy, but also to evaluate the "understanding" of the test subject.

In another embodiment, when words co-occur in the text obtained by converting the speech data of the test subject, the text analysis unit 232 or the determination unit 233 determines whether the test subject "understands" It can be determined that

For example, in the scene of soliciting financial products, the likelihood of the test subject's memory is determined in terms of whether the test subject's utterances are in line with current events.

As shown in the example sentences related to current affairs in Fig. 4, words appearing simultaneously in the same sentence can be regarded as appearing through association. For this reason, when the test subject memorizes a certain word and a topic (episode) related to that word, and the words co-occur in the sentence, it can be considered that the subject can associate the memory. . If this relationship between words is applied to the evaluation of the test subject's "understanding", the data of words that frequently co-occur in the same sentence is analyzed by the data analysis unit 232 of the control unit 23 of the decision-making ability evaluation device 20. , and stored/learned in the data management unit 234 or the storage unit 24 . The determination unit 233 stores, in the data management unit 234 or the storage unit 24, combinations of words co-occurring in the same sentence in the text obtained by converting the speech data of the test subject's speech obtained from the data analysis unit 232. It is possible to evaluate whether or not the test subject is able to associate the memory by comparing with the data of the words obtained and by obtaining the frequency of co-occurrence.

FIG. 5-6 shows an example of obtaining data between words that are frequently co-occurred in the same sentence by storing and learning the data between words in the data management unit 234 or the storage unit 24 of the decision-making ability evaluation device 20. .

As shown in FIG. 5(A), the available words shown in FIG. The control unit 23 acquires electronic data, here, a plurality of economic policy articles posted on a website, and counts the number of words appearing in the text that are the same as those shown in FIG. The text analysis unit 232 counts and obtains the appearance frequency of each word (FIG. 5(C)). Electronic data for analyzing sentences and extracting words is not particularly limited as long as it is text data. Training materials may be converted into text data. Also, the electronic data does not have to be related to current affairs.

In addition, the text analysis unit 232 can analyze sentences in economic policy articles posted on websites, and obtain sets of words co-occurring in the same sentence and their frequency of occurrence (Fig. 6 (A ), (B)).

Such a set of words co-occurring in the same sentence is optionally stored and learned in the data management unit 234 or the storage unit 24 together with the appearance frequency, and the utterance of the test subject acquired from the text analysis unit 232 If words co-occur in the same sentence stored and learned in the data management unit 234 or the storage unit 24 in the text obtained by converting the speech data of the judgment unit 233, It can be determined that a person "understands" current affairs. When words with an appearance frequency higher than a certain number co-occur, the determination unit 233 may determine that the test subject "understands" the current affairs.

In order to facilitate understanding, the above description exemplifies the case where words co-occur in the same sentence. Appearance of co-occurring words in the text obtained by converting the speech data of the entire utterance of the test subject in the dialogue related to the use of the service may be examined.

Regarding "memory", since people with dementia often forget from the most recent memory, it is possible to judge the presence or absence of memory from remarks related to the most recent current event. Within ~3 months), it can be considered that the test subject has memory of recent current events based on the evaluation of "understanding" using such electronic data of current events. In a further embodiment, the text analysis unit 232 of the decision-making ability evaluation device 20 divides frequent expressions included in the electronic text data into groups by date and period (hereinafter referred to as expression groups), and divides the frequent expressions into groups. can be written as a vector. Any existing machine learning model such as BERT (Bidirectional Encode r Representations from Transformers) or USE (Universal Serial Encoder) can be used to vectorize text data. At this time, expressions included in the test subject's utterance and the learned expression group are close (high in similarity), and expressions are made so that the likelihood of the test subject's memory is high.

Fig. 7 is an example of vectorization of sentences. For example, in (1), suppose there are sentences a and b. In (2), these sentences are divided into words (tokens) by morphological analysis. In (3), by assigning a value depending on the appearance frequency to this token, the text can be converted into a string of numbers. In (1), a is the weather and b is the traffic content, but referring to the data set in the field of goods or services planned to be used by the test subject (e.g. finance, economy, current affairs, medical care), It becomes a vector that easily reflects the characteristics of terms in the relevant field.

As shown in Fig. 8, sentences containing combinations of co-occurring words are vectorized from the text data of a specific field. For example, a set 51 of co-occurring words is analyzed from electronic text data 50 on the Internet in the field of finance and finance, sentences containing such co-occurring words are described by multidimensional vectors, and expression group 1 cluster. In addition, sentences obtained from electronic text data 53 on the Internet in the field of sports are also described by multidimensional vectors and clustered into expression group 2 . The expression group 1 and the expression group 2 are shown at coordinates 53 by

reference numerals

54 and 55, respectively.

The distance D of an example sentence 56 (sentences in which utterances are converted into text (sentences containing topics) from group 1 indicates the degree of similarity with the field of finance. For example, if the contents of the analyzed text of the text of the examiner's utterance are decomposed and the content of finance is closer to expression group 1, and if the content of the analysis is the content of sports, expression group It approaches 2. The closer the distance from the group of expressions in the learned specific field is, the closer the example sentence 56 is to the topic, and the speaker can be considered to have memorized the contents of this field. For example, if a sentence containing co-occurring words obtained by converting the utterance of the person to be inspected into text is within a certain range from a group of expressions in a certain specific field, the determination unit 233 determines that the inspection It can be determined that the subject has the ability of "understanding".

In another embodiment, the text analysis unit 232 fills in the [MASK] in the sentence using a bidirectional encoded expression model (BERT model) learned from electronic text data such as current affairs data on a website. Created and printed by the control unit 23 or displayed on the display unit 25 Fill-in-the-blank questions are answered by the test subject, and based on the results, the test subject's "understanding" ability is evaluated. You may According to the BERT model, given an input containing [MASK], we can obtain words that fill [MASK] in descending order of probability or appearance frequency. For example, if you enter "When U.S. interest rates rise, Japanese stock prices [MASK]", [MASK] contains top The answer is obtained as a word of If the test subject's answer matches the probability obtained by BERT or a word with a high frequency of appearance, it can be determined that the test subject has the ability of "understanding". If the test subject's answer does not match the probability obtained by BERT or a word with a high frequency of appearance, it can be determined that the test subject does not have the ability to "understand".

Next, we will explain the evaluation of "recognition" and the evaluation of "(1) logical thinking about results" in "logical thinking".

As noted above, "awareness" means knowing that the information presented, in whole or in part, "relates to you" and/or that you "select" from the presented information. It is to express that you are associating the result when you do it.

For this reason, (1) words are associated with each other between speakers, and (2) words that indicate that the speaker is involved appear in the text converted from the utterance of the test subject. Alternatively, it is possible to use the fact that it can be easily estimated from the text obtained by converting the utterance of the person to be inspected into an evaluation index.

For example, Figure 9 is a conversation between the inspector and the person being inspected.

In response to question 60 from the examiner, "Mr. Kitano, thank you for your deposit until maturity. I would like to confirm again, but do you have any plans to use the funds?" , (I*) don't use the money in particular, so I'm thinking of putting it aside for about 5 years.Since I have enough money for living expenses and hospitalization expenses after retirement, I need this money soon. No.”

When these are viewed as text, at least one word (“use”, “funds”) that co-occurs in the sentence of the question 60 of the inspector appears in the response 61 of the person to be inspected, and In the test subject's answer 61, words co-occur in combinations different from those in the preamble ("use", "place"). For this reason, words are associated between speakers.

In response 61 of the person being tested, the subject may be omitted before ``I don't particularly use funds,'' and in that case, it is necessary to guess from the sentences before and after, but ``I am'', ``This is In this case, it is easy to guess that there is a high probability that "I am" will be filled in, and the words that indicate that you are involved are not included in the text converted from the test subject's utterance. can be regarded as appearing in

Therefore, the test subject can determine that the test subject has the ability of "recognition".

A case where the decision-making ability evaluation device 20 performs the above "recognition" evaluation will be described. FIG. 10(A) is a sentence obtained by converting the voice data of the test subject's utterance into text. When the text analysis unit 232 decomposes the text in FIG. 10(A) by morphological analysis, it is decomposed and listed as shown in FIG. 10(B), for example. The text analysis unit 232 or the determination unit 233 compares whether the text data of the inspector's utterance before the text data of the inspector's utterance includes the same words for the words "use" and "funds." Then, from the comparison result, it can be determined that this co-occurring word appears repeatedly among the speakers. Furthermore, the text analysis unit 232 or the determination unit 233 learns and/or stores in advance whether the words “use” and “place” in the text data of the test subject's utterance are co-occurring words with high appearance frequency. The co-occurring words can be compared and determined.

When the subject in the sentence is omitted, the subject can be estimated using BERT, as shown in FIG. 10(C).

When the text analysis unit 232 determines that the sentence in FIG. presume. When a noun indicating the person himself or his property is embedded in [MASK], the text analysis unit 232 or the determination unit 233 can estimate that the topic is likely to be related to the person himself.

In this way, the decision-making ability determination unit 238 can determine that the test subject has the ability of "recognition".

Furthermore, among the responses 61 of this test subject (Fig. 11(A)), there are the conjunctive particles ``because I don't particularly use the funds'' (conjunctive), + Auxiliary verbs) also appear to indicate causes, reasons, grounds, motives, etc. (Note: Grammar varies from country to country, ``kara'' and ``because'' are classified as conjunctions in English, for example.)

FIG. 11B shows a part of the result of the text analysis unit 232 decomposing the text of FIG. 11(A) by morphological analysis. Particles/conjunctive particles" (Note: In English, the whole "so" is classified as a conjunction), but the text of the test subject's answer is the text of the test subject's utterance before the test subject's answer. In sentences that contain co-occurring words that differ from , if you can extract words that indicate the cause or reason, such as ``kara'' or ``so'', evaluate the ability of ``logical thinking about the result'' by counting the number of words For example, when the number is a certain number or more (for example, one or more), the text analysis unit 232 or the determination unit 233 determines that the test subject is "logical thinking about the result" can be determined to have the ability of FIG. 11C shows an implementation example.

Next, "(2) logical thinking for comparison" in "logical thinking" will be explained.
In the evaluation of the test subject's ability to "comparative logical thinking", during the conversation (that is, in the text data converted from the conversation), words that express comparison, presentation of similar things, parallelism, enumeration, etc. Appearance can be used as an evaluation index.

For example, FIGS. 12(A) and (B) are conversations between the inspector and the person being inspected.

Question from the examiner in Fig. 12 (A): "Low interest rates have continued, and the regular interest rate at maturity was 0.3%, but the current interest rate is 0.01% per year for 5 years. 1 million yen is 5 After a year, the interest income will be about 400 yen after taxes.It is unlikely that interest rates will rise.How much return would you like?" ``Well, it would be nice to have about 3%.

In the answers of the test subjects, the relative particle "mo", which is a word that expresses comparison, appears. Parallel words (nouns) appear in front of the two "mo", so it can be considered that the alternative is inherent in the sentence, and the test subject is able to "think logically to compare". can judge.

When the decision-making ability evaluation device 20 evaluates the "recognition" of the "logical thinking to be compared", the text analysis unit 232 decomposes the text obtained by converting the speech data of the test subject's utterance by morphological analysis or the like. . Next, when a word representing comparison or a word representing presentation, parallel, enumeration, etc. of similar things appears in the decomposed list, the text analysis unit 232 or the determination unit 233 can be determined to have the ability of "comparative reasoning". FIG. 12C shows an implementation example.

Examples of comparative words include yori (case particle: A to B), ``mo'' (relative particle: both A and B), ``ka'' (adjunct particle: A or B), and ``ga'' (conjunctive particle). : A, but B) and so on.

Next, we will explain the determination of "(3) logical consistency" in "logical thinking".

As mentioned above, ``logical consistency'' is the process leading to the comparison result of (2), ``no discontinuity in association'' throughout the conversation, and the process leading up to the declaration of choice.

In evaluating the test subject's "logical consistency" ability, the presence or absence of positive (+) and negative (-) remarks between speakers can be used as an evaluation index.

For example, Fig. 13 is a conversation between an inspector and an inspection subject.

In response to the inspector's utterance 62, "The customer's assets are denominated in US dollars, so the asset value is rising. If the coronavirus calms down and the economy can be expected to recover, the customer's assets can also be expected to rise." The subject's utterance 63 is "I wonder if vaccination will get better if vaccination spreads quickly."

The examiner's utterance 62 has positive contents for the other party when the information that the examinee can obtain gain is regarded as positive, and the examiner's utterance 63 also has the content of the examiner's utterance 62. It is a statement that is understood to be positive.

For this reason, in dialogue, when positive and negative are consistent beyond the speaker, it can be considered that the logic of the conversation is consistent.

When the decision-making ability evaluation device 20 evaluates "logical consistency", using a machine learning model, the text analysis unit 322 analyzes electronic text data in a specific field (financial field in this embodiment) Three labels of negative, neutral, and positive are given (two labels of negative and positive may be used), and based on this pre-learned data, the text analysis unit 322 or the determination unit 323 determines the speaker's utterance. The polarity of the text can be determined, and from the consistency of polarity between speakers, the consistency of logic can be determined. When the dialogue between the inspector and the test subject is in a positive-positive relationship or in a negative-negative relationship, the text analysis unit 322 or the determination unit 323 determines whether the test subject's utterance has "logical consistency." ” can be determined. In other relationships, the text analysis unit 322 or the determination unit 323 can determine that there is no "logical consistency" in the test subject's utterance.

To give a more specific example, using a BERT model that has been trained on Wikipedia in advance, we assign negative, neutral, and positive labels to sentences included in securities reports, and use a negative-positive classifier. create. A large amount of electronic data (approximately 1,000 to 100,000 sentences, etc.) is used for learning using the BERT model. Reference numeral 64 in FIG. 14 is the sentence used for the test. If the same sentence contains negative and positive sentences, both labels are given. When the text analysis unit 322 or the determination unit 323 determines a model sentence as indicated by reference numeral 65 in FIG. 14, it is determined as positive (+).

Mainly, if the sentence contains verbs such as recovery, increase, etc., it will be positive, and if it contains verbs such as decline, decrease, it will be negative. Study the entire sentence, including combinations.

In addition, although the content of the text of one speaker's utterance is negative for the other speaker, it may be interpreted inversely and perceived as positive. Alternatively, even though it is positive for the other speaker, it may be interpreted adversely and perceived negatively. In this case, it is also possible by detecting that the text of the other speaker's utterance contains ``but'' (conjunctive), ``ga'', ``but'' (conjunctive particle), etc. , positive and negative including paradoxical parts of speech, the text analysis unit 322 or the determination unit 323 can determine that the test subject's utterance has "logical consistency".

According to the above explanation, a person skilled in the art can easily understand the system configuration for evaluating the "understanding", "recognition", and "logical thinking" abilities of the test subject.

Determining "statement of choice" means determining the presence or absence of "statement of choice". The one or more questions posed to the test subject include questions to evaluate the choice statement. Questions for evaluating the choice statement are, for example, "Would you like more information about the use of (this) product or service?", "Do you use (this) product or service?" It is.

The conversion unit 231 annotates the portion of the text corresponding to the statement of choice among the text data obtained by converting the test subject's answers to the questions for evaluating the statement of choice.

The determination unit 233 determines the "statement of choice" of the test subject based on the text data converted from the test subject's answer to the question for evaluating the statement of choice. For example, if the "statement of choice" is positive text data such as "please", "tell me", "introduce", It can be determined that there is a "statement of choice", and in the case of negative text data such as "Yes", "No need", "No need", it can be determined that there is no "statement of choice".

By storing candidate answers of the person to be examined to the question for evaluating the expression of selection in the data management unit 234 or the storage unit 24, the answers of the person to be examined are stored in the data management unit 234 or the storage unit 24. If it matches the affirmative answer candidate stored in , the determination unit 233 determines that there is a “statement of selection”, and if it matches a negative answer candidate, the determination unit 233 determines “selection It is determined that there is no "statement".

With the above data processing procedure, the determination unit 233 determines the "understanding", "logical thinking", and "expression of choice" of the person to be examined. The determination result of each item may be displayed on the display unit 25 by the control unit 23 or printed by the printer.

If all of the determination results of "understanding", "recognition", "logical thinking", and "expression of choice" are affirmative, the determination unit 233 further determines that the person to be examined has made a decision to use the product or service. It can be determined that it has the ability. In addition, if the determination result of at least one of “understanding”, “recognition”, “logical thinking”, and “expression of choice” is negative, the determination unit 233 further determines that the person to be inspected is a product or service. can be determined not to have decision-making capacity for the use of The control unit 23 may cause the display unit 25 to display the comprehensive determination result as to whether the person to be inspected has the decision-making ability to use the product or service, or the printing machine may print the result. good too.

Below is a specific example of the conversation between the inspector and the test subject. Table 3 shows a scene in which a bank employee (inspector) reports on the operation of customer C (inspected person) whose time deposit is nearing maturity and recommends another financial product. A specific example of determining whether or not the customer C has sufficient decision-making ability to use financial products using the decision-making ability evaluation device of the embodiment will be shown.

Conversation No. Conversation no. At 2, customer C has answered. As explained with regard to the evaluation of "the above recognition" and the evaluation of "(1) logical thinking about the result" in the "logical thinking", the decision-making ability determination unit 238 determines that the voice data of the answer of customer C is Based on the converted text data, it can be determined that customer C's "recognition" and "logical thinking" abilities are positive.

Conversation No. Conversation No. 3 is a question from the staff to evaluate the "logical thinking to be compared" among the "logical thinking" of the person being examined. 4 is a reply to it from customer C. As described above regarding the evaluation of the “logical thinking to be compared”, the decision-making ability determination unit 238 determines whether the “logical thinking” of customer C is It can be determined to be affirmative.

Conversation No. 5 is a question from the staff to evaluate the "understanding" of the test subject. 6 is customer C's response. The decision-making ability determination unit 238 (the text analysis unit 232 or the determination unit 233) can determine that the "understanding" of the customer C is affirmative based on the text data obtained by converting the voice data of the answer of the customer C. can.

Conversation No. 7 and Conversation No. Set of 8, Conversation No. 9 and Conversation No. A set of 10 is a question for evaluating the "logical coherence" of the test subject's "logical thinking".
Examiner's Conversation No. 7 and conversation No. 7 of the subject. The contents of the 8 texts are all positive. In addition, the examiner's conversation No. 9 and conversation No. 9 of the test subject. All 10 texts are positive.

Therefore, the decision-making ability determination unit 238 (the text analysis unit 232 or the determination unit 233) determines that the customer C has the ability of "logical thinking" from the positive-positive correspondence of the text data of the utterance of the employee-customer C. (affirmative) can be determined.

Conversation No. 9 is a question from a staff member to evaluate the test subject's selection. 10 is a reply to it from customer C. Conversation No. Conversation No. 9 responded to the question, "Why don't you try investing in an investment trust?" At 10, customer C answers, "Let's invest in an investment trust." Therefore, the decision-making ability determination unit 238 (the text analysis unit 232 or the determination unit 233) determines that the customer C has made a "statement of choice" (positive) based on the text data of the customer C's answer. can judge.

Conversation No. 1 to No. At time point 10, the decision-making ability determination unit 238 (text analysis unit 232 or determination unit 233) determines that Customer C's "understanding", "recognition", "logical thinking", and "expression of choice" are all affirmative. Therefore, based on this judgment result, customer C can decide that it is sufficient to recommend the use of financial products (in this example, investment trusts) to the person being inspected. You can move on to the introduction of financial products.

As described above, according to the decision-making ability evaluation device 20 of the present embodiment, in the decision-making process of purchasing a product or using a service, the decision-making ability evaluation device 20 can provide questions and answer candidates that can confirm necessary literacy according to transactions. , the solicitor uses the inspection terminal 10 to explain the use of the product to the person to be inspected, who is the customer, and records the situation in real time while recording biometric information (voice data). It is possible to visualize (text, digitize) and judge whether the customer has decision-making ability on the spot. can be confirmed quickly and with high accuracy.

(2) Evaluation of decision-making ability using eye movement data In addition to or instead of evaluation of the subject's "understanding" explained in (1) Evaluation of decision-making ability using text data In addition, the decision-making ability evaluation device may evaluate the "understanding" of the test subject using the eye movement data of the test subject. In addition to the evaluation of decision-making ability using the text data in (1) above, if the subject's "understanding" is also evaluated using eye movement data, the accuracy of the "understanding" evaluation will be further improved. be able to.

In one embodiment, the inspector's question includes an instruction to have the inspected person read a document related to the use of goods or services. The decision-making ability evaluation apparatus 20 captures images of the person to be examined in time series with the imaging device 18 of the examination terminal 10, and acquires the image data of the person to be examined that is transmitted from the examination terminal 10 in real time. to obtain. Next, the line-of-sight measurement unit 236 analyzes the face image data of the inspection subject acquired by the image data acquisition unit 235, extracts the movement of the eyes (line-of-sight trajectory), and measures the line-of-sight trajectory. The determination unit 233 determines the “understanding” of the person to be examined based on the measurement result of the line-of-sight trajectory received from the line-of-sight measurement unit 236 . That is, the determination unit 233 uses short-term memory ( (whether or not the examiner's cognitive function is declining).

The determination of the presence or absence of short-term memory using the trajectory of gaze is as follows.

When trying to read and understand a document containing important matters, it is necessary to accumulate the most recently written content as a memory and process the character information while grasping the logical structure. However, since people with dementia often forget the most recent memory, they forget the most recent memory as they read, so they go back to the previous sentence and read it again.

In FIGS. 15(A) and (B), the red line shows the trajectory of the examinee's line of sight measured by the line of sight measurement unit 236 at each time when the user is reading the terms of use 40 . The terms of use 40 may be a paper terms of use, or may be a terms of use of electronic data displayed on the display unit 25 . The line-of-sight position estimated from the eye movement is described by a coordinate position (hereinafter referred to as line-of-sight position) on the screen of the display unit 25 of the decision-making ability evaluation device 20 . As shown in FIG. 15A, in the case of a healthy person, the trajectory of the line-of-sight position hardly goes back. However, as shown in FIG. 15(B), in the case of a person whose cognitive function has deteriorated, in order to reconfirm the content shown immediately before, the line-of-sight position goes back to the place once passed.

15(A) and (B), the original text is analyzed for each morpheme, and each morpheme is numbered (hereinafter referred to as line of sight position number). A region in which a morpheme exists (hereinafter referred to as a morpheme region) is defined by a coordinate position or the like. The line-of-sight position is recorded in chronological order as to which coordinate region of each morpheme the line-of-sight position is included in. FIGS. 16B and 16C are schematic diagrams showing temporal changes in line-of-sight position numbers. The line-of-sight position estimated from the eye movement is described by a coordinate position (hereinafter referred to as line-of-sight position) on the screen of the display unit 25 of the decision-making ability evaluation device 20 . FIG. 16(B) shows a schematic diagram of a change in the line-of-sight position of a healthy person, and FIG. 16(C) shows a change in the line-of-sight position of a person with impaired cognitive function and memory.

For example, the ability of short-term memory using the gaze position is determined whether a word that the gaze stays for a certain time or more is a period-specific word. is determined by whether or not the person to be examined can speak.

Classify time-series data by short-term memory ability. Represent each data in a multidimensional space. By defining at least one cluster separation boundary as a function, short-term memory ability can be estimated from the time-series data.

For example, the time-series data of gaze trajectories are classified into three categories: healthy subjects, MCI patients, and dementia patients. The time-series data of the line-of-sight trajectories of the healthy subject, the MCI patient, and the dementia patient are stored in the data management unit 234 or the storage unit 24 of the decision-making ability evaluation device 20 . These data are used as reference data of the trajectory of the line of sight, and the determination unit 233 compares the reference data with the time-series data of the trajectory of the line of sight of the test subject to determine whether or not the test subject understands (short-term memory). Evaluation can be based on criteria for patients with cognitive impairment.

Any method that evaluates cognitive function based on eye movement may be used to evaluate cognitive function based on the line of sight trajectory estimated from eye movement. See, for example, the eye-tracking cognitive assessment method described in Sci Rep. 2019 Sep 10;9(1):12932. doi: 10.1038/s41598-019-49275-x.

(3) Evaluation of decision-making ability using face direction data In addition to or instead of evaluation of the subject's "understanding" explained in (1) Evaluation of decision-making ability using text data In addition, the decision-making ability evaluation device may evaluate the "understanding" of the test subject using the face direction data of the test subject. In addition to the evaluation of decision-making ability using the text data in (1) above, if the subject's "understanding" is also evaluated using the face direction data, the accuracy of the "understanding" evaluation will be further improved. be able to.

In one embodiment, the inspector's question includes an instruction to have the inspected person read a document related to the use of goods or services. The decision-making ability evaluation apparatus 20 captures images of the subject in time series with the imaging device 18 of the inspection terminal 10 , and acquires the image data transmitted from the inspection terminal 10 in real time by the image data acquisition unit 235 . Next, the image data acquisition unit 235 acquires the data. Next, the face orientation measurement unit 237 analyzes the image data of the face of the person to be inspected acquired by the image data acquisition unit 235, and measures the orientation of the face. The determination unit 233 determines the “understanding” of the person to be examined based on the face direction measurement result received from the face direction measurement unit 237 . In other words, based on the temporal change in the direction of the face of the test subject while receiving questions about the use of products or services, the evaluation of the test subject's understanding of short-term memory or not).

The determination of the presence or absence of short-term memory using the measurement results of face orientation is as follows.

In general, when cognitive function declines, facial expressions disappear and interest in events in front of one's eyes declines. Therefore, the criteria for determination can be set as appropriate. can be determined based on A healthy person spends a long time in which the angle of the face orientation approximates the reference angle. On the other hand, as the strength of attention decreases, the time period during which the orientation of the face of the person to be examined deviates from the reference angle increases.

The face is extracted from the captured video image, and the time when the face is facing the terminal is used as a reference. Describe the deviation of the orientation of the face from the reference in terms of the angle of rotation. In the case of a healthy person, when explaining an important matter, the angle of the face orientation approximates the reference angle for a long period of time. However, as the strength of attention decreases, the time during which the angle of the orientation of the face deviates from the reference angle increases. Focus on this feature. The face direction measurement unit 237 describes the temporal change in the angle of the face direction per unit time as time-series data.

Classify the time-series data according to attentional ability, and represent each data in a multidimensional space. By defining the separation boundary of at least one or more clusters as a function, short-term memory ability can be estimated from the time-series data.

For example, the time-series data of face orientation is classified into three categories: healthy subjects, MCI patients, and dementia patients. The time-series data of the face orientations of the healthy subject, the MCI patient, and the dementia patient are stored in the data management unit 234 or the storage unit 24 of the decision-making ability evaluation device 20 . These data are used as reference data for the orientation of the face, and the determination unit 233 compares the reference data with the time-series data of the orientation of the face of the examination subject to determine the presence or absence of understanding (short-term memory) of the examination subject. Evaluation can be based on criteria for patients with cognitive impairment.

Any method may be used to evaluate cognitive functions based on facial expressions. See, e.g., 2021 Jan 25;13(2):1765-1772, DOI 10.18632/aging.202545, Facial Expression-Based Cognitive Assessment Method Using AI.

(4) Processing Executed Using the Decision-Making Ability Evaluation System of this Embodiment Here, each processing executed using the decision-making ability evaluation system of this embodiment will be described.

In the present embodiment, an inspector who operates the inspection terminal 10, for example, a doctor who inspects the person to be inspected, asks the person to be inspected questions prepared in advance. Test questions are, for example, as described above.

The inspection subject's answer to the question is recorded by the inspector or the inspection subject operating the inspection terminal 10.

FIG. 17 is a flowchart showing the flow of processing executed by the inspection terminal 10 of this embodiment. The processing shown in FIG. 17 is executed by the control unit 13 as a program that is activated when the examiner instructs the start of recording.

As shown in FIG. 17 , when the inspector or the person to be inspected instructs the inspection terminal 10 to start recording, the control unit 13 acquires voice data input via the microphone 17 and controls the control unit 13 By recording in the memory or storage unit 104 provided in the, the uttered voice of the person to be examined is recorded (S10).

Next, the inspector operates the operation unit 11 to instruct the control unit 13 to start the inspection of the person to be inspected. The instruction to start the examination may be given to the control unit 13 only when the question to the person to be examined is finished and the answer from the person to be examined is obtained, or at any time after the examination is started. you can go When the control unit 13 of the test terminal 10 determines that there is an instruction to start the test (S20), it transmits the recorded voice data indicating the content of the test subject's utterance to the decision-making ability evaluation device 20 via the communication connection unit 12. Send (S30).

In the decision-making ability evaluation device 20, when the control unit 23 receives the speech data of the test subject's utterance content from the test terminal 10, the test subject's decision-making ability evaluation process is started. The determination processing executed by the control unit 23 will be described later.

When the decision-making ability evaluation device 20 transmits the determination result obtained by the determination process described above to the inspection terminal 10 via the communication connection unit 22, the control unit 13 of the inspection terminal 10 receives the determination result (S40), The determination result is output to the display device 15 (S50). For example, the control unit 13 displays the contents on the display device 15 when it is determined that the person to be examined has the decision-making ability to use the product or service. When it is determined that the person to be examined does not have the decision-making ability to use the product or service, the control unit 13 displays the content on the display device 15 . This allows the inspector to grasp whether or not the person to be inspected has the decision-making ability to use the product or service.

FIG. 18 is a flow chart showing the flow of processing executed by the decision-making ability evaluation device 20 of this embodiment. The processing shown in FIG. 18 is executed by the control unit 23 as a program that is activated when the voice data of the utterance content of the person to be inspected is received from the inspection terminal 10 .

　The test subject will answer by voice while receiving questions about the use of the product or service. The control unit 23 of the decision-making ability evaluation apparatus 20 acquires the speech data of the person to be examined by receiving the speech data of the speech content of the person to be examined from the examination terminal 10 (S110).

Next, the conversion unit 231 performs voice recognition on the voice data of the inspector's utterance and the voice data of the inspection subject's utterance acquired by the voice data acquisition unit 230, and converts each utterance into text data in a form that can be specified. (S120). Next, the determination unit 233 determines the decision-making ability of the person to be inspected regarding the use of products or services based on the text data converted by the conversion unit 231 (S130). For details of determination of the decision-making ability of the test subject to use products or services by the decision-making ability evaluation device 20, see "2. Evaluation of the test subject by the decision-making ability evaluation device or the decision-making ability evaluation system". "(1) Evaluation of decision-making ability using text data" "(2) Evaluation of decision-making ability using eye movement data" "(3) Evaluation of decision-making ability using face orientation data" , as explained in detail.

Next, the control unit 23 transmits the determination result obtained by the determination process to the inspection terminal 10 via the communication connection unit 22 (S140). After that, the process ends.

According to the embodiment described above, the following effects can be obtained.
(1) The control unit 23 acquires, from the inspection terminal 10, utterances or answers to questions regarding the use of goods or services of the person being inspected as voice data, and determines the decision-making ability of the person being inspected in using the goods or services. I made it Since the questions are about the test subject's use of goods or services, unlike simple diagnosis of cognitive function, the test subject's decision-making ability in response to the test subject's use of the product or service can be quickly and more accurately evaluated. Highly accurate evaluation is possible.
(2) The control unit 23 determines whether or not there is "understanding", "recognition", "logical thinking", and "expression of choice", so that the person to be examined has decision-making ability regarding the use of goods or services. Whether or not is determined with higher accuracy. This makes it possible to more accurately evaluate decision-making ability in the use of products or services, unlike mere diagnosis of cognitive functions.
(3) Evaluation of decision-making ability for evaluating the decision-making ability of the test subject in using the product or service of this embodiment is performed using the biometric information (voice, eye movement, face direction) of the test subject. ing. The test subject can perform the test simply by answering the questions verbally. For this reason, the examiner's training is unnecessary, and the examination can be automatically performed by the decision-making ability evaluation device 20, and examination results can be obtained in which variations due to examiners are reduced or eliminated.
(4) Decision-making ability evaluation for evaluating the decision-making ability of the test subject in using the product or service of this embodiment is performed using the test subject's biometric information (voice, eye movement, face direction). ing. The test subject can perform the test simply by answering the questions verbally. Therefore, it is possible to reduce the burden on the person to be inspected as compared with an inspection that requires description on a document.
(5) The control unit 23 outputs to the inspection terminal 10 the determination result as to whether or not the person to be inspected has decision-making ability regarding the use of the product or service. This allows the test subject, the tester, or both to ascertain whether the test subject has decision-making ability.

The present invention is not limited to the embodiments described above, and the following various modifications are possible.
(1) Questions regarding the use of products or services are not limited to those issued by the examiner, and may be issued by another person, or stored in the data management unit 234 or the storage unit 24 of the decision-making ability evaluation device 20. and may be automatically read by an instruction from the control unit 23 at appropriate times.
(2) In the above-described embodiment, the test terminal 10 and the decision-making ability evaluation device 20 are connected for communication, and the control unit 23 of the decision-making ability evaluation device 20 receives the test subject's utterance voice data from the test terminal 10. received and performed the decision-making ability of the test subject. However, the decision-making ability evaluation device 20 may be used alone. For example, as shown in FIG. 19, a decision-making ability evaluation device 20 includes an operation unit 21, a speaker 2, a microphone 27, and an imaging device . The examiner operates the decision-making ability evaluation device 20 to input speech data of the person to be examined into the decision-making ability evaluation device 20, instruct the start of the determination process, and the control unit 23 outputs the determination result. You may make it output to the display apparatus 25 of the decision-making ability evaluation apparatus 20, and display it. By using the decision-making ability evaluation device 20 alone, it can be used as a stand-alone device.
(3) As shown in FIG. 20, the person to be inspected operates the inspection terminal 10, and the inspector is equipped with a second inspection terminal 30 separate from the inspection terminal 10, so that the inspection can be performed via a communication line such as the Internet. The testing terminal 10 and the second testing terminal 30 can be connected for communication with each other, and can also be connected for communication with the decision-making ability evaluation device 20, so that a client-server type or cloud type determination system can be constructed. The second inspection terminal 30 includes an operation unit 31, a communication connection unit 32, a control unit 33, a storage unit 34, a display device 35 such as a display, a speaker 36, and the like as described for the inspection terminal 10. A microphone 37 and an imaging device 38 can be provided, and the inspection terminal 10 and the second inspection terminal 30 can interact through voice and images.
(4) Criteria for judging whether a person to be tested has decision-making ability in the use of a product or service may be set as appropriate by a person skilled in the field of the product or service according to the content of the product or service. For example, in determining whether to purchase a financial product, a different threshold value may be set for each product.
(5) The determination unit 233 may be omitted, and the text analysis unit 232 may perform determination processing performed by the determination unit 233 .
(6) It is preferable that the decision-making ability evaluation device 20 evaluates all of "understanding", "recognition", "logical thinking", and "expression of choice" in terms of accuracy of evaluation of decision-making ability. , all four may not be evaluated. For example, the decision-making ability evaluation device 20 may evaluate three of "understanding,""recognition," and "logical thinking," and "indication of choice" may be evaluated by a human examiner. Alternatively, the decision-making ability evaluation device 20 may evaluate at least two of "understanding", "recognition", and "logical thinking". Alternatively, the decision-making ability evaluation device 20 may evaluate one of "understanding" and "recognition" and "logical thinking". Alternatively, the decision-making ability evaluation device 20 may evaluate three of "understanding", "logical thinking", and "expression of choice", or two of "understanding" and "logical thinking", Both "recognition" and "logical thinking" may be evaluated. The decision-making ability evaluation device 20 may evaluate any one of "understanding", "recognition", or "logical thinking".
(7) The decision-making ability evaluation device 20 can determine three of "understanding", "recognition", and "logical thinking", but the speech data of the test subject is used to evaluate the understanding of the test subject. "Understanding" may not be determined if it does not include the test subject's answer to the question. In this case, the test subject's voice data is the test subject's answer to the question for evaluating the test subject's recognition and the test subject's answer to the question for evaluating the test subject's logical thinking. If included, the decision-making ability evaluation device 20 judges two of "recognition" and "logical thinking". Similarly, if the test subject's voice data does not include the test subject's answer to the question for evaluating the test subject's recognition, "recognition" is not determined and the test subject's voice data "Logical thinking" may not be determined if it does not include the test subject's answers to questions for evaluating the subject's logical thinking.

(8) Evaluation of (1) logical thinking and speculation about the result, (2) logical thinking for comparison, and (3) logical consistency of “logical thinking” is the evaluation of decision-making ability. Although preferred for accuracy, it is not necessary to evaluate all three. Any one or two of (1) to (3) may be evaluated.
(9) A part of the extracted text (words and phrases) is stored in the storage unit 24, and the control unit 23 displays or displays it on the display unit 25 together with the determination result of the presence or absence and degree of decision-making ability. You may make it print on paper media, such as a check sheet and an interview record.
(10) Based on the judgment result by the decision-making ability evaluation device 20, for example, the liquidity to be strengthened for the customer based on the literacy necessary for the use of the product or service (for example, various transactions) that the customer who is the person to be inspected wishes to use Intelligence may be imparted and trained by customers to enhance their own trading ability and maintain decision-making ability over the long term.
(11) The judgment result by the decision-making ability evaluation device 20 is shared by both the inspector and the customer who is the person to be inspected, so that it can be carried on a mobile terminal or the like, and can be used in transactions with other solicitors. can also
(12) The decision-making ability evaluation device, the decision-making ability evaluation system, and the decision-making ability evaluation method of the present invention may be used for purposes other than the process from soliciting a certain product to deciding to purchase it.
(13) Using the decision-making ability evaluation device, the decision-making ability evaluation system, or the decision-making ability evaluation method of the present invention, the data collected from the test subject in one decision-making ability evaluation is used for another decision-making ability evaluation. may be used for the future decision-making ability evaluation device, decision-making ability evaluation system, or decision-making ability evaluation method of the present invention, together with the data collected from the test subject.
(14) The data linked in (13) above is saved as a log by either the decision-making ability evaluation device or the decision-making ability evaluation system, and the product content, judgment result, and / or incident , and such data sets can be used to quantify the complexity and complexity of transactions by product.
(15) The data linked in (13) above is saved as a log by either the decision-making ability evaluation device or the decision-making ability evaluation system, and the product content, judgment result, and / or incident For example, if the determination result is negative, the litigation risk and the like can be learned by the decision-making ability evaluation device, so that the litigation risk prediction can be estimated using this data set.
(16) The decision-making ability evaluation device 20 may be divided into a plurality of devices, and the speech data acquisition unit 230, the conversion unit 231, the text analysis unit 232, the determination unit 233, and the data management unit 234 of the decision-making ability determination unit 238 , the image acquisition unit 235, the line-of-sight measurement unit 236, and the face direction measurement unit 237 may be performed by a plurality of physically separated decision-making ability evaluation devices 20. FIG.

The present disclosure also includes the following embodiments.
Section 1. A decision-making ability evaluation device used to evaluate a person's decision-making ability in the use of goods or services,
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In a decision-making ability evaluation device comprising
The voice data of the person to be inspected is
the test subject's answers to questions for evaluating the test subject's understanding;
the test subject's responses to questions to assess the test subject's cognition; and the test subject's responses to questions to assess the test subject's reasoning;
including at least two of
When the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding, the determination of the decision-making ability by the decision-making ability determination unit includes the test subject's Including determining the understanding of the test subject based on the text data converted from the test subject's answers to the questions for evaluating the understanding of
When the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's recognition, the determination of the decision-making ability by the decision-making ability determination unit includes the test subject's Including determining the recognition of the test subject based on the text data converted from the test subject's answer to the question for evaluating the recognition of
and when the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's logical thinking, the determination of the decision-making ability by the decision-making ability determination unit A decision-making ability evaluation device including determining the logical thinking of a person being examined based on text data obtained by converting the person's answers to questions for evaluating the person's logical thinking.
Section 2. the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's expression of choice;
Judgment of decision-making ability by the decision-making ability judgment unit,
2. Decision-making according to paragraph 1, comprising determining the test subject's statement of choice based on text data obtained by converting the test subject's answer to a question for evaluating the test subject's statement of choice. Ability evaluation device.
Item 3. The determination of decision-making ability by the decision-making ability determination unit is performed by combining words with high frequency of co-occurrence in the text obtained by converting the voice data of the test subject's utterances in the dialogue related to the use of the product or service. Item 3. The apparatus for evaluating decision-making ability according to

Item

1 or 2, which is a fill-in-the-blank question of the second expression in the sentence including the second expression with a high value.
Item 5. The voice data acquisition unit includes a question for evaluating the recognition of the person being examined, and the person's answer to the question for evaluating the person's recognition,
The decision-making ability determination unit,
At least one same word appears in common between the text obtained by converting the voice data of the question for evaluating the recognition of the test subject and the text obtained by converting the voice data of the answer of the test subject. matter,
A combination of co-occurrences of the commonly appearing word and another word in the text obtained by converting the voice data of the test subject's answer is a question for evaluating the recognition of the test subject. and that the word related to the test subject appears in the text obtained by converting the test subject's answer. Item 5. The decision-making ability evaluation device according to any one of items 1 to 4, which determines that the
Item 6. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's logical thinking,
The text data obtained by converting the test subject's answers to the questions for evaluating the test subject's logical thinking includes words representing comparison, or words representing presentation, paralleling, or enumeration of similar items. 5. The decision-making ability evaluation device according to any one of 1 to 4.
Item 7. Judgment of decision-making ability by the decision-making ability judgment unit,
Based on whether the contents of the text data converted from the question for evaluating the understanding of the test subject and the text data converted from the test subject's answer to it are positive or negative, Item 5. The decision-making ability evaluation device according to any one of items 1 to 4, including determining logical thinking.
Item 8. A decision-making ability evaluation device used to evaluate a person's decision-making ability in the use of goods or services,
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In a decision-making ability evaluation device comprising
The determination of decision-making ability by the decision-making ability determination unit is performed by combining words with high frequency of co-occurrence in the text obtained by converting the voice data of the test subject's utterances in the dialogue related to the use of the product or service. A decision-making ability assessment device that includes determining that a test subject "understands" if it is being awakened.
Item 9. A decision-making ability evaluation device used to evaluate a person's decision-making ability in the use of goods or services,
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In a decision-making ability evaluation device comprising
The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
The questions for evaluating the test subject's comprehension include a first expression in a specific field and the frequency of occurrence with the expression, created using a machine learning model trained on text data related to current events. A decision-making ability evaluation device, which is a fill-in-the-blank question of a second expression in sentences containing a second expression with a high value.
Item 10. A decision-making ability evaluation device used to evaluate a person's decision-making ability in the use of goods or services,
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In a decision-making ability evaluation device comprising
The voice data acquisition unit includes a question for evaluating the recognition of the person being examined, and the person's answer to the question for evaluating the person's recognition,
The decision-making ability determination unit,
At least one same word appears in common between the text obtained by converting the voice data of the question for evaluating the recognition of the test subject and the text obtained by converting the voice data of the answer of the test subject. matter,
A combination of co-occurrences of the commonly appearing word and another word in the text obtained by converting the voice data of the test subject's answer is a question for evaluating the recognition of the test subject. and that the word related to the test subject appears in the text obtained by converting the test subject's answer. A decision-making ability evaluation device that judges that
Item 11. A decision-making ability evaluation device used to evaluate a person's decision-making ability in the use of goods or services,
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In a decision-making ability evaluation device comprising
The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's logical thinking,
The text data obtained by converting the test subject's answers to the questions for evaluating the test subject's logical thinking includes words representing comparison, or words representing presentation, paralleling, or enumeration of similar things. Decision ability evaluation device.
Item 12. A decision-making ability evaluation device used to evaluate a person's decision-making ability in the use of goods or services,
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In a decision-making ability evaluation device comprising
Judgment of decision-making ability by the decision-making ability judgment unit,
Based on whether the contents of the text data converted from the question for evaluating the understanding of the test subject and the text data converted from the test subject's answer to it are positive or negative, A decision-making ability assessment device that includes judging logical thinking.
Item 13. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
questions for assessing the subject's comprehension include instructions for the subject to read a document related to the use of goods or services;
The decision-making ability evaluation device,
an image acquisition unit that acquires image data of a person to be inspected;
further comprising a line-of-sight measurement unit that analyzes the image data of the face of the inspection subject acquired by the image acquisition unit and measures the trajectory of the line of sight;
2. The decision-making ability evaluation device according to item 1, wherein the decision-making ability determination unit determines the understanding of the person being examined based on the measurement result of the line-of-sight trajectory received from the line-of-sight measurement unit.
Item 14. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
questions for assessing the subject's comprehension include instructions for the subject to read a document related to the use of goods or services;
The decision-making ability evaluation device,
an image acquisition unit that acquires image data of a person to be inspected;
further comprising a face orientation measurement unit that analyzes the image data of the face of the person to be inspected acquired by the image acquisition unit and measures the orientation of the face;
2. The apparatus for evaluating decision-making ability according to Item 1, wherein the decision-making ability determination unit determines the understanding of the person being examined based on the face orientation measurement result received from the face orientation measurement unit.
Item 15. Item 15. A decision-making ability evaluation system for evaluating the decision-making ability of an inspected person in using a product or service, comprising: an inspection terminal; and a decision ability evaluation device,
The decision-making ability evaluation system, wherein the speech data acquisition unit of the decision-making ability evaluation device acquires the examination subject's speech data from a dialogue related to use of the product or service received from the examination terminal.
Item 16. A decision-making ability evaluation program used to evaluate a person's decision-making ability in the use of goods or services, the computer comprising:
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In the decision-making ability evaluation program that functions as
The voice data of the person to be inspected is
the test subject's answers to questions for evaluating the test subject's understanding;
the test subject's responses to questions to assess the test subject's cognition; and the test subject's responses to questions to assess the test subject's reasoning;
including at least two of
When the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding, the determination of the decision-making ability by the decision-making ability determination unit includes the test subject's Including determining the understanding of the test subject based on the text data converted from the test subject's answers to the questions for evaluating the understanding of
When the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's recognition, the determination of the decision-making ability by the decision-making ability determination unit includes the test subject's Including determining the recognition of the test subject based on the text data converted from the test subject's answer to the question for evaluating the recognition of
and when the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's logical thinking, the determination of the decision-making ability by the decision-making ability determination unit A program for evaluating decision-making ability, including judging the logical thinking of an inspected person based on text data obtained by converting the responses of the inspected person to questions for evaluating the logical thinking of the inspected person.
Item 17. the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's expression of choice;
The judgment of decision-making ability by the decision-making ability judging unit is based on text data obtained by converting the test subject's answers to questions for evaluating the test subject's expression of selection. 17. The decision-making ability evaluation program according to Item 16, comprising determining the.
Item 18. The determination of decision-making ability by the decision-making ability determination unit is performed by combining words with high frequency of co-occurrence in the text obtained by converting the voice data of the test subject's utterances in the dialogue related to the use of the product or service. 18. A decision-making ability assessment program according to

clause

16 or 17, comprising determining that the test subject understands if aroused.
Item 19. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
The questions for evaluating the test subject's comprehension include a first expression in a specific field and the frequency of occurrence with the expression, created using a machine learning model trained on text data related to current events. 18. The program for assessing decision-making ability according to

Item

16 or 17, which is a fill-in-the-blank question of the second expression of the sentence containing the second expression with a high .
Item 20. The voice data acquisition unit includes a question for evaluating the recognition of the person being examined, and the person's answer to the question for evaluating the person's recognition,
The decision-making ability determination unit,
At least one same word appears in common between the text obtained by converting the voice data of the question for evaluating the recognition of the test subject and the text obtained by converting the voice data of the answer of the test subject. matter,
A combination of co-occurrences of the commonly appearing word and another word in the text obtained by converting the voice data of the test subject's answer is a question for evaluating the recognition of the test subject. and that the word related to the test subject appears in the text obtained by converting the test subject's answer. 20. The program for evaluating decision-making ability according to any one of items 16 to 19, wherein the decision-making ability evaluation program determines that the
Item 21. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's logical thinking,
The text data obtained by converting the test subject's answers to the questions for evaluating the test subject's logical thinking includes words representing comparison, or words representing presentation, paralleling, or enumeration of similar items. 19. The decision-making ability evaluation program according to any one of 16-19.
Item 22. The determination of decision-making ability by the decision-making ability determination unit is based on the content of the text data converted from the question for evaluating the understanding of the test subject and the text data converted from the test subject's answer to the question, 20. The decision-making ability evaluation program according to any one of items 16 to 19, comprising determining the logical thinking of the test subject based on whether it is positive or negative.
Item 23. A decision-making ability evaluation program used to evaluate a person's decision-making ability in the use of goods or services, the computer comprising:
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In the decision-making ability evaluation program that functions as
The determination of decision-making ability by the decision-making ability determination unit is performed by combining words with high frequency of co-occurrence in the text obtained by converting the voice data of the test subject's utterances in the dialogue related to the use of the product or service. A decision-making ability assessment program that includes determining that the test subject "understands" when being awakened.
Item 24. A decision-making ability evaluation program used to evaluate a person's decision-making ability in the use of goods or services, the computer comprising:
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In the decision-making ability evaluation program that functions as
The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
The questions for evaluating the test subject's comprehension include a first expression in a specific field and the frequency of occurrence with the expression, created using a machine learning model trained on text data related to current events. A program for assessing decision-making ability, which is a fill-in-the-blank question of the second expression of sentences containing the second expression with a high .
Item 25. A decision-making ability evaluation program used to evaluate a person's decision-making ability in the use of goods or services, the computer comprising:
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In the decision-making ability evaluation program that functions as
The voice data acquisition unit includes a question for evaluating the recognition of the person being examined, and the person's answer to the question for evaluating the person's recognition,
The decision-making ability determination unit,
At least one same word appears in common between the text obtained by converting the voice data of the question for evaluating the recognition of the test subject and the text obtained by converting the voice data of the answer of the test subject. matter,
A combination of co-occurrences of the commonly appearing word and another word in the text obtained by converting the voice data of the test subject's answer is a question for evaluating the recognition of the test subject. and that the word related to the test subject appears in the text obtained by converting the test subject's answer. A decision-making ability assessment program that determines
Item 26. A decision-making ability evaluation program used to evaluate a person's decision-making ability in the use of goods or services, the computer comprising:
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In the decision-making ability evaluation program that functions as
The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's logical thinking,
The text data obtained by converting the test subject's answers to the questions for evaluating the test subject's logical thinking includes words representing comparison, or words representing presentation, paralleling, or enumeration of similar things. Decision-making ability assessment program.
Item 27. A decision-making ability evaluation program used to evaluate a person's decision-making ability in the use of goods or services, the computer comprising:
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In the decision-making ability evaluation program that functions as
The determination of decision-making ability by the decision-making ability determination unit is based on the content of the text data converted from the question for evaluating the understanding of the test subject and the text data converted from the test subject's answer to the question, A decision-making ability assessment program that includes judging a test subject's reasoning on the basis of being positive or negative.
Item 28. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
questions for assessing the subject's comprehension include instructions for the subject to read a document related to the use of goods or services;
The decision-making ability evaluation program causes the computer to:
an image acquisition unit that acquires image data of a person to be inspected;
further functions as a line-of-sight measurement unit that analyzes the image data of the face of the inspection subject acquired by the image acquisition unit and measures the trajectory of the line of sight;
17. The decision-making ability evaluation program according to item 16, wherein the decision-making ability determination unit determines the comprehension of the test subject based on the measurement result of the line-of-sight trajectory received from the line-of-sight measurement unit.
Item 29. The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
questions for assessing the subject's comprehension include instructions for the subject to read a document related to the use of goods or services;
The decision-making ability evaluation program causes the computer to:
an image acquisition unit that acquires image data of a person to be inspected;
analyzing the image data of the face of the person to be inspected acquired by the image acquisition unit and further functioning as a face orientation measurement unit for measuring the orientation of the face;
17. The decision-making ability evaluation program according to Item 16, wherein the decision-making ability determination unit determines the comprehension of the test subject based on the face orientation measurement result received from the face orientation measurement unit.
Item 30. A recording medium recording the decision-making ability evaluation program according to any one of Items 16 to 29.

20... Decision-making ability evaluation device, 230... Voice data acquisition unit, 231... Conversion unit, 238... Decision-making ability determination unit.

Claims

A decision-making ability evaluation device used to evaluate a person's decision-making ability in the use of goods or services,
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In a decision-making ability evaluation device comprising
The voice data of the person to be inspected is
the test subject's answers to questions for evaluating the test subject's understanding;
the test subject's responses to questions to assess the test subject's cognition; and the test subject's responses to questions to assess the test subject's reasoning;
including at least two of
When the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding, the determination of the decision-making ability by the decision-making ability determination unit includes the test subject's Including determining the understanding of the test subject based on the text data converted from the test subject's answers to the questions for evaluating the understanding of
When the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's recognition, the determination of the decision-making ability by the decision-making ability determination unit includes the test subject's Determining the recognition of the test subject based on text data converted from the test subject's answers to questions for evaluating the recognition of the test subject, and When the test subject's answers to questions for evaluating logical thinking are included, the determination of decision-making ability by the decision-making ability determination unit is based on the examination of questions for evaluating the logical thinking of the test subject. A decision-making ability evaluation device including determining the logical thinking of a test subject based on text data obtained by converting the subject's answer.
the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's expression of choice;
Judgment of decision-making ability by the decision-making ability judgment unit,
2. The intent of claim 1, comprising determining the test subject's statement of choice based on text data converted from the test subject's answers to questions for evaluating the test subject's statement of choice. Decision ability evaluation device.
The determination of decision-making ability by the decision-making ability determination unit is performed by combining words with high frequency of co-occurrence in the text obtained by converting the voice data of the test subject's utterances in the dialogue related to the use of the product or service. 3. The apparatus for assessing decision-making ability according to claim 1 or 2, comprising determining that the test subject understands if the test subject is awakened.
The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
The questions for evaluating the test subject's comprehension include a first expression in a specific field and the frequency of occurrence with the expression, created using a machine learning model trained on text data related to current events. 3. The apparatus for evaluating decision-making ability according to claim 1, wherein the second expression is a fill-in-the-blank question in a sentence containing the second expression with a high .
The voice data acquisition unit includes a question for evaluating the recognition of the person being examined, and the person's answer to the question for evaluating the person's recognition,
The decision-making ability determination unit,
At least one same word appears in common between the text obtained by converting the voice data of the question for evaluating the recognition of the test subject and the text obtained by converting the voice data of the answer of the test subject. matter,
A combination of co-occurrences of the commonly appearing word and another word in the text obtained by converting the voice data of the test subject's answer is a question for evaluating the recognition of the test subject. and that the word related to the test subject appears in the text obtained by converting the test subject's answer. The decision-making ability evaluation device according to any one of claims 1 to 4, which determines that the
The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's logical thinking,
The text data obtained by converting the test subject's answers to the questions for evaluating the test subject's logical thinking includes words representing comparison, or words representing presentation, paralleling, or enumeration of similar things. 5. The apparatus for evaluating decision-making ability according to any one of items 1 to 4.
Judgment of decision-making ability by the decision-making ability judgment unit,
Based on whether the contents of the text data converted from the question for evaluating the understanding of the test subject and the text data converted from the test subject's answer to it are positive or negative, The decision-making ability evaluation device according to any one of claims 1 to 4, including judging logical thinking.
The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
questions for assessing the subject's comprehension include instructions for the subject to read a document related to the use of goods or services;
The decision-making ability evaluation device,
an image acquisition unit that acquires image data of a person to be inspected;
further comprising a line-of-sight measurement unit that analyzes the image data of the face of the inspection subject acquired by the image acquisition unit and measures the trajectory of the line of sight;
2. The apparatus for evaluating decision-making ability according to claim 1, wherein the decision-making ability determination unit determines the understanding of the test subject based on the measurement result of the line-of-sight trajectory received from the line-of-sight measurement unit.
The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
questions for assessing the subject's comprehension include instructions for the subject to read a document related to the use of goods or services;
The decision-making ability evaluation device,
an image acquisition unit that acquires image data of a person to be inspected;
further comprising a face orientation measurement unit that analyzes the image data of the face of the person to be inspected acquired by the image acquisition unit and measures the orientation of the face;
2. The apparatus for evaluating decision-making ability according to claim 1, wherein the decision-making ability determination unit determines the understanding of the person being examined based on the face direction measurement result received from the face direction measurement unit.
A decision-making ability evaluation system for evaluating the decision-making ability of an inspected person in using a product or service, comprising: an inspection terminal; and a communication connection with the inspection terminal. and the decision-making ability evaluation device described,
The decision-making ability evaluation system, wherein the speech data acquisition unit of the decision-making ability evaluation device acquires the examination subject's speech data from a dialogue related to use of the product or service received from the examination terminal.
A decision-making ability evaluation program used to evaluate a person's decision-making ability in the use of goods or services, the computer comprising:
a voice data acquisition unit that acquires voice data of a person to be tested from conversations related to the use of goods or services;
a conversion unit that converts the voice data of the person to be examined acquired by the voice data acquisition unit into text data;
a decision-making ability determination unit that determines the decision-making ability of a person to be inspected for use of goods or services based on the text data converted by the conversion unit;
In the decision-making ability evaluation program that functions as
The voice data of the person to be inspected is
the test subject's answers to questions for evaluating the test subject's understanding;
the test subject's responses to questions to assess the test subject's cognition; and the test subject's responses to questions to assess the test subject's reasoning;
including at least two of
When the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding, the determination of the decision-making ability by the decision-making ability determination unit includes the test subject's Including determining the understanding of the test subject based on the text data converted from the test subject's answers to the questions for evaluating the understanding of
When the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's recognition, the determination of the decision-making ability by the decision-making ability determination unit includes the test subject's Including determining the recognition of the test subject based on the text data converted from the test subject's answer to the question for evaluating the recognition of
and when the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's logical thinking, the determination of the decision-making ability by the decision-making ability determination unit A program for evaluating decision-making ability, including judging the logical thinking of an inspected person based on text data obtained by converting the responses of the inspected person to questions for evaluating the logical thinking of the inspected person.
the test subject's voice data includes the test subject's answers to questions for evaluating the test subject's expression of choice;
The judgment of decision-making ability by the decision-making ability judging unit is based on text data obtained by converting the test subject's answers to questions for evaluating the test subject's expression of selection. 12. The program for evaluating decision-making ability according to claim 11, comprising determining:
The determination of decision-making ability by the decision-making ability determination unit is performed by combining words with high frequency of co-occurrence in the text obtained by converting the voice data of the test subject's utterances in the dialogue related to the use of the product or service. 13. The program for assessing decision-making ability according to claim 11 or 12, comprising determining that the test subject understands if aroused.
The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
The questions for evaluating the test subject's comprehension include a first expression in a specific field and the frequency of occurrence with the expression, created using a machine learning model trained on text data related to current events. 13. The decision-making ability evaluation program according to claim 11 or 12, which is a fill-in-the-blank question of the second expression of sentences containing the second expression with a high .
The voice data acquisition unit includes a question for evaluating the recognition of the person being examined, and the person's answer to the question for evaluating the person's recognition,
The decision-making ability determination unit,
At least one same word appears in common between the text obtained by converting the voice data of the question for evaluating the recognition of the test subject and the text obtained by converting the voice data of the answer of the test subject. matter,
A combination of co-occurrences of the commonly appearing word and another word in the text obtained by converting the voice data of the test subject's answer is a question for evaluating the recognition of the test subject. and that the word related to the test subject appears in the text obtained by converting the test subject's answer. 15. The decision-making ability evaluation program according to any one of claims 11 to 14, which determines that the decision-making ability evaluation program.
The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's logical thinking,
The text data obtained by converting the test subject's answers to the questions for evaluating the test subject's logical thinking includes words representing comparison, or words representing presentation, paralleling, or enumeration of similar things. 15. The decision-making ability evaluation program according to any one of items 11 to 14.
The determination of decision-making ability by the decision-making ability determination unit is based on the content of the text data converted from the question for evaluating the understanding of the test subject and the text data converted from the test subject's answer to the question, The decision-making ability evaluation program according to any one of claims 11 to 14, comprising judging the logical thinking of the test subject based on whether it is positive or negative.
The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
questions for assessing the subject's comprehension include instructions for the subject to read a document related to the use of goods or services;
The decision-making ability evaluation program causes the computer to:
an image acquisition unit that acquires image data of a person to be inspected;
further functions as a line-of-sight measurement unit that analyzes the image data of the face of the inspection subject acquired by the image acquisition unit and measures the trajectory of the line of sight;
12. The decision-making ability evaluation program according to claim 11, wherein the decision-making ability determination unit determines the comprehension of the test subject based on the measurement result of the line-of-sight trajectory received from the line-of-sight measurement unit.
The test subject's voice data includes the test subject's answers to questions for evaluating the test subject's understanding,
questions for assessing the subject's comprehension include instructions for the subject to read a document related to the use of goods or services;
The decision-making ability evaluation program causes the computer to:
an image acquisition unit that acquires image data of a person to be inspected;
analyzing the image data of the face of the person to be inspected acquired by the image acquisition unit and further functioning as a face orientation measurement unit for measuring the orientation of the face;
12. The decision-making ability evaluation program according to claim 11, wherein the decision-making ability determination unit determines the understanding of the person being examined based on the face orientation measurement result received from the face orientation measurement unit.
A recording medium for recording the decision-making ability evaluation program according to any one of claims 11 to 19.