WO2022114224A1 - Determination device and program - Google Patents

Determination device and program Download PDF

Info

Publication number
WO2022114224A1
WO2022114224A1 PCT/JP2021/043888 JP2021043888W WO2022114224A1 WO 2022114224 A1 WO2022114224 A1 WO 2022114224A1 JP 2021043888 W JP2021043888 W JP 2021043888W WO 2022114224 A1 WO2022114224 A1 WO 2022114224A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
learning
unit
acquisition unit
learning content
Prior art date
Application number
PCT/JP2021/043888
Other languages
French (fr)
Japanese (ja)
Inventor
司 木村
正行 沼尾
進太郎 小倉
Original Assignee
国立大学法人大阪大学
株式会社進鳳堂
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 国立大学法人大阪大学, 株式会社進鳳堂 filed Critical 国立大学法人大阪大学
Priority to JP2022565510A priority Critical patent/JP7418873B2/en
Publication of WO2022114224A1 publication Critical patent/WO2022114224A1/en
Priority to JP2023220362A priority patent/JP2024026554A/en

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G09B19/04—Speaking
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G09B19/06—Foreign languages
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00—Simulators for teaching or training purposes
    • G09B9/02—Simulators for teaching or training purposes for teaching control of vehicles or other craft
    • G09B9/04—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles
    • G09B9/052—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles characterised by provision for recording or measuring trainee's performance

Definitions

  • the present invention relates to a determination device and a program.
  • a device for determining a physical condition using a biological signal has been known.
  • a technique that combines a biological signal with a speech training, language learning, and sleep state determination device for aphasia patients As such techniques, and in languages, for example, at least one of the phonemes, parts, English difficulty, sentence length, sentence structure, and voice speed of listening to English speech is estimated from brain activity.
  • a technique has been proposed (see, for example, Patent Document 1).
  • the present invention has been made in view of the above-mentioned conventional situation, and an object of the present invention is to provide a determination device and a program capable of easily outputting the proficiency level for a learning subject from a biological signal.
  • the present invention is a determination device for determining a user's proficiency level regarding a predetermined learning subject, and acquires a biological signal of the user who is viewing the audiovisual information related to the predetermined learning subject.
  • the present invention relates to a determination device including a determination unit for determining a degree and an output unit for outputting a determination result.
  • the biological signal acquisition unit is an electroencephalogram acquisition unit that acquires the user's brain wave as the user's biological signal, and it is preferable that the calculation unit calculates the degree of concentration as the degree of change in the state of the user.
  • the biological signal acquisition unit is an electrical signal acquisition unit that acquires an electrical signal related to skin electrical activity as the user's biological signal, and the calculation unit calculates the stress level as the degree of change in the state of the user. It is preferable to do.
  • the predetermined learning subject is a language.
  • the determination device includes a learning content acquisition unit that acquires a plurality of predetermined learning contents provided to the user according to the determination result, and a moving image providing unit that provides the acquired learning content to the user. Further, among the plurality of the learning contents provided to the user, a specific unit for specifying the learning content most suitable for the user is further provided, and the brain wave acquisition unit provides the provided learning content. The brain wave of the user being viewed is acquired, the calculation unit calculates the concentration degree of the user on the learning content based on the acquired brain wave, and the specific unit calculates the concentration degree based on the calculated concentration degree. , The learning content is specified, and the output unit preferably outputs information for identifying the specified learning content.
  • the determination device includes a learning content acquisition unit that acquires a plurality of predetermined learning contents provided to the user according to the determination result, and a moving image providing unit that provides the acquired learning content to the user.
  • the learning content provided to the user is further provided with a specific unit for specifying the learning content most suitable for the user among the plurality of learning contents provided to the user, and the skin electrical signal acquisition unit is provided with the learning.
  • An electric signal related to the skin electrical activity of the user who is watching the content is acquired, and the calculation unit calculates the degree of stress on the learning content of the user based on the acquired signal related to the skin electrical activity. It is preferable that the specific unit identifies the learning content based on the calculated stress level, and the output unit outputs information for identifying the identified learning content.
  • the present invention is a program that causes a computer to function as a determination device for determining a user's proficiency level regarding a predetermined learning subject, wherein the computer is used to view audiovisual information related to the predetermined learning subject.
  • a brain wave acquisition unit that acquires the brain wave of the user being watched, a calculation unit that calculates the degree of state change of the user regarding the learning subject based on the acquired brain wave, and a calculation unit that calculates the degree of state change based on the calculated degree of state change.
  • the present invention relates to a program that functions as a determination unit for determining a user's proficiency level regarding the learning subject and an output unit for outputting a determination result.
  • the determination device 1 is a device for determining the proficiency level of the user U with respect to a learning subject related to education. Further, the determination device 1 is a device that can recommend to the user U excellent contents for enhancing concentration in learning subjects related to education. The determination device 1 measures, for example, the proficiency level of the user U with respect to a language that is one of the learning subjects. Further, the determination device 1 is a device capable of recommending (presenting) to the user U the learning content that can be expected to have the effect of increasing the concentration of the user U among the plurality of learning contents related to the language.
  • the determination device 1 determines the degree of state change of the user U by using the biological signal of the user U.
  • the determination device 1 determines the degree of state change of the user U, in particular, using a signal related to the brain wave of the user U or the electrical activity of the skin as an example of the biological signal.
  • the determination device 1 causes the user U to view audiovisual information in determining the proficiency level of the user U, and acquires a signal related to the brain wave or skin electrical activity thereof.
  • audiovisual information includes moving images, still images, paper-based texts / photographs, and the like. In each of the following embodiments, the audiovisual information will be described by taking a moving image as an example.
  • the determination device 1 uses the degree of concentration of the user U as the degree of change in the state of the user U.
  • the determination device 1 uses the stress degree of the user U as the state change degree of the user U.
  • the relationship between concentration and brain waves will be explained.
  • the frontal theta wave of the user U is used as an index as the degree of concentration in language learning.
  • theta waves are brain wave activities in the 4-7 Hz band obtained by frequency analysis such as fast Fourier transform.
  • the concentration degree is calculated by measuring the theta wave of the user U during and before and after viewing the predetermined moving image.
  • the determination device 1 is a device for determining the proficiency level of the user U regarding a predetermined learning subject.
  • the determination device 1 provides a predetermined moving image to the user U. Further, the determination device 1 determines the proficiency level of the user U by acquiring the brain waves of the user U who views the provided moving image.
  • the predetermined learning subject is explained using a language as an example.
  • the determination device 1 outputs a moving image storage unit 11, a moving image providing unit 12, an electroencephalogram acquisition unit 13, a calculation unit 14, a determination information storage unit 15, and a determination unit 16.
  • a unit 17 is provided.
  • the moving image storage unit 11 is a recording medium such as a hard disk.
  • the moving image storage unit 11 stores the moving image provided to the user U.
  • the moving image storage unit 11 stores, for example, moving images related to learning subjects. Specifically, the moving image storage unit 11 stores a predetermined self-introduction moving image using the target language.
  • the moving image providing unit 12 is realized, for example, by operating the CPU.
  • the moving image providing unit 12 provides the user U with a moving image related to the learning subject in a viewable manner.
  • the moving image providing unit 12 acquires a moving image stored in the moving image storage unit 11.
  • the moving image providing unit 12 provides the acquired moving image to the user U.
  • the moving image providing unit 12 provides the moving image to the user U in a viewable state by displaying the moving image on the display 101 or the like.
  • the brain wave acquisition unit 13 is realized, for example, by operating the CPU.
  • the electroencephalogram acquisition unit 13 is an example of a biological signal acquisition unit (not shown) that acquires the biological signal of the user who is viewing the audiovisual information related to a predetermined learning subject.
  • the electroencephalogram acquisition unit 13 acquires the electroencephalogram of the user U who is viewing the provided moving image for the user U.
  • the electroencephalogram acquisition unit 13 acquires, for example, an electroencephalogram obtained from a dry electrode electroencephalograph 102 installed on the head of the user U, as shown in FIG.
  • the brain wave acquisition unit 13 acquires, for example, brain waves during viewing of a moving image and before and after viewing a moving image.
  • the calculation unit 14 is realized, for example, by operating the CPU.
  • the calculation unit 14 calculates the degree of state change for the learning subject of the user U based on the acquired biological signal.
  • the calculation unit 14 calculates the concentration ratio of the user U regarding the learning subject based on the acquired brain wave.
  • the calculation unit 14 calculates the concentration degree of the user U by, for example, calculating the difference between theta waves based on the brain waves during and before and after watching the moving image.
  • the brain wave is calculated by calculating the difference between the brain wave during and after watching the moving image and the brain wave before watching the moving image.
  • the calculation unit 14 calculates, for example, the difference between the brain waves from the brain waves during the viewing of the moving image and before and after the viewing of the moving image for a predetermined period.
  • the determination information storage unit 15 is a recording medium such as a hard disk.
  • the determination information storage unit 15 stores the criteria for determining the language level of the user U as determination information.
  • the determination information storage unit 15 stores, for example, an index of a level for determining a language level as an advanced person or a beginner as determination information.
  • the determination information storage unit 15 stores the index to be determined as the determination information by using, for example, the upper limit value and the lower limit value of theta wave.
  • the determination unit 16 is realized, for example, by operating the CPU.
  • the determination unit 16 determines the proficiency level of the user U regarding the learning subject based on the calculated concentration level. For example, as shown in FIG. 3, the determination unit 16 determines the proficiency level of the user U by using the difference in theta waves of the user U calculated by the calculation unit 14.
  • the determination unit 16 determines, for example, either advanced or beginner level as the proficiency level.
  • the determination unit 16 determines the proficiency level (advanced or beginner) depending on which region contains theta waves, for example, using the determination information.
  • the output unit 17 is realized, for example, by operating the CPU.
  • the output unit 17 outputs the determination result.
  • the output unit 17 outputs the determination result to a display device such as a display, for example. Further, the output unit 17 outputs the determination result to a printing device such as a printer.
  • the moving image providing unit 12 provides the moving image provided to the user U so that it can be viewed (step S1).
  • the electroencephalogram acquisition unit 13 acquires the electroencephalogram of the user U (step S2).
  • step S3 calculates the difference of theta waves as the degree of concentration.
  • step S4 determines the proficiency level of the user U using the concentration level.
  • step S4: YES determines the degree of concentration of the user U using the concentration level.
  • step S5 determines the degree of concentration of the user U using the concentration level.
  • step S7 determines the degree of concentration of the user U using the concentration level.
  • step S5 the determination unit 16 determines that the user U is an advanced user.
  • step S6 the output unit 17 outputs the determination result (step S6). As a result, the processing by this flow ends.
  • step S7 the determination unit 16 determines that the user U is a beginner. Then, the process proceeds to step S6.
  • Each configuration included in the determination device 1 can be realized by hardware, software, or a combination thereof.
  • what is realized by software means that it is realized by a computer reading and executing a program.
  • Non-temporary computer-readable media include various types of tangible storage mediums.
  • Examples of non-temporary computer-readable media include magnetic recording media (eg, flexible disks, magnetic tapes, hard disk drives), optomagnetic recording media (eg, optomagnetic disks), CD-ROMs (Read Only Memory), CD-. Includes R, CD-R / W, and semiconductor memory (eg, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (random access memory)).
  • the display program may also be supplied to the computer by various types of transient computer readable medium.
  • Examples of temporary computer readable media include electrical, optical, and electromagnetic waves.
  • the temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.
  • An electroencephalogram acquisition unit that acquires the brain wave of the user U who is viewing the audiovisual information of the user U, which is a determination device 1 for determining the proficiency level of the user U regarding the predetermined learning subject. 13 and a calculation unit 14 that calculates the concentration level of the user U's learning subject based on the acquired brain waves, and a determination unit 16 that determines the proficiency level of the user U's learning subject based on the calculated concentration level. And an output unit 17 that outputs a determination result. This makes it possible to easily output the proficiency level for the learning subject from the biological signal. For example, since the proficiency level can be easily visualized, it becomes possible to formulate learning contents suitable for the user U.
  • the determination device 1 and the program according to the second embodiment of the present invention specify the learning content to be used for the learning of the user U according to the proficiency level of the user U determined in the first embodiment. For example, the determination device 1 identifies the learning content that is more interesting to the beginner among the learning contents that are the moving images corresponding to the beginner to the user U who is the beginner. The determination device 1 identifies learning content including soccer for, for example, a user U who is interested in soccer.
  • the determination device 1 according to the second embodiment is different from the first embodiment in that the content storage unit 18, the learning content acquisition unit 19, and the specific unit 20 are further provided. Further, in the determination device 1 according to the second embodiment, the operations of the moving image providing unit 12, the electroencephalogram acquisition unit 13, the calculation unit 14, the determination unit 16, and the output unit 17 are different from those of the first embodiment.
  • the content storage unit 18 is a recording medium such as a hard disk.
  • the content storage unit 18 stores a plurality of learning contents as moving images. Further, the content storage unit 18 stores the content according to the preference of each of the plurality of users U as the plurality of learning contents.
  • the content storage unit 18 stores, for example, learning content in which the introduction of soccer is explained in a language, which can be provided to the user U who is interested in soccer.
  • the learning content acquisition unit 19 is realized, for example, by operating the CPU.
  • the learning content acquisition unit 19 acquires a plurality of predetermined learning contents provided to the user U according to the determination result.
  • the content acquisition unit acquires, for example, a plurality of learning contents according to the proficiency level of the user U.
  • the specific unit 20 is realized, for example, by operating the CPU.
  • the specifying unit 20 identifies the learning content most suitable for the user U among the plurality of learning contents provided to the user U.
  • the specifying unit 20 specifies, for example, the theta wave during viewing of the learning content, and the learning content obtained from which the difference between the highest theta waves is obtained, as the learning content most appropriate for the user U.
  • the specifying unit 20 specifies the learning content based on the concentration level calculated by the following calculation unit. For example, the specifying unit 20 identifies the learning content whose concentration is the highest by the user U as the learning content suitable for the user U.
  • the moving image providing unit 12 provides the acquired learning content to the user U.
  • the moving image providing unit 12 provides, for example, a plurality of acquired learning contents to the user U so that they can be sequentially viewed.
  • the brain wave acquisition unit 13 acquires the brain wave of the user U who is viewing the provided learning content.
  • the electroencephalogram acquisition unit 13 acquires the electroencephalogram of the user U for each of the plurality of learning contents.
  • the calculation unit 14 calculates the degree of concentration of the user U on the learning content based on the acquired brain waves.
  • the calculation unit 14 calculates the concentration degree of the user U for each of the plurality of learning contents. In the present embodiment, the calculation unit 14 calculates the degree of concentration of the user U for each of the plurality of learning contents.
  • the output unit 17 outputs information that identifies the specified learning content.
  • the output unit 17 displays, for example, information (such as a moving image name) that identifies the specified learning content on a display device such as a display.
  • the learning content acquisition unit 19 acquires a plurality of learning contents (step S11).
  • the moving image providing unit 12 provides the acquired learning content to the user U in a viewable state (step S12).
  • the electroencephalogram acquisition unit 13 acquires the electroencephalogram of the user U who is viewing the learning content (step S13).
  • the calculation unit 14 calculates the concentration degree of the user U based on the acquired brain wave (step S14).
  • step S15 it is determined whether or not the next learning content is played (step S15). If there is no next learning content (step S15: NO), the process proceeds to step S16. On the other hand, if there is the next learning content (step S15: YES), the process returns to step S3.
  • step S16 the specifying unit 20 specifies content suitable for the user U.
  • step S17 the output unit 17 outputs the specified content (step S17).
  • the determination device 1 provides a learning content acquisition unit 19 that acquires a plurality of predetermined learning contents provided to the user U according to the determination result, and a moving image providing the acquired learning contents to the user U.
  • the brain wave acquisition unit 13 further includes a unit 12 and a specific unit 20 that identifies the learning content most suitable for the user U among the plurality of learning contents provided to the user U, and the brain wave acquisition unit 13 provides the provided learning content.
  • the brain wave of the user U who is watching the game is acquired, the calculation unit 14 calculates the concentration degree of the user U on the learning content based on the acquired brain wave, and the specific unit 20 calculates the concentration degree based on the calculated concentration degree.
  • the learning content is specified, and the output unit 17 outputs information for identifying the specified learning content. Thereby, it is possible to specify the learning content for which the learning effect can be further desired. Therefore, the proficiency level of the user U can be further improved.
  • the determination device 1 and the program according to the third embodiment of the present invention will be described with reference to FIGS. 7 to 9.
  • the same components as those in the above-described embodiment are designated by the same reference numerals, and the description thereof will be omitted or simplified.
  • the determination device 1 and the program according to the third embodiment use electric signals related to skin electrical activity (hereinafter, also referred to as skin electrical signals) instead of using brain waves as biological signals in the first embodiment and the second embodiment. ) Is used.
  • Electrical signals associated with skin electrical activity include, for example, skin resistance, skin impedance, or skin potential. As shown in FIG.
  • the determination device 1 according to the third embodiment acquires a skin electrical signal from the arm portion of the user U.
  • the determination device 1 and the program calculate the skin conductance level (SCL) from the skin electrical signal and use it for the determination.
  • the determination device 1 according to the third embodiment calculates the degree of stress related to the learning subject of the user U by using the electric signal related to the skin electrical activity. Further, the determination device 1 according to the third embodiment calculates the proficiency level of the user U regarding the learning subject by using the calculated stress level.
  • the determination device 1 and the program according to the third embodiment are different from the first and second embodiments in that the skin electrical signal acquisition unit 21 is provided instead of the electroencephalogram acquisition unit 13. Further, the determination device 1 and the program according to the third embodiment are different from the first and second embodiments in that the calculation unit 14 calculates the difference value of the skin electrical signal for each time. Further, in the determination device 1 and the program according to the third embodiment, as an index of the level at which the determination information storage unit 15 determines that the language level is advanced or beginner, every hour of the skin electrical signal (skin conductance level). It differs from the second and third embodiments in that the index for determining the difference value of is stored as the determination information. Further, in the determination device 1 and the program according to the third embodiment, the determination unit 16 calculates the proficiency level of the user U by using the difference in the skin electrical signal (skin conductance level) in the second and third embodiments. Different from the form.
  • the skin electrical signal acquisition unit 21 is realized, for example, by operating a CPU.
  • the skin electrical signal acquisition unit 21 is an example of a biological signal acquisition unit (not shown) that acquires the biological signal of the user who is viewing the audiovisual information related to a predetermined learning subject.
  • the skin electrical signal acquisition unit 21 acquires an electrical signal related to the skin electrical signal of the user U who is viewing the provided moving image for the user U.
  • the skin electrical signal acquisition unit 21 is, for example, as shown in FIG. 7, a skin electrical activity measuring instrument 103 (for example, a wristwatch (wristband) type measuring instrument (not shown) wound around the arm of the user U). )
  • the skin electrical signal acquisition unit 21 acquires, for example, the skin electrical signal during viewing of the moving image and before and after viewing the moving image.
  • the calculation unit 14 calculates, for example, the average value of the conductivity (hereinafter, also simply referred to as the average value) as the stress level of the user U for the skin conductance level of the skin electrical signal passed through the low-pass filter (not shown).
  • the calculation unit 14 calculates, for example, the average value of the conductivity from the skin electrical signals during the viewing of the moving image and before and after the viewing of the moving image as the stress degree of the user U.
  • the determination unit 16 determines the proficiency level of the user U by using the difference between the average values of the user U calculated by the calculation unit 14, for example.
  • the determination unit 16 determines, for example, either advanced or beginner level as the proficiency level.
  • the determination unit 16 determines the proficiency level (advanced or beginner) according to the difference value (change in stress level) of the average value, for example, using the determination information. For example, the determination unit 16 determines that the person is a beginner when the average value increases from before viewing the moving image to after viewing the moving image, taking FIG. 9 as an example. That is, when the difference value of the average value is positive (when the stress level is increasing), the determination unit 16 determines that the person is a beginner.
  • the determination unit 16 determines, for example, that the person is an advanced person when the average value decreases from before viewing the moving image to after viewing. That is, when the difference value of the average value is negative (when the stress degree is decreasing), the determination unit 16 determines that the person is an advanced person.
  • the biological signal acquisition unit is an electrical signal acquisition unit that acquires an electrical signal related to skin electrical activity as a user's biological signal. Since the skin electrical activity measuring instrument (wristband type measuring instrument) 103 can be used as compared with the case of acquiring the brain wave, the biological signal can be easily acquired.
  • the determination device 1 may further include a learning status acquisition unit (not shown) for acquiring the learning status of the user U.
  • the learning status acquisition unit may acquire the test score of the user U and the like.
  • the determination unit 16 may generate determination information regarding the proficiency level in advance by specifying the transition of the concentration degree according to the acquired learning situation.
  • the learning status acquisition unit may acquire information including self-introduction of the user U as a learning status.
  • the learning content acquisition unit 19 may acquire the learning content corresponding to the interest of the user U included in the learning situation and provide the learning content to the user U for viewing.
  • the number of learning contents acquired by the learning content acquisition unit 19 can be reduced, and the number of learning contents viewed by the user U can be reduced. Therefore, it is possible to streamline the identification of the learning content.
  • the electroencephalogram acquisition unit 13 may acquire only the electroencephalogram during or immediately after watching the moving image.
  • the calculation unit 14 may calculate the difference of theta wave, assuming that the level of theta wave before viewing the moving image is 0, instead of the difference from before viewing the moving image. Specifically, the calculation unit 14 may calculate the theta wave level during video viewing or the theta wave level immediately after video viewing as the difference between theta waves.
  • the biological signal is not limited to the electroencephalogram, but may be a pulsation, an electrocardiogram, or the like.
  • the learning subject is not limited to the language, and may be another subject generally called "learning".
  • the calculation unit may calculate a signal for determination by using a bandpass filter or a highpass filter.
  • the proficiency level may be determined by using both the electroencephalogram and the skin potential at the same time.
  • the learning content having less stress may be specified by using the stress degree of the third embodiment.
  • the specifying unit 20 may specify the learning content based on the calculated stress level.

Abstract

Provided is a determination device and a program which can easily output a proficiency level for a subject of study on the basis of a biological signal.　A determination device 1 determines the proficiency level of a user U regarding a prescribed subject of study, the determination device comprising: a biological signal acquisition unit which acquires, from a user U viewing audiovisual information regarding a prescribed subject of study, a biological signal of the user U during viewing; a calculation unit 14 which calculates a degree of state change of the user U regarding the subject of study on the basis of the acquired biological signal; a determination unit 16 which determines the proficiency level regarding the subject of study of the user U on the basis of the calculated degree of state change; and an output unit 17 which outputs a determination result.

Description

判定装置及びプログラムJudgment device and program
　本発明は、判定装置及びプログラムに関する。 The present invention relates to a determination device and a program.
　従来より、生体信号を用いて身体の状態を判定する装置が知られている。例えば、失語症患者の発話訓練、言語学習、及び睡眠状態の判定装置に生体信号を組み合わせた技術が知られている。このような技術として、また、例えば、語学では、英語音声の聞き取りによる音素、品詞、英語の難易度、文の長さ、文の構造、及び音声の速度のうち少なくともひとつを脳活動から推定する技術が提案されている（例えば、特許文献１参照）。 Conventionally, a device for determining a physical condition using a biological signal has been known. For example, there is known a technique that combines a biological signal with a speech training, language learning, and sleep state determination device for aphasia patients. As such techniques, and in languages, for example, at least one of the phonemes, parts, English difficulty, sentence length, sentence structure, and voice speed of listening to English speech is estimated from brain activity. A technique has been proposed (see, for example, Patent Document 1).
特開２０１９－１２８５３３号公報Japanese Unexamined Patent Publication No. 2019-128533
　ところで、上記特許文献１に記載の技術のように、生体信号を語学に用いるものはあるものの、教育用の学習科目に対して生体信号を用いる技術はなかった。そこで、教育において、生体信号から学習科目に対する習熟度を容易に出力することができれば好適である。 By the way, like the technique described in Patent Document 1, there is a technique that uses a biological signal for language learning, but there is no technique that uses a biological signal for a learning subject for education. Therefore, in education, it is preferable if the proficiency level for the learning subject can be easily output from the biological signal.
　本発明は、上記従来の実状に鑑みてなされたものであり、生体信号から学習科目に対する習熟度を容易に出力することが可能な判定装置及びプログラムを提供することを目的とする。 The present invention has been made in view of the above-mentioned conventional situation, and an object of the present invention is to provide a determination device and a program capable of easily outputting the proficiency level for a learning subject from a biological signal.
　本発明は、所定の学習科目に関するユーザの習熟度を判定する判定装置であって、前記所定の学習科目に関連する視聴覚情報を視聴する前記ユーザについて、視聴中の前記ユーザの生体信号を取得する生体信号取得部と、取得された生体信号に基づいて、前記ユーザの前記学習科目に関する状態変化度合を算出する算出部と、算出された状態変化度合に基づいて、前記ユーザの前記学習科目に関する習熟度を判定する判定部と、判定結果を出力する出力部と、を備える判定装置に関する。 The present invention is a determination device for determining a user's proficiency level regarding a predetermined learning subject, and acquires a biological signal of the user who is viewing the audiovisual information related to the predetermined learning subject. A biomedical signal acquisition unit, a calculation unit that calculates the degree of state change of the user regarding the learning subject based on the acquired biosignal, and a proficiency of the user regarding the learning subject based on the calculated degree of state change. The present invention relates to a determination device including a determination unit for determining a degree and an output unit for outputting a determination result.
　また、前記生体信号取得部は、前記ユーザの生体信号として前記ユーザの脳波を取得する脳波取得部であり、前記算出部は、前記ユーザの状態変化度合として、集中度を算出するのが好ましい。 Further, the biological signal acquisition unit is an electroencephalogram acquisition unit that acquires the user's brain wave as the user's biological signal, and it is preferable that the calculation unit calculates the degree of concentration as the degree of change in the state of the user.
　また、前記生体信号取得部は、前記ユーザの生体信号として皮膚電気活動に関連する電気信号を取得する電気信号取得部であり、前記算出部は、前記ユーザの状態変化度合として、ストレス度を算出するのが好ましい。 Further, the biological signal acquisition unit is an electrical signal acquisition unit that acquires an electrical signal related to skin electrical activity as the user's biological signal, and the calculation unit calculates the stress level as the degree of change in the state of the user. It is preferable to do.
　また、前記所定の学習科目は、語学であるのが好ましい。 In addition, it is preferable that the predetermined learning subject is a language.
　また、判定装置は、判定結果に応じて、前記ユーザに提供される複数の所定の学習コンテンツを取得する学習コンテンツ取得部と、取得された前記学習コンテンツを前記ユーザに提供する動画像提供部と、前記ユーザに提供される複数の前記学習コンテンツのうち、前記ユーザへの適性が最も高い前記学習コンテンツを特定する特定部と、をさらに備え、前記脳波取得部は、提供された前記学習コンテンツを視聴中の前記ユーザの脳波を取得し、前記算出部は、取得された脳波に基づいて、前記ユーザの前記学習コンテンツに対する集中度を算出し、前記特定部は、算出された集中度に基づいて、前記学習コンテンツを特定し、前記出力部は、特定された前記学習コンテンツを識別する情報を出力するのが好ましい。 Further, the determination device includes a learning content acquisition unit that acquires a plurality of predetermined learning contents provided to the user according to the determination result, and a moving image providing unit that provides the acquired learning content to the user. Further, among the plurality of the learning contents provided to the user, a specific unit for specifying the learning content most suitable for the user is further provided, and the brain wave acquisition unit provides the provided learning content. The brain wave of the user being viewed is acquired, the calculation unit calculates the concentration degree of the user on the learning content based on the acquired brain wave, and the specific unit calculates the concentration degree based on the calculated concentration degree. , The learning content is specified, and the output unit preferably outputs information for identifying the specified learning content.
　また、判定装置は、判定結果に応じて、前記ユーザに提供される複数の所定の学習コンテンツを取得する学習コンテンツ取得部と、取得された前記学習コンテンツを前記ユーザに提供する動画像提供部と、前記ユーザに提供される複数の前記学習コンテンツのうち、前記ユーザへの適性が最も高い前記学習コンテンツを特定する特定部と、をさらに備え、前記皮膚電気信号取得部は、提供された前記学習コンテンツを視聴中の前記ユーザの皮膚電気活動に関連する電気信号を取得し、前記算出部は、取得された皮膚電気活動に関連する信号に基づいて、前記ユーザの前記学習コンテンツに対するストレス度を算出し、前記特定部は、算出されたストレス度に基づいて、前記学習コンテンツを特定し、前記出力部は、特定された前記学習コンテンツを識別する情報を出力するのが好ましい。 Further, the determination device includes a learning content acquisition unit that acquires a plurality of predetermined learning contents provided to the user according to the determination result, and a moving image providing unit that provides the acquired learning content to the user. The learning content provided to the user is further provided with a specific unit for specifying the learning content most suitable for the user among the plurality of learning contents provided to the user, and the skin electrical signal acquisition unit is provided with the learning. An electric signal related to the skin electrical activity of the user who is watching the content is acquired, and the calculation unit calculates the degree of stress on the learning content of the user based on the acquired signal related to the skin electrical activity. It is preferable that the specific unit identifies the learning content based on the calculated stress level, and the output unit outputs information for identifying the identified learning content.
　また、本発明は、所定の学習科目に関するユーザの習熟度を判定する判定装置としてコンピュータを機能させるプログラムであって、前記コンピュータを、前記所定の学習科目に関連する視聴覚情報を視聴する前記ユーザについて、視聴中の前記ユーザの脳波を取得する脳波取得部、取得された脳波に基づいて、前記ユーザの前記学習科目に関する状態変化度合を算出する算出部、算出された状態変化度合に基づいて、前記ユーザの前記学習科目に関する習熟度を判定する判定部、判定結果を出力する出力部、として機能させるプログラムに関する。 Further, the present invention is a program that causes a computer to function as a determination device for determining a user's proficiency level regarding a predetermined learning subject, wherein the computer is used to view audiovisual information related to the predetermined learning subject. , A brain wave acquisition unit that acquires the brain wave of the user being watched, a calculation unit that calculates the degree of state change of the user regarding the learning subject based on the acquired brain wave, and a calculation unit that calculates the degree of state change based on the calculated degree of state change. The present invention relates to a program that functions as a determination unit for determining a user's proficiency level regarding the learning subject and an output unit for outputting a determination result.
　本開示によれば、生体信号から学習科目に対する習熟度を容易に出力することが可能な判定装置及びプログラムを提供することができる。 According to the present disclosure, it is possible to provide a determination device and a program capable of easily outputting the proficiency level for a learning subject from a biological signal.
本発明の第１実施形態に係る判定装置を用いた概要を示す概略図である。It is a schematic diagram which shows the outline using the determination apparatus which concerns on 1st Embodiment of this invention. 第１実施形態の判定装置の構成を示すブロック図である。It is a block diagram which shows the structure of the determination apparatus of 1st Embodiment. 第１実施形態の判定装置の脳波と集中度との関係を示すグラフである。It is a graph which shows the relationship between the electroencephalogram of the determination apparatus of 1st Embodiment, and the degree of concentration. 第１実施形態の判定装置の動作の流れを示すフローチャートである。It is a flowchart which shows the flow of operation of the determination apparatus of 1st Embodiment. 本発明の第２実施形態に係る判定装置の構成を示すブロック図である。It is a block diagram which shows the structure of the determination apparatus which concerns on 2nd Embodiment of this invention. 第２実施形態の判定装置の動作の流れを示すフローチャートである。It is a flowchart which shows the flow of operation of the determination apparatus of 2nd Embodiment. 本発明の第３実施形態に係る判定装置を用いた概要を示す概略図である。It is a schematic diagram which shows the outline using the determination apparatus which concerns on 3rd Embodiment of this invention. 第３実施形態の判定装置の構成を示すブロック図である。It is a block diagram which shows the structure of the determination apparatus of 3rd Embodiment. 第３実施形態の判定装置の皮膚電気活動に関連する電気信号とストレス度との関係を示すグラフである。It is a graph which shows the relationship between the electric signal and the degree of stress related to the skin electric activity of the determination apparatus of 3rd Embodiment.
　以下、本発明の各実施形態に係る判定装置１及びプログラムについて、図１から図９を参照して説明する。
　まず、各実施形態に係る判定装置１の概要について説明する。
　判定装置１は、教育に関する学習科目に関して、ユーザＵの習熟度を判定する装置である。また、判定装置１は、教育に関する学習科目に関して、集中力を高めるのに優れたコンテンツをユーザＵに推薦可能な装置である。判定装置１は、例えば、学習科目の１つである語学に関して、ユーザＵの習熟度を測定する。また、判定装置１は、語学に関する複数の学習コンテンツのうち、ユーザＵの集中力を高める効果を期待できる学習コンテンツをユーザＵに推薦（提示）可能な装置である。判定装置１は、ユーザＵの生体信号を用いて、ユーザＵの状態変化度合を判定する。判定装置１は、特に、生体信号の一例として、ユーザＵの脳波又は皮膚電気活動に関連する信号を用いて、ユーザＵの状態変化度合を判定する。以下の各実施形態では、判定装置１は、ユーザＵの習熟度を判定するにあたり、視聴覚情報をユーザＵに視聴させ、その脳波又は皮膚電気活動に関連する信号を取得する。また、視聴覚情報は、動画像、静止画像、又は紙ベースのテキスト・写真等を含む。以下の各実施形態では、視聴覚情報は、一例として、動画像を例に説明される。なお、以下の第１実施形態では、判定装置１は、ユーザＵの状態変化度合として、ユーザＵの集中度を用いる。また、以下の第３実施形態では、判定装置１は、ユーザＵの状態変化度合として、ユーザＵのストレス度を用いる。 Hereinafter, the determination device 1 and the program according to each embodiment of the present invention will be described with reference to FIGS. 1 to 9.
First, an outline of the determination device 1 according to each embodiment will be described.
The determination device 1 is a device for determining the proficiency level of the user U with respect to a learning subject related to education. Further, the determination device 1 is a device that can recommend to the user U excellent contents for enhancing concentration in learning subjects related to education. The determination device 1 measures, for example, the proficiency level of the user U with respect to a language that is one of the learning subjects. Further, the determination device 1 is a device capable of recommending (presenting) to the user U the learning content that can be expected to have the effect of increasing the concentration of the user U among the plurality of learning contents related to the language. The determination device 1 determines the degree of state change of the user U by using the biological signal of the user U. The determination device 1 determines the degree of state change of the user U, in particular, using a signal related to the brain wave of the user U or the electrical activity of the skin as an example of the biological signal. In each of the following embodiments, the determination device 1 causes the user U to view audiovisual information in determining the proficiency level of the user U, and acquires a signal related to the brain wave or skin electrical activity thereof. In addition, audiovisual information includes moving images, still images, paper-based texts / photographs, and the like. In each of the following embodiments, the audiovisual information will be described by taking a moving image as an example. In the following first embodiment, the determination device 1 uses the degree of concentration of the user U as the degree of change in the state of the user U. Further, in the following third embodiment, the determination device 1 uses the stress degree of the user U as the state change degree of the user U.
　次に、集中力と脳波との関係について説明する。
　学術的なエビデンスとして、前頭部シータ波と集中度とは、相関があることが知られている（Ｉｓｈｉｉ　ｅｔ　ａｌ．，　１９９９；ＤＯＩ：　１０．１０９７／００００１７５６－１９９９０３１７０－００００３）。以下の実施形態では、語学学習への集中度として、ユーザＵの前頭部シータ波を指標とする。ここで、シータ波は、高速フーリエ変換等の周波数解析によって得られる４－７Ｈｚ帯域の脳波活動である。また、以下の実施形態では、所定の動画像の視聴中及びその前後における、ユーザＵのシータ波を測定することにより、集中度を算出する。 Next, the relationship between concentration and brain waves will be explained.
As academic evidence, it is known that there is a correlation between frontal theta waves and concentration ratio (Ishii et al., 1999; DOI: 10.1097 / 00001756-199903170-00003). In the following embodiment, the frontal theta wave of the user U is used as an index as the degree of concentration in language learning. Here, theta waves are brain wave activities in the 4-7 Hz band obtained by frequency analysis such as fast Fourier transform. Further, in the following embodiment, the concentration degree is calculated by measuring the theta wave of the user U during and before and after viewing the predetermined moving image.
［第１実施形態］
　次に、本発明の第１実施形態に係る判定装置１について、図１から図４を参照して説明する。
　判定装置１は、所定の学習科目に関するユーザＵの習熟度を判定する装置である。判定装置１は、図１に示すように、所定の動画像をユーザＵに対して提供する。また、判定装置１は、提供された動画像を視聴するユーザＵの脳波を取得することにより、ユーザＵの習熟度を判定する。本実施形態において、所定の学習科目は、一例として、語学を用いて説明される。判定装置１は、図２に示すように、動画像格納部１１と、動画像提供部１２と、脳波取得部１３と、算出部１４と、判定情報格納部１５と、判定部１６と、出力部１７と、を備える。 [First Embodiment]
Next, the determination device 1 according to the first embodiment of the present invention will be described with reference to FIGS. 1 to 4.
The determination device 1 is a device for determining the proficiency level of the user U regarding a predetermined learning subject. As shown in FIG. 1, the determination device 1 provides a predetermined moving image to the user U. Further, the determination device 1 determines the proficiency level of the user U by acquiring the brain waves of the user U who views the provided moving image. In this embodiment, the predetermined learning subject is explained using a language as an example. As shown in FIG. 2, the determination device 1 outputs a moving image storage unit 11, a moving image providing unit 12, an electroencephalogram acquisition unit 13, a calculation unit 14, a determination information storage unit 15, and a determination unit 16. A unit 17 is provided.
　動画像格納部１１は、例えば、ハードディスク等の記録媒体である。動画像格納部１１は、ユーザＵに提供される動画像を格納する。動画像格納部１１は、例えば、学習科目に関する動画像を格納する。具体的には、動画像格納部１１は、対象となる語学を用いた、所定の自己紹介動画を格納する。 The moving image storage unit 11 is a recording medium such as a hard disk. The moving image storage unit 11 stores the moving image provided to the user U. The moving image storage unit 11 stores, for example, moving images related to learning subjects. Specifically, the moving image storage unit 11 stores a predetermined self-introduction moving image using the target language.
　動画像提供部１２は、例えば、ＣＰＵが動作することにより実現される。動画像提供部１２は、ユーザＵに対して、学習科目に関する動画像を視聴可能に提供する。動画像提供部１２は、動画像格納部１１に格納されている動画像を取得する。動画像提供部１２は、取得した動画像をユーザＵに対して提供する。動画像提供部１２は、例えば、図１に示すように、ディスプレイ１０１等に動画像を表示することにより、ユーザＵに対して、視聴可能な状態で動画像を提供する。 The moving image providing unit 12 is realized, for example, by operating the CPU. The moving image providing unit 12 provides the user U with a moving image related to the learning subject in a viewable manner. The moving image providing unit 12 acquires a moving image stored in the moving image storage unit 11. The moving image providing unit 12 provides the acquired moving image to the user U. As shown in FIG. 1, for example, the moving image providing unit 12 provides the moving image to the user U in a viewable state by displaying the moving image on the display 101 or the like.
　脳波取得部１３は、例えば、ＣＰＵが動作することにより実現される。脳波取得部１３は、所定の学習科目に関する視聴覚情報を視聴するユーザについて、視聴中のユーザの生体信号を取得する生体信号取得部（図示せず）の一例である。脳波取得部１３は、提供された動画像を視聴するユーザＵについて、視聴中のユーザＵの脳波を取得する。脳波取得部１３は、例えば、図１に示すように、ユーザＵの頭部に設置される乾式電極脳波計１０２から得られる脳波を取得する。本実施形態において、脳波取得部１３は、例えば、動画像の視聴中及び動画像の視聴前後の脳波を取得する。 The brain wave acquisition unit 13 is realized, for example, by operating the CPU. The electroencephalogram acquisition unit 13 is an example of a biological signal acquisition unit (not shown) that acquires the biological signal of the user who is viewing the audiovisual information related to a predetermined learning subject. The electroencephalogram acquisition unit 13 acquires the electroencephalogram of the user U who is viewing the provided moving image for the user U. The electroencephalogram acquisition unit 13 acquires, for example, an electroencephalogram obtained from a dry electrode electroencephalograph 102 installed on the head of the user U, as shown in FIG. In the present embodiment, the brain wave acquisition unit 13 acquires, for example, brain waves during viewing of a moving image and before and after viewing a moving image.
　算出部１４は、例えば、ＣＰＵが動作することにより実現される。算出部１４は、取得された生体信号に基づいて、ユーザＵの学習科目に対する状態変化度合を算出する。本実施形態において、算出部１４は、取得された脳波に基づいて、ユーザＵの学習科目に関する集中度を算出する。算出部１４は、例えば、動画視聴中及び視聴前後の脳波に基づいてシータ波の差分を算出することにより、ユーザＵの集中度を算出する。具体的には、動画視聴中及び動画視聴後の脳波について、動画視聴前の脳波との差分を算出することにより、脳波を算出する。算出部１４は、例えば、動画像の視聴中及び動画像の視聴前後の所定期間の脳波から脳波の差分を算出する。 The calculation unit 14 is realized, for example, by operating the CPU. The calculation unit 14 calculates the degree of state change for the learning subject of the user U based on the acquired biological signal. In the present embodiment, the calculation unit 14 calculates the concentration ratio of the user U regarding the learning subject based on the acquired brain wave. The calculation unit 14 calculates the concentration degree of the user U by, for example, calculating the difference between theta waves based on the brain waves during and before and after watching the moving image. Specifically, the brain wave is calculated by calculating the difference between the brain wave during and after watching the moving image and the brain wave before watching the moving image. The calculation unit 14 calculates, for example, the difference between the brain waves from the brain waves during the viewing of the moving image and before and after the viewing of the moving image for a predetermined period.
　判定情報格納部１５は、例えば、ハードディスク等の記録媒体である。判定情報格納部１５は、ユーザＵの語学レベルを判定する基準について、判定情報として格納する。判定情報格納部１５は、例えば、語学レベルについて、上級者又は初級者と判定するレベルの指標を判定情報として格納する。判定情報格納部１５は、例えば、シータ波の上限値及び下限値を用いて、判定する指標を判定情報として格納する。 The determination information storage unit 15 is a recording medium such as a hard disk. The determination information storage unit 15 stores the criteria for determining the language level of the user U as determination information. The determination information storage unit 15 stores, for example, an index of a level for determining a language level as an advanced person or a beginner as determination information. The determination information storage unit 15 stores the index to be determined as the determination information by using, for example, the upper limit value and the lower limit value of theta wave.
　判定部１６は、例えば、ＣＰＵが動作することにより実現される。判定部１６は、算出された集中度に基づいて、ユーザＵの学習科目に関する習熟度を判定する。判定部１６は、例えば、図３に示すように、算出部１４によって算出されたユーザＵのシータ波の差分を用いて、ユーザＵの習熟度を判定する。判定部１６は、例えば、習熟度として、上級及び初級のいずれかを判定する。判定部１６は、例えば、判定情報を用いて、いずれの領域にシータ波が含まれているかによって、習熟度（上級者又は初級者）を判定する。 The determination unit 16 is realized, for example, by operating the CPU. The determination unit 16 determines the proficiency level of the user U regarding the learning subject based on the calculated concentration level. For example, as shown in FIG. 3, the determination unit 16 determines the proficiency level of the user U by using the difference in theta waves of the user U calculated by the calculation unit 14. The determination unit 16 determines, for example, either advanced or beginner level as the proficiency level. The determination unit 16 determines the proficiency level (advanced or beginner) depending on which region contains theta waves, for example, using the determination information.
　出力部１７は、例えば、ＣＰＵが動作することにより実現される。出力部１７は、判定結果を出力する。出力部１７は、例えば、ディスプレイ等の表示装置に判定結果を出力する。また、出力部１７は、プリンタ等の印刷装置に判定結果を出力する。 The output unit 17 is realized, for example, by operating the CPU. The output unit 17 outputs the determination result. The output unit 17 outputs the determination result to a display device such as a display, for example. Further, the output unit 17 outputs the determination result to a printing device such as a printer.
　次に、判定装置１の動作について、図４を参照して説明する。
　まず、動画像提供部１２は、ユーザＵに提供する動画を視聴可能に提供する（ステップＳ１）。次いで、脳波取得部１３は、ユーザＵの脳波を取得する（ステップＳ２）。 Next, the operation of the determination device 1 will be described with reference to FIG.
First, the moving image providing unit 12 provides the moving image provided to the user U so that it can be viewed (step S1). Next, the electroencephalogram acquisition unit 13 acquires the electroencephalogram of the user U (step S2).
　次いで、算出部１４は、集中度としてシータ波の差分を算出する（ステップＳ３）。次いで、判定部１６は、集中度を用いてユーザＵの習熟度を判定する（ステップＳ４）。集中度が高い場合（ステップＳ４：ＹＥＳ）、処理は、ステップＳ５に進む。一方、集中度が低い場合（ステップＳ４：ＮＯ）、処理は、ステップＳ７に進む。 Next, the calculation unit 14 calculates the difference of theta waves as the degree of concentration (step S3). Next, the determination unit 16 determines the proficiency level of the user U using the concentration level (step S4). When the degree of concentration is high (step S4: YES), the process proceeds to step S5. On the other hand, when the degree of concentration is low (step S4: NO), the process proceeds to step S7.
　ステップＳ５において、判定部１６は、ユーザＵを上級者と判定する。次いで、出力部１７は、判定結果を出力する（ステップＳ６）。これにより、本フローによる処理は、終了する。 In step S5, the determination unit 16 determines that the user U is an advanced user. Next, the output unit 17 outputs the determination result (step S6). As a result, the processing by this flow ends.
　ステップＳ７において、判定部１６は、ユーザＵを初級者と判定する。次いで、処理は、ステップＳ６に進む。 In step S7, the determination unit 16 determines that the user U is a beginner. Then, the process proceeds to step S6.
　次に、プログラムについて説明する。
　判定装置１に含まれる各構成は、ハードウェア、ソフトウェア又はこれらの組み合わせによりそれぞれ実現することができる。ここで、ソフトウェアによって実現されるとは、コンピュータがプログラムを読み込んで実行することにより実現されることを意味する。 Next, the program will be described.
Each configuration included in the determination device 1 can be realized by hardware, software, or a combination thereof. Here, what is realized by software means that it is realized by a computer reading and executing a program.
　プログラムは、様々なタイプの非一時的なコンピュータ可読媒体(non-transitory computer readable medium)を用いて格納され、コンピュータに供給することができる。非一時的なコンピュータ可読媒体は、様々なタイプの実体のある記録媒体(tangible storage medium)を含む。非一時的なコンピュータ可読媒体の例は、磁気記録媒体（例えば、フレキシブルディスク、磁気テープ、ハードディスクドライブ）、光磁気記録媒体（例えば、光磁気ディスク）、ＣＤ－ＲＯＭ(Read Only Memory)、ＣＤ－Ｒ、ＣＤ－Ｒ／Ｗ、半導体メモリ（例えば、マスクＲＯＭ、ＰＲＯＭ(Programmable ROM)、ＥＰＲＯＭ(Erasable PROM)、フラッシュＲＯＭ、ＲＡＭ(random access memory）)を含む。また、表示プログラムは、様々なタイプの一時的なコンピュータ可読媒体(transitory computer readable medium)によってコンピュータに供給されてもよい。一時的なコンピュータ可読媒体の例は、電気信号、光信号、及び電磁波を含む。一時的なコンピュータ可読媒体は、電線及び光ファイバ等の有線通信路、又は無線通信路を介して、プログラムをコンピュータに供給できる。 The program is stored using various types of non-transitory computer readable medium and can be supplied to the computer. Non-temporary computer-readable media include various types of tangible storage mediums. Examples of non-temporary computer-readable media include magnetic recording media (eg, flexible disks, magnetic tapes, hard disk drives), optomagnetic recording media (eg, optomagnetic disks), CD-ROMs (Read Only Memory), CD-. Includes R, CD-R / W, and semiconductor memory (eg, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (random access memory)). The display program may also be supplied to the computer by various types of transient computer readable medium. Examples of temporary computer readable media include electrical, optical, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.
　以上、本実施形態に係る判定装置１及びプログラムによれば、以下の効果を奏する。
（１）所定の学習科目に関するユーザＵの習熟度を判定する判定装置１であって、所定の学習科目に関する視聴覚情報を視聴するユーザＵについて、視聴中のユーザＵの脳波を取得する脳波取得部１３と、取得された脳波に基づいて、ユーザＵの学習科目に関する集中度を算出する算出部１４と、算出された集中度に基づいて、ユーザＵの学習科目に関する習熟度を判定する判定部１６と、判定結果を出力する出力部１７と、を備える。これにより、生体信号から学習科目に対する習熟度を容易に出力することができる。例えば、習熟度を容易に可視化することができるので、ユーザＵに適した学習内容を策定することが可能になる。 As described above, according to the determination device 1 and the program according to the present embodiment, the following effects are obtained.
(1) An electroencephalogram acquisition unit that acquires the brain wave of the user U who is viewing the audiovisual information of the user U, which is a determination device 1 for determining the proficiency level of the user U regarding the predetermined learning subject. 13 and a calculation unit 14 that calculates the concentration level of the user U's learning subject based on the acquired brain waves, and a determination unit 16 that determines the proficiency level of the user U's learning subject based on the calculated concentration level. And an output unit 17 that outputs a determination result. This makes it possible to easily output the proficiency level for the learning subject from the biological signal. For example, since the proficiency level can be easily visualized, it becomes possible to formulate learning contents suitable for the user U.
［第２実施形態］
　次に、本発明の第２実施形態に係る判定装置１及びプログラムについて説明する。第２実施形態の説明にあたって、前述の実施形態と同一の構成要件については同一符号を付し、その説明を省略もしくは簡略化する。
　第２実施形態に係る判定装置１及びプログラムは、第１実施形態で判定されたユーザＵの習熟度に応じて、ユーザＵの学習に供される学習コンテンツを特定する。例えば、判定装置１は、初級者であるユーザＵに対して、初級者に対応する動画である学習コンテンツのうち、より初級者にとって興味のある学習コンテンツを特定する。判定装置１は、例えば、サッカーに興味のあるユーザＵに対して、サッカーを含む学習コンテンツを特定する。 [Second Embodiment]
Next, the determination device 1 and the program according to the second embodiment of the present invention will be described. In the description of the second embodiment, the same components as those in the above-described embodiment are designated by the same reference numerals, and the description thereof will be omitted or simplified.
The determination device 1 and the program according to the second embodiment specify the learning content to be used for the learning of the user U according to the proficiency level of the user U determined in the first embodiment. For example, the determination device 1 identifies the learning content that is more interesting to the beginner among the learning contents that are the moving images corresponding to the beginner to the user U who is the beginner. The determination device 1 identifies learning content including soccer for, for example, a user U who is interested in soccer.
　第２実施形態に係る判定装置１は、コンテンツ格納部１８と、学習コンテンツ取得部１９と、特定部２０と、をさらに備える点で、第１実施形態と異なる。また、第２実施形態に係る判定装置１は、動画像提供部１２、脳波取得部１３、算出部１４、判定部１６、及び出力部１７の動作が第１実施形態と異なる。 The determination device 1 according to the second embodiment is different from the first embodiment in that the content storage unit 18, the learning content acquisition unit 19, and the specific unit 20 are further provided. Further, in the determination device 1 according to the second embodiment, the operations of the moving image providing unit 12, the electroencephalogram acquisition unit 13, the calculation unit 14, the determination unit 16, and the output unit 17 are different from those of the first embodiment.
　コンテンツ格納部１８は、例えば、ハードディスク等の記録媒体である。コンテンツ格納部１８は、複数の学習コンテンツを動画像として格納する。また、コンテンツ格納部１８は、複数の学習コンテンツとして、複数のユーザＵのそれぞれの好みに応じたコンテンツを格納する。コンテンツ格納部１８は、例えば、サッカーに興味のあるユーザＵに対して提供可能な、サッカーの紹介を語学で説明した学習コンテンツを格納する。 The content storage unit 18 is a recording medium such as a hard disk. The content storage unit 18 stores a plurality of learning contents as moving images. Further, the content storage unit 18 stores the content according to the preference of each of the plurality of users U as the plurality of learning contents. The content storage unit 18 stores, for example, learning content in which the introduction of soccer is explained in a language, which can be provided to the user U who is interested in soccer.
　学習コンテンツ取得部１９は、例えば、ＣＰＵが動作することにより実現される。学習コンテンツ取得部１９は、判定結果に応じて、ユーザＵに提供される複数の所定の学習コンテンツを取得する。コンテンツ取得部は、例えば、ユーザＵの習熟度に応じた複数の学習コンテンツを取得する。 The learning content acquisition unit 19 is realized, for example, by operating the CPU. The learning content acquisition unit 19 acquires a plurality of predetermined learning contents provided to the user U according to the determination result. The content acquisition unit acquires, for example, a plurality of learning contents according to the proficiency level of the user U.
　特定部２０は、例えば、ＣＰＵが動作することにより実現される。特定部２０は、ユーザＵに提供される複数の学習コンテンツのうち、ユーザＵへの適性が最も高い学習コンテンツを特定する。特定部２０は、例えば、学習コンテンツの視聴中のシータ波について、最も高いシータ波の差分を得られた学習コンテンツについて、ユーザＵへの適正が最も高い学習コンテンツとして特定する。特に、特定部２０は、以下の算出部において算出された集中度に基づいて、学習コンテンツを特定する。特定部２０は、例えば、ユーザＵによって最も高い集中度を示された学習コンテンツについて、ユーザＵに適した学習コンテンツとして特定する。 The specific unit 20 is realized, for example, by operating the CPU. The specifying unit 20 identifies the learning content most suitable for the user U among the plurality of learning contents provided to the user U. The specifying unit 20 specifies, for example, the theta wave during viewing of the learning content, and the learning content obtained from which the difference between the highest theta waves is obtained, as the learning content most appropriate for the user U. In particular, the specifying unit 20 specifies the learning content based on the concentration level calculated by the following calculation unit. For example, the specifying unit 20 identifies the learning content whose concentration is the highest by the user U as the learning content suitable for the user U.
　動画像提供部１２は、取得された学習コンテンツをユーザＵに提供する。動画像提供部１２は、例えば、取得された複数の学習コンテンツを順次視聴可能にユーザＵに提供する。 The moving image providing unit 12 provides the acquired learning content to the user U. The moving image providing unit 12 provides, for example, a plurality of acquired learning contents to the user U so that they can be sequentially viewed.
　脳波取得部１３は、提供された学習コンテンツを視聴中のユーザＵの脳波を取得する。脳波取得部１３は、複数の学習コンテンツごとに、ユーザＵの脳波を取得する。 The brain wave acquisition unit 13 acquires the brain wave of the user U who is viewing the provided learning content. The electroencephalogram acquisition unit 13 acquires the electroencephalogram of the user U for each of the plurality of learning contents.
　算出部１４は、取得された脳波に基づいて、ユーザＵの学習コンテンツに対する集中度を算出する。算出部１４は、複数の学習コンテンツごとに、ユーザＵの集中度を算出する。本実施形態において、算出部１４は、複数の学習コンテンツごとに、ユーザＵの集中度の度合いを算出する。 The calculation unit 14 calculates the degree of concentration of the user U on the learning content based on the acquired brain waves. The calculation unit 14 calculates the concentration degree of the user U for each of the plurality of learning contents. In the present embodiment, the calculation unit 14 calculates the degree of concentration of the user U for each of the plurality of learning contents.
　出力部１７は、特定された学習コンテンツを識別する情報を出力する。出力部１７は、例えば、ディスプレイ等の表示装置に、特定された学習コンテンツを識別する情報（動画名等）を表示する。 The output unit 17 outputs information that identifies the specified learning content. The output unit 17 displays, for example, information (such as a moving image name) that identifies the specified learning content on a display device such as a display.
　次いで、判定装置１の動作につい、図６を参照して説明する。
　まず、学習コンテンツ取得部１９は、複数の学習コンテンツを取得する（ステップＳ１１）。次いで、動画像提供部１２は、取得した学習コンテンツについて、視聴可能な状態でユーザＵに提供する（ステップＳ１２）。次いで、脳波取得部１３は、学習コンテンツを視聴中のユーザＵの脳波を取得する（ステップＳ１３）。次いで、算出部１４は、取得した脳波に基づいて、ユーザＵの集中度を算出する（ステップＳ１４）。 Next, the operation of the determination device 1 will be described with reference to FIG.
First, the learning content acquisition unit 19 acquires a plurality of learning contents (step S11). Next, the moving image providing unit 12 provides the acquired learning content to the user U in a viewable state (step S12). Next, the electroencephalogram acquisition unit 13 acquires the electroencephalogram of the user U who is viewing the learning content (step S13). Next, the calculation unit 14 calculates the concentration degree of the user U based on the acquired brain wave (step S14).
　次いで、次の学習コンテンツが再生されるか否かが判断される（ステップＳ１５）。次の学習コンテンツがない場合（ステップＳ１５：ＮＯ）、処理は、ステップＳ１６に進む。一方、次の学習コンテンツがある場合（ステップＳ１５：ＹＥＳ）、処理は、ステップＳ３に戻る。 Next, it is determined whether or not the next learning content is played (step S15). If there is no next learning content (step S15: NO), the process proceeds to step S16. On the other hand, if there is the next learning content (step S15: YES), the process returns to step S3.
　ステップＳ１６において、特定部２０は、ユーザＵに対して適したコンテンツを特定する。次いで、出力部１７は、特定されたコンテンツを出力する（ステップＳ１７）。 In step S16, the specifying unit 20 specifies content suitable for the user U. Next, the output unit 17 outputs the specified content (step S17).
　以上、本実施形態に係る判定装置１及びプログラムによれば、以下の効果を奏する。
（２）判定装置１は、判定結果に応じて、ユーザＵに提供される複数の所定の学習コンテンツを取得する学習コンテンツ取得部１９と、取得された学習コンテンツをユーザＵに提供する動画像提供部１２と、ユーザＵに提供される複数の学習コンテンツのうち、ユーザＵへの適性が最も高い学習コンテンツを特定する特定部２０と、をさらに備え、脳波取得部１３は、提供された学習コンテンツを視聴中のユーザＵの脳波を取得し、算出部１４は、取得された脳波に基づいて、ユーザＵの学習コンテンツに対する集中度を算出し、特定部２０は、算出された集中度に基づいて、学習コンテンツを特定し、出力部１７は、特定された学習コンテンツを識別する情報を出力する。これにより、より学習効果を望むことができる学習コンテンツを特定することができる。したがって、ユーザＵの習熟度をより高めることができる。 As described above, according to the determination device 1 and the program according to the present embodiment, the following effects are obtained.
(2) The determination device 1 provides a learning content acquisition unit 19 that acquires a plurality of predetermined learning contents provided to the user U according to the determination result, and a moving image providing the acquired learning contents to the user U. The brain wave acquisition unit 13 further includes a unit 12 and a specific unit 20 that identifies the learning content most suitable for the user U among the plurality of learning contents provided to the user U, and the brain wave acquisition unit 13 provides the provided learning content. The brain wave of the user U who is watching the game is acquired, the calculation unit 14 calculates the concentration degree of the user U on the learning content based on the acquired brain wave, and the specific unit 20 calculates the concentration degree based on the calculated concentration degree. , The learning content is specified, and the output unit 17 outputs information for identifying the specified learning content. Thereby, it is possible to specify the learning content for which the learning effect can be further desired. Therefore, the proficiency level of the user U can be further improved.
［第３実施形態］
　次に、本発明の第３実施形態に係る判定装置１及びプログラムについて、図７から図９を参照して説明する。第３実施形態の説明にあたって、前述の実施形態と同一の構成要件については同一符号を付し、その説明を省略もしくは簡略化する。
　第３実施形態に係る判定装置１及びプログラムは、第１実施形態及び第２実施形態において生体信号として脳波を用いたのに代えて、皮膚電気活動に関連する電気信号（以下、皮膚電気信号ともいう）を用いる。皮膚電気活動に関連する電気信号は、例えば、皮膚抵抗、皮膚インピーダンス、又は皮膚電位が挙げられる。第３実施形態に係る判定装置１は、図７に示すように、ユーザＵの腕部から皮膚電気信号を取得する。本実施形態において、判定装置１及びプログラムは、一例として、皮膚電気信号から皮膚コンダクタンス水準（ＳＣＬ）を算出して判定に用いる。第３実施形態に係る判定装置１は、皮膚電気活動に関連する電気信号を用いて、ユーザＵの学習科目に関するストレス度を算出する。また、第３実施形態に係る判定装置１は、算出されたストレス度を用いて、ユーザＵの学習科目に関する習熟度を算出する。 [Third Embodiment]
Next, the determination device 1 and the program according to the third embodiment of the present invention will be described with reference to FIGS. 7 to 9. In the description of the third embodiment, the same components as those in the above-described embodiment are designated by the same reference numerals, and the description thereof will be omitted or simplified.
The determination device 1 and the program according to the third embodiment use electric signals related to skin electrical activity (hereinafter, also referred to as skin electrical signals) instead of using brain waves as biological signals in the first embodiment and the second embodiment. ) Is used. Electrical signals associated with skin electrical activity include, for example, skin resistance, skin impedance, or skin potential. As shown in FIG. 7, the determination device 1 according to the third embodiment acquires a skin electrical signal from the arm portion of the user U. In the present embodiment, the determination device 1 and the program, as an example, calculate the skin conductance level (SCL) from the skin electrical signal and use it for the determination. The determination device 1 according to the third embodiment calculates the degree of stress related to the learning subject of the user U by using the electric signal related to the skin electrical activity. Further, the determination device 1 according to the third embodiment calculates the proficiency level of the user U regarding the learning subject by using the calculated stress level.
　第３実施形態に係る判定装置１及びプログラムは、図８に示すように、脳波取得部１３に代えて、皮膚電気信号取得部２１を備える点で、第１及び第２実施形態と異なる。また、第３実施形態に係る判定装置１及びプログラムは、算出部１４が、時間ごとの皮膚電気信号の差分値を算出する点で第１及び第２実施形態と異なる。また、第３実施形態に係る判定装置１及びプログラムは、判定情報格納部１５が、語学レベルについて、上級者又は初級者と判定するレベルの指標として、皮膚電気信号（皮膚コンダクタンス水準）の時間ごとの差分値を判定する指標を判定情報として格納する点で、第２及び第３実施形態と異なる。また、第３実施形態に係る判定装置１及びプログラムは、判定部１６が、皮膚電気信号（皮膚コンダクタンス水準）の差分を用いて、ユーザＵの習熟度を算出する点で第２及び第３実施形態と異なる。 As shown in FIG. 8, the determination device 1 and the program according to the third embodiment are different from the first and second embodiments in that the skin electrical signal acquisition unit 21 is provided instead of the electroencephalogram acquisition unit 13. Further, the determination device 1 and the program according to the third embodiment are different from the first and second embodiments in that the calculation unit 14 calculates the difference value of the skin electrical signal for each time. Further, in the determination device 1 and the program according to the third embodiment, as an index of the level at which the determination information storage unit 15 determines that the language level is advanced or beginner, every hour of the skin electrical signal (skin conductance level). It differs from the second and third embodiments in that the index for determining the difference value of is stored as the determination information. Further, in the determination device 1 and the program according to the third embodiment, the determination unit 16 calculates the proficiency level of the user U by using the difference in the skin electrical signal (skin conductance level) in the second and third embodiments. Different from the form.
　皮膚電気信号取得部２１は、例えば、ＣＰＵが動作することにより実現される。皮膚電気信号取得部２１は、所定の学習科目に関する視聴覚情報を視聴するユーザについて、視聴中のユーザの生体信号を取得する生体信号取得部（図示せず）の一例である。皮膚電気信号取得部２１は、提供された動画像を視聴するユーザＵについて、視聴中のユーザＵの皮膚電気信号に関連する電気信号を取得する。皮膚電気信号取得部２１は、例えば、図７に示すように、ユーザＵの腕部に巻き回しされる皮膚電気活動測定計１０３（例えば、リストウォッチ（リストバンド）型測定器（図示せず））から得られる皮膚電気活動に関連する電気信号を取得する。本実施形態において、皮膚電気信号取得部２１は、例えば、動画像の視聴中及び動画像の視聴前後の皮膚電気信号を取得する。 The skin electrical signal acquisition unit 21 is realized, for example, by operating a CPU. The skin electrical signal acquisition unit 21 is an example of a biological signal acquisition unit (not shown) that acquires the biological signal of the user who is viewing the audiovisual information related to a predetermined learning subject. The skin electrical signal acquisition unit 21 acquires an electrical signal related to the skin electrical signal of the user U who is viewing the provided moving image for the user U. The skin electrical signal acquisition unit 21 is, for example, as shown in FIG. 7, a skin electrical activity measuring instrument 103 (for example, a wristwatch (wristband) type measuring instrument (not shown) wound around the arm of the user U). ) To obtain electrical signals related to skin electrical activity. In the present embodiment, the skin electrical signal acquisition unit 21 acquires, for example, the skin electrical signal during viewing of the moving image and before and after viewing the moving image.
　算出部１４は、例えば、ローパスフィルタ（図示せず）を通した皮膚電気信号の皮膚コンダクタンス水準について、伝導率の平均値（以下、単に平均値ともいう）をユーザＵのストレス度として算出する。算出部１４は、例えば、動画像の視聴中及び動画像の視聴前後の所定期間の皮膚電気信号から伝導率の平均値をユーザＵのストレス度として算出する。 The calculation unit 14 calculates, for example, the average value of the conductivity (hereinafter, also simply referred to as the average value) as the stress level of the user U for the skin conductance level of the skin electrical signal passed through the low-pass filter (not shown). The calculation unit 14 calculates, for example, the average value of the conductivity from the skin electrical signals during the viewing of the moving image and before and after the viewing of the moving image as the stress degree of the user U.
　判定部１６は、例えば、図９に示すように、算出部１４によって算出されたユーザＵの平均値の差分を用いて、ユーザＵの習熟度を判定する。判定部１６は、例えば、習熟度として、上級及び初級のいずれかを判定する。判定部１６は、例えば、判定情報を用いて、平均値の差分値（ストレス度の変化）に応じて習熟度（上級者又は初級者）を判定する。判定部１６は、例えば、図９を例として、動画像の視聴前から視聴後にかけて、平均値が上昇してる場合に初級者と判定する。すなわち、判定部１６は、平均値の差分値が正である場合（ストレス度が上昇している場合）に、初級者と判定する。また、判定部１６は、例えば、動画像の視聴前から視聴後にかけて、平均値が下降している場合に上級者と判定する。すなわち、判定部１６は、平均値の差分値が負である場合（ストレス度が下降している場合）に、上級者と判定する。 As shown in FIG. 9, the determination unit 16 determines the proficiency level of the user U by using the difference between the average values of the user U calculated by the calculation unit 14, for example. The determination unit 16 determines, for example, either advanced or beginner level as the proficiency level. The determination unit 16 determines the proficiency level (advanced or beginner) according to the difference value (change in stress level) of the average value, for example, using the determination information. For example, the determination unit 16 determines that the person is a beginner when the average value increases from before viewing the moving image to after viewing the moving image, taking FIG. 9 as an example. That is, when the difference value of the average value is positive (when the stress level is increasing), the determination unit 16 determines that the person is a beginner. Further, the determination unit 16 determines, for example, that the person is an advanced person when the average value decreases from before viewing the moving image to after viewing. That is, when the difference value of the average value is negative (when the stress degree is decreasing), the determination unit 16 determines that the person is an advanced person.
　以上、本実施形態に係る判定装置１及びプログラムによれば、以下の効果を奏する。
（３）生体信号取得部は、ユーザの生体信号として皮膚電気活動に関連する電気信号を取得する電気信号取得部である。脳波を取得する場合に比べ、皮膚電気活動測定計（リストバンド型測定器）１０３を用いることができるので、生体信号を容易に取得することができる。 As described above, according to the determination device 1 and the program according to the present embodiment, the following effects are obtained.
(3) The biological signal acquisition unit is an electrical signal acquisition unit that acquires an electrical signal related to skin electrical activity as a user's biological signal. Since the skin electrical activity measuring instrument (wristband type measuring instrument) 103 can be used as compared with the case of acquiring the brain wave, the biological signal can be easily acquired.
　以上、本発明の判定装置及びプログラムの好ましい各実施形態につき説明したが、本発明は、上述の実施形態に制限されるものではなく、適宜変更が可能である。 Although the preferred embodiments of the determination device and the program of the present invention have been described above, the present invention is not limited to the above-described embodiments and can be appropriately modified.
　例えば、上記実施形態において、判定装置１は、ユーザＵの学習状況を取得する学習状況取得部（図示せず）をさらに備えてもよい。学習状況取得部は、ユーザＵのテストの点数等を取得してもよい。そして、判定部１６は、取得した学習状況に応じた集中度の推移を特定することにより、習熟度に関する判定情報を予め生成するようにしてもよい。また、学習状況取得部は、ユーザＵの自己紹介等を含む情報を学習状況として取得してもよい。この場合、学習コンテンツ取得部１９は、学習状況に含まれるユーザＵの興味に対応する学習コンテンツを取得するとともに、ユーザＵに視聴可能に提供してもよい。これにより、学習コンテンツ取得部１９が取得する学習コンテンツの数を少なくすることができ、ユーザＵが視聴する学習コンテンツの数を減らすことができる。したがって、学習コンテンツの特定を効率化することができる。 For example, in the above embodiment, the determination device 1 may further include a learning status acquisition unit (not shown) for acquiring the learning status of the user U. The learning status acquisition unit may acquire the test score of the user U and the like. Then, the determination unit 16 may generate determination information regarding the proficiency level in advance by specifying the transition of the concentration degree according to the acquired learning situation. Further, the learning status acquisition unit may acquire information including self-introduction of the user U as a learning status. In this case, the learning content acquisition unit 19 may acquire the learning content corresponding to the interest of the user U included in the learning situation and provide the learning content to the user U for viewing. As a result, the number of learning contents acquired by the learning content acquisition unit 19 can be reduced, and the number of learning contents viewed by the user U can be reduced. Therefore, it is possible to streamline the identification of the learning content.
　また、上記実施形態において、脳波取得部１３は、動画視聴中又は動画視聴直後の脳波のみを取得するようにしてもよい。算出部１４は、動画視聴前との差分ではなく、仮に動画視聴前のシータ波のレベルを０として、シータ波の差分を算出してもよい。具体的には、算出部１４は、動画視聴中のシータ波のレベル又は動画視聴直後のシータ波のレベルをシータ波の差分として算出してもよい。 Further, in the above embodiment, the electroencephalogram acquisition unit 13 may acquire only the electroencephalogram during or immediately after watching the moving image. The calculation unit 14 may calculate the difference of theta wave, assuming that the level of theta wave before viewing the moving image is 0, instead of the difference from before viewing the moving image. Specifically, the calculation unit 14 may calculate the theta wave level during video viewing or the theta wave level immediately after video viewing as the difference between theta waves.
　また、上記実施形態において、生体信号は、脳波に限定されず、脈動、心電図等であってもよい。また、上記実施形態において、学習科目は、語学に限定されず、一般的に「学習」と呼ばれる他の科目であってもよい。 Further, in the above embodiment, the biological signal is not limited to the electroencephalogram, but may be a pulsation, an electrocardiogram, or the like. Further, in the above embodiment, the learning subject is not limited to the language, and may be another subject generally called "learning".
　また、第３実施形態において、ローパスフィルタを通した皮膚コンダクタンス水準を用いる点を例示したが、これに制限されない。算出部は、バンドパスフィルタ又はハイパスフィルタを用いて判定用の信号を算出してもよい。 Further, in the third embodiment, the point of using the skin conductance level through a low-pass filter is illustrated, but the present invention is not limited to this. The calculation unit may calculate a signal for determination by using a bandpass filter or a highpass filter.
　また、上記実施形態において、脳波及び皮膚電位の両者を同時に用いて習熟度を判定してもよい。また、第２実施形態において、第３実施形態のストレス度を用いてストレスの少ない学習コンテンツを特定するようにしてもよい。具体的には、特定部２０は、算出されたストレス度に基づいて、学習コンテンツを特定してもよい。 Further, in the above embodiment, the proficiency level may be determined by using both the electroencephalogram and the skin potential at the same time. Further, in the second embodiment, the learning content having less stress may be specified by using the stress degree of the third embodiment. Specifically, the specifying unit 20 may specify the learning content based on the calculated stress level.
　１　判定装置
　１２　動画像提供部
　１３　脳波取得部
　１４　算出部
　１６　判定部
　１７　出力部
　１９　学習コンテンツ取得部
　２０　特定部
　Ｕ　ユーザ 1 Judgment device 12 Motion image provider 13 Brain wave acquisition unit 14 Calculation unit 16 Judgment unit 17 Output unit 19 Learning content acquisition unit 20 Specific unit U User

Claims (7)

  1. 　所定の学習科目に関するユーザの習熟度を判定する判定装置であって、
    　前記所定の学習科目に関する視聴覚情報を視聴する前記ユーザについて、視聴中の前記ユーザの生体信号を取得する生体信号取得部と、
    　取得された生体信号に基づいて、前記ユーザの前記学習科目に関する状態変化度合を算出する算出部と、
    　算出された状態変化度合に基づいて、前記ユーザの前記学習科目に関する習熟度を判定する判定部と、
    　判定結果を出力する出力部と、
    を備える判定装置。     It is a judgment device that judges the user's proficiency level regarding a predetermined learning subject.
    For the user who views audiovisual information related to the predetermined learning subject, a biological signal acquisition unit that acquires the biological signal of the user who is viewing, and a biological signal acquisition unit.
    Based on the acquired biological signal, a calculation unit that calculates the degree of state change of the user regarding the learning subject, and a calculation unit.
    A determination unit that determines the user's proficiency level with respect to the learning subject based on the calculated state change degree.
    An output unit that outputs the judgment result and
    Judgment device.
  2. 　前記生体信号取得部は、前記ユーザの生体信号として前記ユーザの脳波を取得する脳波取得部であり、
    　前記算出部は、前記ユーザの状態変化度合として、集中度を算出する請求項１に記載の判定装置。     The biological signal acquisition unit is an electroencephalogram acquisition unit that acquires the user's brain wave as the user's biological signal.
    The determination device according to claim 1, wherein the calculation unit calculates a degree of concentration as a degree of change in the state of the user.
  3. 　前記生体信号取得部は、前記ユーザの生体信号として皮膚電気活動に関連する電気信号を取得する皮膚電気信号取得部であり、
    　前記算出部は、前記ユーザの状態変化度合として、ストレス度を算出する請求項１に記載の判定装置。     The biological signal acquisition unit is a skin electrical signal acquisition unit that acquires an electrical signal related to skin electrical activity as the user's biological signal.
    The determination device according to claim 1, wherein the calculation unit calculates a stress degree as a state change degree of the user.
  4. 　前記所定の学習科目は、語学である請求項１から３のいずれかに記載の判定装置。 The predetermined learning subject is the determination device according to any one of claims 1 to 3, which is a language.
  5. 　判定結果に応じて、前記ユーザに提供される複数の所定の学習コンテンツを取得する学習コンテンツ取得部と、
    　取得された前記学習コンテンツを前記ユーザに提供する動画像提供部と、
    　前記ユーザに提供される複数の前記学習コンテンツのうち、前記ユーザへの適性が最も高い前記学習コンテンツを特定する特定部と、
    をさらに備え、
    　前記脳波取得部は、提供された前記学習コンテンツを視聴中の前記ユーザの脳波を取得し、
    　前記算出部は、取得された脳波に基づいて、前記ユーザの前記学習コンテンツに対する集中度を算出し、
    　前記特定部は、算出された集中度に基づいて、前記学習コンテンツを特定し、
    　前記出力部は、特定された前記学習コンテンツを識別する情報を出力する請求項２に記載の判定装置。     A learning content acquisition unit that acquires a plurality of predetermined learning contents provided to the user according to the determination result, and a learning content acquisition unit.
    A moving image providing unit that provides the acquired learning content to the user,
    A specific unit that identifies the learning content that is most suitable for the user among the plurality of learning contents provided to the user.
    Further prepare
    The brain wave acquisition unit acquires the brain wave of the user who is viewing the provided learning content, and obtains the brain wave.
    The calculation unit calculates the degree of concentration of the user on the learning content based on the acquired brain waves.
    The specific unit identifies the learning content based on the calculated concentration ratio.
    The determination device according to claim 2, wherein the output unit outputs information for identifying the specified learning content.
  6. 　判定結果に応じて、前記ユーザに提供される複数の所定の学習コンテンツを取得する学習コンテンツ取得部と、
    　取得された前記学習コンテンツを前記ユーザに提供する動画像提供部と、
    　前記ユーザに提供される複数の前記学習コンテンツのうち、前記ユーザへの適性が最も高い前記学習コンテンツを特定する特定部と、
    をさらに備え、
    　前記皮膚電気信号取得部は、提供された前記学習コンテンツを視聴中の前記ユーザの皮膚電気活動に関連する電気信号を取得し、
    　前記算出部は、取得された皮膚電気活動に関連する信号に基づいて、前記ユーザの前記学習コンテンツに対するストレス度を算出し、
    　前記特定部は、算出されたストレス度に基づいて、前記学習コンテンツを特定し、
    　前記出力部は、特定された前記学習コンテンツを識別する情報を出力する請求項３に記載の判定装置。     A learning content acquisition unit that acquires a plurality of predetermined learning contents provided to the user according to the determination result, and a learning content acquisition unit.
    A moving image providing unit that provides the acquired learning content to the user,
    A specific unit that identifies the learning content that is most suitable for the user among the plurality of learning contents provided to the user.
    Further prepare
    The skin electrical signal acquisition unit acquires an electrical signal related to the skin electrical activity of the user who is viewing the provided learning content.
    The calculation unit calculates the degree of stress on the learning content of the user based on the acquired signal related to the skin electrical activity.
    The specific unit identifies the learning content based on the calculated stress level.
    The determination device according to claim 3, wherein the output unit outputs information for identifying the specified learning content.
  7. 　所定の学習科目に関するユーザの習熟度を判定する判定装置としてコンピュータを機能させるプログラムであって、
    　前記コンピュータを、
    　前記所定の学習科目に関する視聴覚情報を視聴する前記ユーザについて、視聴中の前記ユーザの生体信号を取得する生体信号取得部、
    　取得された生体信号に基づいて、前記ユーザの前記学習科目に関する状態変化度合を算出する算出部、
    　算出された状態変化度合に基づいて、前記ユーザの前記学習科目に関する習熟度を判定する判定部、
    　判定結果を出力する出力部、
    として機能させるプログラム。
          A program that causes a computer to function as a judgment device for determining a user's proficiency level in a given learning subject.
    The computer
    A biological signal acquisition unit that acquires a biological signal of the user who is viewing the user who is viewing audiovisual information related to the predetermined learning subject.
    A calculation unit that calculates the degree of state change of the user regarding the learning subject based on the acquired biological signal.
    A determination unit that determines the user's proficiency level with respect to the learning subject based on the calculated state change degree.
    Output section that outputs the judgment result,
    A program that functions as.
PCT/JP2021/043888 2020-11-30 2021-11-30 Determination device and program WO2022114224A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2022565510A JP7418873B2 (en) 2020-11-30 2021-11-30 Judgment device and program
JP2023220362A JP2024026554A (en) 2020-11-30 2023-12-27 Judgment device and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-197916 2020-11-30
JP2020197916 2020-11-30

Publications (1)

Publication Number Publication Date
WO2022114224A1 true WO2022114224A1 (en) 2022-06-02

Family

ID=81755631

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/043888 WO2022114224A1 (en) 2020-11-30 2021-11-30 Determination device and program

Country Status (2)

Country Link
JP (2) JP7418873B2 (en)
WO (1) WO2022114224A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004229948A (en) * 2003-01-31 2004-08-19 Hitachi Ltd Learning situation determination program and user situation determination system
JP2007130454A (en) * 2005-10-14 2007-05-31 Mitsubishi Chemicals Corp Device for regulating psychosomatic situation of transfer boarding person and method for controlling the device for regulating psychosomatic situation
US20180113509A1 (en) * 2015-05-12 2018-04-26 Samsung Electronics Co., Ltd. Method and device for providing content
JP2018124483A (en) * 2017-02-02 2018-08-09 日本電信電話株式会社 Learning support system, learning support device, and learning support method
JP2019215438A (en) * 2018-06-12 2019-12-19 日本電信電話株式会社 Analysis system and analysis method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005055659A (en) 2003-08-04 2005-03-03 Seiko Epson Corp Learning support device, learning support system, learning support method, and program

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004229948A (en) * 2003-01-31 2004-08-19 Hitachi Ltd Learning situation determination program and user situation determination system
JP2007130454A (en) * 2005-10-14 2007-05-31 Mitsubishi Chemicals Corp Device for regulating psychosomatic situation of transfer boarding person and method for controlling the device for regulating psychosomatic situation
US20180113509A1 (en) * 2015-05-12 2018-04-26 Samsung Electronics Co., Ltd. Method and device for providing content
JP2018124483A (en) * 2017-02-02 2018-08-09 日本電信電話株式会社 Learning support system, learning support device, and learning support method
JP2019215438A (en) * 2018-06-12 2019-12-19 日本電信電話株式会社 Analysis system and analysis method

Also Published As

Publication number Publication date
JPWO2022114224A1 (en) 2022-06-02
JP2024026554A (en) 2024-02-28
JP7418873B2 (en) 2024-01-22

Similar Documents

Publication Publication Date Title
Chen et al. Automatic classification of eye activity for cognitive load measurement with emotion interference
KR101535432B1 (en) Contents valuation system and contents valuating method using the system
Kantono et al. The effect of background music on food pleasantness ratings
JP5119375B2 (en) Concentration presence / absence estimation device and content evaluation device
US11301775B2 (en) Data annotation method and apparatus for enhanced machine learning
CN108078573B (en) Interest orientation value testing method based on physiological response information and stimulation information
Martens et al. Prevalence and characteristics of positional nystagmus in normal subjects
Perry et al. Velopharyngeal structural and functional assessment of speech in young children using dynamic magnetic resonance imaging
JP2010520554A (en) Method and system for creating an aggregated view of user responses in time-varying media using physiological data
US20200320770A1 (en) Dialog-based testing using avatar virtual assistant
JP2015229040A (en) Emotion analysis system, emotion analysis method, and emotion analysis program
Loeb et al. A laboratory evaluation of an auditory display designed to enhance intraoperative monitoring
US20160367165A1 (en) Non-invasive method for assessing and monitoring brain injuries
Alshehri et al. An exploratory study of detecting emotion states using eye-tracking technology
KR102183435B1 (en) An user stress relieving method and system using virtual reality and biofeedback
van den Broek et al. Unobtrusive sensing of emotions (USE)
Bruder et al. Subvocalization in singers: Laryngoscopy and surface EMG effects when imagining and listening to song and text
Angerstein et al. Diagnosis and differential diagnosis of voice disorders
WO2022114224A1 (en) Determination device and program
JP7352914B2 (en) Recall image estimation device, recollection image estimation method, control program, recording medium
Collett et al. Smooth or stepped? Laboratory comparison of enhanced sonifications for monitoring patient oxygen saturation
Kwon et al. The impact of background music on film audience’s attentional processes: Electroencephalography alpha-rhythm and event-related potential analyses
Ruben et al. Healthcare providers’ nonverbal behavior can lead patients to show their pain more accurately: an analogue study
Bennett et al. Stress velopharyngeal incompetence in collegiate trombone players
Maxfield Semantic and phonological encoding times in adults who stutter: Brain electrophysiological evidence

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21898195

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022565510

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21898195

Country of ref document: EP

Kind code of ref document: A1