US20230165511A1 - Cognitive ability detection device and cognitive ability detection method - Google Patents

Cognitive ability detection device and cognitive ability detection method Download PDF

Info

Publication number
US20230165511A1
US20230165511A1 US18/161,917 US202318161917A US2023165511A1 US 20230165511 A1 US20230165511 A1 US 20230165511A1 US 202318161917 A US202318161917 A US 202318161917A US 2023165511 A1 US2023165511 A1 US 2023165511A1
Authority
US
United States
Prior art keywords
motor
correction data
cognitive ability
cognitive
brain signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
US18/161,917
Other languages
English (en)
Inventor
Shingo Okajima
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Murata Manufacturing Co Ltd
Original Assignee
Murata Manufacturing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Murata Manufacturing Co Ltd filed Critical Murata Manufacturing Co Ltd
Assigned to MURATA MANUFACTURING CO., LTD. reassignment MURATA MANUFACTURING CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: OKAJIMA, SHINGO
Publication of US20230165511A1 publication Critical patent/US20230165511A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/369—Electroencephalography [EEG]
    • A61B5/375—Electroencephalography [EEG] using biofeedback
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/168—Evaluating attention deficit, hyperactivity
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/369—Electroencephalography [EEG]
    • A61B5/372—Analysis of electroencephalograms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/398—Electrooculography [EOG], e.g. detecting nystagmus; Electroretinography [ERG]
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00—Evaluating a particular growth phase or type of persons or animals
    • A61B2503/12—Healthy persons not otherwise provided for, e.g. subjects of a marketing survey
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/163—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/369—Electroencephalography [EEG]
    • A61B5/377—Electroencephalography [EEG] using evoked responses
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/70—Game security or game management aspects
    • A63F13/79—Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
    • A63F13/798—Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories for assessing skills or for ranking players, e.g. for generating a hall of fame

Definitions

  • the present disclosure relates to a cognitive ability detection device and a cognitive ability detection method for detecting cognitive ability to a stimulus from the outside.
  • Patent Literature 1 describes a cognitive ability detection technique using a brain signal. The technique described in Patent Literature 1 detects an event-related potential from a brain signal and uses the event-related potential to detect cognitive ability.
  • Patent Literature 2 describes a technique for analyzing and diagnosing a brain cerebration function that uses brain wave data.
  • the technique in Patent Literature 2 detects a motor readiness potential from brain wave data and uses the motor readiness potential to diagnose a brain cerebration function.
  • Patent Literature 3 describes a behavior prediction technique using a brain wave. The technique of Patent Literature 3 predicts a behavior of a person by using a motor readiness potential.
  • the event-related potential in the technique described in Patent Literature 1 includes a motor readiness potential together with an event-related potential (hereinafter, referred to as cognitive potential) such as the P300 generated at the time of recognition.
  • cognitive potential an event-related potential
  • an object of the present disclosure is to provide a technique for improving the measurement accuracy of the cognitive potential such as the P300.
  • a cognitive ability detection device of the present disclosure includes a brain signal acquisition unit, a correction data storage unit, and a cognitive signal generation unit.
  • the brain signal acquisition unit acquires a brain signal including an event-related potential.
  • the correction data storage unit stores motor readiness potential correction data depending on a type of an action.
  • the cognitive signal generation unit generates a cognitive signal by correcting the brain signal with the motor readiness potential correction data.
  • This configuration suppresses the motor readiness potential included in the event-related potential (cognitive potential).
  • the present disclosure can improve the measurement accuracy of the cognitive potential.
  • FIG. 1 is a functional block diagram illustrating a configuration of a cognitive signal generation unit according to a first embodiment.
  • FIG. 2 is a diagram illustrating a configuration of a cognitive ability detection system according to the first embodiment.
  • FIGS. 3 A, 3 B, and 3 C are tables illustrating examples of correction data stored in a database.
  • FIG. 4 A is a diagram illustrating an example of a waveform of a brain signal
  • FIG. 4 B is an enlarged view of a region including the electro-oculogram (EOG) and the P300 in the waveform illustrated in FIG. 4 A .
  • EOG electro-oculogram
  • FIG. 5 is a diagram illustrating an example of the motor readiness potential correction data.
  • FIG. 6 is a diagram illustrating an example of a waveform of the cognitive signal.
  • FIG. 7 is a diagram illustrating an example of a waveform of the brain signal.
  • FIG. 8 is a diagram illustrating an example of the motor readiness potential correction data.
  • FIG. 9 is a diagram illustrating an example of a waveform of the cognitive signal.
  • FIG. 10 is a flowchart illustrating an example of a generation method of a database.
  • FIGS. 11 A, 11 B, 11 C, and 11 D are diagrams each illustrating an example of a video at the time of database generation.
  • FIG. 12 is a flowchart illustrating an example of a generation method of a cognitive signal.
  • FIGS. 13 A, 13 B, 13 C, and 13 D illustrate respective waveforms in a case where a plurality of actions are performed with respect to one cognition.
  • FIGS. 14 A, 14 B, 14 C, and 14 D illustrate respective waveforms in a case where a plurality of actions are individually performed on each of a plurality of consecutive cognitions.
  • FIG. 15 is a functional block diagram illustrating a configuration of a cognitive signal generation unit according to a second embodiment.
  • FIG. 16 is a diagram illustrating a configuration of a cognitive ability detection system according to the second embodiment.
  • FIG. 17 is a diagram illustrating part of a configuration of a cognitive ability detection system according to a third embodiment.
  • FIG. 18 is a diagram illustrating a configuration of a cognitive ability detection system for games.
  • FIG. 19 is a diagram illustrating a configuration of a cognitive ability detection system for a game in multiplay.
  • FIG. 1 is a functional block diagram illustrating a configuration of a cognitive signal generation unit according to the first embodiment.
  • FIG. 2 is a diagram illustrating a configuration of a cognitive ability detection system according to the first embodiment.
  • a description will be made using as an example a case where a cognitive ability test is performed on driving.
  • the present embodiment described an example in which the cognitive ability test is applied to a drive simulator.
  • the cognitive ability detection system 1 includes: a cognitive ability detection device 30 including a cognitive signal generation unit 10 ; a brain signal sensor 111 ; a display 391 ; a simulated pedal 392 ; and a simulated steering wheel 393 .
  • the display 391 is disposed in front of a subject 80 .
  • the simulated pedal 392 and the simulated steering wheel 393 are disposed at such positions that the subject 80 can operate the simulated pedal 392 and the simulated steering wheel 393 .
  • a specific (physical) configuration of the cognitive ability detection system 1 (drive simulator) is not illustrated except for the display 391 , the simulated pedal 392 , and the simulated steering wheel 393 .
  • the brain signal sensor 111 is attached to the subject 80 . More specifically, the brain signal sensor 111 is attached at a position including the top of the head (the position of CZ on a scalp potential distribution map (International 10-20 method)) of the subject 80 .
  • the cognitive ability detection device 30 is connected to the brain signal sensor 111 and the display 391 .
  • the cognitive ability detection device 30 is implemented by an arithmetic processing unit or the like such as a processor (e.g., of a personal computer).
  • the cognitive ability detection device 30 includes the cognitive signal generation unit 10 , a control unit 31 , a video output unit 32 , a determination unit 33 , and an operation input unit 300 .
  • the operation input unit 300 receives, from a user or the like, operation inputs such as: an input of a trigger for start and end of a cognitive ability detection test; and a selection of a type of the cognitive ability detection test, and the operation input unit 300 outputs the operation inputs to the control unit 31 .
  • the control unit 31 performs overall control of the cognitive ability detection device 30 .
  • the control unit 31 controls the start, end, and the like of the cognitive ability detection test in accordance with the operation inputs from the operation input unit 300 . Furthermore, the control unit 31 instructs the video output unit 32 to output a video for the selected cognitive ability detection test.
  • the control unit 31 outputs prior information corresponding to the selected cognitive ability detection test to the cognitive signal generation unit 10 .
  • the prior information corresponding to the cognitive ability detection test is information defining a type of an action or the like that the subject 80 causes in response to recognition of danger.
  • the prior information defines that, in response to cognition of a sudden appearance of a person, an operation of a brake pedal or a steering wheel is performed.
  • the prior information may include, for example, identification information of the subject 80 , type information of the subject 80 , and the like.
  • the video output unit 32 outputs a video of the selected cognitive ability detection test to display 391 .
  • the display 391 displays this video.
  • the subject 80 can view the video of the cognitive ability detection test.
  • the brain signal (brain wave) includes an event-related potential.
  • the brain signal sensor 111 detects the brain signal and outputs the brain signal to the cognitive signal generation unit 10 .
  • the cognitive signal generation unit 10 generates a cognitive signal from the brain signal detected by the brain signal sensor 111 .
  • the determination unit 33 analyzes the cognitive signal to determine a cognitive ability, for example, to determine whether the subject 80 has a cognitive ability and to determine the level of the cognitive ability of the subject 80 . Note that the determination of the cognitive ability by using the cognitive signal uses, for example, an appearance of the P300.
  • the determination of the cognitive ability can use various known methods, and therefore the description thereof will be omitted here.
  • the cognitive signal generation unit 10 includes a brain signal acquisition unit 11 , an information input unit 12 , an EOG detection unit 131 , an MRCP correction data selection unit 132 , a calculation unit 133 , and a database 20 .
  • the database 20 corresponds to the correction data storage unit of the present disclosure.
  • the abbreviation MRCP is a movement-related cortical potential, and means a motor-related potential (motor readiness potential) in the present disclosure.
  • the brain signal acquisition unit 11 acquires a brain signal from the brain signal sensor 111 and outputs the brain signal to the calculation unit 133 and the EOG detection unit 131 .
  • the brain signal acquisition unit 11 may include an amplifier circuit and a filter circuit. By including an amplifier circuit, the brain signal acquisition unit 11 can amplify the brain signal to a predetermined signal level (amplitude). By including a filter circuit, the brain signal acquisition unit 11 can suppress noise components other than the event-related potential included in the brain signal.
  • the information input unit 12 is an input interface for prior information.
  • the information input unit 12 receives the prior information from the control unit 31 described above, and outputs the prior information to the MRCP correction data selection unit 132 .
  • the information input unit 12 further includes a user interface, and may receive the prior information by an operation input from the outside. Note that the prior information from the control unit 31 may be directly input to the MRCP correction data selection unit 132 . That is, the information input unit 12 can be omitted.
  • the EOG detection unit 131 detects an electro-oculogram EOG from the brain signal.
  • the EOG detection unit 131 detects a saccade and a fixation from the electro-oculogram.
  • the EOG detection unit 131 detects a timing at which a change from the saccade to the fixation, and outputs the timing of the change to the calculation unit 133 as a reference timing.
  • the EOG detection unit 131 may output detection results of the saccade and the fixation to the calculation unit 133 .
  • the calculation unit 133 may detect the timing of the change from the saccade to the fixation and set the timing as the reference timing.
  • the database 20 stores correction data (motor readiness potential correction data) corresponding to the motor readiness potential for each action or for each subject.
  • the correction data is data that simulates the waveform of the motor readiness potential corresponding to the action or the subject. These pieces of correction data are acquired by data sampling processing in advance (details will be described later) and stored in the database 20 .
  • FIGS. 3 A, 3 B, and 3 C are tables illustrating examples of correction data stored in the database.
  • the motor readiness potential correction data is written as MRCP correction data.
  • the motor readiness potential correction data is set for each type of an action.
  • motor readiness potential correction data MRCPc(A), motor readiness potential correction data MRCPc(B), motor readiness potential correction data MRCPc(C), and motor readiness potential correction data MRCPc(D) are respectively set for an action ACT(A), an action ACT(B), an action ACT(C), and an action ACT(D).
  • An actual example of each of the action ACT(A), the action ACT(B), the action ACT(C), and the action ACT(D) is, in the case of a drive simulator, a steering wheel operation, an accelerator operation, a brake operation, or the like under a specific environment.
  • the motor readiness potential correction data is set for each subject.
  • motor readiness potential correction data MRCPc( 1 ), motor readiness potential correction data MRCPc( 2 ), motor readiness potential correction data MRCPc( 3 ), and motor readiness potential correction data MRCPc( 4 ) are respectively set for a subject SUB( 1 ), a subject SUB( 2 ), a subject SUB( 3 ), and a subject SUB( 4 ).
  • the motor readiness potential correction data is set for each combination of the subject and the type of an action. Details of the individual combinations are not described, but, for example, the motor readiness potential correction data MRCPc(A 1 ) is set for a combination of the action ACT(A) and the subject SUB( 1 ), and the motor readiness potential correction data MRCPc(D 4 ) is set for a combination of the action ACT(D) and the subject SUB( 4 ).
  • the MRCP correction data selection unit 132 selects and reads out the motor readiness potential correction data stored in the database 20 by using the prior information from the information input unit 12 . For example, if the action ACT(A) is specified in the prior information, the MRCP correction data selection unit 132 selects the motor readiness potential correction data MRCPc(A). If the subject SUB( 2 ) is specified in the prior information, the MRCP correction data selection unit 132 selects the motor readiness potential correction data MRCPc( 2 ). If the action ACT(A) and the subject SUB( 2 ) are specified in the prior information, the MRCP correction data selection unit 132 selects the motor readiness potential correction data MRCPc(A 2 ).
  • the MRCP correction data selection unit 132 may select the motor readiness potential correction data with reference to a degree of importance. For example, in a case where the motor readiness potential correction data corresponding to a plurality of types of actions is stored, a degree of importance is associated with each action. When a plurality of types of actions are included in the prior information, the MRCP correction data selection unit 132 selects, for example, the motor readiness potential correction data corresponding to an action having the highest degree of importance.
  • the MRCP correction data selection unit 132 outputs the selected motor readiness potential correction data to the calculation unit 133 .
  • the calculation unit 133 generates a cognitive signal by correcting the brain signal using the motor readiness potential correction data selected by the MRCP correction data selection unit 132 (which is selected correction data). More specifically, for example, the calculation unit 133 generates the cognitive signal by subtracting the selected correction data from the brain signal. At this time, the calculation unit 133 executes subtraction processing on the basis of the reference timing set by the EOG detection unit 131 or the calculation unit 133 .
  • FIG. 4 A is a diagram illustrating an example of a waveform of the brain signal
  • FIG. 4 B is an enlarged view of a region including the EOG and the P300 in the waveform illustrated in FIG. 4 A
  • FIG. 5 is a diagram illustrating an example of the motor readiness potential correction data
  • FIG. 6 is a diagram illustrating an example of a waveform of the cognitive signal.
  • the brain signal includes an electro-oculogram EOG including a saccade and a fixation, a cognitive event-related potential P300, and a motor readiness potential MRCP.
  • the electro-oculogram EOG includes a saccade and a fixation.
  • the saccade is generated by a movement of an eyeball caused by cognition, which rapidly changes (changes in a negative potential direction) a voltage due to the movement of the eyeball caused by cognition.
  • the fixation stops the movement of the eyeball and gazes at a cognitive target, which stabilizes the voltage.
  • the cognitive event-related potential P300 is a temporary voltage (temporary voltage in the positive potential direction) generated when the subject 80 cognizes an object, and is generated about 300 msec after the reference timing of cognition.
  • the motor readiness potential MRCP is a voltage generated when the subject 80 performs an action in response to the cognition of cognitive target, and the voltage value gradually increases (negative potential) after the cognition, and the voltage value decreases (gets close to 0 V) with completion of the action.
  • the motor readiness potential correction data is set on the basis of the motor readiness potential MRCP.
  • the motor readiness potential correction data is set, for example, using a maximum voltage value V 1 , a time difference S 1 , a time difference t 11 , and a time difference t 12 as illustrated in FIG. 5 .
  • the maximum voltage value V 1 is set by a maximum value (negative potential) of the motor readiness potential MRCP.
  • the time difference Si is set by a time difference between the reference timing and a time of the maximum voltage value V 1 (maximum value time).
  • the reference timing is set by a timing of the change from the saccade to the fixation.
  • the time difference t 11 is set by the time difference between the maximum value time and the time at which the motor readiness potential MRCP starts changing.
  • the start time of the changing can be set as follows. For example, the motor readiness potential MRCP is subjected to approximation processing in such a manner that the voltage rise region is linear approximated, and the start time of the changing is set by the time at which the approximated line intersects with the 0-volt line. The setting of the start time of the changing does not need to be set in this manner.
  • the time difference t 12 is set at the time difference between the maximum value time and the time at which the motor readiness potential MRCP ends changing.
  • the end time of the changing can be set as follows.
  • the motor readiness potential MRCP is subjected to approximation processing in such a manner that the voltage drop region is linear approximated, and the start time of the changing is set by the time at which the approximated line intersects with the 0-volt line.
  • the setting of the end time of the changing does not need to be set in this manner.
  • these settings are performed on the basis of previously sampled potentials.
  • the previous sampling may be performed in advance on a subject 80 him or herself, or it is possible to use a brain signal acquired at the time of a past cognitive ability test of the subject 80 .
  • these settings may also use a statistical value (for example, an average value, a median value, or the like) of the motor readiness potentials MRCP detected from a plurality of persons.
  • the settings may be performed in consideration of attributes such as gender and age of the subject 80 .
  • the motor readiness potential correction data is set by a plurality of numerical values that characterize the motor readiness potential MRCP.
  • a storage capacity of the motor readiness potential correction data can be made small without suppressing the characteristics of the motor readiness potential MRCP.
  • the motor readiness potential correction data it is possible to use waveform data (all of the sampled voltage values) of the motor readiness potential MRCP sampled in advance.
  • the calculation unit 133 subtracts the motor readiness potential correction data set as described above from the brain signal by using, as a reference, the reference timing set by the EOG detection unit 131 or the calculation unit 133 . At this time, by using linear interpolation or the like, the calculation unit 133 restores the waveform of the motor readiness potential correction data from the motor readiness potential correction data, as depicted by the solid line in FIG. 5 . Then, the calculation unit 133 subtracts the waveform of the restored motor readiness potential correction data from the brain signal (waveform of the brain signal).
  • the motor readiness potential correction data set as described above is similar to or substantially coincides with the motor readiness potential MRCP included in the brain signal acquired from the subject 80 . Therefore, as illustrated in FIG. 6 , the cognitive signal obtained by subtracting the motor readiness potential correction data from the brain signal is a signal in which the motor readiness potential MRCP is suppressed from the brain signal. In other words, the cognitive signal has a waveform in which the Electro-oculogram EOG and the cognitive event-related potential P300 appear more clearly.
  • the cognitive signal becomes a signal in which the cognitive ability can be detected more easily and more reliably.
  • the measurement accuracy of the cognitive potential such as the P300 is improved.
  • the determination unit 33 can determine the cognitive ability with higher accuracy by using the cognitive signal.
  • the calculation unit 133 may subtract the motor readiness potential correction data from the brain signal after correcting the voltage values of the motor readiness potential correction data on the basis of a maximum voltage value of the acquired brain signal and a maximum voltage value of the motor readiness potential correction data.
  • the calculation unit 133 calculates a ratio between the maximum voltage value of the acquired brain signal and the maximum voltage value of the motor readiness potential correction data.
  • the calculation unit 133 corrects the voltage values of the motor readiness potential correction data on the basis of this ratio and subtracts the corrected voltage values from the brain signal. As a result, the motor readiness potential included in the brain signal is more effectively suppressed.
  • FIGS. 4 A, 4 B, 5 , and 6 illustrate a case where a voltage change region of the motor readiness potential MRCP and the cognitive event-related potential P300 do not overlap each other.
  • FIGS. 7 , 8 , and 9 even in a case where the voltage change region of the motor readiness potential MRCP and the cognitive event-related potential P300 overlap each other, by performing the above-described processing, the cognitive signal becomes a waveform in which the cognitive event-related potential P300 appears more clearly.
  • FIG. 7 is a diagram illustrating an example of a waveform of the brain signal.
  • FIG. 8 is a diagram illustrating an example of the motor readiness potential correction data.
  • FIG. 9 is a diagram illustrating an example of the waveform of the cognitive signal.
  • a motor readiness potential correction data (time difference S 2 , time difference t 21 , time difference t 22 ) is set in accordance with the rapidness of the voltage change. Since an action or a subject are set as the prior information, the MRCP correction data selection unit 132 can select appropriate motor readiness potential correction data on the basis of the prior information.
  • the cognitive signal has a waveform in which the cognitive event-related potential P300 appears more clearly as illustrated in FIG. 9 .
  • the cognitive event-related potential P300 is buried in the motor readiness potential MRCP as illustrated in FIG. 7 , the motor readiness potential MRCP is suppressed as illustrated in FIG. 9 , and the cognitive event-related potential P300 can be easily detected.
  • the motor readiness potential correction data stored in the above-described database 20 is generated as follows, for example.
  • FIG. 10 is a flowchart illustrating an example of a generation method of the database.
  • FIGS. 11 A, 11 B, 11 C, and 11 D are diagrams each illustrating an example of a video at the time of database generation.
  • a judge who judges the cognitive ability selects an event on which the cognitive ability will be determined (step S 21 ).
  • the cognitive ability detection device receives selection of an event.
  • the cognitive ability detection device presents trigger information corresponding to the selected event for generating a database, to a person such as a subject with respect to whom motor readiness potential correction data is to be generated (step S 22 ).
  • the trigger information for database generation is presented by, for example, a video as illustrated in FIGS. 11 A, 11 B, 11 C, and 11 D . Note that the trigger information is not limited to a video, and may be sound, stimulation, or the like.
  • FIGS. 11 A, 11 B, 11 C, and 11 D an automobile 901 and a reaction start line 910 are displayed in a video 90 .
  • the video 90 changes to move downward (see the thick arrows in the drawing) so that the automobile 901 moves upward on the video 90 while the automobile 901 does not change its position. At this time, a positional relationship between the automobile 901 and the reaction start line 910 does not change.
  • an avoidance target 902 appears from the upper end of the video 90 .
  • the person with respect to whom motor readiness potential correction data is to be generated has been given an instruction to start an avoidance action after the avoidance target 902 reaches the reaction start line 910 . Therefore, in this state, the person with respect to whom motor readiness potential correction data is to be generated visually follows the avoidance target 902 . As a result, an electro-oculogram EOG is generated.
  • the cognitive ability detection device measures (step S 23 ) and acquires a brain signal in this series of actions.
  • the cognitive ability detection device extracts the waveform of the motor readiness potential from the brain signal (step S 24 ). As described above, the start timing of the avoidance is roughly obtained from the video. Therefore, the cognitive ability detection device can more accurately extract the motor readiness potential by using as a reference the timing at which the avoidance target 902 set in the video reaches the reaction start line 910 .
  • the cognitive ability detection device generates the above-described motor readiness potential correction data from the waveform of the extracted motor readiness potential, and registers the generated motor readiness potential correction data in the database 20 (step S 25 ).
  • the database 20 of the motor readiness potential correction data can be generated by using the above-described method.
  • FIG. 12 is a flowchart illustrating an example of a generation method of a cognitive signal.
  • the cognitive signal generation unit 10 generates the cognitive signal by performing the processing illustrated in FIG. 12 . Note that details of each processing are described in the above description, and a description is omitted except for parts that require further additional description.
  • the cognitive signal generation unit 10 acquires a brain signal (step S 11 ).
  • the cognitive signal generation unit 10 detects an electro-oculogram EOG (step S 12 ).
  • the cognitive signal generation unit 10 determines a reference timing by using the electro-oculogram EOG (step S 13 ).
  • the cognitive signal generation unit 10 reads a motor readiness potential correction data generated in advance as described above in correspondence to prior information (step S 14 ).
  • the cognitive signal generation unit 10 corrects the brain signal by using the read-out (selected) motor readiness potential data and generates a cognitive signal (step S 15 ).
  • this processing is programmed and stored in a storage medium, an external server, or the like.
  • This processing can be implemented in such a manner that an arithmetic processing unit such as a processor (e.g., of a personal computer) that implements the cognitive signal generation unit 10 reads out and executes the program.
  • a processor e.g., of a personal computer
  • the above description describes a generation method of a cognitive signal in a case where one action occurs. However, there is a case where multiple actions occur in an overlapping manner or a continuous manner.
  • FIGS. 13 A, 13 B, 13 C, and 13 D illustrate respective waveforms in a case where a plurality of actions are performed with respect to one cognition.
  • This case corresponds to, for example, a case where a pedestrian jumps out from a crosswalk, a brake pedal is stepped on, and a steering wheel is turned.
  • FIG. 13 A illustrates a waveform of the brain signal
  • FIGS. 13 B and 13 C illustrate respective waveforms of the motor readiness potential correction data for different types of actions
  • FIG. 13 D illustrates a waveform of the cognitive signal.
  • the motor readiness potential correction data MRCPc(A) of FIG. 13 B and the motor readiness potential correction data MRCPc(B) of FIG. 13 C the motor readiness potential correction data is set for each action. Therefore, as illustrated in FIG. 13 A , even when a plurality of motor readiness potentials are included in the brain signal, each motor readiness potential can be suppressed. As a result, as illustrated in FIG. 13 D , the cognitive signal becomes a signal in which the cognitive event-related potential P300 can be easily detected.
  • FIGS. 14 A, 14 B, 14 C, and 14 D illustrate respective waveforms in a case where a plurality of actions are individually performed on each of a plurality of consecutive cognitions.
  • This case corresponds to, for example, a case where after a brake pedal is stepped on to slow down when getting close to a crosswalk, a steering wheel is turned in response to a pedestrian jumping out.
  • FIG. 14 A illustrates a waveform of the brain signal
  • FIGS. 14 B and 14 C illustrate respective waveforms of the motor readiness potential correction data for different types of actions
  • FIG. 14 D illustrates a waveform of the cognitive signal.
  • the motor readiness potential correction data MRCPc(A) of FIG. 14 B and the motor readiness potential correction data MRCPc(B) of FIG. 14 C the motor readiness potential correction data is set for each action. Therefore, as illustrated in FIG. 14 A , even when a plurality of motor readiness potentials are included in the brain signal, each motor readiness potential can be suppressed. As a result, as illustrated in FIG. 14 D , the cognitive signal becomes a signal in which a cognitive event-related potential P300A and a cognitive event-related potential P300B can be detected individually and easily.
  • FIG. 15 is a functional block diagram illustrating a configuration of a cognitive signal generation unit according to the second embodiment.
  • FIG. 16 is a diagram illustrating a configuration of a cognitive ability detection system according to the second embodiment.
  • a cognitive ability detection system 1 A according to the second embodiment is different from the cognitive ability detection system 1 according to the first embodiment in that a cognitive signal generation unit 10 A in a cognitive ability detection device 30 A includes an action detection unit 14 and in that a timing of an action detected by the action detection unit 14 is used.
  • the other part of the configuration of the cognitive ability detection system 1 A is similar to that of the cognitive ability detection device 30 , and a description of a similar part will be omitted.
  • the cognitive ability detection system 1 A includes a camera 394 .
  • the camera 394 acquires a video including a body movement, a facial expression, a movement of the eye, and the like of a subject 80 , and outputs an acquired image to the cognitive signal generation unit 10 A.
  • An action detection sensor such as an acceleration sensor or an angular velocity sensor is attached to a simulated pedal 392 and a simulated steering wheel 393 . These action detection sensors detect a movement of the simulated pedal 392 (an operation of the subject 80 ) and a movement of the simulated steering wheel 393 (an operation of the subject 80 ), and output detected signals to the cognitive signal generation unit 10 A.
  • means for mechanically detecting the movement of the simulated pedal 392 and the movement of the simulated steering wheel 393 may be provided, and the detected signals may be output based on mechanically detected results.
  • the action detection unit 14 of the cognitive signal generation unit 10 A analyzes an eye movement and an action of the subject 80 , and detects the types of the eye movement and the action, from the acquired video. Furthermore, the action detection unit 14 detects a type of the action (operation) of the subject 80 from the detected signals. The action detection unit 14 outputs the detected type of the action and the like to the MRCP correction data selection unit 132 .
  • the MRCP correction data selection unit 132 selects motor readiness potential correction data on the basis of the type of the action detected by the action detection unit 14 . As a result, the MRCP correction data selection unit 132 can select appropriate motor readiness potential correction data even without the prior information.
  • the MRCP correction data selection unit 132 can also select the motor readiness potential correction data on the basis of the detection result of the action detection unit 14 and the prior information. For example, when the detection result of the action detection unit 14 coincides with the prior information, the MRCP correction data selection unit 132 selects the motor readiness potential correction data on the basis of the type of a coincident action. When the detection result of the action detection unit 14 and the prior information do not coincide with each other, the MRCP correction data selection unit 132 selects the motor readiness potential correction data by using either the detection result or the prior information as a preferential reference.
  • the MRCP correction data selection unit 132 displays a warning indicating that there is no coincidence.
  • a judge who judges the cognitive ability may operate to input an appropriate type of an action into the cognitive ability detection device 30 A.
  • the detection result of the action detection unit 14 can also be used for generation of a cognitive signal in the calculation unit 133 .
  • the calculation unit 133 can set the reference timing by using the detection result of the action detection unit 14 even if the EOG detection unit 131 cannot detect the reference timing.
  • the calculation unit 133 estimates a generation period of the motor readiness potential by using the timing of the action (operation).
  • the calculation unit 133 performs correction by using the motor readiness potential correction data, during the estimated period in the brain signal. As a result, the calculation unit 133 can generate a cognitive signal from which the cognitive event-related potential P300 can be easily detected.
  • FIG. 17 is a diagram illustrating part of a configuration of a cognitive ability detection system according to the third embodiment.
  • the cognitive ability detection system according to the third embodiment is different from the cognitive ability detection system 1 according to the first embodiment in a configuration for detecting an EOG.
  • the other part of the configuration of the cognitive ability detection system according to the third embodiment is similar to that of the cognitive ability detection system 1 according to the first embodiment, and a description of a similar part will be omitted.
  • a brain signal sensor 112 is attached to a subject 80 . More specifically, the brain signal sensor 112 is attached at a position including the position of FP 1 (International 10-20 method) of the subject 80 . The brain signal sensor 112 outputs a detected brain signal to a brain signal acquisition unit 11 B of a cognitive signal generation unit 10 B.
  • FP 1 International 10-20 method
  • the brain signal acquisition unit 11 B outputs the brain signal (brain signal at CZ) detected by the brain signal sensor 111 to a calculation unit 133 .
  • the brain signal acquisition unit 11 B outputs the brain signal (brain signal at FP 1 ) detected by the brain signal sensor 112 to an EOG detection unit 131 .
  • the EOG detection unit 131 detects an electro-oculogram EOG from the brain signal (brain signal at FP 1 ) detected by the brain signal sensor 112 .
  • the brain signal serving as the detection source of the EOG is detected from the vicinity of an eye of the subject 80 . Therefore, the EOG detection unit 131 can detect the EOG with higher accuracy.
  • the P300 has been described as an example of the cognitive event-related potential.
  • the cognitive event-related potential may be P100, N400, or the like, and by using the above-described configuration and processing, the cognitive signal generation unit can generate a cognitive signal from which these cognitive event-related potentials can be detected.
  • the above description takes, as an example, a case where a cognitive ability test is performed on driving.
  • the above-described configuration and processing can be applied to any event as long as an action is performed in response to visual recognition of the event.
  • the present disclosure can be applied to a cognitive test for e-sports players and athletes and to a cognitive test for students at school.
  • FIG. 18 is a diagram illustrating a configuration of a cognitive ability detection system for games.
  • a cognitive ability detection system 1 C illustrated in FIG. 18 only about a part different from that of the cognitive ability detection system 1 A according to the second embodiment.
  • the cognitive ability detection system 1 C includes a cognitive ability detection device 30 C, a display 391 , and an operation device 394 .
  • the cognitive ability detection device 30 C includes an application execution unit 39 .
  • the application execution unit 39 executes a game application.
  • the application execution unit 39 outputs a video of a game to the video output unit 32 .
  • the video output unit 32 outputs the video of the game to the display 391 . As a result, the video of the game is displayed on the display 391 .
  • the application execution unit 39 outputs, to the control unit 31 , event information (a specific operation or the like to be input in correspondence to the game video) that can be used to detect the cognitive ability in the game.
  • event information a specific operation or the like to be input in correspondence to the game video
  • control unit 31 On the basis of the event information, the control unit 31 outputs prior information corresponding to a cognitive ability detection test to the cognitive signal generation unit 10 .
  • the operation device 394 is, for example, a keyboard, a mouse, or the like and receives an operation input of the subject 80 who is a game player.
  • the operation device 394 outputs an operation input content to the cognitive signal generation unit 10 and the application execution unit 39 .
  • the application execution unit 39 executes processing in the game application, in accordance with the operation input content.
  • the cognitive signal generation unit 10 A detects the type of an action (operation) of the subject 80 by using the operation input content from the operation device 394 .
  • Such a configuration enables the cognitive ability detection system 1 C to detect the cognitive ability of the game player with respect to the game. Then, for example, the cognitive ability detection system 1 C can detect such characteristics of the game player with respect to game operations that the game player themselves does not notice, from the detection result of the cognitive ability, and the game player can get feedback. Examples of the feedback method include visualized data of the cognitive ability and visualized data of a weak point (problem) based on the detection result of the cognitive ability. As a result, the game player can recognize his or her own weak point and can increase the speed of improving game skill.
  • FIG. 18 illustrates a case where the game machine is implemented by a personal computer (PC), the configuration of the present disclosure can be applied also to a console type game machine.
  • the operation device 394 is not limited to a keyboard, and may be a controller dedicated to the game machine.
  • FIG. 18 illustrates a case where a general game application is used, but a test game application for detecting cognitive ability may be used.
  • the test game application may be executed by the control unit 31 .
  • FIG. 18 illustrates the case of soloplay, but as illustrated in FIG. 19 , the configuration of the present disclosure can be applied also to the case of multiplay.
  • FIG. 19 is a diagram illustrating a configuration of a cognitive ability detection system for a game in multiplay.
  • a cognitive ability detection system 1 D compatible to a multiplay environment includes a plurality of (four in FIG. 19 ) cognitive ability detection systems 1 C, a comprehensive determination unit 50 , and a data communication network 500 .
  • the plurality of cognitive ability detection systems 1 C are connected to the data communication network 500 , and can transmit and receive data through the data communication network 500 .
  • the comprehensive determination unit 50 is connected to the data communication network 500 and acquires detection results of cognitive abilities, and various types of data and information for detecting cognitive abilities from the plurality of cognitive ability detection systems 1 C.
  • the comprehensive determination unit 50 uses the detection results of the cognitive abilities from the plurality of cognitive ability detection systems 1 C to determine the characteristics related to the cognitive ability in multiplay. For example, the comprehensive determination unit 50 , from comparison results of the cognitive abilities of the plurality of players detected by the plurality of cognitive ability detection systems 1 C, determines and visualizes a weak point or the like of the group in the case of multiplay.
  • the comprehensive determination unit 50 may use operation input contents to determine. For example, in the case of a cooperation play, the role of each player of the group is determined from the operation input content.
  • the comprehensive determination unit 50 stores determination criteria for cognitive ability corresponding to each role, and determines cognitive abilities by using the determination criteria. As a result, it is possible to more accurately determined a weak point or the like when each player plays each role, and it is possible to provide the weak points and the like in a visual manner.
  • the comprehensive determination unit 50 stores characteristics of cognitive abilities suitable for each role in a cooperation play. Furthermore, the comprehensive determination unit 50 may determine an appropriate role on the basis of the acquired cognitive ability of each player, and can provide the roles in a visual manner. As a result, each player of the group performing a cooperation play can play the game, playing a role more suitable for the game. Therefore, for example, it is possible to try a quest game or the like having a higher level of difficulty, and motivation for the cooperation play can therefore be raised.
  • the comprehensive determination unit 50 stores a determination criterion for cognitive ability corresponding to each operation, and determines the cognitive ability by using the determination criterion.
  • the comprehensive determination unit 50 can detect not only the cognitive ability but also a reaction speed of operation and the like by using the detection timing of the operation input content.
  • the comprehensive determination unit 50 can also determine a weak point by using such a reaction speed of operation and the like and can also provide the weak point in a visual manner.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Physics & Mathematics (AREA)
  • Psychiatry (AREA)
  • Psychology (AREA)
  • Developmental Disabilities (AREA)
  • Ophthalmology & Optometry (AREA)
  • Child & Adolescent Psychology (AREA)
  • Educational Technology (AREA)
  • Hospice & Palliative Care (AREA)
  • Social Psychology (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
US18/161,917 2020-08-20 2023-01-31 Cognitive ability detection device and cognitive ability detection method Pending US20230165511A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2020-139206 2020-08-20
JP2020139206 2020-08-20
PCT/JP2021/029519 WO2022039067A1 (ja) 2020-08-20 2021-08-10 認知能力検出装置、および、認知能力検出方法

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/029519 Continuation WO2022039067A1 (ja) 2020-08-20 2021-08-10 認知能力検出装置、および、認知能力検出方法

Publications (1)

Publication Number Publication Date
US20230165511A1 true US20230165511A1 (en) 2023-06-01

Family

ID=80322778

Family Applications (1)

Application Number Title Priority Date Filing Date
US18/161,917 Pending US20230165511A1 (en) 2020-08-20 2023-01-31 Cognitive ability detection device and cognitive ability detection method

Country Status (4)

Country Link
US (1) US20230165511A1 (https=)
JP (1) JP7639826B2 (https=)
CN (1) CN115884712B (https=)
WO (1) WO2022039067A1 (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114417238B (zh) * 2022-03-24 2022-06-10 阿呆科技（北京）有限公司 认知偏向矫正系统

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10146323A (ja) * 1996-11-18 1998-06-02 Suzuki Motor Corp 脳波測定装置
CN100387192C (zh) * 2004-07-02 2008-05-14 松下电器产业株式会社 生体信号利用机器及其控制方法
JP4929681B2 (ja) * 2005-11-02 2012-05-09 トヨタ自動車株式会社 眼球停留関連電位解析装置及び解析方法
CN101542415B (zh) * 2006-06-21 2012-08-15 松下电器产业株式会社 服务提供系统
US20090062680A1 (en) * 2007-09-04 2009-03-05 Brain Train Artifact detection and correction system for electroencephalograph neurofeedback training methodology
CN101754715B (zh) * 2008-05-20 2012-07-25 松下电器产业株式会社 视线检测装置、摄像装置以及视线检测方法
JP5127576B2 (ja) * 2008-06-11 2013-01-23 ヤマハ発動機株式会社 精神作業負荷検出装置及びそれを備えた自動二輪車
JP2012095905A (ja) * 2010-11-04 2012-05-24 Panasonic Corp 脳波計測システム、方法及びコンピュータプログラム
WO2012161657A1 (en) * 2011-05-20 2012-11-29 Nanyang Technological University Systems, apparatuses, devices, and processes for synergistic neuro-physiological rehabilitation and/or functional development
EP2767229A4 (en) * 2011-10-11 2015-03-04 Murata Manufacturing Co PORTABLE INSTRUMENT
CN105578954B (zh) * 2013-09-25 2019-03-29 迈恩德玛泽控股股份有限公司 生理参数测量和反馈系统
EP3064130A1 (en) * 2015-03-02 2016-09-07 MindMaze SA Brain activity measurement and feedback system
US20180228430A1 (en) * 2017-02-10 2018-08-16 Mindmaze Holding Sa System, method and apparatus for rehabilitation with tracking
US11850055B2 (en) * 2017-04-28 2023-12-26 Maxell, Ltd. Electroencephalographic data analysis system, information processing terminal, electronic device, and method of presenting information for dementia examination
JP6946734B2 (ja) * 2017-05-17 2021-10-06 日産自動車株式会社 行動予測方法及び行動予測装置
US11064938B2 (en) * 2017-10-31 2021-07-20 Stimscience Inc. Mediation of traumatic brain injury
JP7222176B2 (ja) * 2017-12-11 2023-02-15 日産自動車株式会社 脳波測定方法及び脳波測定装置
EP4520384A3 (en) * 2018-01-25 2025-05-21 Circadian Positioning Systems, Inc. Patch system for monitoring and enhancing sleep and circadian rhythm alignment
CN109318207B (zh) * 2018-11-07 2020-11-10 西安交通大学 一种利用肌电定时的下肢运动准备电位检测系统及方法
CN113228138B (zh) * 2018-12-27 2023-06-06 株式会社村田制作所 认知能力检测装置和认知能力检测系统

Also Published As

Publication number Publication date
JP7639826B2 (ja) 2025-03-05
CN115884712A (zh) 2023-03-31
WO2022039067A1 (ja) 2022-02-24
JPWO2022039067A1 (https=) 2022-02-24
CN115884712B (zh) 2026-03-13

Similar Documents

Publication Publication Date Title
CN107929007B (zh) 一种利用眼动追踪和智能评估技术的注意力和视觉能力训练系统及方法
US8998828B2 (en) Visualization testing and/or training
US10226171B2 (en) Vision cognition and coordination testing and training
KR102477327B1 (ko) 인지 능력 측정을 위한 프로세서 구현 시스템 및 방법
US20200074380A1 (en) Work support device, work support method, and work support program
US11417045B2 (en) Dialog-based testing using avatar virtual assistant
US20170007147A1 (en) Cognitive function evaluation apparatus, method, system and program
US20130096397A1 (en) Sensitivity evaluation system, sensitivity evaluation method, and program
EP3223678B1 (en) Dynamic computer images for improving visual perception
WO2020084351A1 (en) Systems and methods for assessment and measurement of reaction time in virtual/augmented reality
US10987014B2 (en) Information processing apparatus, information processing system, and non-transitory computer readable medium
JP6807108B2 (ja) 認知機能測定システム、認知機能測定通信システム及びプログラム
JP6838902B2 (ja) 疑似体験提供装置、疑似体験提供方法、疑似体験提供システム、及びプログラム
US20230165511A1 (en) Cognitive ability detection device and cognitive ability detection method
JPH1165422A (ja) 作業者の心身状態評価方法，機器を用いた作業の作業内容制御方法及び作業内容制御システム
US11412974B2 (en) Information processing apparatus, information processing system, and non-transitory computer readable medium
Abhishek et al. Stress analysis of a computer game player using electroencephalogram
JP4822235B2 (ja) 眼球停留関連電位解析装置
JP7843663B2 (ja) 推定装置、推定システム、および、推定方法
KR102953017B1 (ko) 운동관련뇌전위 및 가상현실 시뮬레이션을 이용한 뇌졸중 재활치료 시스템 및 방법
JP6550952B2 (ja) 脳波の分析方法および分析装置
JP2024051307A (ja) Ａｉモデル生成方法、感情推定ａｉモデルの学習データ生成方法、感情推定装置、及び車両制御システム
Sharifara et al. A robot-based cognitive assessment model based on visual working memory and attention level
JP2024021933A (ja) 推定装置、推定システム、および、推定方法
JP2023178077A (ja) 感情推定装置、感情推定方法及び感情推定システム

Legal Events

Date Code Title Description
AS Assignment

Owner name: MURATA MANUFACTURING CO., LTD., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:OKAJIMA, SHINGO;REEL/FRAME:062546/0621

Effective date: 20230124

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION COUNTED, NOT YET MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER