WO2022075377A1 - 視線位置判定装置、視線位置判定方法およびトレーニング方法 - Google Patents

視線位置判定装置、視線位置判定方法およびトレーニング方法 Download PDF

Info

Publication number
WO2022075377A1
WO2022075377A1 PCT/JP2021/037044 JP2021037044W WO2022075377A1 WO 2022075377 A1 WO2022075377 A1 WO 2022075377A1 JP 2021037044 W JP2021037044 W JP 2021037044W WO 2022075377 A1 WO2022075377 A1 WO 2022075377A1
Authority
WO
WIPO (PCT)
Prior art keywords
line
sight
determination
user
training
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/037044
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
俊哉 中口
栄司 清水
好幸 平野
千尋 須藤
直美 白岩
友紀 池田
俊介 齋藤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chiba University NUC
Sumitomo Pharma Co Ltd
Original Assignee
Chiba University NUC
Sumitomo Dainippon Pharma Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chiba University NUC, Sumitomo Dainippon Pharma Co Ltd filed Critical Chiba University NUC
Priority to CN202180082042.2A priority Critical patent/CN116546952A/zh
Priority to CA3195141A priority patent/CA3195141A1/en
Priority to EP21877676.3A priority patent/EP4226906A4/en
Priority to US18/248,181 priority patent/US20230404451A1/en
Priority to JP2022555542A priority patent/JPWO2022075377A1/ja
Publication of WO2022075377A1 publication Critical patent/WO2022075377A1/ja
Anticipated expiration legal-status Critical
Priority to JP2025186213A priority patent/JP2026021493A/ja
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/02—Subjective types, i.e. testing apparatus requiring the active assistance of the patient
    • A61B3/028—Subjective types, i.e. testing apparatus requiring the active assistance of the patient for testing visual acuity; for determination of refraction, e.g. phoropters
    • A61B3/032—Devices for presenting test symbols or characters, e.g. test chart projectors
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/163—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4836—Diagnosis combined with treatment in closed-loop systems or methods
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/486—Biofeedback
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/70—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mental therapies, e.g. psychological therapy or autogenous training
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00—Evaluating a particular growth phase or type of persons or animals
    • A61B2503/06—Children, e.g. for attention deficit diagnosis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/168—Evaluating attention deficit, hyperactivity
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/40—Detecting, measuring or recording for evaluating the nervous system
    • A61B5/4076—Diagnosing or monitoring particular conditions of the nervous system
    • A61B5/4088—Diagnosing of monitoring cognitive diseases, e.g. Alzheimer, prion diseases or dementia
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B23/00—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes
    • G09B23/28—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine

Definitions

  • the present disclosure relates to a line-of-sight position determination device, a line-of-sight position determination system, a line-of-sight position determination method, a training system, an evaluation method, a training method, a monitoring method, a treatment method, and a program.
  • Non-Patent Document 1 As one of the effective treatment options for neuropsychiatric disorders, for example, cognitive-behavioral therapy as disclosed in Non-Patent Document 1 is being implemented.
  • Non-Patent Document 1 may not be available even if one wants to receive treatment because there is a shortage of medical professionals who can carry out the treatment.
  • the present disclosure discloses a line-of-sight position determination device capable of reproducing a line-of-sight communication environment close to the real world, a line-of-sight position determination system equipped with a line-of-sight position determination device, a line-of-sight position determination method capable of reproducing a line-of-sight communication environment close to the real world, and a line-of-sight position.
  • Treatment method for neuropsychiatric disorders using the determination method training system equipped with a line-of-sight position determination device or line-of-sight position determination system, evaluation method of line-of-sight communication ability using the line-of-sight position determination method, training method using the line-of-sight position determination method.
  • the line-of-sight position determination device of one aspect of the present disclosure is The line-of-sight position input section where the position of the user's line of sight is input, Judgment area setting unit that sets the judgment area and A determination unit for determining whether or not the line-of-sight position input by the line-of-sight position input unit is in the determination area, and a determination unit.
  • the determination unit determines that the position of the line of sight is in the determination area
  • the determination unit includes an output unit that outputs feedback to the user.
  • the line-of-sight position determination system of one aspect of the present disclosure is The line-of-sight position determination device of the above-described aspect and It is provided with a line-of-sight position acquisition unit that acquires the position of the line-of-sight of the user and outputs the position to the line-of-sight position input unit.
  • the method for determining the line-of-sight position is as follows. Detects the position of the user's line of sight and Set the judgment area and It is determined whether or not the detected position of the line of sight is in the determination area, and When it is determined that the position of the line of sight is in the determination area, feedback is output to the user.
  • the training system of one aspect of the present disclosure is The line-of-sight position determination device of the above-described embodiment or the line-of-sight position determination system of the above-described embodiment is provided.
  • the evaluation method of one aspect of the present disclosure is The line-of-sight position determination method of the above aspect was used.
  • the training method of one aspect of the present disclosure is The line-of-sight position determination method of the above aspect was used.
  • the monitoring method of one aspect of the present disclosure is The line-of-sight position determination method of the above aspect was used.
  • the treatment method of one aspect of the present disclosure is The training method of the above aspect was used.
  • the program of one aspect of the present disclosure is Have the computer execute the line-of-sight position determination method or training method of the above-described embodiment.
  • a determination area is set so as to include a social object to which the line of sight is directed, and a line-of-sight match determination and feedback are performed to create a communication environment with a line of sight close to the real world. Can be reproduced.
  • the line-of-sight position determination device can realize a line-of-sight position determination system that can reproduce a communication environment with a line of sight close to the real world.
  • a determination area is set so as to include a social object to which the line of sight is directed, and line-of-sight matching determination and feedback are performed to communicate with a line of sight close to the real world.
  • the environment can be reproduced.
  • the line-of-sight position determination method reproduces a communication environment with a line of sight close to the real world, and can realize highly effective treatment and training. It can also provide treatment and training that can be performed even when the practitioner (eg, doctor, psychologist (psychologist), counselor, therapist) is in a remote location or the practitioner is absent.
  • the practitioner eg, doctor, psychologist (psychologist), counselor, therapist
  • the line-of-sight position determination device or the line-of-sight position determination system and the line-of-sight position determination method can reproduce a communication environment with a line of sight close to the real world, and can realize a system with a high training effect. ..
  • the evaluation is standardized by the line-of-sight position determination method regardless of the practitioner's specialty or skill level, or even when the practitioner is remote or absent.
  • a method and a monitoring method can be realized.
  • FIG. 3 is a block diagram showing a configuration of a line-of-sight position determination system including the line-of-sight position determination device according to the first embodiment of the present disclosure.
  • FIG. 3 is a block diagram showing a configuration of a line-of-sight position determination system including the line-of-sight position determination device according to the second embodiment of the present disclosure.
  • FIG. 3 is a block diagram showing a configuration of a line-of-sight position determination system including the line-of-sight position determination device according to the third embodiment of the present disclosure.
  • FIG. 3 is a third diagram for explaining a target position and a determination area in the line-of-sight position determination device of FIG.
  • FIG. 4 is a fourth diagram for explaining a target position and a determination area in the line-of-sight position determination device of FIG.
  • FIG. 3 is a block diagram showing a configuration of a line-of-sight position determination system including the line-of-sight position determination device according to the fourth embodiment of the present disclosure.
  • the flowchart for demonstrating the line-of-sight determination process in the line-of-sight position determination apparatus of FIG. The block diagram which shows the 3rd modification of the line-of-sight position determination system of FIG.
  • the line-of-sight position determination system 1 of the first embodiment of the present disclosure includes a line-of-sight position determination device 10 and a line-of-sight position acquisition unit 20.
  • the line-of-sight position acquisition unit 20 acquires the position of the user's line of sight and outputs it to the line-of-sight position determination device 10.
  • the line-of-sight position determination device 10 includes a line-of-sight position input unit 11, a determination area setting unit 15, a determination unit 12, and an output unit 13, and the functions are realized by the CPU executing a predetermined program. Will be done.
  • the line-of-sight position input unit 11 inputs the position of the user's line of sight output from the line-of-sight position acquisition unit 20, and outputs the input position of the user's line of sight to the determination unit 12.
  • the determination area setting unit 15 sets the determination area P2 (see FIG. 6) so as to include the target position P1 which is the position of the user's gaze target, and outputs the information of the determination area P2 to the determination unit 12.
  • the determination area P2 is used as an allowable range of the line-of-sight position in the line-of-sight match determination. For example, by setting the determination area P2 so as to include the eyeball of a person or animal to be watched, it is possible to determine whether or not the user can make eye contact.
  • the determination area setting unit 15 can set the union of the determination areas P2 set for each target position P1 as the final determination area.
  • the target position P1 can be transmitted to the user by voice, not limited to the image. Therefore, the target position P1 and the determination area P2 may not be displayed in the image reflected in the user's field of view (hereinafter referred to as the field of view image).
  • the target position P1 is set as a social object to which the user looks, and for example, an image presented to the user (hereinafter referred to as a presented image) is attached with changes in X and Y coordinates with time in advance. Set.
  • Social objects include, for example, a part of the face such as the eyeball, nose, eyebrows, mouth of a person or animal, a part of the body such as hair, ears, neck, shoulders, hands of a person or animal, and a person or It can include the entire body of the animal and all or part of the attachment to the body, including clothing such as a tie or scarf.
  • the determination area setting unit 15 determines the distance L between the centers of the left and right eyeballs (hereinafter referred to as eyeball positions P3 and P4, respectively) in the view image 40 shown in FIG.
  • the determination area P2 can be set according to the size of the target image 100 based on the above.
  • the size of the determination region P2 is defined based on the size of the face, and the distance L between the centers of the left and right eyeballs is referred to as an element for determining the size of the face.
  • the determination area P2 can be provided with a lower limit value in its size. This is because if the target image 100 in the visual field image 40 is too small because the target image 100 in the presented image is too small, or the screen on which the presented image is presented is too far from the user, the eyeball This is because it becomes difficult to accurately grasp the position of the user's line of sight due to the influence of the fixative fine movement and the detection noise of the line-of-sight sensor.
  • the lower limit value of the determination area P2 may be an arbitrary value determined in advance regardless of the user, or may be an arbitrary value that can be set at the time of use. Further, the lower limit value of the determination region P2 may be a value determined based on the line-of-sight position fluctuation data when the user gazes at an arbitrary point. For example, a region of a circle whose radius is twice the standard deviation (2SD) of the line-of-sight position fluctuation data may be set as the lower limit of the determination area P2, or may be three times the standard deviation (3SD) or three times the standard deviation (3SD) depending on the training stage. The range may be expanded to 4 times (4SD).
  • the lower limit value of the determination region P2 may be determined for each user or may be determined from the average value of a plurality of users, but considering the variation in the fixative tremor of the eyeball among individuals, the lower limit value may be determined. It is preferable that it is determined for each user.
  • the average value of a plurality of healthy persons can be set as the lower limit value of the determination area P2.
  • the line-of-sight position fluctuation data means a plot of changes in the line-of-sight position over time.
  • the determination area P2 is set so as not to fall below the lower limit value.
  • the size of the determination region P2 is calculated based on the distance L between the left and right eyeball positions P3 and P4 in the view image 40, and when the size is smaller than the lower limit value, the lower limit value is the size of the determination region P2. Is set as. More specifically, for example, when the size of the determination region P2 shown in FIG. 8 is the lower limit value and the target image 100 is smaller than that of FIG. 8 and FIG. 9 is the view image 40, the size is the same as that of FIG. The determination area P2 of is set. As a result, the line-of-sight coincidence can be accurately determined regardless of the size of the target image in the field view image.
  • the determination unit 12 determines whether or not the position of the user's line of sight output from the line-of-sight position input unit 11 is in the determination area P2 (hereinafter referred to as line-of-sight match determination).
  • the determination area P2 may be set in advance on the presentation image presented to the user, for example, at the time of the line-of-sight matching determination. Further, the presented image in which the determination area P2 is set may be stored in, for example, a storage device (not shown) of the line-of-sight position determination device 10. Whether or not the position of the line of sight of the user is in the determination area P2 is determined as follows, for example.
  • the determination unit 12 determines whether or not the position of the user's line of sight is located in the determination area P2. Then, the time elapsed while staying in the determination area P2 (hereinafter referred to as the first time) from the time when the position of the user's line of sight is located in the determination area P2 is the preset maintenance time (use). It is determined whether or not the position of the line of sight of the person has reached the time to be maintained in the determination area P2, hereinafter referred to as the set maintenance time). When it is determined that the first time has reached the set maintenance time, the determination unit 12 determines that the position of the line of sight of the user is in the determination area P2 (in other words, the lines of sight match). The first time may be the cumulative time of staying in the determination area P2 from the time when the user's line of sight is first located in the determination area P2.
  • the first time is measured by, for example, the measuring unit 16 of the line-of-sight position determination device 10.
  • the measuring unit 16 can further measure one or more of the following indicators for determining the social line-of-sight control ability. For example, by further providing a storage unit 52 (see FIG. 12) that stores the user's line-of-sight position as a time transition of XY coordinates during training, the relationship between the user's line-of-sight position and the target position P1 or the determination area P2 can be obtained. It can be calculated with XY coordinates, and various indexes of social line-of-sight control ability can be measured. The index for determining the social gaze control ability can be aggregated for each task or for the entire training.
  • the output unit 13 outputs feedback to the user depending on whether or not the determination unit 12 determines that the position of the line of sight is in the determination area P2.
  • Feedback is given to the user and / or the person facing the user through a sense selected from visual, auditory and tactile sensations.
  • Feedback is feedback selected from, for example, an image containing letters, symbols and paintings, a sound containing voice, and vibration, the position of the line of sight via a display and / or a speaker (neither shown).
  • Is output after it is determined that is in the determination area P2 (for example, in real time).
  • the feedback may be output not only after it is determined that the position of the line of sight is in the determination region P2, but also in the stage before that.
  • the output unit 13 can output feedback even when the position of the line of sight is not located in the determination area P2.
  • the output unit 13 can output feedback that guides the line of sight to the determination area P2.
  • the output unit 13 outputs the analysis result of the index of social gaze control ability (for example, this result, comparison between this result and past result, this result and average value of other users). It is possible to output feedback to the user, medical staff, face-to-face person, etc.
  • the feedback for the analysis result may be output as an individual index of a plurality of social gaze control abilities, or may be output as a total score summarizing a plurality of indicators of the social gaze control ability. It should be noted that a device for feedback output may be separately provided and configured to output feedback via this device. This device may form a part of the line-of-sight position determination device 10, or may not form a part of the line-of-sight position determination device 10.
  • Each part constituting the line-of-sight position determination device 10 may be provided in, for example, an external device (for example, a server).
  • the line-of-sight position determination device 10 further includes a communication device connected to the external device wirelessly or by wire.
  • the line-of-sight position input unit 11 outputs the input position of the user's line-of-sight to the determination unit 12 of the external device via the communication device. Further, the output unit 13 acquires the determination result of the determination unit 12 via the communication device.
  • the line-of-sight position determination device 10 can also be configured as shown below.
  • the difficulty level setting unit 50 is configured to change and set the training difficulty level (in other words, the training load). good.
  • the difficulty level of the training includes at least one of the difficulty level of the line-of-sight match determination and the difficulty level of the task.
  • the parameters of the difficulty level of the line-of-sight matching determination for example, the size of the determination area P2 and the setting maintenance time can be mentioned. Multiple levels can be prepared for each parameter, and the difficulty level can be set by using parameters of any level individually or in combination.
  • the determination area P2 when the determination area P2 has a size including the entire human face and the line-of-sights match in the setting where the setting maintenance time is 2 seconds, the determination is made as shown in FIG.
  • the difficulty level of the line-of-sight matching determination can be increased.
  • the determination area P2 is further reduced and / or the setting maintenance time is increased (for example, 3 seconds) to further determine the line-of-sight matching. You can increase the difficulty level.
  • the difficulty level setting unit 50 can be configured to set the training difficulty level based on the result determined by the determination unit 12. For example, when the first time measured by the measuring unit 16 reaches a preset maintenance time and it is determined that the position of the line of sight is in the determination area, the difficulty setting unit 50 determines the size of the determination area. And / or set the training load by setting the length of the maintenance time. Specifically, when the determination unit 12 determines that the lines of sight do not match, the difficulty setting unit 50 determines the difficulty level of the line-of-sight matching determination by expanding the determination area P2 and / or reducing the maintenance time. Can be reduced.
  • the line-of-sight position determination device 10 may be provided with an operation unit 51 (see FIG. 12) capable of accepting a difficulty level changing operation for changing the training difficulty level.
  • the difficulty level setting unit 50 may be configured to set the difficulty level of the training by the difficulty level change operation received by the operation unit 51, and may determine the social line-of-sight control ability and / or the social line-of-sight control ability.
  • the difficulty setting unit 50 may be configured to set the difficulty of training according to the index.
  • the operation unit 51 is provided separately from the line-of-sight position determination device 10, but the present invention is not limited to this, and the operation unit 51 may be provided integrally with the line-of-sight position determination device 10.
  • the line-of-sight position determination device 10 may be provided with a storage unit 52 (see FIG. 12) that stores the measured index of the social line-of-sight control ability.
  • the difficulty setting unit 50 stores, for example, the index of the social line-of-sight control ability measured by the measurement unit 16 is measured and stored by the measurement unit 16 before the measured index of the social line-of-sight control ability. If it is higher than the index of social gaze control ability stored in the part 52, the training load is increased.
  • the line-of-sight position determination device 10 may be provided with a control ability acquisition unit 53 (see FIG. 12) for acquiring an index of the social line-of-sight control ability of another user.
  • the difficulty setting unit 50 may obtain, for example, the deviation of each task from the average value of the index of the user's social line-of-sight control ability measured by the measurement unit 16 by the control ability acquisition unit 53.
  • the task that the user is not good at is estimated, and the training load is based on the estimated task that the user is not good at. To set. This can enhance the effect of training.
  • the index of the social line-of-sight control ability of another user may be measured in advance by the measuring unit 16 and stored in the storage unit 52, or may be stored in an external device (for example, a server).
  • the control ability acquisition unit 53 acquires the index of the social line-of-sight control ability of another user stored in the storage unit 52 or the external device by wireless or wired communication.
  • the index of the social line-of-sight control ability of another user may be measured by the measuring unit 16 of the other line-of-sight position determination device 10, or may be measured by another device other than the line-of-sight position determination device 10. good.
  • the estimation of the problem that the user is not good at may be configured to be performed by another component unit (for example, the control ability acquisition unit 53) instead of the difficulty level setting unit 50.
  • the difficulty setting unit 50 may be omitted so that the training load is not set by the line-of-sight position determination device 10.
  • the line-of-sight position determination device 10 may be provided with a maintenance time setting unit 54 (see FIG. 12), and the maintenance time setting unit may be configured to set the set maintenance time.
  • the line-of-sight position determination system 1 of the first embodiment can be implemented, for example, in the embodiment shown in FIG. 3 or FIG.
  • the head-mounted display (HMD) 31 is provided with a line-of-sight position acquisition unit 20 (for example, an infrared line-of-sight tracking sensor), and the feedback output from the line-of-sight position determination device 10 is the HMD 31. It is output via the screen 33, a speaker (not shown), and the like. Further, the presented image is presented to the user via the screen 33 of the HMD 31, and the presented image is regarded as a field view image.
  • the determination area P2 is set, for example, based on the information regarding the target position P1 attached to the presented image in advance. In the line-of-sight position determination system 1 of FIG.
  • the HMD 31 is provided with a presentation image acquisition unit 34 for acquiring the presentation image.
  • the presentation image acquisition unit 34 may acquire the presentation image from an external device connected wirelessly or by wire, or may acquire it from a storage device (not shown) of the line-of-sight position determination device 10. Further, in the line-of-sight position determination system 1 of FIG. 3, the line-of-sight position determination device 10 and the line-of-sight position acquisition unit 20 can be built in the HMD 31, and the line-of-sight position determination device 10 and the line-of-sight position acquisition unit 20 are provided side by side in the HMD 31. You can also do it.
  • a line-of-sight position determination device 10 for example, a line-of-sight position determination device 10, a line-of-sight position acquisition unit 20 (for example, a line-of-sight sensor), and a presentation image acquisition unit 34 are provided separately from the display 32, and the screen 33 of the display 32. Feedback is output via a speaker (not shown) or the like.
  • the presented image acquired by the presented image acquisition unit 34 is presented to the user via the screen 33 of the display 32, and the presented image is regarded as a field view image.
  • the determination area P2 is set, for example, based on the information regarding the target position P1 attached to the presented image in advance.
  • the line-of-sight position acquisition unit 20 and the presentation image acquisition unit 34 can be provided on the display 32.
  • the line-of-sight position determination system 1 may further include a display (not shown) for the practitioner for displaying the presented image presented to the user to the operator (practitioner).
  • the display for the practitioner displays the presented image to the operator via a screen (not shown).
  • the line-of-sight position determination system 1 may be configured to display the field-of-sight image and the line-of-sight position in addition to the presented image by the display for the practitioner.
  • the line-of-sight position determination system 1 may be configured to present the feedback output from the line-of-sight position determination device 10 via a screen, a speaker (not shown), or the like.
  • the operator can grasp the result of the line-of-sight position determination or the progress of training by looking at the display. As a result, the difficulty level of the training can be changed or the training can be interrupted via the operation unit 51 during the training.
  • the line-of-sight position determination device 10 may include any one, a plurality, or all of a measurement unit 16, a difficulty level setting unit 50, an operation unit 51, a storage unit 52, a control ability acquisition unit 53, and a maintenance time setting unit 54. ..
  • the line-of-sight position determination system 1 of the second embodiment of the present disclosure is different from the first embodiment in that the line-of-sight position determination device 10 includes a target position setting unit 14.
  • the same reference number as that of the first embodiment is assigned and the description thereof will be omitted.
  • the target position setting unit 14 sets a target position P1 (see FIG. 6) as a target for the user of the line-of-sight position determination device 10 to match the line of sight.
  • the target position P1 is the position of the gaze target, for example, at least one manually or automatically at an arbitrary position of the target image in the presentation image including the image of the person or animal to be gaze (hereinafter referred to as the target image). Is set.
  • face recognition software and / or an object detection algorithm may be used as a method of setting the target position.
  • An arbitrary position set as the target position P1 includes, for example, an eyeball position, but is not limited to this.
  • a part of the face such as the nose, eyebrows, and mouth may be set as the target position P1
  • a part of the body such as hair, ears, neck, shoulders, and hands may be set as the target position P1, or the target image 100 itself.
  • the whole body of a person or an animal may be set as the target position P1, or a part of the attachment to the body including clothes such as a tie or a scarf may be set as the target position P1.
  • the target position setting unit 14 may acquire the presentation image from the storage device (not shown) of the line-of-sight position determination device 10 or acquire the presentation image from an external device such as a server connected by wire or wirelessly. You may.
  • the line-of-sight position determination system 1 of the third embodiment of the present disclosure is different from the first embodiment in the following points.
  • the same reference number as that of the first embodiment is assigned and the description thereof will be omitted.
  • a point where the line-of-sight position determination device 10 further includes a marker generation unit 17.
  • a point where the line-of-sight position input unit 11 has a display position detection unit 111 and a line-of-sight position conversion unit 112.
  • a point where the line-of-sight position acquisition unit 20 has an image pickup unit 21 and a line-of-sight direction acquisition unit 22.
  • the line-of-sight position determination device 10 makes a determination based on the information of the wearable terminal 35 having the line-of-sight position acquisition unit 20, and feedback is output via the screen 33 of the display 32 or the like.
  • the marker generation unit 17 generates, for example, a marker image for displaying a marker (for example, a QR code (registered trademark) and / or an AR marker) at the four corners of the screen 33.
  • the generated marker image is output to the display position detection unit 111 of the line-of-sight position input unit 11 and the screen 33.
  • the marker image can be created, for example, for the first time using the line-of-sight position determination system 1, and thereafter, the marker image created first can be used.
  • the marker image initially created may be stored in, for example, a storage device of the line-of-sight position determination device 10 or may be stored in a server connected via a communication device.
  • the display position detection unit 111 inputs the view image output from the image pickup unit 21 of the line-of-sight position acquisition unit 20 and the marker image generated by the marker generation unit 17.
  • the display position detection unit 111 detects the position of the marker image in the field view image, calculates a coordinate conversion matrix (for example, using a homography conversion matrix), and outputs the matrix information to the line-of-sight position conversion unit 112.
  • the line-of-sight position conversion unit 112 is a user in the coordinate system of the view image based on the line-of-sight vector output from the line-of-sight direction acquisition unit 22 of the line-of-sight position acquisition unit 20 and the matrix information output from the display position detection unit 111. Converts the line-of-sight position of to the line-of-sight position in the coordinate system of the presented image. The converted position of the user's line of sight is output to the determination unit 12.
  • the image pickup unit 21 is an example of a field of view image acquisition unit, and captures and acquires a user's field of view image.
  • the acquired view image is output to the display position detection unit 111.
  • the line-of-sight direction acquisition unit 22 detects the line-of-sight direction (in other words, the line-of-sight vector) of the user.
  • the detected line-of-sight vector is output to the line-of-sight position conversion unit 112.
  • the line-of-sight position determination system 1 of the third embodiment uses a wearable terminal having a line-of-sight position acquisition unit 20, high-precision line-of-sight detection can be realized regardless of the type of the display 32.
  • the line-of-sight movement outside the screen 33 and the movement of the user's head can also be memorized.
  • the line-of-sight position determination system 1 of the third embodiment may be provided with the target position setting unit 14 of the second embodiment.
  • the marker generation unit 17 can be omitted.
  • a marker image (hereinafter referred to as a generated marker image) is generated outside the line-of-sight position determination system 1 and stored in an external device such as a server.
  • the generated marker image is output from an external device via a communication device and input to the display position detection unit 111.
  • the line-of-sight position determination system 1 of the fourth embodiment of the present disclosure is different from the second embodiment in the following points.
  • the same reference number is assigned to the same portion as that of the second embodiment, and the description thereof will be omitted.
  • a point where the line-of-sight position acquisition unit 20 has an image pickup unit 21 and a line-of-sight direction acquisition unit 22.
  • the line-of-sight position acquisition unit 20 is provided in the wearable terminal 35, and the feedback output from the line-of-sight position determination device 10 provided separately from the wearable terminal 35 is output as voice feedback via the speaker 36.
  • the field image captured by the imaging unit 21 is output to the target position setting unit 14.
  • the determination area P2 is set based on the information of the target position P1.
  • the line-of-sight direction acquisition unit 22 detects the user's line-of-sight direction (line-of-sight vector), and the detected line-of-sight vector is output to the line-of-sight position input unit 11.
  • the determination area P2 can be set so as to include the human facing the user, so that a realistic human-to-human communication can be experienced.
  • the feedback output from the line-of-sight position determination device 10 to the user is not limited to voice feedback, and may be output via a screen (not shown).
  • the screen may be built in the wearable terminal 35, or may be provided separately from the wearable terminal 35.
  • the line-of-sight position determination method of the present disclosure a line-of-sight position determination method using the line-of-sight position determination device 10 (hereinafter referred to as the line-of-sight position determination method of the present disclosure) will be described.
  • the line-of-sight position determination method of FIG. 11 there is a line-of-sight position determination method of FIG. 11, and this line-of-sight position determination method is implemented, for example, by the CPU of the line-of-sight position determination device 10 executing a predetermined program, and is applied to treatment and training of neuropsychiatric disorders. You can also do it.
  • the target position P1 and the determination area P2 are set in the line-of-sight position determination device 10 (for example, the line-of-sight position determination device 10 of the second and fourth embodiments) including the target position setting unit 14.
  • the difficulty of training is set. The difficulty level and maintenance time of the training can be omitted if they are set in advance.
  • the position of the line of sight of the user is input to the line-of-sight position input unit 11 (step S1), and the determination unit 12 determines whether or not the position of the line of sight of the user is located in the determination area P2. Determination (step S2). When it is not determined that the position of the line of sight is located in the determination area P2, the determination unit 12 determines that the lines of sight do not match (line-of-sight mismatch) (step S7).
  • the determination unit 12 When it is determined that the line-of-sight position is located in the determination area P2, the determination unit 12 has reached a preset maintenance time (set maintenance time) while remaining in the determination area P2. Whether or not it is determined (step S3). When it is not determined that the set maintenance time has been reached for the elapsed time while staying in the determination area P2, the determination unit 12 determines that the lines of sight do not match (step S7).
  • the determination unit 12 determines that the lines of sight have matched (step S4), and the output unit 13 informs the user. Feedback is output in real time (step S5). It should be noted that the real time includes a predetermined time lag (for example, a time lag that occurs for technical reasons). After that, the line-of-sight position determination device 10 determines whether or not to end the line-of-sight match determination, in other words, whether or not to continuously perform the line-of-sight match determination (step S6).
  • step S6 the line-of-sight position determination device 10 ends the line-of-sight match determination. If it is determined in step S7 that the line-of-sight match determination is not established (that is, the line-of-sight match is not established), it is possible to return to step S1 and perform the line-of-sight match determination again after lowering the difficulty level of training. ..
  • the line-of-sight position determination device 10 determines in step S6 to end the line-of-sight match determination.
  • the line-of-sight position determination method using the line-of-sight position determination device 10 can be applied to, for example, diagnosis, severity classification, treatment, training and / or monitoring of neuropsychiatric disorders.
  • neuropsychiatric disorders include psychiatric disorders and neurodegenerative disorders.
  • the psychiatric disorders to which the present disclosure is applicable are not particularly limited, but are, for example, in the diagnostic criteria of DSM-5, neurodevelopmental disorder group, schizophrenia spectrum disorder and other psychotic disorder group, anxiety group, obsessive-compulsive disorder. And related disease group, psychotic trauma and stress factor related disorder group, neurocognitive disorder group and the like. It also includes diseases in which the ability to communicate with the eyes is reduced due to mental illness.
  • the mental illness is not particularly limited, but is preferably a neurodevelopmental disorder group, an anxiety group, obsessive-compulsive disorder and related disease group, and a traumatic and stress factor-related disorder group, and more preferably a neurodevelopmental disorder group, and Anxiety group is mentioned.
  • Diseases in the neurodevelopmental disorder group are not particularly limited, but are, for example, intellectual disability, general developmental delay, speech disorder, speech disorder, childhood onset fluency, and social (verbal) communication disorder.
  • Unspecified communication disorder autism spectrum disorder, attention deficit / hyperactivity disorder, localized learning disorder, developmental coordinated motility disorder, homozygous motility disorder, turret disease, persistent (chronic) exercise or voice ticosis, provisional tic Diseases, other identified tic disorders, unspecified tic disorders, other identified neurodevelopmental disorders, unspecified neurodevelopmental disorders, and the like.
  • Turretosis, persistent (chronic) motor or vocal ticosis, provisional ticosis, other identified tic disorders, unspecified tic disorders, other identified neurodevelopmental disorders, and unspecified neurodevelopmental disorders And more preferably childhood-onset fluency and autism spectrum disorders.
  • schizophrenia-type personality disorder is not particularly limited, but are, for example, schizophrenia-type personality disorder, delusional disorder, short-term psychotic disorder, schizophrenia-like disorder, schizophrenia.
  • Symptoms schizophrenia emotional disorders, substance / drug-induced psychotic disorders, psychotic disorders due to other medical disorders, tension disorders related to other mental disorders, tension pathological disorders due to other medical disorders, unspecified These include tension disease, other identified schizophrenia spectrum disorders and other psychotic disorders, unspecified schizophrenia spectrum disorders and other psychotic disorders, debilitating psychotic syndrome (quasi-psychotic syndrome), and the like.
  • the diseases of the anxiety group are not particularly limited, but for example, separation anxiety, scene silence (selective silence), localized phobia, social anxiety, panic, square phobia, general phobia, substance. • Drug-induced anxiety, anxiety due to other medical disorders, other identified phobias, etc. It is preferably separation anxiety, scene silence (selective silence), specific phobia, social anxiety, panic, agoraphobia, and general phobia, and more preferably social anxiety.
  • Obsessive-compulsive disorder, dysmorphic phobia, trichotillomania, and excoriation disorder are preferred, and dysmorphic phobia is particularly preferred.
  • Diseases in the group of traumatic and stress-related disorders are not particularly limited, but are, for example, reactive attachment disorders, desuppressive interpersonal interaction disorders, post-traumatic stress disorders, acute stress disorders, adaptation disorders, etc. Specified trauma and stress factor-related disorders, unspecified trauma and stress factor-related disorders, and the like.
  • the disease of the neurocognitive impairment group is not particularly limited, and examples thereof include delirium, dementia, and mild cognitive impairment. Dementia and mild cognitive impairment are preferred.
  • the neurodegenerative disease is not particularly limited, and examples thereof include Parkinson's disease, cranial neuropathy and / or other diseases in which a decrease in visual communication ability is observed.
  • the method for determining the line-of-sight position of the present disclosure is training for a person who has not been diagnosed with a neuropsychiatric disorder but has a tendency to deteriorate the ability of line-of-sight communication, or a person who may have an obstacle to social life due to a decrease in line-of-sight communication ability. Can also be applied to. As a result, training can be started at an early timing, and it is possible to avoid aggravation and intractability of neuropsychiatric disorders.
  • the training using the line-of-sight position determination method of the present disclosure (hereinafter referred to as the training of the present disclosure) is carried out by a training system equipped with a line-of-sight position determination device 10 or a line-of-sight position determination system 1, and communication by a line of sight close to the real world.
  • the environment can be reproduced, and for example, it is carried out with the goal of improving and improving the line-of-sight communication ability.
  • training of various line-of-sight communication abilities can be carried out.
  • the line-of-sight communication ability is an index of the ability to communicate through the line of sight in interpersonal relationships in the real world.
  • Gaze communication ability includes social gaze control ability (ability to control and use gaze as a signal), social gaze understanding ability (ability to understand gaze as signal), and social gaze transmission ability (in an appropriate context). It is composed of the ability to emit the line of sight as a signal), the ability to respond to the social line of sight (the ability to respond to the line of sight as a signal in an appropriate context), and the like.
  • Examples of the social gaze control ability include a social gaze matching ability, a social gaze shift ability, and a joint gaze ability. These can be measured through the training of the present disclosure (see Table 1).
  • Gaze communication ability includes Liebowitz Social Anxiety Scale, Social Phobia Inventory, Patient Health Questionnaire -9, Generalized Anxiety Disorder -7, etc.
  • the index for determining the social gaze control ability that is, the possibility of gaze matching, the analysis value of the first time, the second) Time, line-of-sight distance, and number of line-of-sight matches
  • the line-of-sight communication ability can be comprehensively evaluated at the time of examination by combining a clinical score and an index for determining social line-of-sight control ability.
  • the analysis value of the first time is the average value or the maximum value of the time elapsed while staying in the determination area P2 from the time when the position of the line of sight of the user is located in the determination area P2, and the first time. It is a ratio of time (ratio of time staying in the determination area P2), and the second time is determined to be in the determination area P2 from the time when the position of the user's line of sight is first input to the line-of-sight position input unit.
  • the line-of-sight distance is the average value of the distances between the target position P1 and the line-of-sight position within the determination time.
  • the social line-of-sight control ability can be trained, for example, by setting the determination area P2 so as to include a social object to which the line of sight is directed.
  • the social line-of-sight matching ability can be trained, for example, by setting the determination area P2 to include a social object that is a gaze target.
  • eye contact training can be performed by setting the determination area P2 to include the eyeball position.
  • the social line-of-sight shift ability can be trained, for example, by setting the determination area P2 to include a social object to be the target of the line-of-sight shift.
  • the joint gaze ability can be trained, for example, by setting the determination area P2 to include a social object designated as a shared object by another person.
  • the social line-of-sight control ability is determined based on any one or a combination of the possibility of line-of-sight matching, the first time, the second time, the line-of-sight distance, and the number of line-of-sight matching. For example, when different users tackle the same task, it is determined that the user who can match the line of sight has a higher social line-of-sight control ability than the user who cannot match the line of sight.
  • the analysis value of the first time is long or large
  • the second time is short
  • the line-of-sight distance is short
  • the number of line-of-sight matches is large, and the like means that the social line-of-sight control ability is high. ..
  • Examples of the ability to transmit social gaze include “Power Gazing”, which indicates that one is confident in contact, “Social Gazing”, which indicates an intention to interact, and “Intimate Gazing”, which indicates an intention to become close. ..
  • the training in this disclosure consists of any task in which one instruction is given to look at a social object.
  • the task can be determined by the line-of-sight communication ability that you want to improve.
  • the task is not particularly limited as long as it is configured for the purpose of improving and improving the ability, but it is preferable to incorporate the viewpoint of cognitive behavioral therapy.
  • By correcting cognitive-behavioral biased patterns in a cognitive-behavioral therapy it is possible to obtain the effects of attention shift training performed in cognitive-behavioral therapy, not just the acquisition of social gaze control ability. ..
  • a patient with social anxiety disorder has a bias in his / her own (internal) attention, and is in a state where he / she cannot flexibly switch between them. Therefore, teachings that pay attention to the facial expression recognition and emotion recognition of others (for example, “Look at the other person's face. What kind of facial expression?" Or “Look at the other person's face. Which" Do you feel like that? ”, Etc.), which has the effect of facilitating the shift of social gaze to the outside (others, etc.) in the training of social gaze shift ability.
  • teachings that indicate that you are in contact with confidence for example, "look at the other person's forehead and both eyes alternately" or teaching that you want to interact (for example, “the other person's eyes”).
  • “Alternately look at the mouth and mouth” or by making it a task that includes teaching (for example, "Alternately look at the other person's eyes and chest") to show the intention to get close to each other, the ability to transmit social gaze. It is also possible to learn.
  • an auditory attention shift training method called "Attention Training Technique (ATT)” that distinguishes between multiple sounds has been formulated.
  • ATT Automatic Training Technique
  • the training of the present disclosure is extremely useful in that it can realize visual attention shift training by combining the line-of-sight determination performed by the training system of the present disclosure and the task with cognitive-behavioral modification. expensive.
  • the training includes the first task in which the determination area P2 is set so as to include the constituent parts of the social object (for example, eyes, nose, mouth, forehead, etc.) to which the line of sight is directed, and the constituent parts. It may include a second task in which the determination area P2 is set so as to include the structural unit (for example, when the eye is a constituent part, the face, the whole body, etc. are the constituent units). .. Further, in the training, a third task in which the determination area P2 is set so as to alternately include the constituent parts and the constituent units, and facial expressions and / or facial expressions of social objects in which the determination area P2 is set are set. A fourth task of guessing emotions may be included.
  • the constituent parts of the social object for example, eyes, nose, mouth, forehead, etc.
  • Training is performed by the user performing one or more tasks. For example, it may be performed by performing a plurality of tasks presented in succession, and a plurality of trainings may be performed as a series of trainings at intervals of days and times.
  • the training result can be calculated as an evaluation for each task or a comprehensive evaluation for multiple tasks.
  • the task is a unit in which the line-of-sight matching determination is continuously performed for a predetermined time (for example, 20 seconds or 30 seconds), and the result of the line-of-sight matching determination is obtained at least once.
  • the difficulty level of training can be decided arbitrarily. For example, it can be determined based on the results of training already performed, and may be determined to be gradually higher.
  • the difficulty level of training can be set according to the difficulty level of the line-of-sight match judgment and / or the difficulty level of the task.
  • the difficulty level of the line-of-sight match determination can be set by the determination area P2 and / or the maintenance time.
  • the difficulty level of the line-of-sight matching determination can be changed by enlarging or reducing the determination area P2 and / or increasing or decreasing the maintenance time.
  • the difficulty level of the task is determined, for example, by the subjective and / or objective evaluation of the user.
  • the user's subjective and / or objective assessment includes, for example, the user's subjective and / or objective stress index.
  • the user's subjective stress means the stress felt by the user, and the stress index includes self-reporting of anxiety about training and the degree of pain.
  • the user's objective stress means stress evaluated by a person other than the user, and the stress index includes the social gaze control ability evaluated in training, the heart rate and heart rate fluctuation index during training, and training.
  • the degree of opening of the pupil inside, the number of blinks during training, their changes, etc. can be mentioned.
  • Heart rate variability indicators include low frequency components (LF), high frequency components (HF) and / or their ratios (LF / HF).
  • the stress applied to the user may be determined by the ease of applying stress that is generally assumed. For example, a task consisting of asking a person with a scary appearance for directions is more likely to put stress on the user than a task consisting of asking a person with a gentle appearance for directions. I can say.
  • the difficulty level of the task is changed, for example, by changing the elements constituting the task.
  • the elements constituting the task include those shown in Table 2 in addition to the teaching that directs the line of sight to the social object.
  • a method of presenting the task to the user there are a method of presenting by video content (video and / or still image), a method of presenting in VR space, a method of presenting in the real world, and depending on the selected presentation method. It is possible to change the difficulty level of the task.
  • the difficulty level of the task can be changed depending on the type of image (video, still image) and the type of image (illustration, animation, photo).
  • the duration, frequency and duration of each training are not particularly limited and can be arbitrarily set by the user and / or the practitioner.
  • one to 240 minutes of training is performed once every 90 days to 12 times a day for a period of one day to one year.
  • the effect of treatment can be expected by noticing the significance of eye contact and / or eye contact with social objects.
  • the effect of treatment can be expected by intensively performing 10-minute training once a day 12 times.
  • the effect of treatment can be expected by training at a slow pace of 20 minutes once every 90 days for one year.
  • the duration of each training session can be set arbitrarily, but if it is less than 1 minute per training session, it may be too short and the treatment effect may be reduced, and if it exceeds 240 minutes per training session, the user.
  • the load on the patient may become too great and the effect of treatment may be reduced.
  • the frequency of training can be set arbitrarily, but if training is performed at a frequency lower than once every 90 days (for example, once every 120 days), the training interval is too long and the effect of treatment is effective. May decrease.
  • when training is performed at a frequency higher than 12 times a day (for example, 20 times a day) the load on the user may become too large and the effect of the treatment may be reduced.
  • the period, frequency and duration of each training are not particularly limited and can be arbitrarily set by the user and / or the practitioner.
  • 10 to 40 minutes of training is performed once to twice a week, 8 to 16 times. Considering that it is common to go to the hospital about once a week, for example, assuming that one 20-minute training is performed once a week, it is considered that it takes about 8 weeks to become a habit. Because.
  • the period, frequency and duration of each training are not particularly limited and can be arbitrarily set by the user.
  • 10 to 40 minutes of training is performed once a day to once a week.
  • the total number of training sessions is not particularly limited, but is preferably performed in the range of 8 to 30 training sessions.
  • Outpatient treatment at a medical institution may be used in combination with home treatment.
  • the training disclosed in this disclosure is used not only for those who have been diagnosed with neuropsychiatric disorders, but also for those who have a tendency to have a decline in their line-of-sight communication ability, or those who may have an obstacle to their social life due to a decline in their line-of-sight communication ability. can.
  • the duration, frequency, and duration of each training are not particularly limited and can be arbitrarily set by the user and / or the practitioner.
  • the time and frequency are not particularly limited, but the training is preferably performed once a day to once a week for 10 to 40 minutes each time.
  • the line-of-sight position determination device 10 of the present disclosure includes a determination unit 12 for determining whether or not the position of the user's line of sight input to the line-of-sight position input unit 11 is in the determination area P2, and a determination area for setting the determination area P2. It includes a setting unit 15 and an output unit 13 that outputs feedback to the user when the determination unit 12 determines that the position of the line of sight is in the determination area P2. For example, by setting the determination area P2 so as to include the eyeball position of the person facing the user, it is possible to reproduce a communication environment with line-of-sight matching close to the real world.
  • the line-of-sight position determination device 10 of the first embodiment when it is determined that the position of the line-of-sight of the user is in the determination area, feedback is output to the user. Therefore, for example, when the line-of-sight position determination device 10 is used for the treatment or training of a neuropsychiatric disorder, the user's motivation for the treatment or training can be increased. For example, by setting the determination area P2 based on the concept of cognitive-behavioral therapy, it is possible to carry out training of various line-of-sight communication abilities.
  • the judgment unit 12 When the time (first time) elapsed from the time when the position of the line of sight of the user is located in the judgment area P2 while staying in the judgment area P2 reaches the preset maintenance time, the judgment unit 12 is used. It is determined that the position of the line of sight is in the determination area P2. With such a configuration, the line-of-sight matching determination can be performed more accurately.
  • the measuring unit 16 measures an index of social line-of-sight control ability. For example, the measurement unit 16 determines that the analysis value of the first time and the position of the line of sight are in the determination area P2 from the time when the line-of-sight position is first input to the line-of-sight position input unit 11 as an index of the social line-of-sight control ability. Measure at least one of the second time elapsed during the period, the distance between the user's line-of-sight position and the determination area P2, and the number of times the line-of-sight position is determined to be in the determination area P2. do. By using the measured index, it is possible to determine the social gaze control ability of the user. For example, by recording the measured social gaze control ability over time, it is possible to diagnose a neuropsychiatric disorder in which gaze control is difficult, or to monitor the treatment or training effect on the neuropsychiatric disorder.
  • the output unit 13 outputs feedback to the user in real time. With this configuration, it is possible to reproduce a communication environment with a line of sight closer to the real world.
  • the line-of-sight position determination device 10 further includes a target position setting unit 14 for setting a target position P1 to which the user aligns the line of sight.
  • a target position setting unit 14 for setting a target position P1 to which the user aligns the line of sight.
  • the determination area setting unit 15 is, for example, the entire body of a person facing the user, a part of the body of the person facing the user, the entire face of the person facing the user, and a part of the face of the person facing the user.
  • the determination area P2 can be set to include one selected from the eye part of the person facing the user and a part of the eyeball position of the person facing the user. With such a configuration, it is possible to reproduce a communication environment with a line of sight closer to the real world.
  • the determination area setting unit 15 is, for example, an entire animal body, a part of the animal body, an entire animal face, a part of the animal face, or an animal in an image of an animal including a person displayed on a display facing the user.
  • the determination region P2 can be set as the target position P1 so as to include one selected from the eye portion and the eyeball position of the animal. With such a configuration, it is possible to reproduce a communication environment with a line of sight closer to the real world.
  • the determination area setting unit 15 can set the determination area P2 so as to include, for example, the eyeball position of the animal in the image of the animal including the person facing the user or the person displayed on the display facing the user. .. With such a configuration, it is possible to reproduce a communication environment with a line of sight closer to the real world.
  • the determination area setting unit 15 determines the size of the determination area P2 based on, for example, the distance L between the left and right eyeball positions P3 and P4 of the person facing the user or the person displayed on the display facing the user. Can be set. With such a configuration, the size of the target image seen by the user can be calculated with a simple configuration, for example, it can be used as an index of the difficulty level of the task or used for standardizing the size of the judgment area P2 between tasks. can do.
  • a lower limit is set for the size of the determination area P2.
  • the line-of-sight position determination device 10 further includes a difficulty level setting unit 50 that sets the difficulty level of determination by the determination unit 12. With such a configuration, it is possible to set a plurality of levels of difficulty for the line-of-sight matching determination.
  • the difficulty level setting unit 50 sets the difficulty level of the line-of-sight matching determination by setting the size of the determination area P2 and / or the length of the maintenance time. With such a configuration, it is possible to easily set a plurality of levels of difficulty for the line-of-sight matching determination.
  • Feedback is given through one or more senses selected from visual, auditory and tactile sensations.
  • the line-of-sight position determination system 1 of the present disclosure includes a line-of-sight position determination device 10 and a line-of-sight position acquisition unit 20 that acquires the position of the user's line of sight and outputs it to the line-of-sight position input unit 11.
  • the line-of-sight position determination device 10 can realize a line-of-sight position determination system 1 that can reproduce a communication environment with a line of sight close to the real world.
  • the line-of-sight position determination method of the present disclosure detects the position of the line of sight of the user, determines whether or not the position of the detected line of sight is in the determination area P2, and determines that the position of the line of sight is in the determination area P2. If so, feedback is output to the user. Further, the program of the present disclosure causes a computer to execute the method of determining the line-of-sight position of the present disclosure. With such a configuration, for example, by setting the determination area P2 so as to include a social object to which the line of sight is directed, performing line-of-sight matching determination and feedback, it is possible to reproduce a communication environment with a line of sight closer to the real world.
  • the line-of-sight position determination method of the present disclosure can also be applied to a method for diagnosing a neuropsychiatric disorder and a method for supporting the diagnosis of a neuropsychiatric disorder.
  • a plurality of images in which the determination area P2 is set are continuously presented to the user.
  • the communication from the line of sight of the unreal world to the communication with the line of sight close to the real world is stepwise. It is possible to reproduce the communication environment with a clear line of sight.
  • the treatment method, training method, evaluation method and monitoring method of the present disclosure use the line-of-sight position determination method of the present disclosure.
  • the line-of-sight position determination method easily and uniformly reproduces the communication environment with the line of sight closer to the real world and outputs feedback, so that the treatment is highly continuous and highly effective.
  • the method and training method can be realized.
  • the therapeutic effect of the treatment method of the present disclosure and the training effect of the training method of the present disclosure are the Liebowitz Social Anxiety Scale, the Social Phobia Inventory, and the Patient Health Questionnaire-.
  • Health-related QOL evaluation self-administered using the medical and economic health-related QOL evaluation scale EuroQol 5 Dimension (EQ-5D), anxiety disorder of eye contact, And / or show that at least one improvement in the enjoyment of eye contact can be expected.
  • the difficulty of the task and the determination can be adjusted by the user, so that the anxiety and stress of the user can be reduced.
  • the situation where the practitioner is in a remote place regardless of the specialty and skill level of the practitioner (for example, a doctor, a psychologist (psychologist), a counselor, a therapist).
  • standardized treatment and training can be provided even in the absence of the practitioner.
  • the treatment method of the present disclosure also includes a treatment support method.
  • the training system of the present disclosure includes a line-of-sight position determination device 10 or a line-of-sight position determination system 1, and is configured to be capable of performing training using the line-of-sight position determination method.
  • a line-of-sight position determination device 10 or the line-of-sight position determination system 1 and the line-of-sight position determination method By the line-of-sight position determination device 10 or the line-of-sight position determination system 1 and the line-of-sight position determination method, a communication environment closer to the real world can be reproduced, and a highly effective training system can be realized.
  • the line-of-sight position determination device of the first aspect of the present disclosure is The line-of-sight position input section where the position of the user's line of sight is input, Judgment area setting unit that sets the judgment area and A determination unit for determining whether or not the line-of-sight position input by the line-of-sight position input unit is in the determination area, and a determination unit.
  • the determination unit determines that the position of the line of sight is in the determination area
  • the determination unit includes an output unit that outputs feedback to the user.
  • the line-of-sight position determination device of the second aspect of the present disclosure is Further, a measuring unit for measuring the first time elapsed in a state of staying in the determination area from the time when the position of the line of sight is located in the determination area is further provided.
  • the determination unit When the first time measured by the measuring unit reaches the preset maintenance time, it is determined that the position of the line of sight is in the determination region.
  • the line-of-sight position determination device of the third aspect of the present disclosure is The output unit is The feedback is output to the user in real time.
  • the line-of-sight position determination device is Further, a target position setting unit for setting a target position for the user to match his / her line of sight is provided.
  • the line-of-sight position determination device is The determination area setting unit is The entire body of the animal, including the person facing the user, the part of the body of the animal facing the user, the entire face of the animal facing the user, the face of the animal facing the user.
  • the determination area is set to include one selected from a portion, the eye of the animal facing the user, and a portion of the eyeball position of the animal facing the user.
  • the line-of-sight position determination device is The determination area setting unit is The whole body of the animal, a part of the body of the animal, the whole face of the animal, a part of the face of the animal, the eye of the animal, in the image of the animal including a person displayed on the display facing the user. And, the determination area is set so as to include one selected from the eyeball positions of the animal.
  • the line-of-sight position determination device is The determination area setting unit is The determination area is set so as to include the eyeball position of the animal.
  • the line-of-sight position determination device is The determination area setting unit is The size of the determination region is set based on the distance between the left and right eyeball positions of the animal in the image of the animal including the person included in the view image of the user.
  • the line-of-sight position determination device is A lower limit is set for the size of the determination area.
  • the line-of-sight position determination device is The animal is a human.
  • the line-of-sight position determination device is The measurement unit that measures the first time elapsed from the time when the position of the line of sight is located in the determination area stays in the determination area, and the determination is made from the time when the position of the line of sight is located in the determination area. In addition to the first time elapsed while staying in the area, the index of the user's social gaze control ability is measured.
  • the line-of-sight position determination device is The index of the social line-of-sight control ability is the analysis value of the first time, from the time when the line-of-sight position is first input to the line-of-sight position input unit to the time when it is determined to be in the determination area. It is at least one of a second time elapsed, a distance between the user's line-of-sight position and the determination area, and the number of times the line-of-sight position is determined to be in the determination area.
  • the line-of-sight position determination device is By comparing the measured index of the social gaze control ability of the user with the index of the social gaze control ability of another user, a plurality of the above-mentioned tasks of the training composed of a plurality of tasks. Of these, the problem that the user is not good at is estimated.
  • the line-of-sight position determination device is It also has a difficulty setting unit that sets the training load consisting of multiple tasks.
  • the difficulty setting unit sets the training load according to the measured index of the social gaze control ability.
  • the line-of-sight position determination device is It also has a difficulty setting unit that sets the training load consisting of multiple tasks.
  • the line-of-sight position determination device is The difficulty setting unit sets the training load based on the result determined by the determination unit.
  • the line-of-sight position determination device is In the difficulty setting unit, when the measured index of the social gaze control ability is higher than the measured index of the social gaze control ability before the measured index of the social gaze control ability. , Increase the load of the training.
  • the line-of-sight position determination device is Further, a measuring unit for measuring the first time elapsed in a state of staying in the determination area from the time when the position of the line of sight is located in the determination area is further provided.
  • the determination unit When the first time measured by the measuring unit reaches a preset maintenance time, it is determined that the position of the line of sight is in the determination region.
  • the difficulty setting unit is The training load is set by setting the size of the determination area and / or the length of the maintenance time.
  • the line-of-sight position determination device is The difficulty setting unit sets the deviation of each of the tasks with respect to the measured average value of the index of the social gaze control ability of the user as the average value of the index of the social gaze control ability of the other user. By comparing with each deviation of the task with respect to the above, the task that the user is not good at is estimated, and the load of the training is set based on the estimated task.
  • the line-of-sight position determination device is Further, a measuring unit for measuring the first time elapsed in a state of staying in the determination area from the time when the position of the line of sight is located in the determination area is further provided. In addition to the first time, the measuring unit measures an index of the user's social gaze control ability.
  • the line-of-sight position determination device is Further, a measuring unit for measuring the first time elapsed in a state of staying in the determination area from the time when the position of the line of sight is located in the determination area is further provided.
  • the determination unit When the first time measured by the measuring unit reaches a preset maintenance time, it is determined that the position of the line of sight is in the determination region.
  • the difficulty setting unit is The training load is set by setting the size of the determination area and / or the length of the maintenance time.
  • the line-of-sight position determination device is The index of the social line-of-sight control ability is the analysis value of the first time, from the time when the line-of-sight position is first input to the line-of-sight position input unit to the time when it is determined to be in the determination area. It is at least one of a second time elapsed, a distance between the user's line-of-sight position and the determination area, and the number of times the line-of-sight position is determined to be in the determination area.
  • the line-of-sight position determination device is It is further equipped with an operation unit that can accept the difficulty change operation for changing the training load.
  • the difficulty setting unit sets the difficulty level of the training by the difficulty level changing operation accepted by the operation unit.
  • the line-of-sight position determination device is In the difficulty setting unit, when the measured index of the social gaze control ability is higher than the measured index of the social gaze control ability before the measured index of the social gaze control ability. , Increase the load of the training.
  • the line-of-sight position determination device is The feedback is provided through one or more sensations selected from visual, auditory and tactile sensations.
  • the line-of-sight position determination device is The difficulty setting unit sets the deviation of each of the tasks with respect to the measured average value of the index of the social gaze control ability of the user with respect to the average value of the index of the social gaze control ability of the other user. By comparing with each deviation of the task, the task that the user is not good at is estimated, and the training load is set based on the estimated task.
  • the line-of-sight position determination device is It is used for the diagnosis, severity classification, treatment, training, and / or monitoring of neuropsychiatric disorders, or for improving the ability to communicate with the eyes.
  • the line-of-sight position determination device is It is further equipped with an operation unit that can accept the difficulty change operation for changing the training load.
  • the difficulty setting unit sets the difficulty level of the training by the difficulty level changing operation accepted by the operation unit.
  • the line-of-sight position determination device is The neuropsychiatric disorder is an anxiety group or a neurodevelopmental disorder group.
  • the line-of-sight position determination system is The line-of-sight position determination device of the above-described aspect and It has a line-of-sight direction acquisition unit that detects the line-of-sight direction of the user, and includes a line-of-sight position acquisition unit that outputs the line-of-sight direction of the user detected by the line-of-sight direction acquisition unit to the line-of-sight position input unit.
  • the line-of-sight position determination system is The line-of-sight position acquisition unit Further having a view image acquisition unit for acquiring the view image of the user, The position of the line of sight of the user is acquired based on the view image.
  • the line-of-sight position determination system is The line-of-sight position input unit A display position detecting unit that detects the position of the presented image presented to the user in the field image acquired by the field image acquisition unit, and a display position detecting unit. Based on the detected position of the presented image, a line-of-sight position changing unit that converts the position of the line of sight of the user in the coordinate system of the field image to the position of the line of sight of the user in the coordinate system of the presented image. Have more.
  • the line-of-sight position determination method is as follows. Enter the position of the user's line of sight and Set the judgment area and It is determined whether or not the input position of the line of sight is in the determination area, and When it is determined that the position of the line of sight is in the determination area, feedback is output to the user.
  • the line-of-sight position determination method is as follows.
  • the first time elapsed from the time when the position of the line of sight is located in the determination area is measured while the position of the line of sight remains in the determination area.
  • the measured first time reaches the preset maintenance time, it is determined that the position of the line of sight is in the determination area.
  • the method for determining the line-of-sight position according to the 28th aspect of the present disclosure is as follows.
  • the feedback is output to the user in real time.
  • the line-of-sight position determination method is as follows. Set the target position where the user looks at, The determination area including the target position is set.
  • the method for determining the line-of-sight position is as follows.
  • the entire body of the animal including the person facing the user, the part of the body of the animal facing the user, the entire face of the animal facing the user, the face of the animal facing the user.
  • the determination area is set to include one selected from a portion, the eye of the animal facing the user, and a portion of the eyeball position of the animal facing the user.
  • the method for determining the line-of-sight position according to the 31st aspect of the present disclosure is as follows.
  • the determination area is set to include one selected from the eyeball positions of the animal.
  • the method for determining the line-of-sight position according to the 32nd aspect of the present disclosure is as follows.
  • the size of the determination region is set based on the distance between the left and right eyeball positions of the animal including the person facing the user.
  • the method for determining the line-of-sight position according to the 33rd aspect of the present disclosure is as follows.
  • a lower limit is set for the size of the determination area.
  • the line-of-sight position determination method is as follows.
  • the lower limit value is determined based on the line-of-sight position fluctuation data representing the line-of-sight position that changes with the passage of time when the user gazes at an arbitrary point.
  • the method for determining the line-of-sight position according to the 35th aspect of the present disclosure is as follows.
  • the animal is a human.
  • the training system of the 36th aspect of the present disclosure is The line-of-sight position determination device of the above-described embodiment or the line-of-sight position determination system of the above-described embodiment is provided.
  • the evaluation method according to the 37th aspect of the present disclosure is as follows.
  • the line-of-sight position determination method of the above aspect was used.
  • the evaluation method according to the 38th aspect of the present disclosure is as follows.
  • the line-of-sight communication ability is a social line-of-sight control ability or a social line-of-sight transmission ability.
  • the evaluation method of the 39th aspect of the present disclosure is
  • the social gaze control ability is a social gaze matching ability, a social gaze shift ability, or a joint gaze ability.
  • the training method of the 40th aspect of the present disclosure is Training is carried out using the line-of-sight position determination method of the above aspect.
  • the training method of the 41st aspect of the present disclosure is The training is composed of a plurality of tasks configured so that a determination result as to whether or not the position of the line of sight is in the determination region can be obtained at least once, and the plurality of tasks are continuously performed.
  • the task includes directing the line of sight to any one of the plurality of determination areas according to the teaching.
  • the training method of the 42nd aspect of the present disclosure is For the above-mentioned problem,
  • the first task in which the determination area is set so as to include the constituent parts of the social object to which the line of sight is directed, and It includes a second task in which the determination area is set to include a structural unit that includes the constituent parts.
  • the training method of the 43rd aspect of the present disclosure is for the above-mentioned problem, A third task is included in which the determination area is set so as to alternately include the constituent parts and the constituent units.
  • a fourth task of inferring the facial expression and / or emotion of the social object in which the determination area is set is included.
  • the training method of the 45th aspect of the present disclosure is The training load is set according to the difficulty level of the task.
  • the training method of the 46th aspect of the present disclosure is The training load is set based on indicators including the subjective or objective evaluation of the user.
  • the training method of the 47th aspect of the present disclosure includes an evaluation in which the user self-reports the pain experienced by performing the training.
  • the training method of the 47-2 aspect of the present disclosure is The training load is set by the determination result of whether or not the position of the line of sight is in the determination area.
  • the training method of the 48th aspect of the present disclosure For the objective evaluation of the user, the result of the training, the change and / or the heart rate fluctuation index of the user during the training, the degree of opening of the pupil of the user, and the user. Includes at least one of the changes in the number of blinks.
  • the training method according to the 48-2 aspect of the present disclosure
  • the first time elapsed from the time when the position of the line of sight is located in the determination area while the position of the line of sight remains in the determination area reaches a preset maintenance time, and the position of the line of sight is the position of the determination area. If it is determined to be in the determination area,
  • the training load is set by setting the size of the determination area and / or the length of the maintenance time.
  • the training method of the 49th aspect of the present disclosure It measures an index of social line-of-sight control ability, which is the ability to control and use the line of sight as a signal.
  • the training method of the 50th aspect of the present disclosure is When the position of the line of sight is first input for the first time elapsed from the time when the position of the line of sight is located in the determination area to the state where the index of the social line-of-sight control ability remains in the determination area.
  • the second time elapsed from the time when it is determined to be in the determination area, the distance between the line-of-sight position of the user and the determination area, and the position of the line of sight are in the determination area. It is at least one of the number of times determined to be.
  • the training method of the 51st aspect of the present disclosure is The training load is set by the measured index of the user's social gaze control ability.
  • the training method of the 52nd aspect of the present disclosure is The training load is set based on the result of determination as to whether or not the position of the line of sight is in the set determination region.
  • the training method of the 53rd aspect of the present disclosure When the first time reaches a preset maintenance time and it is determined that the position of the line of sight is in the determination region.
  • the training load is set by setting the size of the determination area and / or the length of the maintenance time.
  • the training method of the 53-2 aspect of the present disclosure is The first time elapsed from the time when the position of the line of sight is located in the determination area and the state of staying in the determination area, and the index of the social line-of-sight control ability which is the ability to control and use the line of sight as a signal. measure.
  • the training method of the 54th aspect of the present disclosure In the training, among a plurality of tasks configured so that a determination result as to whether or not the position of the line of sight is in the determination area can be obtained at least once, the task is continuously used in order from the task having the lowest difficulty level. It is configured to be presented to the person.
  • the training method of the 54-2 aspect of the present disclosure is The index of the social line-of-sight control ability is the analysis value of the first time, the second time elapsed from the time when the position of the line of sight is first input to the time when it is determined to be in the determination area. , The distance between the line-of-sight position of the user and the determination area, and at least one of the number of times the position of the line of sight is determined to be in the determination area.
  • the training method according to the 55-2 aspect of the present disclosure is If the measured index of the social gaze control ability is higher than the measured index of the social gaze control ability before the measured index of the social gaze control ability, the training load is high. do.
  • the training method according to the 56-2 aspect of the present disclosure The deviation of each of the tasks with respect to the measured average value of the index of the social gaze control ability of the user and the deviation of each of the tasks with respect to the average value of the index of the social gaze control ability of another user. By comparing, the task that the user is not good at is estimated, and the load of the training is set based on the estimated task.
  • the training method according to the 57-2 aspect of the present disclosure
  • the difficulty level of the training is set by the difficulty level changing operation for changing the training load.
  • the monitoring method according to the 55th aspect of the present disclosure is described.
  • the line-of-sight position determination method of the above aspect was used.
  • the 56th aspect of the present disclosure is a method for treating a neuropsychiatric disorder. Training using the training method of the above aspect is carried out.
  • the 57th aspect of the present disclosure is a method for treating a neuropsychiatric disorder. During the period of 1 day to 1 year, the training for 1 minute to 240 minutes is performed once every 90 days to 12 times a day.
  • the 58th aspect of the present disclosure is a method for treating a neuropsychiatric disorder.
  • the training load is gradually increased.
  • the 59th aspect of the present disclosure is a method for treating a neuropsychiatric disorder.
  • the difficulty level of the training is changed according to the user.
  • the method for diagnosing a neuropsychiatric disorder according to the 60th aspect of the present disclosure is as follows.
  • the line-of-sight position determination method of the above aspect was used.
  • the program of the 61st aspect of the present disclosure is A computer is made to execute the line-of-sight position determination method of the above aspect.
  • the program of the 62nd aspect of the present disclosure is Have the computer perform the training method of the above aspect.
  • the line-of-sight position determination device is The line-of-sight position input section where the position of the user's line of sight is input, Judgment area setting unit that sets the judgment area and A determination unit for determining whether or not the line-of-sight position input by the line-of-sight position input unit is in the determination area, and a determination unit.
  • the determination unit determines that the position of the line of sight is in the determination area, the determination unit includes an output unit that outputs feedback to the user.
  • the line-of-sight position determination device of the second aspect of the present disclosure is Further, a measuring unit for measuring the first time elapsed in a state of staying in the determination area from the time when the position of the line of sight is located in the determination area is further provided.
  • the determination unit When the first time measured by the measuring unit reaches the preset maintenance time, it is determined that the position of the line of sight is in the determination region.
  • the line-of-sight position determination device of the third aspect of the present disclosure is In addition to the first time, the measuring unit measures an index of social line-of-sight control ability.
  • the line-of-sight position determination device is The index of the social line-of-sight control ability is the analysis value of the first time, from the time when the line-of-sight position is first input to the line-of-sight position input unit to the time when it is determined to be in the determination area. It is at least one of a second time elapsed, a distance between the user's line-of-sight position and the determination area, and the number of times the line-of-sight position is determined to be in the determination area.
  • the line-of-sight position determination device is The output unit is The feedback is output to the user in real time.
  • the line-of-sight position determination device is Further, a target position setting unit for setting a target position for the user to match his / her line of sight is provided.
  • the line-of-sight position determination device is The determination area setting unit is The entire body of the animal, including the person facing the user, the part of the body of the animal facing the user, the entire face of the animal facing the user, the face of the animal facing the user.
  • the determination area is set to include one selected from a portion, the eye of the animal facing the user, and a portion of the eyeball position of the animal facing the user.
  • the line-of-sight position determination device is The determination area setting unit is The whole body of the animal, a part of the body of the animal, the whole face of the animal, a part of the face of the animal, the eye of the animal, in the image of the animal including a person displayed on the display facing the user. And, the determination area is set so as to include one selected from the eyeball positions of the animal.
  • the line-of-sight position determination device is The determination area setting unit is The determination area is set so as to include the eyeball position of the animal.
  • the line-of-sight position determination device is The determination area setting unit is The size of the determination region is set based on the distance between the left and right eyeball positions of the animal in the image of the animal including the person included in the view image of the user.
  • the line-of-sight position determination device is A lower limit is set for the size of the determination area.
  • the line-of-sight position determination device is The animal is a human.
  • the line-of-sight position determination device is It also has a difficulty setting unit that sets the difficulty level of training consisting of multiple tasks.
  • the difficulty level of the training is set by the difficulty level of the task and / or the difficulty level of the line-of-sight matching determination which is a determination of whether or not the input position of the line of sight is in the determination area.
  • the line-of-sight position determination device is Further, a measuring unit for measuring the first time elapsed in a state of staying in the determination area from the time when the position of the line of sight is located in the determination area is further provided.
  • the determination unit When the first time measured by the measuring unit reaches a preset maintenance time, it is determined that the position of the line of sight is in the determination region.
  • the difficulty setting unit is By setting the size of the determination area and / or the length of the maintenance time, the difficulty level of the line-of-sight matching determination is set.
  • the line-of-sight position determination device is The difficulty setting unit sets the difficulty level of the training based on the result determined by the determination unit.
  • the line-of-sight position determination device is Further equipped with an operation unit capable of accepting the difficulty level change operation for changing the difficulty level of the training.
  • the difficulty setting unit sets the difficulty level of the training by the difficulty level changing operation accepted by the operation unit.
  • the line-of-sight position determination device is The feedback is provided through one or more sensations selected from visual, auditory and tactile sensations.
  • the line-of-sight position determination device is Used for diagnosis, severity classification, treatment, training, and / or monitoring of neuropsychiatric disorders, or for improving gaze communication and / or social gaze control.
  • the line-of-sight position determination device is The neuropsychiatric disorder is an anxiety group or a neurodevelopmental disorder group.
  • the line-of-sight position determination system is The line-of-sight position determination device of the above-described aspect and It has a line-of-sight direction acquisition unit that detects the line-of-sight direction of the user, and has a line-of-sight direction acquisition unit. It includes a line-of-sight position acquisition unit that outputs the line-of-sight direction of the user detected by the line-of-sight direction acquisition unit to the line-of-sight position input unit.
  • the line-of-sight position determination system is The line-of-sight position acquisition unit Further having a view image acquisition unit for acquiring the view image of the user, The position of the line of sight of the user is acquired based on the view image.
  • the line-of-sight position determination system is The line-of-sight position input unit A display position detecting unit that detects the position of the presented image presented to the user in the field image acquired by the field image acquisition unit, and a display position detecting unit. It further includes a line-of-sight position changing unit that converts the coordinate system of the field image into the coordinate system of the presented image based on the detected position of the presented image.
  • the line-of-sight position determination method is as follows. Enter the position of the user's line of sight and Set the judgment area and It is determined whether or not the input position of the line of sight is in the determination area, and When it is determined that the position of the line of sight is in the determination area, feedback is output to the user.
  • the line-of-sight position determination method is as follows.
  • the first time elapsed from the time when the position of the line of sight is located in the determination area is measured while the position of the line of sight remains in the determination area.
  • the measured first time reaches the preset maintenance time, it is determined that the position of the line of sight is in the determination area.
  • the line-of-sight position determination method is as follows. In addition to the first time, an index of social gaze control ability is measured.
  • the line-of-sight position determination method is as follows.
  • the index of the social line-of-sight control ability is the analysis value of the first time, from the time when the line-of-sight position is first input to the line-of-sight position input unit to the time when it is determined to be in the determination area.
  • the second time elapsed, the distance between the line-of-sight position of the user and the determination area, and at least one of the number of times the position of the line of sight is determined to be in the determination area.
  • the line-of-sight position determination method is as follows.
  • the feedback is output to the user in real time.
  • the line-of-sight position determination method is as follows. Set the target position where the user looks at, The determination area including the target position is set.
  • the line-of-sight position determination method is as follows.
  • the determination area is set to include one selected from the eye portion of the person facing the user and a part of the eyeball position of the person facing the user.
  • the line-of-sight position determination method is as follows.
  • the determination area is set to include one selected from the eyeball positions of the animal.
  • the line-of-sight position determination method is as follows.
  • the size of the determination region is set based on the distance between the left and right eyeball positions of the animal including the person facing the user.
  • the line-of-sight position determination method according to the A32 aspect of the present disclosure is A lower limit is set for the size of the determination area.
  • the line-of-sight position determination method is as follows.
  • the animal is a human.
  • the line-of-sight position determination method is as follows. Judgment as to whether or not the input position of the line of sight is in the set determination area is performed according to the set difficulty level of the training composed of a plurality of tasks.
  • the line-of-sight position determination method is as follows. When the first time elapsed while staying in the determination area from the time when the position of the line of sight is located in the determination area reaches a preset maintenance time, and the position of the line of sight is in the determination area. If judged, The difficulty of the training is set by setting the size of the determination area and / or the length of the maintenance time.
  • the line-of-sight position determination method is as follows.
  • the difficulty level of the training is set by the result of determination as to whether or not the position of the line of sight is in the set determination area.
  • the line-of-sight position determination method is as follows. A plurality of images in which the determination area is set are continuously presented to the user.
  • the training system of the A38 aspect of the present disclosure is The line-of-sight position determination device of the above-described embodiment or the line-of-sight position determination system of the above-described embodiment is provided.
  • the method for evaluating the line-of-sight communication ability according to the A39 aspect of the present disclosure is as follows.
  • the line-of-sight position determination method of the above aspect was used.
  • the method for evaluating the line-of-sight communication ability according to the A40 aspect of the present disclosure is as follows.
  • the line-of-sight communication ability is a social line-of-sight control ability or a social line-of-sight transmission ability.
  • the method for evaluating the line-of-sight communication ability according to the A41 aspect of the present disclosure is as follows.
  • the social gaze control ability is a social gaze matching ability, a social gaze shift ability, or a joint gaze ability.
  • the training method of the A42 aspect of the present disclosure is Training is carried out using the line-of-sight position determination method of the above aspect.
  • the training method of the A43 aspect of the present disclosure is The training is composed of a plurality of tasks configured so that a determination result as to whether or not the position of the line of sight is in the determination region can be obtained at least once, and the plurality of tasks are continuously performed.
  • the task includes directing the line of sight to one of the plurality of determination areas of different sizes according to the teaching.
  • the training method of the A44 aspect of the present disclosure is For the above-mentioned problem,
  • the first task in which the determination area is set so as to include the constituent parts of the social object to which the line of sight is directed, and It includes a second task in which the determination area is set to include a structural unit that includes the constituent parts.
  • a third task is included in which the determination area is set so as to alternately include the constituent parts and the constituent units.
  • the training method of the A46 aspect of the present disclosure is for the above-mentioned problem, In addition to directing the line of sight to the determination area, a fourth task of inferring the facial expression and / or emotion of the social object in which the determination area is set is included.
  • the training method of the A47 aspect of the present disclosure is The difficulty level of the training is set by the difficulty level of the task.
  • the training method of the A48 aspect of the present disclosure is The difficulty of the training is set based on an index including the subjective or objective evaluation of the user.
  • the training method of the A49 aspect of the present disclosure is The subjective evaluation of the user includes an evaluation in which the user self-reports the pain experienced by performing the training.
  • the training method of the A50 aspect of the present disclosure is
  • the user's objective evaluation includes at least one of the result of the training, a change in the user's heart rate during the training, and a change in the degree of pupil opening of the user.
  • the training method of the A51 aspect of the present disclosure is The difficulty level of the training is set by the difficulty level of the line-of-sight matching determination, which is a determination of whether or not the input position of the line of sight is in the determination area.
  • the training method of the A52 aspect of the present disclosure is An index of the user's social line-of-sight control ability is measured, and the difficulty level of the line-of-sight matching determination is set by the index.
  • the monitoring method of the A53 aspect of the present disclosure is as follows.
  • the line-of-sight position determination method of the above aspect was used.
  • the method for treating a psychiatric disorder according to the A54 aspect of the present disclosure is as follows. Training using the training method of the above aspect is carried out.
  • the method for treating a psychiatric disorder according to the A55 aspect of the present disclosure is as follows. During the period of 1 day to 1 year, the training for 1 minute to 240 minutes is performed once every 90 days to 12 times a day.
  • the method for treating a psychiatric disorder according to the A56 aspect of the present disclosure is as follows.
  • the difficulty of the training is gradually increased.
  • the method for treating a psychiatric disorder according to the A57 aspect of the present disclosure is as follows.
  • the difficulty level of the training is changed according to the user.
  • the program of aspect A58 of the present disclosure is A computer is made to execute the line-of-sight position determination method of the above aspect.
  • the program of the A59 aspect of the present disclosure is Have the computer perform the training method of the above aspect.
  • Line-of-sight position determination system 10 Line-of-sight position determination device 11 Line-of-sight position input unit 111 Display position detection unit 112 Line-of-sight position conversion unit 12 Judgment unit 13 Output unit 14 Target position setting unit 15 Judgment area setting unit 16 Measurement unit 17 Marker generation unit 20 Line-of-sight Position acquisition unit 21 Imaging unit 22 Line-of-sight direction acquisition unit 31 Head-mounted display 32 Display 33 Screen 34 Presented image acquisition unit 35 Wearable terminal 36 Speaker 40 View image 50 Difficulty setting unit 51 Operation unit 52 Storage unit 53 Control capability acquisition unit 54 Maintenance Time setting unit 100 Target image P1 Target position P2 Judgment area

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Veterinary Medicine (AREA)
  • Psychiatry (AREA)
  • Pathology (AREA)
  • Child & Adolescent Psychology (AREA)
  • Psychology (AREA)
  • Developmental Disabilities (AREA)
  • Hospice & Palliative Care (AREA)
  • Social Psychology (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Educational Technology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Ophthalmology & Optometry (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Quality & Reliability (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Optics & Photonics (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • User Interface Of Digital Computer (AREA)
  • Eye Examination Apparatus (AREA)
  • Position Input By Displaying (AREA)
PCT/JP2021/037044 2020-10-07 2021-10-06 視線位置判定装置、視線位置判定方法およびトレーニング方法 Ceased WO2022075377A1 (ja)

Priority Applications (6)

Application Number Priority Date Filing Date Title
CN202180082042.2A CN116546952A (zh) 2020-10-07 2021-10-06 视线位置确定设备、视线位置确定方法和训练方法
CA3195141A CA3195141A1 (en) 2020-10-07 2021-10-06 Sightline-position determination device, sightline-position determination method, and training method
EP21877676.3A EP4226906A4 (en) 2020-10-07 2021-10-06 SIGHT LINE POSITION DETERMINATION DEVICE, SIGHT LINE POSITION DETERMINATION METHOD, AND LEARNING METHOD
US18/248,181 US20230404451A1 (en) 2020-10-07 2021-10-06 Sightline-position determination device, sightline-position determination method, and training method
JP2022555542A JPWO2022075377A1 (https=) 2020-10-07 2021-10-06
JP2025186213A JP2026021493A (ja) 2020-10-07 2025-11-05 視線位置判定装置、視線位置判定方法およびトレーニング方法

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2020169779 2020-10-07
JP2020-169779 2020-10-07
JP2021-095207 2021-06-07
JP2021095207 2021-06-07

Publications (1)

Publication Number Publication Date
WO2022075377A1 true WO2022075377A1 (ja) 2022-04-14

Family

ID=81126965

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/037044 Ceased WO2022075377A1 (ja) 2020-10-07 2021-10-06 視線位置判定装置、視線位置判定方法およびトレーニング方法

Country Status (5)

Country Link
US (1) US20230404451A1 (https=)
EP (1) EP4226906A4 (https=)
JP (2) JPWO2022075377A1 (https=)
CA (1) CA3195141A1 (https=)
WO (1) WO2022075377A1 (https=)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115346642A (zh) * 2022-07-27 2022-11-15 山东心法科技有限公司 一种自闭症谱系障碍的智能训练方法、设备及介质
CN116473816A (zh) * 2023-04-18 2023-07-25 广州视景医疗软件有限公司 一种针对弱视训练的视觉交互方法和装置
WO2024117679A1 (ko) * 2022-11-29 2024-06-06 주식회사 뉴다이브 시선 추적 기반 사회적 상황의 인지력 분석 장치, 방법 및 컴퓨터 프로그램

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008307978A (ja) * 2007-06-13 2008-12-25 Toyota Motor Corp 情報出力制御装置
JP2010104754A (ja) * 2008-09-30 2010-05-13 Hanamura Takeshi 情動分析装置
JP2011206542A (ja) * 2010-03-30 2011-10-20 National Univ Corp Shizuoka Univ 自閉症診断支援用装置
JP2014071779A (ja) * 2012-09-28 2014-04-21 Jvc Kenwood Corp 診断支援装置および診断支援方法
JP2019046438A (ja) * 2017-09-05 2019-03-22 株式会社Ｊｖｃケンウッド 評価装置、及び評価方法
JP2019175413A (ja) * 2018-03-29 2019-10-10 富士通株式会社 判定プログラム、判定方法および判定装置
US20200074150A1 (en) * 2016-06-21 2020-03-05 Stefan Zechner Method and device for modifying the affective visual information in the field of vision of an user
JP2020144247A (ja) * 2019-03-07 2020-09-10 株式会社豊田中央研究所 車載表示装置、車載表示方法、および、コンピュータプログラム

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10405786B2 (en) * 2013-10-09 2019-09-10 Nedim T. SAHIN Systems, environment and methods for evaluation and management of autism spectrum disorder using a wearable data collection device
US9672649B2 (en) * 2013-11-04 2017-06-06 At&T Intellectual Property I, Lp System and method for enabling mirror video chat using a wearable display device
CN107533634A (zh) * 2015-03-23 2018-01-02 控制辐射系统有限公司 眼睛跟踪系统
CA3048068A1 (en) * 2017-01-10 2018-07-19 Biostream Technologies, Llc Adaptive behavioral training, and training of associated physiological responses, with assessment and diagnostic functionality
JP6787601B2 (ja) * 2019-03-19 2020-11-18 Ｉｍｐｕｔｅ株式会社 自閉症治療支援システム、自閉症治療支援装置、及びプログラム
CN110764613B (zh) * 2019-10-15 2023-07-18 北京航空航天大学青岛研究院 基于头戴式眼动模组的眼动追踪校准方法

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008307978A (ja) * 2007-06-13 2008-12-25 Toyota Motor Corp 情報出力制御装置
JP2010104754A (ja) * 2008-09-30 2010-05-13 Hanamura Takeshi 情動分析装置
JP2011206542A (ja) * 2010-03-30 2011-10-20 National Univ Corp Shizuoka Univ 自閉症診断支援用装置
JP2014071779A (ja) * 2012-09-28 2014-04-21 Jvc Kenwood Corp 診断支援装置および診断支援方法
US20200074150A1 (en) * 2016-06-21 2020-03-05 Stefan Zechner Method and device for modifying the affective visual information in the field of vision of an user
JP2019046438A (ja) * 2017-09-05 2019-03-22 株式会社Ｊｖｃケンウッド 評価装置、及び評価方法
JP2019175413A (ja) * 2018-03-29 2019-10-10 富士通株式会社 判定プログラム、判定方法および判定装置
JP2020144247A (ja) * 2019-03-07 2020-09-10 株式会社豊田中央研究所 車載表示装置、車載表示方法、および、コンピュータプログラム

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
See also references of EP4226906A4
YOSHINAGA ET AL., PSYCHOTHERAPY AND PSYCHOSOMATICS, vol. 85, no. 4, 2016, pages 208 - 217

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115346642A (zh) * 2022-07-27 2022-11-15 山东心法科技有限公司 一种自闭症谱系障碍的智能训练方法、设备及介质
WO2024117679A1 (ko) * 2022-11-29 2024-06-06 주식회사 뉴다이브 시선 추적 기반 사회적 상황의 인지력 분석 장치, 방법 및 컴퓨터 프로그램
CN116473816A (zh) * 2023-04-18 2023-07-25 广州视景医疗软件有限公司 一种针对弱视训练的视觉交互方法和装置

Also Published As

Publication number Publication date
JP2026021493A (ja) 2026-02-10
US20230404451A1 (en) 2023-12-21
EP4226906A4 (en) 2024-10-30
JPWO2022075377A1 (https=) 2022-04-14
CA3195141A1 (en) 2022-04-14
EP4226906A1 (en) 2023-08-16

Similar Documents

Publication Publication Date Title
US12427376B2 (en) Systems and methods for an artificial intelligence engine to optimize a peak performance
US20220331663A1 (en) System and Method for Using an Artificial Intelligence Engine to Anonymize Competitive Performance Rankings in a Rehabilitation Setting
US10548805B2 (en) Virtual reality apparatus and methods therefor
Bekele et al. Design of a virtual reality system for affect analysis in facial expressions (VR-SAAFE); application to schizophrenia
US20220313143A1 (en) Virtual immersive sensorimotor device and methods to detect neurological impairments
WO2022075377A1 (ja) 視線位置判定装置、視線位置判定方法およびトレーニング方法
CN108882875A (zh) 用于神经血管刺激的设备
JP2014523041A (ja) 拡張現実感表示によって従業員に健康情報を提供するためのシステム、コンピュータ媒体およびコンピュータにより実行される方法
CA2953752A1 (en) Virtual reality apparatus and methods therefor
US12224052B2 (en) System and method for using AI, machine learning and telemedicine for long-term care via an electromechanical machine
Simone et al. Head-mounted displays for clinical virtual reality applications: pitfalls in understanding user behavior while using technology
AU2017200112A1 (en) Virtual reality apparatus and methods therefor
CN113257387B (zh) 一种用于康复训练的可穿戴设备、康复训练方法和系统
Bekele et al. Responses during facial emotional expression recognition tasks using virtual reality and static IAPS pictures for adults with schizophrenia
US20240194320A1 (en) System and method for using ai, machine learning and telemedicine to perform pulmonary rehabilitation via an electromechanical machine
JP6713526B1 (ja) Ｖｄｔ症候群及び繊維筋痛症の改善
TWI844438B (zh) 應用於促進心肺適能訓練的介入方法及系統
CN113223690B (zh) 经由远程医疗来使对象康复的方法和系统
HK40099043A (zh) 视线位置确定设备、视线位置确定方法和训练方法
Gabay et al. Passive identification of subjective preferences toward individual items using eye-tracking in a virtual reality environment
Rodríguez-Mansilla et al. Virtual reality as a complementary therapy in the rehabilitation of balance and gait disorders in patients with mild cognitive impairment and Alzheimer’s disease: Systematic review
US20230320640A1 (en) Bidirectional sightline-position determination device, bidirectional sightline-position determination method, and training method
CN116546952A (zh) 视线位置确定设备、视线位置确定方法和训练方法
Vartak et al. Cognitive state estimation for adaptive learning systems using wearable physiological sensors
US20220028291A1 (en) Device for the implementation of serious games for the prevention and/or treatment of mental disorders

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21877676

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022555542

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 3195141

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2021877676

Country of ref document: EP

Effective date: 20230508

WWE Wipo information: entry into national phase

Ref document number: 202180082042.2

Country of ref document: CN

WWW Wipo information: withdrawn in national office

Ref document number: 2021877676

Country of ref document: EP