WO2021141186A1 - Système et procédé d'apprentissage de réadaptation cognitive de types multiples - Google Patents

Système et procédé d'apprentissage de réadaptation cognitive de types multiples Download PDF

Info

Publication number
WO2021141186A1
WO2021141186A1 PCT/KR2020/007726 KR2020007726W WO2021141186A1 WO 2021141186 A1 WO2021141186 A1 WO 2021141186A1 KR 2020007726 W KR2020007726 W KR 2020007726W WO 2021141186 A1 WO2021141186 A1 WO 2021141186A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
training
cognitive rehabilitation
rehabilitation training
group
Prior art date
Application number
PCT/KR2020/007726
Other languages
English (en)
Korean (ko)
Inventor
천승호
안도현
Original Assignee
주식회사 휴메닉
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 휴메닉 filed Critical 주식회사 휴메닉
Publication of WO2021141186A1 publication Critical patent/WO2021141186A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/70—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mental therapies, e.g. psychological therapy or autogenous training
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • A61B5/02438—Detecting, measuring or recording pulse rate or heart rate with portable devices, e.g. worn by the patient
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/163—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/40—Detecting, measuring or recording for evaluating the nervous system
    • A61B5/4076—Diagnosing or monitoring particular conditions of the nervous system
    • A61B5/4088—Diagnosing of monitoring cognitive diseases, e.g. Alzheimer, prion diseases or dementia
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0044—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2205/00—General characteristics of the apparatus
    • A61M2205/35—Communication
    • A61M2205/3576—Communication with non implanted data transmission devices, e.g. using external transmitter or receiver
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2205/00—General characteristics of the apparatus
    • A61M2205/50—General characteristics of the apparatus with microprocessors or computers
    • A61M2205/502—User interfaces, e.g. screens or keyboards
    • A61M2205/507—Head Mounted Displays [HMD]

Definitions

  • the present invention relates to a multi-type cognitive rehabilitation training system and method.
  • the computer-based cognitive training program is a software therapy tool that increases and improves cognitive functions by consistently and repeatedly training the cognitive areas that have been specially reduced due to cognitive impairment.
  • the present invention is implemented in a multi-type capable of cognitive rehabilitation training for a plurality of trainees, so that a small number of occupational therapists (OTs) can efficiently control the group and perform simultaneous or individual training.
  • OTPs occupational therapists
  • a multi-type cognitive rehabilitation training system for group cognitive rehabilitation training, it communicates with user terminals corresponding to users participating in group cognitive rehabilitation training, and the user's access to the user terminals And it includes a manager terminal for controlling the execution of the training content, there is provided a multi-type cognitive rehabilitation training system, characterized in that the integrated management for users participating in group cognitive rehabilitation training is performed by the manager terminal.
  • the manager terminal includes a multi-user management unit for integrated management of users participating in group cognitive rehabilitation training, wherein the multi-user management unit includes a group login management module for managing access to users participating in group cognitive rehabilitation training and ; It may include an automatic matching module for automatically matching the users and the user terminals to change the difficulty level and change the team for the training content.
  • the multi-user management unit may further include an auto-run module for maintaining the group training by conducting training on behalf of the evacuees when one or more of the users deviate midway.
  • the multi-user management unit may further include a monitoring module for monitoring at least one of the user terminal status of the users, training time information and biometric information, and user status information.
  • the user terminal may include: a camera for photographing a user's face; an image analysis unit that analyzes the video of the face captured by the camera and measures a change in green luminance of the face surface; A biometric information monitoring unit for detecting a user's pulse and estimating a stress index based on the green luminance change may be included.
  • the user terminal is a VR device that is a head-mounted display capable of playing the 3D training content, and the VR device includes: an eye tracker installed on the front to measure the user's eye movement; and an IR sensor that is installed on the earphone provided on the side and measures the user's pulse wave and oxygen saturation.
  • the user terminal may further include a bio-information monitoring unit for determining the user's stress index based on the pulse wave and the oxygen saturation level or for diagnosing Alzheimer's disease based on the eye movement.
  • the manager terminal may further include an access control unit for synchronizing a training time by correcting a time difference caused by an access network for users belonging to the same training group.
  • the user terminal may include a camera for photographing the user's face, and the user terminal may automatically log in to the multi-type cognitive rehabilitation training service by recognizing the user's face through the camera.
  • a multi-type cognitive rehabilitation training method performed in a multi-type cognitive rehabilitation training system for group cognitive rehabilitation training user terminals are matched for users participating in group cognitive rehabilitation training, and group login is performed. managing; selecting group training content for the group cognitive rehabilitation training; controlling the user terminals to execute the group training content in the user terminals;
  • a multi-type cognitive rehabilitation training method comprising the step of integrally monitoring the users during the execution of the group training content.
  • cognitive rehabilitation training for a plurality of trainees is implemented as a multi-type, so that a small number of occupational therapists (OTs) can effectively control the group while performing simultaneous or individual training.
  • OTPs occupational therapists
  • FIG. 1 is a block diagram of a multi-type cognitive rehabilitation training system according to an embodiment of the present invention
  • FIG. 2 is a block diagram of a manager terminal included in a multi-type cognitive rehabilitation training system according to an embodiment of the present invention
  • FIG. 3 is a flowchart of a multi-type cognitive rehabilitation training method according to an embodiment of the present invention.
  • FIG. 4 is a flowchart of a method for synchronizing training time points of the same group of users in a multi-type cognitive rehabilitation training system according to an embodiment of the present invention
  • 6 to 12 are exemplary screens related to the group training user management program
  • FIG. 13 is a conceptual diagram of a VR device for using 3D group training content applied to a multi-type cognitive rehabilitation training system according to an embodiment of the present invention
  • FIGS. 14 to 17 are diagrams illustrating a face recognition process executed in a user terminal
  • FIG. 1 is a configuration diagram of a multi-type cognitive rehabilitation training system according to an embodiment of the present invention
  • FIG. 2 is a configuration block diagram of a manager terminal included in a multi-type cognitive rehabilitation training system according to an embodiment of the present invention
  • FIG. 6 12 to 12 are exemplary screens related to a group training user management program.
  • the multi-type cognitive rehabilitation training system 10 provides group training for users who require cognitive rehabilitation training (users, trainers, hereinafter collectively referred to as 'users') to lead cognitive function improvement It is characterized by being able to To this end, a plurality of user terminals are implemented so that they can be easily managed in one manager terminal operated by an occupational therapist (OT, manager, hereinafter collectively referred to as 'manager').
  • OT occupational therapist
  • the multi-type cognitive rehabilitation training system 10 includes a plurality of user terminals (200-1 to N, hereinafter may be collectively referred to as '200') and the manager terminal 100.
  • the user terminal 200 is a terminal assigned to a user requiring cognitive rehabilitation training, and may be a computing device of a smartphone, tablet, PC, etc. in which cognitive rehabilitation training contents in the form of software or programs can be executed.
  • a camera 210 for monitoring the user's cognitive rehabilitation training situation may be connected to the user terminal 200 .
  • the user terminal 200 may be connected to a VR device 220 capable of executing 3D training content for realistic cognitive rehabilitation training.
  • the VR device 220 may be a head mounted display (HMD).
  • the user accesses (login) the service for cognitive rehabilitation training.
  • the training content selected by the manager's group management when executed in the user terminal 200 , it may be visually and/or aurally output through an output device provided in the user terminal 200 .
  • the output device is a display device, a visual screen may be displayed, and if the output device is an audio device, an auditory sound may be output.
  • Some user terminals 200 - 1 and 200 - 2 are used by users located in a designated training space, and may be connected to the manager terminal 100 through an internal network.
  • the user terminal 200-N used by the user may be connected to the manager terminal 100 through an external network. have.
  • the manager terminal 100 is a terminal operated by the manager, and may be one of a smartphone, a tablet, a PC, etc. equipped with a program (group training user management program) for managing users individually or in groups. have. Example screens related to the group training user management program are shown in FIGS. 6 to 12 .
  • the manager terminal 100 may include a multi-user management unit 110 and an access control unit 120 .
  • the multi-user management unit 110 individually and integrally manages a plurality of users to provide cognitive rehabilitation training for a plurality of users.
  • the multi-user management unit 110 may include a group login management module 111 that enables the manager terminal 100 to control access to a user corresponding to each user terminal 200 .
  • user management, PC management, individual, and group screens may be implemented in a tab form.
  • the manager can control login or logout for a specific user. Based on the user information input through the user management screen, with respect to the plurality of user terminals 200, a user using each user terminal 200 may be matched and training may be performed.
  • a plurality of user terminals 200 managed by the manager terminal 100 are displayed (see FIGS. 6 and 7 ).
  • ten user terminals are indicated by PC1 to PC10.
  • connection status icon of the corresponding user terminal 200 is displayed at the upper left of the PC item 510 .
  • the connection status icon may be green when the connection is in progress, yellow when the connection is waiting, and red when the connection is unavailable.
  • a search interface for searching for a user registered through the user management screen may be provided on one side of the PC management screen.
  • the assigned user terminal 200 may be matched.
  • the first user terminal PC1 allocated to the Hong Gil-dong user information about the user matched with the PC item may be displayed.
  • the user information displayed on the PC item may include one or more of name, gender, date of birth, and access time.
  • the user may be matched by dragging and dropping the icon for the user searched on the right side of the screen into the PC item corresponding to the user terminal (see User Kim Young-hee and PC2 item in FIG. 7 ). Through this, the manager can intuitively match the user and the user terminal.
  • training contents executable by the user terminal selected from among the user terminals managed by the manager terminal 100 may be displayed (see FIG. 8 ).
  • the manager terminal 100 may select and execute training content necessary for the user matched with the corresponding user terminal.
  • an execution screen of the training content currently being executed in the corresponding user terminal may be displayed.
  • the display of the execution screen may be, for example, a pop-up window method.
  • the manager can check the training screen of the user through the manager terminal 100 for any user without going directly to the location where the user terminal 200 is located.
  • a room item 520 for a plurality of users to perform group training together is displayed (see FIGS. 9 and 10 ).
  • group training content to be executed eg, a game
  • users participating in the corresponding group training may be displayed.
  • a room interface 521 capable of selecting content, selecting participants, and adjusting a team may be displayed.
  • the running game information and training monitoring information corresponding to the user may be checked. Through this, it is possible to monitor the progress of individual training for individual users during the group training process.
  • FIG. 11 shows a case where one user for group training is registered
  • FIG. 12 shows a case where a plurality of users for group training are registered.
  • One user is matched for each PC item, and brief information about each user is displayed, so the manager can monitor the individual training progress in an integrated way.
  • the multi-user management unit 110 may further include an automatic matching module 113 .
  • an automatic matching module 113 In the past, managers had to go to each user's computer one by one to change the difficulty level and change the team. However, in this embodiment, the manager terminal 100 through the automatic matching module 113 can easily adjust the details of cognitive rehabilitation training such as difficulty change and team change for each user through individual screens or group screens. .
  • the multi-user management unit 110 may further include an auto-run module 115 .
  • the auto-run module 115 enables automatic training progress even in a state where at least one of the users participating in the group training has no training-related action.
  • the auto-run module 115 automatically replaces the action of the mid-way runner with a predefined standard action so that the group for training is maintained even in a situation where more than one person departs midway, so that training through the training content is performed. can make it run smoothly.
  • the multi-user management unit 110 may further include a monitoring module 117 .
  • the monitoring module 117 may check the power state of the corresponding terminal based on terminal information provided from each user terminal 200 .
  • the user terminal is a smartphone or tablet to which power is not supplied at all times, it is possible to check the power state in the manager terminal 100 (see FIG. 7 ), thereby preventing user departure due to a power problem in advance.
  • the monitoring module 117 may provide training time information such as usage time and accumulated training time for each user.
  • the monitoring module 117 is provided in the user terminal 200 or measured using a device linked to the user's biometric information and / or user status information based on the biometric information (stress index, Alzheimer's diagnosis, etc.) to the user terminal Received from 200, it can be stored and managed in response to each user.
  • manager terminal 100 may further include an access control unit 120 in addition to the multi-user management unit 110 .
  • the access control unit 120 may synchronize training time points by correcting a time difference caused by an access network for user terminals belonging to the same training group.
  • the access control unit 120 may compensate for this difference in response time so that group training can be performed smoothly regardless of the user's location. The time difference correction will be described in more detail later.
  • FIG. 3 is a flowchart of a multi-type cognitive rehabilitation training method according to an embodiment of the present invention.
  • Each step of the multi-type cognitive rehabilitation training method according to this embodiment may be performed in each component of the multi-type cognitive rehabilitation training system 10 described above, in particular, the manager terminal 100 .
  • the manager terminal 100 matches multi-users for each user terminal 200 within the PC item managed by the manager terminal 100 (step S310 ).
  • Multi-user means users participating in group training.
  • the matching relationship between the multi-user and the user terminal may be displayed as a PC item as described above.
  • the manager terminal 100 selects content for group training (step S320).
  • the group training content may include 2D training content or 3D training content.
  • 2D training content can be selected, and when the user terminal is equipped with a VR device, 3D training content can be selected.
  • the manager terminal 100 controls to execute the group training content for the user terminals belonging to the training group (step S330).
  • the user terminal state, the training situation, etc. are monitored for each of the multi-users (step S340).
  • the monitoring results may be converted into training results for each multi-user and stored in a database.
  • management may be performed individually for each of the multi-users participating in the group training (step S350). As shown in FIG. 8 , it is possible to check the currently running training content through the personal screen check. As shown in Fig. 9, by selecting a user icon, it is also possible to individually monitor the running game information and the training state.
  • FIG. 4 is a flowchart of a training time synchronization method of the same group of users in a multi-type cognitive rehabilitation training system according to an embodiment of the present invention
  • FIG. 5 is a table showing before and after correction of CPU occupancy and response time.
  • the access control unit 120 of the manager terminal 100 described above corrects the difference in training timing that may occur depending on the actual location so that effective group training can be performed for the same group users, so that all group members receive training at the same place. A similar situation can be provided.
  • a home user may access the manager terminal 100 through the Internet.
  • Other users may access the manager terminal 100 through their own network.
  • the home user may be given an ID assigned by the manager terminal 100 and participate in group training through the manager terminal 100 .
  • the manager terminal 100 divides the internal CPU to provide capacity to be used by home users (step S410). Default CPU share can be assigned to home users and internal users.
  • the time difference between users caused by the communication time difference By correcting the time difference between users caused by the communication time difference, it is possible to make it appear to be used in real time. To this end, the time difference with other internal users can be corrected by identifying the signal input by the home user during group training and processing it first.
  • test game may be provided for time synchronization between the home user and the internal user (step S420).
  • a response time before correction for each user is acquired (step S430).
  • the CPU occupancy corresponding to the response time before correction is adjusted (step S440).
  • the CPU occupancy can be increased, and when the response time is relatively short, the CPU occupancy can be decreased.
  • the time difference may be corrected by making the response time difference for each user within the error range (step S450).
  • A is a home user accessing through an external remote network
  • B and C are internal users in a group training site, and they all belong to the same training group.
  • the required error range in this example is 0.5 seconds.
  • A's response time is 5 seconds
  • B's response time is 3.5 seconds
  • C's response time is 2 seconds.
  • smooth group training is difficult because A and C have a time difference of 3 seconds.
  • A's CPU occupancy can be raised to 50%, B's CPU occupancy can be changed to 35%, and C's occupancy can be changed to 15%.
  • CPU occupancy can be adjusted similarly to the length of response time.
  • the response time becomes 2.8 seconds for A, 2.5 seconds for B, and 2.5 seconds for C, so the time difference of up to 0.3 seconds can be included within the error range.
  • the time required for the calculation may be included in the loading time before the execution of the training content.
  • the camera 210 may be used for monitoring and analyzing biometric information for each user who is a group training participant.
  • the user terminal 200 may include a biometric information monitoring unit and an image analysis unit 202 connected to the camera 210 .
  • a user's face is photographed using the camera 210, and the image analysis unit 202 analyzes the captured video in real time.
  • the image analysis unit 202 After recognizing the user's face in the video, the image analysis unit 202 enlarges a part of the skin of the face surface. Since the face recognition method is obvious to those skilled in the art to which the present invention pertains, a detailed description thereof will be omitted.
  • the biometric information monitoring unit 204 may measure a heartbeat according to the skin color change and determine the user's stress index based on this.
  • the skin color change may be a green luminance change of the face surface.
  • Hemoglobin has the property of easily absorbing green light.
  • the pulse can be detected by capturing the green luminance change.
  • the image analysis unit 202 calculates the average luminance of each color by dividing the image into RGB components for each frame in the video of the photographed face. Then, noise common to each color is removed and only the green luminance waveform is extracted.
  • the biometric information monitoring unit 204 may estimate the heart rate based on this.
  • the stress index if the heart rate is out of the normal range of 60 to 90, it can be judged as stress. That is, when bradycardia of 60 or less or tachycardia of 90 or more continues for a certain period of time, it can be determined as a stress state.
  • LED When measuring heart rate, LED can be used in addition to image analysis using a camera.
  • An LED light emitting unit and a phototransistor light receiving unit may be disposed at a portion touched by a user's finger. Hemoglobin contained in blood can detect a pulse from the LED reflected light irradiated to the finger by using the property of easily absorbing green wavelength light.
  • FIG. 13 is a conceptual diagram of a VR device for using 3D group training contents applied to a multi-type cognitive rehabilitation training system according to an embodiment of the present invention.
  • the VR device 220 for executing the 3D group training content may be provided in the user terminal 200 -N.
  • the VR device 220 is a head mounted display as shown in FIG. 13
  • the 3D group training content may be VR (Virtual Reality) or AR (Augmented Reality) based cognitive rehabilitation training content. have.
  • the VR device 220 may include a display on which 3D group training content is reproduced inside the front side.
  • the user may perform 3D group training by wearing the VR device 220 and gazing at the inner display.
  • An eye tracker 222 for measuring the user's eye movement may be installed on the front of the VR device 220 .
  • the IR sensor 224 may be installed on the side of the VR device 220 .
  • the IR sensor 224 is mounted on the user's ear, and can measure the user's pulse wave and oxygen saturation.
  • the biometric information monitoring unit 204 may determine the user's stress index based on the pulse wave and oxygen saturation measured by the IR sensor 224 or diagnose Alzheimer's based on the eye movement measured by the eye tracker 222 . .
  • the light irradiated from the IR sensor 224 may pass through the ear blood vessel, and the transmitted light may be detected by the receiver. Some of the light is absorbed by the tissues and the skin and blood filled arteries, increasing the absorbance. Absorbance is lower when the artery is empty.
  • fixation elements ie, skin and tissue
  • fixation elements ie, skin and tissue
  • both oxygenated and coral-depleted blood can be measured, so two wavelengths of light can be detected.
  • the pulse oximeter pulse oximeter
  • the pulse oximeter has a significantly higher IR absorption rate of oxygen-rich hemoglobin with respect to oxidized hemoglobin than that of low-oxygen hemoglobin, oxygen saturation can be judged by comparing the two values.
  • the eye tracker 222 measures the user's eye movement. After having the user gaze at the central gaze point, when the surrounding gaze point appears, the user can quickly move the gaze to the changed gaze point to examine the quick view. Alzheimer's patients can be classified as suspected of Alzheimer's if the delay time is increased during the rapid viewing process, and the delay time of the rapid viewing is accumulated and lengthened at the continuously presented gaze points based on this.
  • the reverse quick viewing test may be performed by instructing the user to move the eye in a direction opposite to the presented target.
  • Alzheimer's patients have lower accuracy in reverse fast viewing, and if errors persist because they do not correct well after making errors, they can be classified as suspected of Alzheimer's.
  • biometric information for individual users can be monitored using the IR sensor 224, the eye tracker 222, and the like, and stress index measurement or Alzheimer's disease diagnosis can be performed.
  • recognition of a user connected using an arbitrary user terminal 200 may be performed through automatic face recognition.
  • the user terminal 200 may be provided with a camera 210 as shown in FIG. 1 .
  • the camera 210 of the user terminal 200 disposed in the seat automatically recognizes and stores the face.
  • the manager inputs information such as a user's name, the face and personal information are matched and finally stored.
  • login may be performed through the automatic face recognition function. After logging in, you can participate in multi-training or view standard training data.
  • the face recognition performed by the image analyzer 202 may be implemented by applying the ResNet algorithm.
  • the face recognition solution itself follows the ResNet algorithm, but if the user is a child in a growing stage and the face changes over time, the next step can be taken for a stable face recognition login.
  • Face recognition is first performed on user B (step S600).
  • the face of user B who reconnected after a certain period of time, is photographed while recognizing and updated with the latest face information (step S710).
  • the update period of the face information may be set according to the age of the user, and when the user is in the growth stage, the update period may be set relatively short.
  • the user's face is recognized.
  • simple personal information about the user may also be input.
  • the personal information input together may include at least one of gender, name, and date of birth.
  • the manager When a user's face is recognized for the first time, the manager inputs user personal information such as name, date of birth, and diagnosis name after face recognition is performed, so that the user can be additionally stored by matching the recognized face information (refer to FIGS. 15 and 16 ) ).
  • FIG. 17 illustrates a main login screen after a user is added. There are individual tabs and group tabs on the main login screen, allowing you to select individual cognitive rehabilitation training or group cognitive rehabilitation training to perform training.
  • the above-described multi-type cognitive rehabilitation training method may be implemented in the form of a recording medium including instructions executable by a computer, such as an application or program module executed by a computer.
  • Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media.
  • Computer-readable media may include computer storage media.
  • Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.
  • the above-described multi-type cognitive rehabilitation training method may be executed by an application basically installed in the terminal (which may include a program included in a platform or operating system basically mounted on the terminal), and the user may use an application store server, an application or It may be executed by an application (ie, a program) installed directly on the master terminal through an application providing server such as a web server related to the corresponding service.
  • the aforementioned multi-type cognitive rehabilitation training method may be implemented as an application (ie, program) installed by default in the terminal or directly installed by the user and recorded in a computer-readable recording medium such as a terminal.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Public Health (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Pathology (AREA)
  • Veterinary Medicine (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Physics & Mathematics (AREA)
  • Psychology (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Psychiatry (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Child & Adolescent Psychology (AREA)
  • Developmental Disabilities (AREA)
  • Hospice & Palliative Care (AREA)
  • Social Psychology (AREA)
  • Data Mining & Analysis (AREA)
  • Cardiology (AREA)
  • Databases & Information Systems (AREA)
  • Neurology (AREA)
  • Physiology (AREA)
  • Educational Technology (AREA)
  • Acoustics & Sound (AREA)
  • Anesthesiology (AREA)
  • Hematology (AREA)
  • Neurosurgery (AREA)
  • Rehabilitation Tools (AREA)

Abstract

Sont divulgués un système et un procédé d'apprentissage de réadaptation cognitive de types multiples. Un système d'apprentissage de réadaptation cognitive de types multiples selon un mode de réalisation de la présente invention comprend un terminal de gestion pour communiquer avec des terminaux d'utilisateur, qui correspondent aux utilisateurs participant à un apprentissage de réadaptation cognitive de groupe, et à réguler des accès des utilisateurs et l'exécution d'un contenu d'apprentissage par rapport aux terminaux d'utilisateur, les utilisateurs participant à l'apprentissage de réadaptation cognitive de groupe pouvant être gérés par le terminal de gestion d'une manière intégrée.
PCT/KR2020/007726 2020-01-09 2020-06-15 Système et procédé d'apprentissage de réadaptation cognitive de types multiples WO2021141186A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020200002850A KR102427569B1 (ko) 2020-01-09 2020-01-09 멀티형 인지재활 훈련 시스템 및 방법
KR10-2020-0002850 2020-01-09

Publications (1)

Publication Number Publication Date
WO2021141186A1 true WO2021141186A1 (fr) 2021-07-15

Family

ID=76788113

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2020/007726 WO2021141186A1 (fr) 2020-01-09 2020-06-15 Système et procédé d'apprentissage de réadaptation cognitive de types multiples

Country Status (2)

Country Link
KR (1) KR102427569B1 (fr)
WO (1) WO2021141186A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024043433A1 (fr) * 2022-08-22 2024-02-29 Lg Electronics Inc. Dispositif de traitement d'image interagissant avec un équipement d'entraînement en force

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120094321A (ko) * 2011-02-16 2012-08-24 주식회사 엔씨소프트 온라인 게임 클라이언트간 피어 투 피어 통신방법
KR20160054325A (ko) * 2014-11-06 2016-05-16 장재윤 맞춤형 개인 트레이닝 관리 시스템 및 방법
KR20170100182A (ko) * 2016-02-25 2017-09-04 롤스톤 주식회사 스포테인먼트시스템
KR20170127123A (ko) * 2016-05-11 2017-11-21 (주)메디즈 그룹형 인지재활 시스템
KR20180068917A (ko) * 2018-06-08 2018-06-22 주식회사 옴니씨앤에스 생체 정보를 이용하여 정신 건강을 관리하기 위한 방법, 시스템 및 비일시성의 컴퓨터 판독 가능 기록 매체

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100805274B1 (ko) 2007-01-16 2008-02-20 성신여자대학교 산학협력단 게임을 이용한 인지 장애 치료 방법 및 그 기록 매체,게임을 이용한 인지 장애 치료 장치
KR101711093B1 (ko) * 2015-02-11 2017-03-02 울산과학기술원 치매의 자가 조기 진단 및 훈련을 위한 안구 운동 및 지각 기능 기반 가상현실 시스템
KR101738278B1 (ko) * 2015-12-31 2017-05-22 성균관대학교산학협력단 영상을 이용한 감정 인식 방법
KR20180045278A (ko) * 2016-10-25 2018-05-04 포항공과대학교 산학협력단 생체신호연동 가상현실 인지재활 시스템

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120094321A (ko) * 2011-02-16 2012-08-24 주식회사 엔씨소프트 온라인 게임 클라이언트간 피어 투 피어 통신방법
KR20160054325A (ko) * 2014-11-06 2016-05-16 장재윤 맞춤형 개인 트레이닝 관리 시스템 및 방법
KR20170100182A (ko) * 2016-02-25 2017-09-04 롤스톤 주식회사 스포테인먼트시스템
KR20170127123A (ko) * 2016-05-11 2017-11-21 (주)메디즈 그룹형 인지재활 시스템
KR20180068917A (ko) * 2018-06-08 2018-06-22 주식회사 옴니씨앤에스 생체 정보를 이용하여 정신 건강을 관리하기 위한 방법, 시스템 및 비일시성의 컴퓨터 판독 가능 기록 매체

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024043433A1 (fr) * 2022-08-22 2024-02-29 Lg Electronics Inc. Dispositif de traitement d'image interagissant avec un équipement d'entraînement en force

Also Published As

Publication number Publication date
KR20210090305A (ko) 2021-07-20
KR102427569B1 (ko) 2022-08-02

Similar Documents

Publication Publication Date Title
WO2018169330A1 (fr) Systèmes et procédés permettant de déterminer des défauts dans le champ visuel d'un utilisateur
US20180338710A1 (en) Systems and methods for markerless tracking of subjects
US20180333092A1 (en) Portable ocular response testing device and methods of use
CN107169309B (zh) 基于头戴式检测设备的视野检测方法、系统及检测装置
US20220148728A1 (en) System and method for analyzing stress of user and managing individual mental health, using hmd device having biosignal sensors mounted therein
CN102686145A (zh) 可视化测试和/或训练
WO2021141186A1 (fr) Système et procédé d'apprentissage de réadaptation cognitive de types multiples
WO2021075641A1 (fr) Appareil numérique et application pour thérapie de la myopie
WO2021040327A1 (fr) Appareil et procédé de prédiction du facteur de risque cardiovasculaire
US20210369115A1 (en) Telemetry monitoring and assessment system of parameters of human vital functions and clinical signs of possible functional disorders and determination of methods of control
US10631727B2 (en) Method and system for detecting time domain cardiac parameters by using pupillary response
WO2013141667A1 (fr) Système produisant des informations quotidiennes sur la santé et procédé produisant des informations quotidiennes sur la santé
WO2023106555A1 (fr) Procédé, dispositif et système de gestion et de régulation du niveau de concentration d'un utilisateur d'un dispositif enregistré de réalité étendue
WO2016167459A1 (fr) Procédé pour exprimer une présence sociale d'un avatar virtuel, à l'aide d'un changement de taille de pupille selon des battements cardiaques, et système l'utilisant
WO2019164273A1 (fr) Méthode et dispositif de prédiction de temps de chirurgie sur la base d'une image chirurgicale
WO2023140676A1 (fr) Procédé et dispositif électronique de gestion du stress d'un utilisateur
CN115813343A (zh) 儿童行为异常评估方法和系统
FR3123795A1 (fr) Système d’aide pour fournir une information de diagnostic
WO2021025507A1 (fr) Système et procédé de dépistage de l'hypotension orthostatique en utilisant un algorithme d'apprentissage automatique basé sur la fréquence cardiaque, et dispositif de mesure à porter sur soi
KR20220063705A (ko) 휴대용 의료 진단 장치 및 이를 이용한 질병 진단 방법
WO2020116739A1 (fr) Dispositif et procédé de prédiction d'un malaise vécu par un·e utilisateur·trice lors de la visualisation d'un contenu de réalité virtuelle
US10667714B2 (en) Method and system for detecting information of brain-heart connectivity by using pupillary variation
WO2021107433A1 (fr) Procédé et appareil pour déterminer l'évolution structurelle d'une maladie oculaire
WO2020209401A1 (fr) Appareil d'imagerie oculaire
WO2022103119A1 (fr) Dispositif de diagnostic médical portable et procédé de diagnostic de maladie utilisant celui-ci

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20912281

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20912281

Country of ref document: EP

Kind code of ref document: A1