KR20160112037A - Customizable reminiscence therapy device and method using the user response feedback - Google Patents
Customizable reminiscence therapy device and method using the user response feedback Download PDFInfo
- Publication number
- KR20160112037A KR20160112037A KR1020150036566A KR20150036566A KR20160112037A KR 20160112037 A KR20160112037 A KR 20160112037A KR 1020150036566 A KR1020150036566 A KR 1020150036566A KR 20150036566 A KR20150036566 A KR 20150036566A KR 20160112037 A KR20160112037 A KR 20160112037A
- Authority
- KR
- South Korea
- Prior art keywords
- user
- multimedia
- multimedia data
- reaction
- age
- Prior art date
Links
Images
Classifications
-
- G06F19/345—
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
-
- G06F19/3406—
-
- G06F19/3431—
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Z—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS, NOT OTHERWISE PROVIDED FOR
- G16Z99/00—Subject matter not provided for in other main groups of this subclass
Landscapes
- Health & Medical Sciences (AREA)
- Hematology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Psychology (AREA)
- Engineering & Computer Science (AREA)
- Anesthesiology (AREA)
- Biomedical Technology (AREA)
- Acoustics & Sound (AREA)
- Physics & Mathematics (AREA)
- Heart & Thoracic Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Medical Treatment And Welfare Office Work (AREA)
Abstract
Description
BACKGROUND OF THE
Korea, which has reached an aging society in 2000, is expected to become an aging society in 2017 and an aging society in 2026. Along with this rapid aging, the prevalence of dementia in the elderly is expected to increase from 9.58% (610,000) in 2014 to 10.39% (840,000) in 2020 and 15.06% (2.17 million) in 2050. Therefore, management of dementia of the elderly is necessary.
Dementia management is largely divided into pharmacotherapy and nonpharmacologic therapy, and nonpharmacologic therapy means all methods used to alleviate dementia symptoms and improve quality of life without the use of medication.
The advantages of non - pharmacotherapy such as cognitive therapy, music therapy, art therapy and recall therapy are complementary to pharmacotherapy with the risk of adverse effects of long - term use and limitations of therapeutic effect. Therefore, the elderly nursing care facilities in hospitals also utilize various non - medication interventions as part of cognitive training programs.
In particular, reminiscence therapy has the effect of improving self-esteem, overcoming depression, and stimulating the vitality of life by allowing the elderly to remember positive and pleasant experiences and to talk with others.
Therefore, it is necessary to develop an automated system for solving the problem of dementia using this recall therapy.
Korean Patent Registration No. 10-0931312 discloses a method and apparatus for searching an automatic or manual record relating to past events and objects based on a keyword or category and expressing the result in various media such as poetry, To a recall system and method using a past record retrieval using the retrieval history as a medium for recall.
Korean Patent Laid-Open Publication No. 10-2009-0097173 discloses a memory training through a visual journal using a capture event sequence to improve memory loss of a user having a diagnosed memory disease such as acquired brain injury or a neurodegenerative disease such as Alzheimer's disease .
The present invention provides a personalized recall therapy apparatus and method using at least one of images, images, and music associated with a user and recognizing a user's emotional behavior reaction and stimulating a user's memory The purpose is to provide.
It is another object of the present invention to provide a customized recall therapy apparatus and method using a user reaction to prevent a mental disease such as dementia or prevent a mental disease from getting worse by inducing a user to recall.
In order to achieve the above object,
The personalized recall therapy apparatus using the user reaction according to the present invention may include a reaction sensing unit for sensing a reaction of a user and a date of the multimedia data that caused the sensed reaction, To gradually induce recall.
An input unit for receiving at least one of multimedia data related to the user and multimedia data related to the mass media, and a database for storing the received multimedia data classified by dates.
Wherein the control unit recognizes the reaction of the user and analyzes the age of the multimedia that caused the recognized reaction and provides the user with the multimedia data related to the analyzed age in a chronological order, Wherein the multimedia designing unit designates the multimedia to feedback the user's response to the data to gradually induce the user's recall.
The control unit may further comprise a database construction unit for storing the received multimedia data in a database by building a database for each generation.
And the reaction analyzing unit recognizes at least one reaction of the user's facial expression, voice, and behavior.
The multimedia designing unit may design the multimedia using a storytelling technique.
The multimedia designing unit may design the multimedia using a closed loop for the feedback.
A customized recall treatment method using a user reaction according to the present invention includes the steps of: sensing a reaction of a user; analyzing a date of multimedia that has caused at least one reaction of the user's facial expression, voice and behavior; Providing the multimedia data related to the multimedia data to the user, and designing the multimedia to feedback the user's response to the provided multimedia data to gradually induce the user's recall.
Receiving at least one of the multimedia data related to the user and the multimedia data related to the mass media, and storing the received multimedia data classified according to the chronological order.
The personalized recall therapy apparatus and method using the user response according to the present invention can provide at least one of images, images and music related to the user to the user and can stimulate the user's memory by recognizing the emotional behavior reaction of the user.
In addition, it can induce the user to recall, thereby preventing the mental disease such as dementia or preventing the mental disease from becoming worse.
1 is a block diagram for explaining a customized recall therapy apparatus according to an embodiment of the present invention.
2 is a block diagram for explaining the control unit shown in FIG. 1 in more detail.
FIG. 3 is a block diagram for explaining the database shown in FIG. 1 in more detail.
4 is an exemplary diagram for explaining facial expression recognition according to an embodiment of the present invention.
5 is an exemplary diagram for explaining a reaction analysis for facial expression recognition according to an embodiment of the present invention.
6 is an exemplary diagram for explaining behavior recognition according to an embodiment of the present invention.
7 is an exemplary diagram for explaining a reaction analysis for behavior recognition according to an embodiment of the present invention.
FIG. 8 is an exemplary diagram illustrating a method of performing a customized recall therapy apparatus according to an embodiment of the present invention.
9 is a flowchart for explaining a customized recall treatment method according to an embodiment of the present invention.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals as used in the appended drawings denote like elements, unless indicated otherwise. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather obvious or understandable to those skilled in the art.
1 is a block diagram for explaining a customized recall therapy apparatus according to an embodiment of the present invention.
Referring to FIG. 1, a customized
The customized
The
In particular, the
The
The RGBD camera may be a Kinect. Kinect is sold by Microsoft in 2010 and includes a camera sensor for receiving color images, two depth sensor sensors, four microphone arrays for voice recognition, and a tilt motor.
Here, the
The
In particular, in order to induce the user's recall, the
The
Here, the
The
At this time, the
2 is a block diagram for explaining the control unit shown in FIG. 1 in more detail.
Referring to FIG. 2, the
The generation unit
In particular, the age-specific
The
The
In detail, the
That is, the
At this time, the
For this, the
The
In one embodiment, the
For example, if the user's response is joyful, the
FIG. 3 is a block diagram for explaining the database shown in FIG. 1 in more detail.
Referring to FIG. 3, the
The
The
In particular, the
The
In particular, the
FIG. 4 is an exemplary view for explaining facial expression recognition according to an embodiment of the present invention. More specifically, FIG. 4 (a) is an exemplary view showing an embodiment of performing facial expression recognition using an active form model, Fig. 4 (b) is an exemplary diagram showing another embodiment for recognizing facial expressions using the active form model. 5 (a) and 5 (b) are views for explaining the reaction analysis of facial expression recognition according to an embodiment of the present invention. More specifically, FIG. 5 (a) b) is an example in which the user's facial expression is analyzed with a happy expression.
4 and 5, the
The
The
At this time, the user's facial expression may be one of emotion of joy, pleasure, sadness, angryness, surprise, and excitement.
FIG. 6 is an exemplary view for explaining behavior recognition according to an embodiment of the present invention. More specifically, FIG. 6 (a) is an illustration showing an actual image of a user, and FIG. 6 (b) Fig. 6 (c) is an example of recognizing the palm portion in Fig. 6 (b). Fig. 7 is an exemplary diagram for explaining a reaction analysis for behavior recognition according to an embodiment of the present invention.
Referring to FIGS. 6 and 7, the
The
FIG. 8 is an exemplary diagram illustrating a method of performing a customized recall therapy apparatus according to an embodiment of the present invention.
Referring to FIG. 8, the customized
The personalized
The personalized
If the user reaction is detected, the customized
In particular, the personalized
9 is a flowchart for explaining a customized recall treatment method according to an embodiment of the present invention.
Referring to FIG. 9, the customized recall treatment method provides the user with at least one of images, images, and music associated with the user, and recognizes the user's emotional behavioral response to stimulate the user's memory. In addition, the customized recall treatment method induces the user to recall to prevent mental illness such as dementia or prevent mental illness from getting worse.
In the first step, the multimedia related to the user is output for each generation (S100). The personalized
The second step recognizes the user's reaction (S110). The personalized
At this time, if the user's reaction is not recognized, the
The third step outputs the multimedia of the age in which the user's reaction occurs (S120). The personalized
The fourth step recognizes the user's reaction (S130). The personalized
In the fifth step, the multimedia that the user has responded to is intensively output (S140). The personalized
The sixth step determines whether there is no multimedia to be outputted to the user (S150). The customized
The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer apparatus is stored. Examples of the computer-readable recording medium include a hard disk, a ROM, a RAM, a CD-ROM, a hard disk, a magnetic tape, a floppy disk, an optical data storage device, And the like.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation in the embodiment in which said invention is directed. It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the scope of the appended claims.
1: Customized reminiscence treatment device
110: input unit
120: reaction detection unit
130:
140:
150: Database
210: DB building section by generation
220: reaction analysis section
230: Multimedia Design Department
310: user multimedia database
320: Multimedia database for each generation
Claims (9)
And a controller for analyzing the age of the multimedia data that caused the sensed response and gradually providing multimedia data related to the analyzed age to the user to induce recall.
An input unit for receiving at least one of multimedia data related to the user and multimedia data related to a mass media; And
Further comprising a database in which the received multimedia data is categorized and stored according to an age.
Wherein,
A reaction analyzer for recognizing the reaction of the user and analyzing the age of the multimedia causing the recognized reaction; And
And multimedia data related to the analyzed ages is provided to the user on an aged basis and the multimedia is designed to gradually feedback the user's feedback on the provided multimedia data to induce the user to recall the multimedia data. And a multimedia designing unit.
Wherein,
Further comprising a database construction unit for storing the received multimedia data in a database by building a database for each generation.
The reaction-
Wherein the user recognizes at least one of a facial expression, a voice, and a behavior of the user.
The multimedia designing unit,
Wherein the multimedia is designed using a storytelling technique.
The multimedia designing unit,
And a multimedia is designed by using a closed loop for the feedback.
Analyzing the age of the multimedia that caused at least one of the user's facial expression, voice, and behavior;
Providing the user with multimedia data related to the analyzed age; And
And designing the multimedia to feedback the user's response to the provided multimedia data to gradually induce the user's recall.
Receiving at least one of multimedia data related to the user and multimedia data related to a mass media; And
Further comprising the step of classifying and storing the received multimedia data by age.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150036566A KR20160112037A (en) | 2015-03-17 | 2015-03-17 | Customizable reminiscence therapy device and method using the user response feedback |
PCT/KR2016/002634 WO2016148499A1 (en) | 2015-03-17 | 2016-03-16 | Customized reminiscence therapy device and method using user reaction feedback |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150036566A KR20160112037A (en) | 2015-03-17 | 2015-03-17 | Customizable reminiscence therapy device and method using the user response feedback |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020170065166A Division KR20170061654A (en) | 2017-05-26 | 2017-05-26 | Customizable reminiscence therapy device and method using the user response feedback |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20160112037A true KR20160112037A (en) | 2016-09-28 |
Family
ID=56920306
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150036566A KR20160112037A (en) | 2015-03-17 | 2015-03-17 | Customizable reminiscence therapy device and method using the user response feedback |
Country Status (2)
Country | Link |
---|---|
KR (1) | KR20160112037A (en) |
WO (1) | WO2016148499A1 (en) |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002007560A (en) * | 2000-06-19 | 2002-01-11 | Az-Navi:Kk | Recollection database system and medium with recorded recollection support program |
KR100931312B1 (en) * | 2007-12-10 | 2009-12-11 | 한국전자통신연구원 | Recall system and method through past record retrieval |
KR101239483B1 (en) * | 2010-04-20 | 2013-03-06 | 가톨릭대학교 산학협력단 | Psychological cure apparatus and method therefor |
KR101589071B1 (en) * | 2013-07-17 | 2016-01-27 | 문경업 | Method for providing cognitive rehabilitation contents based on cognitive ability grade, and mobile device for implementing the same |
-
2015
- 2015-03-17 KR KR1020150036566A patent/KR20160112037A/en active Application Filing
-
2016
- 2016-03-16 WO PCT/KR2016/002634 patent/WO2016148499A1/en active Application Filing
Also Published As
Publication number | Publication date |
---|---|
WO2016148499A1 (en) | 2016-09-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Lapierre et al. | The state of knowledge on technologies and their use for fall detection: A scoping review | |
Grünerbl et al. | Smartphone-based recognition of states and state changes in bipolar disorder patients | |
Dogan et al. | Smartphone-based monitoring of objective and subjective data in affective disorders: where are we and where are we going? Systematic review | |
Alcañiz et al. | Eye gaze as a biomarker in the recognition of autism spectrum disorder using virtual reality and machine learning: A proof of concept for diagnosis | |
Li et al. | Applications of artificial intelligence to aid early detection of dementia: a scoping review on current capabilities and future directions | |
Goffaux et al. | The respective role of low and high spatial frequencies in supporting configural and featural processing of faces | |
US6540674B2 (en) | System and method for supervising people with mental disorders | |
Tröger et al. | Telephone-based dementia screening I: automated semantic verbal fluency assessment | |
Hernandez et al. | Guidelines for assessing and minimizing risks of emotion recognition applications | |
Ntracha et al. | Detection of mild cognitive impairment through natural language and touchscreen typing processing | |
JPWO2016120955A1 (en) | BEHAVIOR PREDICTION DEVICE, BEHAVIOR PREDICTION DEVICE CONTROL METHOD, AND BEHAVIOR PREDICTION DEVICE CONTROL PROGRAM | |
US11751813B2 (en) | System, method and computer program product for detecting a mobile phone user's risky medical condition | |
JP2021531606A (en) | Systems and methods for treating memory disorders | |
Bendayan et al. | Decline in memory, visuospatial ability, and crystalized cognitive abilities in older adults: normative aging or terminal decline? | |
Halfon et al. | Multimodal affect analysis of psychodynamic play therapy | |
Conrad et al. | Interactions between apparent motion rivalry in vision and touch | |
WO2016068795A1 (en) | System and method for providing an indication of the well-being of an individual | |
Katsimerou et al. | Crowdsourcing empathetic intelligence: The case of the annotation of EMMA database for emotion and mood recognition | |
US20170061823A1 (en) | System for tracking and monitoring personal medical data and encouraging to follow personalized condition-based profile and method thereof | |
KR101562247B1 (en) | System and method for lifestyle analysis | |
Zanwar et al. | Use of connected technologies to assess barriers and stressors for age and disability-friendly communities | |
Zeghari et al. | Correlations between facial expressivity and apathy in elderly people with neurocognitive disorders: Exploratory study | |
Yamamoto et al. | Recognition of a baby's emotional cry towards robotics baby caregiver | |
Mateos-García et al. | Driver Stress Detection from Physiological Signals by Virtual Reality Simulator | |
WO2019221252A1 (en) | Information processing device, information processing method, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
AMND | Amendment | ||
E601 | Decision to refuse application | ||
AMND | Amendment | ||
A107 | Divisional application of patent |