KR102372976B1 - Method for providing cognitive reinforcement training game - Google Patents

Abstract

The present disclosure provides a method for providing cognitive reinforcement training for dementia prevention performed by a user terminal including a processor and a memory, the method comprising: generating a dementia prevention game using a life log stored in the user terminal; and executing the dementia prevention game to be played; Including, the dementia prevention game is for sustaining or maintaining the memory related to the user's real life.

Description

Method of providing a cognitive reinforcement training game {METHOD FOR PROVIDING COGNITIVE REINFORCEMENT TRAINING GAME}

The present invention relates to a method for providing a cognitive reinforcement training game, and more specifically, to a method and a server for providing a cognitive reinforcement training game using a game based on profiling a user terminal such as a smartphone for the prevention and treatment of dementia including mild cognitive impairment and the program.

Dementia refers to a state in which a normal person loses normal intellectual ability due to various brain diseases, and includes Alzheimer's disease, vascular dementia, and reversible or treatable dementia. ) and so on. Among them, Alzheimer's disease occurs when brain cells that were performing normal functions slowly die, and accounts for most of the degenerative dementia.

Mild cognitive impairment, which is the pre-stage of dementia, refers to a state in which cognitive function, especially memory, is inferior compared to age and education level, although the ability to carry out daily life is inferior. It is an intermediate stage between normal aging and dementia.

While 1-2% of the normal elderly progress to dementia every year, 10-15% of patients with mild cognitive impairment progress to dementia every year, and about 80% of patients with mild cognitive impairment are transferred to dementia within 6 years. Mild cognitive impairment is a stage that can detect Alzheimer's disease at an early stage and is clinically important in that it can maximize the therapeutic effect.

However, due to social perception that dementia is difficult to cure, lack of nursing personnel, economic burden, and difficulty in early diagnosis and early detection, not only the patient himself but also his family suffers from tremendous suffering. In order to prevent these problems and to prevent and slow the progression of dementia in the early stages of mild cognitive impairment or dementia, programs or systems for diagnosis, rehabilitation, prevention, and treatment are being developed.

However, in the conventional cognitive enhancement program for prevention and treatment, it was not easy to receive continuous treatment or training in daily life because the patient must visit a medical institution and receive treatment and training under the guidance of a psychiatrist and a psychotherapist. An online training method was developed to solve this problem, but it was an abstract method that had nothing to do with the patient's real life, such as rock-paper-scissors, multiplication table, card games, and word matching, which had nothing to do with the actual experience or situation of the subject. .

In the case of dementia or mild cognitive impairment (hereinafter, collectively referred to as 'cognitive disorder'), it is closely related to the deterioration of memory, and it is very effective in terms of cognitive training to maintain memory in real life. However, there was no service that systematically provided cognitive reinforcement learning or training based on the patient's real life or real experience.

Laid-Open Patent Publication No. 10-2016-0018032

The present invention effectively improves the cognitive ability of a patient (user) by continuously generating and providing a method for a cognitive reinforcement training game based on a life log of a user terminal of a patient with cognitive impairment or a risk group by solving the above problems and want to keep

Another object of the present invention is to provide a method and system that enables continuous monitoring of a group to be managed by a system for providing cognitive reinforcement training to easily determine the degree of cognitive impairment or dementia in the elderly.

Furthermore, it is intended to enable active pre- and post-treatment for dementia or mild cognitive impairment by continuously providing a treatment method with excellent user convenience and effectiveness at a low cost.

In order to solve the above problems, the cognitive reinforcement training method according to an embodiment of the present invention is a cognitive reinforcement training method using a game executed by an information processing device including a processor and a memory, so that the user can play the game. executing the game; and determining the user's cognitive ability based on the user's performance result of the game; and, by performing the task of the game, memory related to the user's real life is maintained or strengthened.

The game is generated using the life log obtained from the user terminal. In the cognitive reinforcement training method, one or more games are executed, and after the game is played by the user, a follow-up game related to a keyword of a task, question or answer of the played game is generated and provided.

The method for providing a cognitive reinforcement training game executed by a user terminal including an execution processor and a memory of the present invention includes the steps of: executing a game generated based on information obtained from the user terminal so that the user can play; and acquiring data input as a result of the game being performed by the user.

The game includes content related to the user's real life in order to maintain or enhance the user's memory.

The information obtained from the user terminal is a life log, and the life log is photo information, text information, location information, call information, address book, or schedule information.

The life log is generated in a user terminal or an information processing device in which the game is executed, and the game is generated in the user terminal or the external server.

The photo information includes at least one of a creation (photographing) location of the picture, a creation (photographing) time, an image, and a tag.

The text information includes one or more of a sender, a receiver, a text transmission date and time, and a keyword of the text message, and the text message is transmitted or received by the user terminal.

The call information includes a call party, a call date and time, and a call period.

The address book includes the name, position, company, relationship, email, phone number, and memo stored in the contact form stored in the user terminal.

Schedule information includes event name, location, counterparty, date and time, and memo stored in the calendar program form of the smartphone.

The location information includes movement route information derived from GPS information of the user terminal.

The game is created based on the user's life log.

The generating of the game includes: generating photo information, text information, location information, address book information or schedule information from photo data, text message data, GPS data, address book data, or schedule data stored in the user terminal, respectively; and generating a life-related game by using the obtained information.

In the generating of the game, a life pattern profile is generated from the life log stored in the user terminal using an artificial intelligence algorithm, and the game is executed based on the life pattern profile.

The game is a quiz, the content includes a picture stored in a user terminal, and the picture is a picture related to the user, which is taken or received by the user terminal.

The text information is a text profile including keywords extracted from text message data by a natural language processing analyzer, and the photo information is a photo profile including metadata of a stored photo file.

The location information is a location profile including path information, and generating the game may include: calculating, by a question matching unit, a degree of matching by comparing the profile with stored questions; and selecting a question based on the matching degree and generating a game based on the selected question and the profile.

The methods are executed by a computer program stored in a computer-readable storage medium, and the program includes instructions for performing the method.

The cognitive reinforcement training management system for dementia treatment and prevention includes: the user terminal for executing a cognitive reinforcement training game generated based on user information, providing the user to play the game, and obtaining the result; a server for receiving and processing the result of the game to generate information on the user's cognitive ability; and a monitoring device for receiving information on the user's cognitive ability from the server.

The server generates statistical information by receiving game performance results from a plurality of user terminals.

According to another aspect of the present invention, a server for providing a cognitive reinforcement training game includes: a game generating unit for generating a cognitive reinforcement training game based on a life log received from a user terminal; a game operation unit for providing the game generated by the game generating unit to a user terminal; and a user database for receiving and storing the result of the game performed in the user terminal from the user terminal, wherein the game includes content related to the user's real life in order to maintain or strengthen the user's memory.

The present invention can effectively improve and maintain the cognitive ability of the patient by providing a cognitive reinforcement training game based on the life log of the risk group.

According to the method of the present invention, by providing a customized cognitive reinforcement training game related to the user's real life while having excellent user accessibility at a low cost, it is economical while maintaining and sustaining real life memory, thereby having excellent effect in treating and preventing cognitive disorders.

The present invention also provides a method and system that enables continuous monitoring of a management target group through a cognitive reinforcement training game to easily determine the degree of cognitive impairment or dementia in a patient such as the elderly.

According to another aspect of the present invention, it is possible to not only diagnose the risk of cognitive deterioration in advance, but also to receive professional medical services by supporting active prior treatment of dementia and mild cognitive impairment and monitoring cognitive ability. It works.

1 is a schematic diagram of a system for providing cognitive reinforcement training for dementia prevention and treatment according to an embodiment of the present invention, a user terminal 100, a server 200, and the outside (including medical institutions, hospitals, pharmaceutical companies, families, etc.) It is a diagram schematically illustrating the relationship between the monitoring device 300 .
2 is a conceptual diagram schematically showing the configuration of a user terminal that provides a cognitive reinforcement training game for dementia prevention and treatment according to an embodiment of the present invention.
3 is a diagram schematically showing the structure of a system for providing cognitive reinforcement training for the prevention and treatment of dementia according to an embodiment of the present invention.
4 is a diagram schematically showing an embodiment of the same picture search quiz, which is a form of a cognitive reinforcement training game for the prevention and treatment of dementia of the present invention.
5 is a diagram illustrating an embodiment of a call history quiz, which is a form of a cognitive reinforcement training game for the prevention and treatment of dementia according to the present invention.
6 is a view showing another embodiment of a call history quiz, which is a form of a cognitive reinforcement training game for the prevention and treatment of dementia of the present invention.
7 is a view showing an embodiment of the address book (contact) quiz, which is a form of a cognitive reinforcement training game for the prevention and treatment of dementia of the present invention.
8 is a view showing another embodiment of the address book quiz, which is a form of a cognitive reinforcement training game for the prevention and treatment of dementia of the present invention.
9 is a view showing an embodiment of a photo search quiz and a location search quiz, which are one form of a cognitive reinforcement training game for the prevention and treatment of dementia of the present invention.
10 is a diagram illustrating an embodiment of a quiz based on text message information, which is a form of a cognitive reinforcement training game for the prevention and treatment of dementia according to the present invention.
11 is a diagram illustrating an embodiment of a path finding game, which is a form of a cognitive reinforcement training game for the prevention and treatment of dementia according to the present invention.
12 is a flowchart of a method of providing a cognitive reinforcement training game for preventing and treating dementia according to an embodiment of the present invention.
13 is a view showing an embodiment of a method of adjusting the difficulty of a game in the method of providing cognitive reinforcement training for the prevention and treatment of dementia of the present invention.
14 is a diagram schematically showing the structure of a system for providing cognitive reinforcement training for the prevention and treatment of dementia according to another embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement them. However, the present invention may be embodied in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be “connected” with another part, it is not only “directly connected” but also “electrically or communicatively connected” with another element interposed therebetween. also includes Also, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated.

1 is a schematic diagram of a system for providing a cognitive reinforcement training method using a game for preventing and treating dementia including a user terminal 100, a server 200, and a monitoring device 300 according to an embodiment of the present invention .

The user terminal 100 is an information processing device used or possessed by a user, and may include a processor, a memory, a communication module, and a user interface (touch screen, speaker, keyboard, monitor, microphone, etc.). The user equipment is, for example, a wearable device such as a smart watch, a smartphone, a tablet PC, a mobile device such as a smartphone, a tablet computer, a laptop computer, a desktop computer, an AI speaker, an IP TV, an Internet of Things (IoT) device, a connected It may be a car (connected car), etc., but is not limited thereto, and any information processing device capable of executing the cognitive reinforcement training method, including a memory and a processor, is not limited thereto.

The user terminal 100 may further include a GPS module for providing location information and an acceleration sensor for acquiring user exercise information.

The server 200 may perform data communication with the user terminal 100 in which the cognitive reinforcement training method using a game is executed through a communication network using a communication module. According to some embodiments, the server 100 may include a single server, a group of servers, a cloud server, and the like, and is not limited thereto.

The monitoring device 300 is an information processing device that can be used by a third party other than the user, for example, a third party who wants to monitor the user's dementia or cognitive abnormality, such as a hospital, a doctor, a user's family, or a guardian. Information such as the user's mild cognitive impairment or dementia level and progress is provided to a third party through the monitoring device.

Hereinafter, a method for cognitive reinforcement training using a game according to an embodiment of the present invention will be described by way of example being executed in a smartphone among user terminals.

Referring to FIG. 2 , a system for providing cognitive reinforcement training according to an embodiment of the present invention will be described. The user terminal 100 performs data communication with the server 200 and the external monitoring device 300 through a communication network.

The user terminal 100 is an information processing device capable of executing computer readable program code or process implementation instructions, and includes a processor, a storage unit (memory or permanent storage), a communication unit, and an input/output unit. A processor is used to execute instructions for software that may be loaded into memory, and may be a set of one or more processors or a multi-processor core (depending on the particular implementation).

The cognitive reinforcement training method of the present invention is implemented by an application program executed in the user terminal 100, and the cognitive reinforcement training providing method is also implemented as a program.

According to an embodiment of the present invention, a game for cognitive reinforcement training is generated based on the user's life log such as address book (contact), photos, GPS information, text message (SMS), SNS message, and call history stored in the smartphone, and will provide The terminal in which the user's life log is generated and the terminal in which the game is generated and provided may be the same, but may be different terminals.

The method for providing cognitive reinforcement training according to an embodiment of the present invention generates a game based on a user's life log generated and stored in a smartphone, which is a user terminal, and plays the game through a user interface including visual, auditory, and tactile senses. By executing it, we provide the user with a cognitive reinforcement training method.

The user performs cognitive reinforcement training by playing the game executed on a user terminal such as a smartphone, tablet computer, notebook computer, desktop computer, AI speaker, IP TV, and the like. In other words, in the process of playing a game based on the user's life log, brain activity such as memory and reasoning becomes the process of cognitive reinforcement training.

In addition, various input data for answering or solving a task input in the course of the game are stored in the user terminal as a result of the game, and then processed in the user terminal or server to determine the user's dementia progression level or cognitive ability. The final determination result is provided to the monitoring device 300 .

The game of the present invention includes various types of games for reinforcing cognitive ability, such as quizzes and wayfinding games. A quiz is a game of guessing the answer to a question or the general term for the question.

Execution of games, including games, and input of performing games, including responses from users, are displayed on the screen of a smartphone and may be made by touch of a touch screen or keypad input, etc. can be replaced with In addition, the user terminal includes a haptic module, a gravity sensor, a 6-axis sensor, and the like, and it is also possible to play a game by changing the posture of the smartphone.

2 and 3 schematically show the structure of a system for providing a cognitive reinforcement training method using the game of the present invention, and agents, modules, units, etc. are implemented by a combination of hardware and/or software.

Referring to FIG. 2 , the user terminal 100 includes a game unit 110 , a game operator, a user interface, a communication unit, and a controller for controlling all of the above components. The user terminal may further include a dementia management unit, a profiler, and a game result database.

The game unit 110 includes a log database, a game template database, and a game generator 120 (game generator). The game unit 110 may further include one or more of a picture agent, a message agent, a GPS agent, an address book, and a schedule agent.

The picture agent extracts image information from image data including photos and stores it in the log database, and the message agent extracts text information to create a cognitive reinforcement training game from text and chat data and stores it in the log database. The GPS agent extracts location information from the GPS data obtained from the GPS module, and the address book and schedule agent extracts call history, contact information, and schedule information from call data, address book (contact) and schedule related data and stores them in the log database, respectively. . This will be described in detail later.

In the log database, the user's life log including the user's photo information, location information, message information (including text, SNS, chatting), call information, contact information, and schedule information generated and stored in the user terminal is structured and stored.

Here, the photo information includes the photo-taking time, location, tag, and photo image, and the message information includes the content of the text message, the counterpart of the text message (both sent and received), and transmission/reception date and time. The call information includes the contact person, the date and time of the call, and the duration of the call, and the contact and schedule information includes the name, position, company, relationship, email, phone number, memo, etc. stored in the contact form provided on the smartphone, and schedule information includes the event name, place, counterpart, date and time, memo, etc. stored in the calendar program form of the smartphone.

The user life log is preferably stored as structured data in a log database, and more preferably, information profiled by each agent may be stored. For example, in the case of location information, GPS information at all times is not stored, but route information generated by a GPS agent, that is, origin (place, for example, home), destination, intermediate route, departure time, arrival time. , it is preferable that the addresses (location information) of the source and destination are stored as a profile for the location (location profile). The details of the GPS agent will be described later.

The game template database stores various game templates for various types of cognitive reinforcement training using user life logs, and this game template is periodically updated through communication with the external server 200 .

Meanwhile, the game unit 110 includes a game generating unit, the game generating unit generates a game by referring to the user life log based on the quiz game template stored in the game template database, and the game operating unit allows the user to play the created game. run to play The game operation unit outputs each stage of the game by way of voice or display through the user interface, and receives and processes the user's answer or game play.

First, a game creation method for cognitive reinforcement training will be described.

The game unit creates a game using the user life log stored in the log database according to the game template. This process will be described with a specific example.

4 exemplarily shows a game using a picture stored in a user terminal. Referring to FIG. 4 , the game generating unit generates a game by arbitrarily extracting pictures stored in the user terminal according to the 'find the same picture' template stored in the game template database. In this case, the photos may directly refer to those stored in the album program of the user terminal or may refer to those stored in the log database. These pictures are pictures stored in the user terminal and are pictures taken or collected by the user, and are pictures of people, landscapes, etc. related to the user or the user's life.

Here, the basic template of the 'Find the same picture' game is stored in the game template database as predetermined, such as how to perform, question content, screen composition, required quiz game items (in this case, a photo file), correct answer or how to generate the correct answer, etc. , the game template may be continuously updated through an external server. The game generating unit generates a quiz game as shown in FIG. 4 by adding a picture file, which is a game item, to a predetermined game template, and the game operating unit executes the generated game.

Referring to FIG. 4 , when the user touches the same picture successively or simultaneously in response to an instruction to select the same picture from among the 4 pictures displayed on the screen of the smartphone, the correct answer is correct. Instructions are displayed in text, but may also be output by voice. If different pictures are selected, it is an incorrect answer, and accordingly, the game result is stored in the game result database (DB).

On the other hand, the dementia management unit calculates the degree of cognitive impairment and progress of the user based on the correct answer rate, response speed, number of incorrect answers correction, etc., which are the results of the user's game, and provides the results to the user through the user interface. On the other hand, the dementia management unit transmits the user's game result to the server 200 through the network, and the server creates statistical data such as the average and standard deviation based on the game results of multiple users to provide more sophisticated user information on cognitive impairment. is generated and provided to the user terminal 100 or the monitoring device 300 .

Another method of providing cognitive reinforcement training of the present invention will be described with reference to FIGS. 5 and 6 , a game may be generated based on the call history of the smartphone. As shown in the left side of FIG. 5 , the call record is stored in the smartphone and can be easily referred to.

The game generator may generate a call-related game by referring to the call record stored in the smartphone based on the game template of the call-related quiz.

As indicated in Figures 5 and 6. Game templates such as a game in which people who called yesterday are placed in order, a game to select a person who called yesterday, and a game to find people who called yesterday in the family are stored in advance in the game template database. The game generator creates a game with reference to the call history based on this game template, but the call history refers to the call history of the smartphone directly or refers to information such as the call partner, call date and time, and relationship stored in the log database. can do.

7 is a view showing an embodiment of the address book quiz, which is a form of a cognitive reinforcement training game for the prevention and treatment of dementia according to the present invention. Contacts applications commonly provided on smartphones are designed to input various items such as name, address, workplace, nickname, phone number, birthday, anniversary, and social profile. In the left drawing of FIG. 8, input windows for birthdays, anniversaries, relationships, etc. are provided by way of example.

A birthday finding game may be created using the information stored in the contact or address book. That is, by referring to the address book information in the find birthday quiz game template, the task or question (hereinafter referred to as 'question') of "find a friend whose birthday is in October" and the person in the address book whose birthday is in October and other people in the address book It is possible to create a game that presents the characters together as a view. The basic form of the question and the number of optional views is based on a predetermined template, and the person whose birthday is in the corresponding month or day is arranged in combination from the address book information. Generation of a corresponding quiz includes both a question and a correct answer, and the arrangement order of the views may also vary depending on the difficulty level.

In the process of answering these questions and answers, patients with early dementia can continuously associate or reason with real memories, effectively increasing or activating their memory and reasoning ability. The treatment effect is excellent.

8 is a view showing a method of providing a cognitive reinforcement training game according to another embodiment of the present invention, and a quiz game is generated based on a nickname stored in an address book. In some cases, the name of a person is stored in the address book, but also a nickname other than the name, an alias of the user, and a relationship are also stored. In other words, the names of people are stored in various names, such as mother, country grandfather, best friend, son, youngest child, house, and Kkondae. In this case, in order to activate the memory of the dementia patient, it is possible to create a game that identifies the person with the name stored in the address book.

As shown on the right side of Fig. 8, a game can be created in which the question 'what is the name of the rural grandfather in the address book' and the corresponding name are provided as examples, the method for entering the answer is set, and the correct answer is assigned. However, in this case, the corresponding name information may not be stored in the smartphone, so a view of Not Applicable can be added as a separate view, or a window for direct input can be additionally provided. A feature of the quiz game is that the user's cognitive ability can be determined by storing the quiz history to track whether the same answer has been given, that is, the user's cognitive ability can be determined based on the consistency of answers during continuous quiz repetition. This judgment is made by the game operation department or dementia management department.

An embodiment of the present invention will be described with reference to FIG. 9 showing a picture finding game and a location finding game, which are a form of a cognitive reinforcement training game for the prevention and treatment of dementia of the present invention.

As shown on the left side of FIG. 9 , a photo taken with a smartphone is stored as metadata in the photo file, including the creation (shooting) location, the captured time (year, month, day, time), location, and the like. Accordingly, a game can be created using metadata that is attribute information of a specific photo.

As shown in the middle of FIG. 9 , a game for finding a place related to a photo asking a question about a place where the photo was taken may be created. For example, with the question "Which of the following pictures were taken in Gwangju?", multiple pictures are presented as views and the user can select them. The game generating unit generates a quiz game by using photo information according to a game template stored in the game template database.

In this case, the template includes the question "Which of the following pictures was taken at X?", where X is the generated location data of the photo's metadata, and how to position the photo as a view and provide it for the user to select. do. The game creation unit selects the photos including and not including the position X of the question as metadata as a view together, provides the game through the user interface and creates a quiz game that processes the answers, and the game operation unit We present this game through a user interface and provide it for the user to play.

The right side of FIG. 9 shows the form of a quiz game provided after the photo-related place finding quiz game is finished. The game generating unit generates a quiz game related to X=Gwangju, which is the task keyword of the previous game as a follow-up game. As an example, after a dementia patient completes a game about a picture related to themselves by displaying a map and asking 'Where is Gwangju?', another game including content related to the question of the game is created and provided will do

That is, the method of providing training using the game of the present invention is a method of maintaining and expanding the patient's memory through association. Accordingly, it is a method of executing one game, generating and executing subsequent games related to the keywords of the task, question, and answer of the game.

Meanwhile, according to another embodiment of the present invention, the user terminal 100 includes at least one of a picture agent, a message agent, a GPS agent, an address book, and a schedule agent. A game can be created using the extracted tags using the picture agent. Hereinafter, it will be described in detail with reference to FIG. 3 .

The picture agent extracts picture information, that is, the creation location, time, image, and tag of the picture using picture files and metadata including pictures stored in the user terminal, and the log database of the user terminal 100 . (log database). In this case, the image means an image file of the photo, and may be an original image, a compressed image, or a file name and a storage path stored in the user terminal.

The creation (photography) location and time of the photo are the time (year, month, day, time) and place at which the photo was taken, and are stored as metadata in the photo file. The tag may be input as a description for the photo or may be extracted from the photo by other methods. Generation of the tag will be described later.

The picture agent processes picture files including pictures stored in the user terminal and stores picture information, that is, the location, time, image, and tag of the picture in a log database of the user terminal 100 . In this case, the image means an image file of the photo, and may be an original image, a compressed image, or a name of an image file stored in the user terminal and a storage path thereof. The photo creation location and time are the time (year, month, day, time) and location at which the photo was taken, and are stored as metadata in the photo file.

A vision analyzer extracts tags from a photo, for example, the vision analyzer of FIG. 3 uses "mountain", "snow", "sun", "snow covered" from the picture or photo on the left. The keyword "mountain" can be extracted. The vision analysis unit includes a face or image recognition algorithm for an image file, and an AI learning model for analyzing various existing images can be used. That is, an artificial intelligence learning model that analyzes various photos or images through machine learning and extracts tags for explanation can be used.

The vision analysis department includes, from various photos, main items such as people, cars, roads, etc., photo descriptions such as "one person", "crowd in the square", "traffic congestion", "mountain", "sunset", backgrounds, etc. to extract the tags.

Furthermore, the name of a specific person in the photo may be extracted as tag data. This can be extracted from a case in which the name of a specific person in a picture is entered as a description through a user terminal or other device and stored as metadata, but artificial intelligence It can be extracted as a tag by determining that it is the same person by an algorithm.

The picture agent includes a vision analyzer, and the vision analysis unit extracts tags from the picture, and the picture agent includes picture information (at least one of the photographing location, time, and the tag matched with the picture), that is, the picture profile. is created and stored in the log database.

For example, in the case of a photo of a person eating Jjajangmyeon at a restaurant, the photo file, time (2019. 10. 01. 19 o'clock), location (Dunsan-dong, Daejeon, Mandarin), tags (jajangmyeon, 3 people, Younghee, meal) is stored in the log database by the picture agent.

That is, a profile (photo file, 2019. 10. 01. 19 o'clock, Daejeon Dunsan-dong, Mandarin, Jjajangmyeon, 3 people, Younghee, meal) for the saved photo file is created by the picture agent and stored in the log database. there is.

A question matching unit compares the generated profile with stored questions to calculate a matching degree, and a question with the highest degree of matching is selected, and a game according to the question is generated. In other words, you can create a game that shows the above picture and asks a question like, 'Where did you have dinner last night?'

In this case, the quiz game template asks a question related to a photo, displays a place as a view, and provides it so that the user can select it, and a method (rule) for generating the correct answer and examples of the corresponding question is stored.

The question matching unit calculates a matching degree of the profile for each question by comparing the profile with each of a plurality of questions stored in the question database. Then, a quiz game template corresponding to a question with the highest matching degree is selected, and a game is generated using the profile according to the game template. The game generator selects items with similar properties from the log database to generate examples presented with correct answers.

The stored question may be periodically updated by the external server 200 . Furthermore, the plurality of questions themselves may be stored in an external server, and the question matching unit may receive the questions through real-time communication and compare them with the profile. This can also be applied when creating a game based on other types of profiles.

In order to provide the game, a method of voice recognition may be used in addition to a method of visually displaying. That is, the displayed content is guided by voice through a user device such as an AI speaker, and a method in which the user responds with voice is also possible.

10 is a diagram illustrating an embodiment of generating and providing a game based on text message information, which is a form of a cognitive reinforcement training method for the prevention and treatment of dementia of the present invention.

As shown on the left side of FIG. 10 , a text message including a loan payment date and amount of a bank is stored in the smartphone text record. The message agent extracts text information for creating a game from data such as text and chatting and stores it in a log database. The text information is a text profile including the date and time of text transmission, the sender or receiver of the text, and keywords.

The message agent also includes a natural language processing analyzer (NLP analyzer). Natural language processing analyzers extract keywords from text messages. The natural language processing analyzer is an artificial intelligence algorithm capable of extracting the text information from text messages. The natural language processing analyzer is an artificial intelligence learning model learned by supervised learning on a separate external server and transmitted from the server to the user terminal through a communication network.

In the example of FIG. 10 , the natural language processing analyzer extracts keywords such as Woori Bank, loan, payment, August 9, 100 million won, amount, 380,410 won, etc. from the text message stored in the user terminal. The message agent stores text information including keywords extracted by the natural language processing analyzer, sender and receiver, and transmission date and time as a text profile in the log database.

The process of generating the game of FIG. 10 will be described with reference to FIG. 3 , the game generating unit 120 includes a question matching unit and a question generating unit. The question matching unit calculates a matching degree by comparing the text information (profile) with the questions in the question list. In this case, the question list may be a list of questions of a game template stored in the game template database, but may also be a question list transmitted in real time from an external server. Each question corresponds to a game template.

A question generator generates a question using the text information according to a question having the highest calculated matching degree. Taking the case of Figure 10 as an example, the question with the highest degree of matching to text information including Woori Bank, loan, payment, August 9, and 100 million won is the question form "What day is the monthly loan payment date of OO Bank?" and, referring to the text information, the question "What is the payment date of Woori Bank's loan payment on each month?" is created. The game generating unit 120 generates a game according to the quiz template corresponding to the question, and the game operating unit provides a new game for the user to play.

In the example of FIG. 11 , the GPS agent processes GPS data obtained from the GPS module to generate location information and stores it in a log database. The GPS agent includes a location analyzer (GEO Analyzer), and the location analyzer may extract location information including a user's geographic location, time (date and time), and a movement route from GPS data. The movement route includes information such as date and time, departure point, destination, and route.

The location analyzer (GEO Analyzer) is an artificial intelligence algorithm obtained by machine learning with time and location information as an input set and a path as an output value. Such machine learning is executed in the external server 200, and the artificial intelligence algorithm generated as a result is continuously transmitted and updated to the user terminal.

Meanwhile, the location information generated by the location analyzer is stored in the log database, and the game generating unit 120 generates a game using the location information (profile). The game of FIG. 11 is a game in which the user's movement path is simulated and reproduced using the user's location information. That is, the user's moving route game is generated using the user location information, i.e., the departure point, destination, route, and date and time.

This game is executed in conjunction with a map application, and provides a play environment so that the user can track the route through Street View. It creates a location profile including route, date and time, origin and destination, and creates a question and tracking route. At this time, the question is, for example, 'Where did you go yesterday? I will look at the screen again and move it.' These sentences are generated based on the moving date and time and the moving route, but the basic game template is already determined and stored in the game template database.

That is, the game generator creates a movement path tracking game with reference to the location profile according to the movement path tracking game template.

The rule of the quiz is that the street view is provided according to the direction indication (direction touch, voice indication, or direction indication according to the change of the smartphone position detected by the 3-axis sensor) input from the street view of the starting location provided through the user interface. Accordingly, it provides a street view of the new location. If the input direction indication is different from the movement path of the profile and is wrong, a warning that the input is wrong is output, and accordingly, the direction indication according to the correct movement path is induced. After that, the street view according to the movement path of the profile is continuously provided, but the game ends when the destination is reached.

For these games, a score is calculated based on whether the game arrives at the destination, the play time until the quiz is successful, the number of incorrect answer warnings, etc., and the user's cognitive ability is related to this score cognitive abilities can be assessed.

This game is effective in treating patients because it allows dementia patients to re-track the path they have already taken along the path, and in particular, it can maintain and improve the patient's spatial perception ability or pathfinding ability.

Although the method for providing cognitive decline training of the present invention has been described above by taking various types of games as an example, the technical spirit of the present invention is not limited thereto.

On the other hand, in the method for providing cognitive decline training of the present invention, an algorithm for adjusting the difficulty as follows is provided in a method for profiling a user's life log stored in a user device using artificial intelligence, and for generating and providing a dementia prevention quiz. can

For the treatment of dementia patients, the difficulty of the quiz can be adjusted sequentially. For example, it is possible to adjust the multiple choice from multiple choice 4 to 5 choices, and from single choice to multi choice.

On the other hand, the quiz result executed in the user terminal is stored in the dementia management unit, and the dementia management unit transmits the result to the server, and the server statistically processes multiple user results or multiple quiz results of a single user to determine the progress of dementia patients The degree of cognitive impairment can be analyzed. The cognitive ability determination program according to the analysis result is transmitted to the user terminal, and the cognitive ability determination program of the dementia management unit is updated.

12 shows the flow of information processing executed by the game operating unit.

When the game management department starts a game, it asks a question, and the process of responding to it, measuring response time, and measuring the number of response cancellations is performed in parallel. When the correct answer is entered, the result (correct answer) is stored in the database, and the game that makes additional queries is continued or ended.

If the game continues to ask additional questions, the difficulty level is adjusted, and the difficulty level can be maintained or raised.

On the other hand, if an incorrect answer is entered for a question, it goes to the process of inducing the correct answer, lowering the difficulty or providing a question with an additional hint. Also, if an incorrect answer is entered, the number of incorrect answers is measured and incorrect answers The number of times is counted and stored in the database. The parallel-measured response time and response cancellation frequency are also continuously counted and stored in the database.

According to a preferred embodiment of the present invention, the profiler may extract the user's life pattern profile from the location profile stored in the log database of the user terminal. That is, it is possible to extract, for example, a pattern of taking a break between 3 pm and 5 pm from the user's location information. With reference to the life pattern profile, the game operation unit may provide an alarm for recommending play of the game to the user. That is, it is possible to induce the start of the game by providing a pop-up or audio output that starts the picture matching game at 3 pm, or by loading the game.

When the user makes a voice expression corresponding to the loading of the quiz, for example, a quiz start, or touches the smartphone screen, the game may be provided and started through the interface.

As described above, the method for providing cognitive reinforcement training for dementia prevention of the present invention generates and provides a game using the user's life log obtained from the user terminal, and thus maintains the patient's cognitive ability through the cognitive game related to the user's real life. And it has the effect of sustaining life-related memory. This has a superior effect than the existing abstract game in terms of the effect of preventing and treating dementia, especially early dementia. In addition, such a game may be generated with reference to various information stored in the user terminal according to a game template, but such various information may be extracted through an artificial intelligence analyzer.

Although it has been described above that the game generation of the present invention is performed in the user terminal, the game generation may be performed in the server 200 as shown in FIG. 14 .

A user terminal such as the AI speaker 400 may not have location information by itself. In this case, photos, texts, call logs, location information, etc. generated in a user terminal such as a smartphone carried by the user are processed by the server to generate a game in the same manner as described above, and may be transmitted to an AI speaker or TV. Cognitive training games for users can be played on AI speakers or TVs.

On the other hand, the present invention is not limited to being applied only for the treatment and prevention of dementia. It can also be applied for rehabilitation treatment of patients with various types of cognitive impairment who have abnormalities in memory, perception, and problem-solving ability, such as stroke and traumatic brain injury patients.

The training method for cognitive function improvement according to an embodiment of the present invention may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination.

The program instructions recorded on the computer readable medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the computer software field. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic-type disks such as floppy disks. Included are magneto-optical media and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. In addition, the above-mentioned medium may be a transmission medium such as an optical or metal wire or waveguide including a carrier wave for transmitting a signal designating a program command, a data structure, and the like. Examples of program instructions may include high-level language codes that can be executed by a computer using an interpreter or the like as well as machine language codes such as those generated by a compiler.

The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

The description of the present invention described above is for illustration, and those of ordinary skill in the art to which the present invention pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a dispersed form, and likewise components described as distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be interpreted as being included in the scope of the present invention. do.

100: user terminal
200: server
300: monitoring device
110: game department
120: game creation unit

Claims (8)

As a method of providing a cognitive reinforcement training game executed by an information processing device including a processor and a memory,
executing the game so that a user can play the game; and
Including; acquiring data input as a result of the game being played by the user;
The game is generated using the life log obtained from the user terminal,
The life log is location information, and the location information is a location profile including movement path information of the user extracted from GPS information of the user terminal,
The game is a movement path tracking game that simulates and reproduces the user's movement path, is created with reference to the location profile, and is executed in conjunction with a map application program. It provides a play environment for tracking,
A method of providing a cognitive reinforcement training game, characterized in that the memory related to the user's real life is maintained or strengthened by the process of performing the game.
According to claim 1,
After the game is played by the user, a follow-up game related to the played game is generated and provided,
The subsequent game is a method of providing a cognitive reinforcement training game, characterized in that related to the keyword of the task, question or answer of the game played earlier.
According to claim 1,
The location profile is a method of providing a cognitive reinforcement training game, characterized in that it includes a departure point, destination, route, date and time.
A method of generating a cognitive reinforcement training game including content related to a user's real life so that the memory related to the user's real life is maintained or strengthened in the process of performing a game executed by an information processing device including a processor and a memory, ,
Extracting a location profile including the user's moving route information from the GPS information of the user terminal, and generating a moving route tracking game with reference to the location profile,
The moving path tracking game reproduces the user's moving path by simulating it, and is executed in conjunction with a map application program to provide a play environment so that the user can track the moving path through Street View. A method of generating a cognitive reinforcement training game characterized by
5. The method of claim 4,
The step of generating the movement path tracking game, the question matching unit (question matching) calculating the degree of matching by comparing the location profile with the stored questions; and selecting a question based on the matching degree and generating a game based on the selected question and the location profile.
In a computer program stored in a computer-readable storage medium,
A computer program comprising instructions for performing the method of claim 1 .
As a server that provides cognitive reinforcement training games,
a game generator for generating a cognitive reinforcement training game based on the life log received from the user terminal;
a game operation unit providing the game generated by the game generating unit to a user terminal;
Includes; a user database for receiving and storing the result of the game performed in the user terminal from the user terminal;
The game generating unit generates a movement path tracking game that reproduces the movement path of the user by referring to the location profile,
The location profile is extracted from the GPS data of the user terminal, the server for providing a cognitive reinforcement training game, characterized in that it includes the user's geographic location, time, and movement route.

delete

Images