EP2254473A1 - Procédé et système pour fournir à un utilisateur une stimulation cognitive adaptative à base de règles - Google Patents

Procédé et système pour fournir à un utilisateur une stimulation cognitive adaptative à base de règles

Info

Publication number
EP2254473A1
EP2254473A1 EP08728960A EP08728960A EP2254473A1 EP 2254473 A1 EP2254473 A1 EP 2254473A1 EP 08728960 A EP08728960 A EP 08728960A EP 08728960 A EP08728960 A EP 08728960A EP 2254473 A1 EP2254473 A1 EP 2254473A1
Authority
EP
European Patent Office
Prior art keywords
user
event
cognitive
providing
queries
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP08728960A
Other languages
German (de)
English (en)
Inventor
Jerry Robinson
Melinda Wu
Dan Michel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dakim Inc
Original Assignee
Dakim Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dakim Inc filed Critical Dakim Inc
Publication of EP2254473A1 publication Critical patent/EP2254473A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
    • G09B7/04—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student characterised by modifying the teaching programme in response to a wrong answer, e.g. repeating the question, supplying a further explanation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/117—Identification of persons
    • A61B5/1171—Identification of persons based on the shapes or appearances of their bodies or parts thereof
    • A61B5/1176—Recognition of faces
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/40—Detecting, measuring or recording for evaluating the nervous system
    • A61B5/4076—Diagnosing or monitoring particular conditions of the nervous system
    • A61B5/4088—Diagnosing of monitoring cognitive diseases, e.g. Alzheimer, prion diseases or dementia

Definitions

  • the present disclosure describes an interactive cognitive stimulation system and method, designed to engage individuals in fun and challenging cognitive activities and exercises that will improve their quality of life and, in the case of non-demented seniors, slow or possibly prevent the onset of dementia.
  • an interactive cognitive stimulation system and method designed to engage individuals in fun and challenging cognitive activities and exercises that will improve their quality of life and, in the case of non-demented seniors, slow or possibly prevent the onset of dementia.
  • user's the term user and patient may be used interchangeably
  • cognitive exercises which draw on real-world skills and subject-matter, and which are matched to each user's specific cognitive abilities, background, and interests.
  • the format in which the exercises are presented is fun, entertaining, and, most importantly, unlike a tedious and laborious test.
  • an administrator typically in an assisted living or senior care facility or family member fills out a short "User Data" questionnaire for that user usually using a web-enabled application.
  • the user data is entered usually by way of a keyboard, either a computer keyboard or a virtual keyboard appearing on a computer monitor (touch screen).
  • Answers to the questionnaire provide the basis of obtaining generally two types of information: demographic information and cognitive information, related exclusively to the user.
  • An embodiment of the disclosure uses the demographic information, including such items as date-of-birth, gender, language, culture, education, profession and likes and dislikes, to select appropriate content data from a stored data base, presenting the user only activities relevant to his/her background, interests and age.
  • Cognitive information is then used to set the initial levels of challenge of exercises presented to the user in their first session.
  • Providing each user with a unique program tailored to his specific abilities, interests and experience requires the identification of the specific user prior to the start of each session. Facial recognition technology has been adapted to accomplish this goal.
  • a button represents a notated or identified portion of the screen that the user contacts to identify his input, selection or response. This signals the built-in digital camera to take the user's picture.
  • the system searches its database for a picture that matches the user's picture. In the most common scenario, when a match is found, the user is automatically logged in.
  • the mere act of turning the system on satisfies the user identification process.
  • the user After confirming the user's identity, the user commences a session. During the session, the user participates in activities and exercises addressing six cognitive domains: long-term memory, short-term memory, calculation, language, visuospatial, and critical thinking, all interacting through the touch screen interface. When a user answers a question he/she receives immediate verbal, audio and video feedback, and voice encouragement.
  • a user does not answer a question within a time representative of his/her normal response expectation, the user is prompted to "take a guess, if the user is unsure of the correct answer.” If after two prompts, the user still doesn't respond, the user is directed to the next exercise after a conciliatory transition, such as for example, "This one is really tough. Let's try something else.”
  • the sequence of inquiries is adjusted to give the user easier questions for that domain. This prevents feelings of failure and frustration that could lead users to quit, but in stead, promotes a sense of success, building feelings of accomplishment, self-confidence and self- esteem.
  • the inquiries are adjusted to give the user more difficult questions more appropriate to his/her mental capabilities in that domain. Users will often receive non-challenging and entertaining optional rewards in the form, for example, of a movie or music clip. Over time, the user in a care facility environment or those users connected to a central office via the internet may also receive more tangible rewards and acknowledgements of their accomplishments through the mail.
  • the user's response patterns are recorded and are used to update the user's mental status settings by domain.
  • the mental status data provides the basis for the system undertakes statistical analysis and send alerts regarding changes in patterns of user performance.
  • a significant decline in a user's performance e.g. speed and/or accuracy of response
  • the system can be programmed, with the permission of the user, to send an alert via email to the user's caregivers, physicians and family members if it detects such declines.
  • Fig.1 is an illustration of a block diagram of the general components of a system to provide adaptive rule based cognitive stimulation to a user according to an example embodiment of the present invention
  • Fig.2 is an illustration of a hierarchy of components of a show which includes sessions, events and screens in accordance with an embodiment of the present invention
  • Fig. 3 is a flow chart to determine initial system tasks based upon the nature of the user, in accordance with an embodiment of the present invention
  • Fig. 4 is a flow chart illustrating the creation of cognitive profiles of the user, in accordance with an embodiment of the present invention.
  • Fig. 5 is a flow chart illustrating the initialization of a user's current show environment, in accordance with an embodiment of the present invention
  • Fig. 6 is a flow chart illustrating the sequence of event occurrences and interaction with a user, in accordance with an embodiment of the. present invention
  • Fig. 7 is a flow chart illustrating the determination of the next rule to apply, in accordance with an embodiment of the present invention.
  • Fig. 8 is a flow chart illustrating the determination of the next event to apply, in accordance with an embodiment of the present invention.
  • Fig. 9 is an illustration of a block diagram of system hardware components in accordance with an embodiment of the present invention. in accordance with an embodiment of the present invention.
  • Figs. 10a to 10 z is an illustration of an example session including a sequence of events, queries, and system feed back to the user, in accordance with an embodiment of the present invention.
  • Fig. 11 is a flow chart illustrating the adjustment of the user's cognitive ability in a cognitive domain, in accordance with an embodiment of the present invention.
  • FIG. 1 is an overall simplified block diagram of an example embodiment of the system of the present invention.
  • Stimulator 100 is microprocessor based and is configured to process information, namely User Data for inclusion and update of a User Profile and Content data.
  • the device uses information contained within various databases to interact with the user.
  • Events Rule Database (104), which contains the various rules used to decide when and how events are to be displayed to the user, further described below;
  • User Demographic Profile database (108), which contains the information from the general profile of the user (such as native language, date of birth, likes and dislikes, etc.);
  • Events database (112 which contains the list of information on each event (like Hidden Words in Figures 10T-10X, representing the entire event);
  • User Cognitive Profile database (116) which has the user information relating to their cognitive levels and mental status (further described below);
  • Event Screens database (120) which contains the individual screens in each event (example, each individual screen in Hidden Words shown in Figures 10T, 10U, 10V, and 10X);
  • User Last Show Environment database (124), where information on the last various events the user has seen is stored;
  • Event Screen Elements database (126), which contains the various elements of an event screen (example, button graphics, video clips, pictures, etc); and User Response Database (138), where all the responses to the events shown the user
  • the Stimulator 100 includes a number of operations that perform functions necessary to interact with users, namely: an lnterfacer (130), and an Evaluator (134). Depending on the event screen selected (based on rules described below), the lnterfacer (130) retrieves all the relevant visual and audio cues that comprise that event screen, such as button graphics, movie clips, pictures, etc.
  • the system provides the described information from the Event Screen Elements database 126, and presents it to the user through the touch screen monitor (132A) and/or Speakers (132B).
  • the user then responds by means of touch screen monitor (132A) monitor, and those responses go back through the stimulator 100, to the lnterfacer (130), and then to the evaluator (134).
  • the evaluator (134) processes the user responses, and provides the processed responses to the User Response database (138).
  • the evaluator (134) determines whether the user is ready for a "more difficult” event, or should receive an "easier” event or maintain the same level of event difficulty in continuing with the presentations.
  • the evaluator (134) is also responsible for providing the audio cues to the user depending on the user's response, such as "that's right! or "try again!
  • the stimulator 100 also provides user response information to the User Cognitive Profile database (116) and the User Last Show Environment database (124). During use, these databases that receive information from the stimulator 100 will build upon and update the user profile as well as add additional information that the device uses in future interactions with that user.
  • the User Response Database provides information it has received to an operation called the.Analyzer (142), which analyzes the user's response. While operations undertaken in the Evaluator (134) occurs in real-time, the Analyzer (142) typically processes information during no ⁇ use intervals or during user sleep time. The Analyzer undertakes checking the user's responses for any possible signs indicative of problems regarding the user's health. Depending upon the results of the analysis, the Analyzer (142) will either communicate to the user with an Alert (144) which provides emergency information to caregivers, physicians and/or family members, or communicates with a Report (146) to caregivers, physicians and/or family members
  • the Stimulator 100 initiates a session as shown in Fig 3 at step 300.
  • the system using stored photos and facial recognition technology, attempts to identify the user. In doing so the system determines, by way of the user profile data, whether to commence further operations depending upon whether a new user or existing user is participating in the session. In the event a new user is detected then an assessment at step 302 commences. The assessment retrieves first the user's demographic information, then the user's cognitive information from the questionnaire. If an existing user is detected then an initialize function is undertaken at step 304.
  • Initialization first retrieves the user's demographic information from the questionnaire, then retrieves the user's cognitive information from the User Cognitive Profile Database 108 continually revised during previous user's sessions. Upon completion of either assessment at 302 or initialize at step 304 a stimulate function at 306 is undertaken.
  • An embodiment of the present invention utilizes two different kinds of data: User Data and Content Data.
  • User Data is basically the user profile, representing information about the user that can affect how the system interacts with the user, and creates a user profile that is constantly being updated through continual user interaction.
  • the user profile information is gathered via an Internet link (a remote application). It is a compilation and representation of the users' recorded experience over several months and even years using the system and method described herein.
  • the initial user "baseline” information includes demographic information about the user, which is filled in by a questionnaire answered either by the user or a caregiver, which may include, for example, but is not limited to name, date of birth, country of origin, language (first language/other language spoken/ language preferred), residence history, hobbies, vocation history, special interest areas, family member's names and their relationship to the user, vision limitations, and hearing limitations.
  • User data also includes the cognitive functional level of the user, which details the cognitive ability, or Mental Status (MS) of the user, described as Stage 1 (L1-normal high functionfng), Stage 2 (L2- normal), Stage 3 (L3-normal brain aging), Stage 4 (L4-mild cognitive impairment), and Stage 5 (L5-mild to moderate dementia). Any references to a user's "stage,” will mean the level of their cognitive ability.
  • FIG. 2 is a representation showing the hierarchical structure of the content data and its subparts.
  • a show 200 represents the entire user's experience which can last over several months or years. This show 200 may consist of any number of session 202s (i.e. 202A 1 202B, etc.), one or more per day.
  • a session 202 represents user experience with the system in one sitting, which may last minutes to hours. For example, referring to Figure 10, the entire Figure is considered one session.
  • a session 202 may consist of any number of event 204s (i.e. 204A 1 204B, 204C, 204D, etc.), which represents the smallest "unit" of a user's experience of the device during a session.
  • Event 204 may consist of a single stimulus-response interaction (typically one screen) or multiple stimulus-response interactions (multiple screens). This can include a presentation of a "reward” (movie and music clips, trivia, fun facts, photos) in response to a "correct" user answer.
  • event 204 types include but not being limited to: a demographic questionnaire, Login (user authentication), Main Title (an A/V presentation that displays every session, typically just after the login event), Volume-Adj (a series of screens to allow the user to adjust the volume of the speakers or headphones to their preferred level), Orientation (a quick audio/visual review of how to use the system), Review (an A/V of high points from the users last session 202), News (an Event presenting something involving current news), Question (an Event presented in question format, requiring a single response), Story (an event presented in story format, which may involve multiple user stimulus/response interactions), Puzzle (an event that acts like a well-known puzzle format, like Tic-Tac-Toe), PhysEd (an Event designed to lead the user through physical exercises), Motivation (an A/V presentation designed to improve the users outlook or motivate the user), Entertainment (an A/V presentation just for fun).
  • a demographic questionnaire Login (user authentication), Main Title (an A/V presentation that displays every session, typically just
  • An Event would consist of the presentations illustrated in panels 10H - 10J, 10K - 10L, 10M - 10S, 10T - 10X, and 10Y - 10Z.
  • An Event 204 may consist of one or more event screen 206s (i.e. 206A, 206B, 206C, etc.). These event screens are what the user actually sees and interacts with.
  • An event screen may consist of various event screen elements such as audio from System Speakers (132B) (i.e. music, sound effects), graphic (i.e. images, illustrations, line art), and/or video from touch screen 132A (i.e. movie clips, animations) that also interacts with the user and aids with the user stimulation process. These are illustrated in Figure 10, with the graphic, photos, and movie clips seen in each individual panel.
  • the system can be set up to function in a user's home, medical facility, senior care community, community center, therapeutic center, senior day care center and any similar area.
  • the preferable set up of the system is for the user to be positioned facing the touch screen 132A, so that the Camera (131) can focus on their face.
  • the Camera 131 preferably positioned at the top of the screen will scan the user's face, and use facial recognition technology to identify the user based on a previously scanned photograph normally obtained at initial user data entry.
  • the system proceeds to identify the user and load the appropriate data, such as the user profile and prior use history. After confirming user identity and loading the appropriate data, the system commences a session.
  • the system will either Initialize (if the user has used the system before) or Assess (if the user is using the system for the first time). Subsequently, the system will proceed to user stimulation (further discussed below).
  • the stimulation process will include multitudes of various events types which include but are not limited to: DemoQ (demographic questionnaire), Login (user authentication), Main Title (an A/V presentation that displays every session, typically just after the login event), Volume-Adj (a series of screens to allow the user to adjust the volume of the speakers or headphones to their preferred level), Orientation (a quick A/V review of how to use the invention), Review (an A/V of high points from the users last Session 202), News (an event presenting something involving current news), Question (an event presented in question format, requiring a single response), Story (an event presented in story format, which may involve multiple user stimulus/response interactions), Puzzle (an event that acts like a well-known puzzle format, like Tic- Tac-Toe), Phys Ed (an event designed to lead the user through physical exercises), Motivation (an A/V presentation designed to improve the users outlook or motivate the user), Entertainment (an A ⁇ / presentation just for fun).
  • DemoQ demographic questionnaire
  • Login user authentication
  • Main Title
  • the system selectively uses that include a variety of events (based on, but not limited to fine art, historical events, pop culture, inspirational messages, exercise activities, meditation activities, and spiritual activities).
  • the sessions may include certain special events, such as an ending event or events including a teaser/preview/cliffhanger for motivation for the user to return, and a starting event or events involving the promised activity/exercise from the teaser/preview.
  • the system may present user personal items such as addressing the user by their name, acknowledging their birthday, and/or an inclusion of events that have user specific photos, sound bites, home movies/videos of user/family activities that include family and friends or with places and/or events user is personally familiar with, and questions relating to stored user data (as an example, "how old were you in 1952?).
  • questions that could: be in a multiple choice form; involve events that include movie and music clips, sound effects; involve "radio theater” style vignettes; include “rewards” for getting "correct answers, that include movie and music clips, trivia, fun facts, photos; and involve character voices to help illustrate concepts.
  • the system described herein provides other types of auditory feedback, such as escalating "dings" for "correct” responses.
  • Cognitive domains exercised by such stimulation includes but are not limited to Short Term Memory/Delayed Recall, Long Term Memory, Language, Visual (includes visuospatial and visuoperceptive), Critical Thinking (includes Concept formation, sorting, patterns, logic/reasoning, planning, flexibility), and Mathematical.
  • session duration typically 30- 45-minutes, based on scheduling requirements.
  • An embodiment of the invention will adjust the session (events 204) to match the chosen duration independently of the application of the rules, which determine Event sequence.
  • the system After completion of a session, the system stores all the data it has attained to analyze for future interactions with the user. The system provides reports and any important alerts regarding the user's performance to caregivers, physicians and family members involved with the user's well being.
  • the user system and the home base server can exchange information, which allows the home base server to analyze the user data, upload new content, upgrade software, and diagnose any possible problems with the device.
  • the system can operate standalone, the default function of the system is to cease operation if the system has not communicated with the home base server for longer than two (2) days.
  • the devices in that location that are connected to their facilities' network, the devices will choose one of them to be the "master,” which can change each time such a communication is made. This "master,” will be the first to download the content, and then through the facilities' network spread that download or similar communication to the rest of the systems.
  • the device Upon starting a new session, as mentioned above, the device will remember past interactions with the user, and continue to build upon the user's profile to better conform to the user's needs and ensure maximum stimulation.
  • FIG 3 illustrates a very basic overview of a Session 202.
  • a session begins. If this is the first session for the user, then the system will continue with step 302 Assessment, depicted in detail in Figure 4 described below. If this is not the first session the user had experienced with the system, then the system will instead start step 304 Initialize, depicted in detail in Figure 5 also described below. After the assessment or initialization, the device will continue with step 306 Stimulate, further described below.
  • Figure 4 illustrates the steps taken in an Assessment (step 302), the operation that occurs when a new user starts a new show.
  • the system collects the user's baseline demographic information from the User Demographic Database 108.
  • the system at step 402 determines the user's baseline mental status.
  • Stimulator 100 performs a process identical to step 400, but does so using events from the event database 112.
  • the system at step 404 creates a cognitive profile record. It also records the same mental status determined in step 402, in a User Cognitive Profile database 116.
  • the device uses the single baseline in all the user's cognitive profile records as a starting point for selecting events from the Event Database 112 of appropriate difficulty to present to the user during each Session. After the starting point is determined, the system will proceed with stimulating the user.
  • Figure 5 illustrates the steps taken in an Initialization procedure 304, the operation that occurs when a user who has used the device before, starts a new session. This operation retrieves from databases 108, 116, 124 and 138 all information necessary to conduct a current session 202 in a manner informed by user data stored by stimulator 100 in previous sessions 202s.
  • the system reads the show rules pertinent to the show to be presented. The show rules are organized to properly conduct a presentation through the events and screens to be utilized.
  • the system reads the user's demographic profile from the User Demographic Profile database 108.
  • the system reads the user's Last-Show environment, by retrieving the user's information from the User's Last-Show Environment Database 124, as well as counters (further explained in the Next Rule to Apply section below) reflecting the number of Events 204 that have occurred since the last presentation of Events in each of the cognitive domains. This exercise ensures that repetitive and in some cases, non-suitable events, due to either ease or difficulty or complexity, are not presented in a current show. Accordingly, both the challenge level and interest level to the user is maintained at a value proper for the current user.
  • the system initializes the user's current show environment and proceeds with stimulating the user.
  • an embodiment of the system For processing the large number of possible events to provide cognitive stimulation for the user, an embodiment of the system has a set of "event rules.”
  • the event rules determine both the sequence and manner in which way the Sessions and Events are presented to each user. Instead of "pre-programming" the Sessions and Events (which may give a sense of repetitiveness and not properly address the users interests, needs, nor provide needed day-to-day variations in cognitive ability), the system uses an "adaptive response" technique embodying a concept named, "the next rule to apply” which is discussed further below.
  • a novel aspect of an embodiment of the present invention is that the adaptive response technique makes each session unique for each user, every time it is used.
  • the stimulation may continue for the length of the predetermined duration (DUR) of the session at step 602.
  • cognitive stimulation ends at step 603.
  • the system determines the next rule to apply at step 604.
  • the system uses the determined rule from the previous step to determine the next event to show (606).
  • Each event has a certain number of event screens, and so that event comes with a starting event count above 0, and as the event progresses the number starts to count down as each event screen is presented.
  • the system After determining the rule to be used, the system presents the screens to the user until the Event Screen Count (SC) reaches zero at step 608 which is reached after the system presents the final screen 206 of the event 204 (see Fig 2).
  • SC Event Screen Count
  • Each different event has an associated screen count which represents the number of different screens contained within the particular event. The screen count number depends upon and varies as a function of the type, complexity and objective of the event currently being presented.
  • the system evaluates the user's responses and, if appropriate, changes the value stored in the User Cognitive Profile database 108 for the current user and the current event 204's primary cognitive domain (part of the self adjustment function) in step 610. If the screen counts are above zero, the device will continue to show the user the next screen in the event in step 614. These screens will display a screen 206 of event 204, which includes giving a query and displaying buttons for the user to contact to receive the user's response. Depending on the type of screen and event, the screen will continue to be shown to the user until the button number (B) equals 0, or the "correct" button has been pressed in step 616.
  • the system After the button number (B) reaches 0, or the "correct" button has been chosen, the system then stores the response time and the number of attempts necessary to get a "correct" response for each Screen 206 of the current event 204 in step 618. In the instance that the number of buttons is greater than 0, or is the "incorrect,” button, the system decreases the complexity of the stimulus at 618 in each stimulus-response possibility on each screen 206 from which the user can choose, or provide a verbal or visual hint, or both at step 622.
  • the device receives the user's input at step 620, for each stimulus-response possibility on each screen 206 of event 204, and then gives the user encouraging feedback after each response at step 622 based on his or her response and the results are recorded at step 624.
  • a salient feature of an embodiment of the present system is its rule-based procedure for determining what content the user is presented, and the time of presentation.
  • the rule-based procedure by which an embodiment of the present invention chooses content for a user relies upon rules regarding the characteristics of the content to be shown to users, rather than identifying the exact content to be seen by each user.
  • the procedure ensures that users will not see content inapplicable to them, and allows session times to be of any length, since the content at specific percentages of the session time may be specified.
  • the rules are an important tool for controlling each user's experience during a session using the system described herein.
  • the two main aspects of this experience are show contour and show variability.
  • the show contour provides a continuum of presentations through a session in order to provide the user with the feeling that they are smoothly proceeding from the beginning stage, through the middle stage to ending stage of a session, rather than just experience an abrupt start or an abrupt end with the potential of causing some uneasiness and anxiety in the user.
  • Show variability refers to making the show seem new and novel at all times in order to avoid giving the user a sense of repetitiveness in event or show presentations. It is important to control the show contour because, as in a television episode, each user session is a self-contained episode and must have a beginning, middle, and end.
  • the rules are chosen based on the user's cognitive profile and last show environment. In this example, if the user is high-functioning (L1), then either rule 1 or 3 will apply. The system then attempts to choose a rule based on the minimum frequency specified. If the user has not seen a long-term memory event in the last 6 events, and has not seen a short-term memory event in the last 8 events, then again, both rules 1 and 3 qualify because the user has not met the minimum frequency requirements for both rules. In this case, the sequence number determines which rule is used next. Since rule 1 has a lower sequence number than rule 3, rule 1 is the rule chosen.
  • rule 1 Once rule 1 is selected, it will guide the system in choosing the next event to show the user. Rule 1 requires the system to look in the events database for an event that exercises the cognitive domain of long term memory. The event must also be at a high difficulty level, since the rule chosen indicates that the user's level of functioning is high. Finally, the event must match the user's demographics, as collected in the initial questionnaire. In a similar fashion, if the user level of functioning is mild cognitive impairment (L4), then either rule 2 or 4 will apply and since rule 2 has a lower sequence number than rule 4, rule 2 is chosen. The selection of an event according to rule 2 then follows with the above considerations, relating however, to mild cognitive impairment rather normal high.
  • L4 mild cognitive impairment
  • a show consists of self-contained building blocks called events, which may be of varying lengths and complexity; they are strung together, bead-like, according to the Rules.
  • Events are organized in a hierarchy that includes Domains, event types, and event subtypes. Domains are the cognitive domains familiar to neuropsychologists, such as Long-Term Memory, Short-Term Memory, Language, Visuospatial skills, and two sub-domains of Executive function, Critical thinking and Calculation. There are also specific domains that serve to organize the content not corresponding to familiar cognitive domains. These unique domains include such categories that may be designated as "Spirit and Soul" and "The Center,” a group of exercises that serve to relax and focus the user.
  • Each domain has several associated event types, which are higher-level groupings of events within the domain.
  • the Short-Term Memory domain has an event type called "Lists.”
  • Each event type in turn, has several associated event subtypes, lower-level groupings of events within the event type.
  • An event type identified as a "List” there is an event subtype called "Word Lists.”
  • Each event subtype is associated with one event type, and each event type is associated with one domain.
  • the list identifies the category of the event type, and "word” as distinct from numbers as symbols, for example, defines the nature of the content of the "List”.
  • SIA Special Interest Area
  • the two main purposes of the Rules are to control the contour of the show and provide variation.
  • providing show "contour” provides the user with a sense of a "beginning,” a “middle,” and an “end,” so the user doesn't feel that his show had abruptly started and ended.
  • Providing variation is also important to ensure that the user doesn't get bored with constant repeated events, and encourages repeated use.
  • the first rule type is the Temporal Rule type; temporal rules specify which types of events will be seen at different time periods in each session. All the rules, including the temporal rules, tend to customize the presentation to the current user.
  • the events identified by the temporal rules serve to orient the user at the beginning of each session and to end the session on a positive note.
  • the second rule type is the Frequency Rule type; frequency rules specify how often a user will see a given type of event. Because these frequency rules control the minimum and maximum frequencies of event types, users will see a large range of different event types in a varied fashion.
  • PEST post event subtype
  • Each rule and event has various values associated with them. Some have “count” values (which can be defined in varying ways such as being the minimum amount of events needed before being implemented), or identifying "serial numbers,” (an internal indicia identifying a specific user or event) or similar distinguishing indicia. Depending on the situation, these values are used by the system in different ways to either sort by their values, or make a choice among several choices depending on their counts.
  • the "Minimum-Starting-Event-Count” means that the rule will not be applied if the total number of event's the user has been presented is less than the event count value that the rule has been given. Additionally, as the user continually uses the system, the system counts the number of events they've experienced and totals it into a "Total-Event-Count.” The “Total-Event-Count,” is the number of events the user has seen throughout an entire show.
  • the system reads the "Total-Event-Count", and eliminates from current contention all other rules with Minimum-Starting-Event-Counts that are higher than that "Total-Event-Count.” These higher-numbered events may not yet be appropriate for the user to experience, so eliminates those as choices of events to show the user.
  • the system then eliminates from the current contention all rules with a Number-of-Events- Since-Last-Rule-Application-Count less than the Rule's Minimum-Occurrence- Count in block 704, resulting in providing significant variability.
  • the system goes through a final elimination process, by eliminating from current contention all rules whose group level doesn't match the user's level in the domain to which the rule applies.
  • the system then proceeds through a rule sorting phase, sorting the remaining rules by (number of events since the last application count) - (the rule's maximum number of events since last) in block 708, in descending order.
  • the rule's number of events since the last application count indicates the number of events that have occurred since the last time that event category has been used, and the rule's maximum number of events since last value indicates the number of events that should occur between two events that are of the same subtype.
  • a sort of rules by their "minimum number of events since last" in ascending order in block 710 is performed. This value indicates the minimum number of events that should occur between two events of the same subtype.
  • the system uses it to determine the next event to apply. Depending on the rule chosen, the system will go through the Events Database (112), match information from the User Demographic Database (108) and the User Cognitive Database (116), and sort through the events several times before picking the appropriate events. These steps are further described below.
  • FIG 8 which outlines the steps taken in step 606, "Determine Next Event to Apply.”
  • determining the Next Event to Apply would take place before each event that is between Figure 10G and Figure 10H, between Figure 1OJ and Figure 10K, between Figure 10L and Figure 10M 1 between Figure 10S and Figure 10T, between Figure 10X and Figure 10Y and between Figure 10Y and Figure 10Z, for example.
  • the system may determine the next event in varying ways, but each follows the same basic steps.
  • the system retrieves from the User Cognitive Profile Database (116) the user's current cognitive stage, that is, the present level of the user's cognitive ability and "Last Event Seen serial number.”
  • This "Last Event Seen serial number” is the term that is used for the last event the user has seen, to track the user's progress and to ensure variability of the events the user sees to avoid repetitiveness.
  • the system determines the user's awareness era from the user's birth date plus ten years through the current date and the user's cognitive stage, in block 804. Depending on the Mental Status of the user, it may vary, typically decreasing at higher stages. At Stage 1 , it may begin at the user's date of birth plus 15 years, ending at the present day. Stage 2 it may begin at user's date-of-birth plus 15 years and end 40 yrs later (age 55).
  • step 806 the system gets the next event that matches: the event category determined associated with the determined rule; the language, culture, and gender of the user retrieved from the User Demographic Database (108); the awareness era (previously calculated); the user's level for the event category's domain (retrieved from the User Cognitive Profile Database (116)); the user's special interest areas retrieved from the User Demographic Database (108); with the first serial number greater than the high-watermark serial number retrieved in step 802.
  • the system finds the Next Event to Apply, the system presents the event to the user at the user's level in the particular event's domain.
  • a cognitive stimulation system presents users with an optimum level of challenge. This is true for the following reasons: if the challenge is too great, the user will experience frustration; if the system is not challenging enough, the user will be bored. In either case, the user will likely lose interest in using the system — and therefore no longer receive the benefits of mental stimulation the system provides.
  • the system self-adjusts to provide users with the optimum level of challenge, as follows: As the user plays the system, it evaluates the user's responses to questions. Based on how many incorrect responses the user makes before choosing the correct response, the system determines if the difficulty level is too high or low for the user, and adjusts accordingly. This enables the system to customize the stimulation to the user's individual level of cognitive ability, mitigating the risks of user frustration and boredom.
  • the system self-adjusts independently for each user in each cognitive domain. This reflects the fact that cognitive functioning varies across domains for each individual, and that cognitive decline may take place at varying rates within each domain. With independent self-adjustment in each domain, each user can be at a different difficulty level in each domain, and the user's level in each domain can change independently, further mitigating the risks of user frustration and boredom.
  • Block 1102 evaluates results for a given screen and adjust the user's stage (user's cognitive level), if appropriate.
  • the system evaluates whether the user had responded correctly on the first attempt. If so, the system in block 11 12, continues to count the number of consecutive screens in the screen's domain where the user had responded correctly on the first attempt. If that number is below selected number, typically five, the process ends. If however the number is above another selected number, typically four, the system continues to block 1 120 and raises the difficulty level. If the user does not answer correctly on the first attempt, the system will continue to block 1106 and evaluate whether the user had "failed" the screen.
  • a screen is considered failed if it exhibits the following combinations of screen attributes and user responses, if the screen is considered failed in any of the following cases, the system will continue to block 1108 and count the number of failed screens in that screen's domain:
  • the screen has only one correct response and the user makes at least two incorrect responses before arriving at the correct response.
  • the screen has multiple correct responses that do not have a specific sequence order and the user's number of incorrect responses before choosing all the correct responses is greater than or equal to two-thirds of the number of incorrect responses on the screen.
  • the screen has multiple correct responses that do have a specific sequence order and does not have buttons that are not in the sequence, and the user's number of out-of-sequence responses before arriving at the correct sequence is greater than or equal to two-thirds of the number of buttons on the screen.
  • the screen has multiple correct responses that do have a specific sequence order, does have buttons that are not in the sequence, and does not display a virtual keyboard or in the instance that the user's number of incorrect or out-of-sequence responses, before arriving at the correct sequence, is greater than or equal a predetermined percentage (preferably two-thirds) of the number of buttons on the screen. However, each response that is correct but out of sequence is multiplied by a predetermined percentage (preferably one-half) before beginning this calculation.
  • the screen displays a virtual keyboard; the user is required to spell a word that is the correct response, and the user has spelled at least two incorrect words before arriving at the correct word.
  • the first situation that results in decreased difficulty of content seen by the user decreases the difficulty level in only one domain.
  • the system will show easier content in a domain if the user has failed three screens in the domain. Experience has shown that three screen failures is the threshold for frustration in most users and the point at which users want to see easier content.
  • figure 11 block 1108 if the number of failed screens is above 2, the system moves on to block 1110 and decreases the difficulty level in that one domain.
  • the system moves to block 1122. It would be not be appropriate for the system to decrease the difficulty level of content merely because the user had simply been careless on a few screens, or had difficulty with one isolated subject in the domain, that is, if the user's three failed screens were an anomaly. To account for this possibility, the system provides a way to nullify failed screens. If the user does not fail on four consecutive screens in a domain, the system subtracts one from the number of screen failures in the domain seen in block 1 124. The logic behind this is that, if a failure is truly an anomaly, then the user must prove this by performing above the failure threshold on multiple screens in succession. Otherwise, the process ends.
  • the system also contemplates a special case where in the event an adjustment has been made by way of improvement from L4 or L5 and a single screen failure within the next three screen in the applicable domain occurs, the user will immediately returned from L3 to L4 or from L4 to L5 as the case may be.
  • the rationale for the readjustment is to ensure that a user who should realistically be at L4 or L5 but who responds correctly and consecutively to several queries in L4 or L5, isn't elevated to L3 or L4 as the case may be, and left there inappropriately, but is quickly returned to the easier level (L's) after rapid subsequent failures.
  • the system has an override feature that will drop the difficulty level in all domains if the user has failed at least five screens in a row across at least three domains.
  • Such a pattern of failures indicates the user is having a multi-domain decrement in functioning. This may be the result of the normal day-to-day fluctuation in mental acuity frequently seen in demented users, or it may be the result of a more serious medical problem, such as a small stroke. In either case, the system will accommodate the user by decreasing the difficulty level of all content shown to the user.
  • the system in block 1108 counts the number of failed screens and if greater than three, the system moves to block 1114 and counts the number of consecutive failed screens. If the number of failed screens is below five, the difficulty level remains unchanged. If instead the number is above 4, then the system counts the number of different domains in which the user failed consecutively in block 1116. if the number of failed domains is less than three, the difficulty level remains unchanged. If however the number is above 2, then the system decreases the difficulty level in all domains in block 1118.
  • the interface 126A may also include a camera 131 used at least for identifying the user.
  • the events have a button/answer/input control that will either: disappear when a "correct" choice is made; use pictures, words, or numbers to display choices; and other possible mediums to interact with the user.
  • This on-screen control can display further answers, and serve as an input device for user responses.
  • the screen can also display an on-screen calendar for date orientation. Audio interface may be provided by a standard speaker 126B with accompanying electronics 950.
  • the device is composed of integrated hardware and software.
  • the show rules data base 104, the events data base 120, the screens data base 120, the user response data base 132, the user demographic profile data base 108, the user cognitive data base 116 and the user last show environment data base 112 may be contained in a commercially available digital storage medium.
  • the stimulator 100 and analyzer 136 may be implemented in memory units known to those skilled in the art.
  • the system through networking circuitry 930 can update or download content and upload user performance. Complex data manipulation and control processes may be undertaken in commercially available or specially designed central processing units 902.
  • the device can provide reports and any important alerts regarding the user's performance to caregivers, physicians and family members.
  • the device can be set up to function in a user's home, medical facility, senior care community, community center, therapeutic center, senior day care center and any similar area.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Business, Economics & Management (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Psychology (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Social Psychology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Psychiatry (AREA)
  • Hospice & Palliative Care (AREA)
  • Developmental Disabilities (AREA)
  • Child & Adolescent Psychology (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

L'invention porte sur un procédé et sur un système pour fournir une stimulation cognitive évolutive, hautement variable, en continu et à long terme sur un spectre large de domaines cognitifs. On présente à l'utilisateur une série d'activités audio/visuelles de divertissement personnalisées pour l'utilisateur, sur la base de l'expérience de vie de l'utilisateur et du niveau cognitif, chaque activité fournissant une stimulation dans un ou plusieurs domaines cognitifs. Les activités elles-mêmes et leurs niveaux de défi peuvent changer, en temps réel, sur à la fois le court et le long terme, variant par rapport aux structures de réponse d'utilisateur d'historique et en cours, créant une expérience qui reste engageante, avec une utilisation en continu, sur une période de mois ou d'années.
EP08728960A 2008-02-04 2008-02-04 Procédé et système pour fournir à un utilisateur une stimulation cognitive adaptative à base de règles Withdrawn EP2254473A1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2008/052951 WO2009099435A1 (fr) 2008-02-04 2008-02-04 Procédé et système pour fournir à un utilisateur une stimulation cognitive adaptative à base de règles

Publications (1)

Publication Number Publication Date
EP2254473A1 true EP2254473A1 (fr) 2010-12-01

Family

ID=39816872

Family Applications (1)

Application Number Title Priority Date Filing Date
EP08728960A Withdrawn EP2254473A1 (fr) 2008-02-04 2008-02-04 Procédé et système pour fournir à un utilisateur une stimulation cognitive adaptative à base de règles

Country Status (3)

Country Link
EP (1) EP2254473A1 (fr)
CA (1) CA2724689A1 (fr)
WO (1) WO2009099435A1 (fr)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2529216T3 (es) 2010-06-23 2015-02-18 Colgate-Palmolive Company Composición oral terapéutica
KR101652045B1 (ko) * 2014-10-21 2016-08-29 주식회사 한국첨단기술경영원 맞춤형 회상 콘텐츠 기반의 인지능력향상 시스템
US10896407B2 (en) 2017-05-16 2021-01-19 International Business Machines Corporation Cognitive adaptation to user behavior for personalized automatic processing of events
KR102316255B1 (ko) * 2017-07-07 2021-10-21 가부시키가이샤 시마쓰세사쿠쇼 인지 기능 판정 방법
US10678845B2 (en) 2018-04-02 2020-06-09 International Business Machines Corporation Juxtaposing contextually similar cross-generation images

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7970620B2 (en) * 1992-11-17 2011-06-28 Health Hero Network, Inc. Multi-user remote health monitoring system with biometrics support
US6280198B1 (en) * 1999-01-29 2001-08-28 Scientific Learning Corporation Remote computer implemented methods for cognitive testing
US6632174B1 (en) 2000-07-06 2003-10-14 Cognifit Ltd (Naiot) Method and apparatus for testing and training cognitive ability
US6663392B2 (en) * 2001-04-24 2003-12-16 The Psychological Corporation Sequential reasoning testing system and method
US20060210955A1 (en) 2003-09-17 2006-09-21 David Skoglund Method and arrangement in a computer training system
US20060229505A1 (en) * 2005-04-08 2006-10-12 Mundt James C Method and system for facilitating respondent identification with experiential scaling anchors to improve self-evaluation of clinical treatment efficacy
US20070299319A1 (en) 2006-06-09 2007-12-27 Posit Science Corporation Cognitive Training Using A Continuous Performance Adaptive Procedure

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2009099435A1 *

Also Published As

Publication number Publication date
WO2009099435A1 (fr) 2009-08-13
CA2724689A1 (fr) 2009-08-13

Similar Documents

Publication Publication Date Title
US8273020B2 (en) Method and system for providing rule based cognitive stimulation to a user
US11069249B2 (en) Method and system for fall prevention in older adults
US12094363B2 (en) Context-aware adaptive data processing application
US8678833B2 (en) Method and device for training of a user
US8814359B1 (en) Memory recollection training system and method of use thereof
Raczynski et al. Handbook of health promotion and disease prevention
US20110229862A1 (en) Method and Apparatus for Training Brain Development Disorders
US20140250043A1 (en) Method and system for maintaining cognitive abilities
US20110256513A1 (en) Speech comprehension training system, methods of production and uses thereof
US20140051053A1 (en) Method and Apparatus for Brain Development Training Using Eye Tracking
Blok et al. Gamification to motivate the unmotivated smoker: The “Take a Break” digital health intervention
EP2254473A1 (fr) Procédé et système pour fournir à un utilisateur une stimulation cognitive adaptative à base de règles
Lackey Relationships between motivation, self-efficacy, mindsets, attributions, and learning strategies: An exploratory study
Elford Using tele-coaching to increase behavior-specific praise delivered by secondary teachers in an augmented reality learning environment
Ivy et al. Toward the development of a self-management intervention to promote pro-social behaviors for students with visual impairment
McMorrow et al. Community-led mental health promotion for people of color in the United States
Saethang et al. A gaming strategy for teaching the use of critical cardiovascular drugs
Whitaker et al. Influencing client expectations about career counseling using a videotaped intervention
Tompoulidis RELAX AND LOG ON FACEBOOK: EXAMINING STUDENTS’USE OF FACEBOOK TO RELIEVE ACADEMIC STRESS THROUGH PERCEIVED SOCIAL SUPPORT
Neill The use of empirically supported treatment components for trauma exposure: The role of therapist training and characteristics
Trudel Mindfulness practices to improve stress management in the secondary classroom
Sheldrake et al. Can Imagining Actions as Occurring Involuntarily Cause Intentional Behaviour to Feel Involuntary?
Weigel Adolescents who stutter: Perceptions of effective therapy techniques
Charles Investigating Multiculturalism in Sport Psychology
Meredith A web-based intervention with email support for community college students

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20100903

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

17Q First examination report despatched

Effective date: 20110124

DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20150901