CN105956174A - Method for constructing memory chain and strengthening memory by using memory chain - Google Patents

Abstract

The invention discloses a method for constructing a memory network and strengthening memory by using the memory network. The method at least comprises the following steps: establishing an original information database, carrying out data updating on original information in the original information database according to different psychological states of a user when the user checks the original information, storing the updated data in an associated information database, and establishing a triggering information database at the same time; and extracting, by the triggering information database, a recommendation which generates at least one piece of original information in the original information database on the basis of triggering information provided by the user and data information in the associated information database, so as to assist the user to establish the memory network. According to the method disclosed in the invention, a part of proper photos are intelligently extracted to be checked by the aged through combining the emotion information of the aged and date information, so that the emotion state of the current aged is considered and the time factors are associated, thereby bringing positive effect to stimulate the memory of the aged and improve the emotions of the aged.

Description

A kind of constructive memory chain and the method using it for strengthening memory

Technical field

The present invention relates to a kind of method selectively presenting related information based on mood data, particularly relate to a kind of structure Build memory chain and the method using it for strengthening memory.

Background technology

Cognitive function be human brain understanding and reflection objective things psychological function, including consciousness, learning and memory, attention, Language, thinking etc., along with the growth at people's age, the cognitive function of people can decline, and common performance is each side such as hypomnesis Face function declines, such as audition, visual deterioration, handicapped etc., and what this can be serious affects our quality of life.Alzheimer Symptom be usually expressed as the decline of the serious loss of cognitive competence, memory, reasoning, judgement the most also can show Significantly decline.In terms of for the treatment nurse of mild cognition impairment and relevant disease, therapy of missing old times or old friends have been found to be A kind of effective method, compared to traditional Drug therapy, it can alleviate the fear for medicine, dependence feeling and medicine The secondary injury caused by side effect itself brought.

Chinese patent (CN 104571500 A) discloses a kind of method enforced one's memory, it is characterised in that including: Xiang Yong Family display needs the content of memory；Receive the information that described user is inputted for the described content needing memory；According to institute State the information that the information of input is relevant, it is judged that whether the content of described needs memory is the content needing to enforce one's memory；Described When to need the content of memory be the content needing to enforce one's memory, control content that described needs enforce one's memory with default week time Phase displays to the user that.This patent is by displaying to the user that the content needing strengthening with default time cycle property, strong to obtain Change the effect of memory.But, this patent can not be according to the mental change constructive memory network of user, it is impossible to according to user to memory The mental change of content adjusts memory content, it is impossible to enough make user reach the effect enforced one's memory in joyful psychological environment. It is badly in need of method and product that a kind of user of making carries out enforcing one's memory under different mental statuss currently on the market.

Summary of the invention

For the deficiency of prior art, the invention provides a kind of constructive memory network and use it for strengthening the side of memory Method, described method at least comprises the following steps:

When setting up original information data storehouse and check raw information in described original information data storehouse according to user different Mental status carries out data renewal to described raw information, and the data of renewal is stored in related information data base, simultaneously Set up trigger message data base；

Trigger message that described trigger message data base provides based on user and the data message of related information data base, carry Take and produce the recommendation of raw information at least one original information data storehouse, to assist user to set up memory network.

According to one preferred embodiment, trigger condition and described related information data in described trigger message data base The mental status data in storehouse and/or the raw information in described original information data storehouse set up mapping relations.

According to one preferred embodiment, the trigger condition kind in described trigger message data base at least includes the time Triggering, place triggering, personage's triggering, content trigger and emotion trigger；

Wherein said emotion triggers and triggers for trigger message data base mood based on user coefficient Y, emotion and associate letter The mapping relations of the mental status data of breath data base and the mapping relations of mental status data and raw information are extracted and are produced The recommendation of raw information at least one original information data storehouse.

According to one preferred embodiment, described mood coefficient Y is that history emotional information based on described user is with generally The mode of rate predicts described user's current emotional information, current emotional information be p (s | E_t-1, E_t-2..., E_t-n),

Wherein s represents the emotional information that described user is current, E_t-1For previous emotional information, E_t-nFor front n-th Emotional information, E_t-iThe emotional information of the expression front i & lt relative to current time t.

According to one preferred embodiment, described mood coefficient Y is carried out point according to the history emotional information of neighbouring n time Analysis, note t represents current time, t_iRepresent the time point that neighbouring i-th emotion is corresponding, t_iEmotion numerical value be e_t-i, then t and t_iIt Between time difference be Δ t=t-t_i, then e_t-iEmotion numerical value in current time is: E_t-i=e_t-i ^(t)=f (e_t-i, Δ t)= e_t-i* exp (-Δ t/ (24*60*60)), above formula considers emotion value by the time Decay Rate of exponential damping, wherein e_t-iIt is 1；

According to the history emotion numerical value of passing n time, it is calculated as follows and predicts mood coefficient:

Y=max_s∈S(p(s|E_t-1, E_t-2..., E_t-n)), wherein emotion collection be combined into S={ happy, sad, frightened, surprised, Indignation, envy }；

If the change of mood coefficient meets Markov character, there is Y=max_s∈S(p(s|E_t-1), the most current mood relies on Emotion in a upper time point.

According to one preferred embodiment, according to the value of the mood coefficient Y that prediction obtains, at least one is former to extract generation The recommendation of raw information in beginning information database.

According to one preferred embodiment, the data of described related information data base are that user checks described raw information Mental status data different during raw information in data base, it is possible to obtain described by the facial expression recording and analyzing user Mental status data.

According to one preferred embodiment, described mental status data also include that described user is based on raw information actively The mental status data of typing, described mental status data include positive state and passive state, and with corresponding original letter Breath sets up mapping relations.

According to one preferred embodiment, the step strengthening memory at least includes: sets up original information data storehouse, completes User is to raw information basic in raw information and the typing of relevant information that is described essential information, it is achieved user is to former The first review of beginning information；

The trigger message provided based on user and the data message of related information data base, trigger message data base extracts product The recommendation of raw information at least one original information data storehouse raw, it is achieved user's review again to raw information；

Based on user's impression degree of depth to raw information, raw information display device is capable of for described raw information Prompting show, to realize user's looking back again raw information, thus realize strengthen user memory purpose.

According to one preferred embodiment, the raw information in described original information data storehouse comprise basic raw information and Describing the relevant information of basic raw information, described basic raw information is at least the one in image or sound, described description The class that the relevant information of basic raw information is at least in the time to basic raw information, place, personage, content is carried out Additional description.

According to a further aspect of the invention, the present invention provides a kind of constructive memory network and uses it for strengthening memory Method, it is characterised in that set up multimedia information lib and according to checking described multimedia information lib with corresponding test object in The mode that psychographic information during each image is relevant creates and updates the related information of respective image, in order to set up and corresponding figure As relevant memory correlation database is in order to set up memory network for corresponding test object.

According to a preferred implementation, described test object is when each image checked in described multimedia information lib Feeding back, in the way of actively or passively, the psychographic information produced for described image, described psychographic information includes recall info and feelings Sense information.

According to a preferred implementation, the psychographic information fed back by described test object and described image carry out mapping pass Connection forms the related information of described image, thus sets up the memory correlation database for storing described related information.

According to a preferred implementation, described related information also includes that described image is liked journey by described test object Degree information, share number information, described test object is expressed in the way of voice, picture and/or word closes with described image The recall info of connection.

According to a preferred implementation, emotion information based on described related information and described test object selects and shows Show the image information making the mental status of described test object be adjusted to positive psychology state.

According to a preferred implementation, described emotion information history emotion information based on described test object is with probability Mode be analyzed, emotion information Y is

Y=max_s∈S(p(s|E_t-1, E_t-2..., E_t-n)),

Wherein, emotion set S={S₁、S₂、…S_i, S_iRepresent emotional category, E_t-nThe history emotion letter of n-th before representing Breath, n >=1, and E_t-n∈ S, then emotion information Y is the emotion information analyzing the described test object obtained.

According to a preferred implementation, described history emotion information E_t-nDecay based on the time, i.e. $E_{t-n}=e_{t-n}^{\left(t\right)}=f(e_{t-n},\mathrm{\Δt})=e_{t-n}*\exp (-\mathrm{\Δt}/(24*60*60)),$

Wherein e_t-nThe emotion numerical value of n-th before representing, Δ t represents the time t that the emotion of front n-th occurs_nWith present tense Between the time difference of t.

According to a preferred implementation, when described test object checks described image with selectable pushbutton type feedback Emotion information.

According to a preferred implementation, in the way of gathering micro-expression of described test object, analyze described test object Emotion information when each image checked in described multimedia information lib.

According to a preferred implementation, described multimedia information lib include store image image library and with described image The relevant information storehouse for storing photographed image-related information of mapping relations is set up in storehouse, described image information with described image with corresponding Relevant information combination mode show.

The Advantageous Effects of the present invention:

The present invention provide constructive memory network and use it for strengthen memory method, it is possible to check original according to user The psychographic information of the mental status prediction user of information, adjusts the image information of display, makes user according to the emotional information of prediction The effect enforced one's memory it is issued in positive mental status.The psychology effect that user is produced by the present invention by analyzing image information Should, selecting display to have the image information of good effect thus adjust the mental status of user, the life making user is more healthy.

Constructive memory network that the present invention provides and the method using it for strengthening memory, it is adaptable to student, adult and old Year, people was used for strengthening memory, the old people day by day failed especially for memory, can be that it strengthens warm, happy memory, Giving up the memory of passiveness, the old age making old people is the happiest.

Accompanying drawing explanation

Fig. 1 is the method logical schematic of the present invention；

Fig. 2 is the schematic diagram of currently preferred a kind of mode testing object record psychographic information；

Fig. 3 is the time dependent curve synoptic diagram of emotion of the test object of the present invention；

Fig. 4 is the pattern diagram that currently preferred pictorial information shows in the way of time shaft；With

Fig. 5 is a kind of constructive memory network and the module diagram using it for strengthening the system of memory.

Reference numerals list

10: mobile terminal 20: service end

101: MIM message input module 102: psychographic information acquisition module

103: original information data module 104: image information display module

105: trigger message DBM 201: data analysis module

202: related information library module 203: micro-Expression analysis module

Detailed description of the invention

It is described in detail with embodiment below in conjunction with the accompanying drawings.

In the present invention, memory chain is according to the multiple image informations formed after testing the psychographic information adjustment of object at any time Between information carry out arranging thus constitute test object remember chain dynamically.Multiple memory chains constitute memory network. Memory network carries the recall info to test object with positive psychology effect.Memory network can be one-dimensional memory net Network, it is also possible to be two dimension memory network, Three Dimensional Memory network.Even, the dimension of memory network can increase, and forms Memory Network.

The invention provides a kind of constructive memory network and use it for the method strengthening memory, described method at least includes Following steps: different when setting up original information data storehouse and check raw information in described original information data storehouse according to user Mental status carries out carrying out described raw information data renewal, and the data of renewal is stored in related information data base, Set up trigger message data base simultaneously；Trigger message that described trigger message data base provides based on user and related information data The data message in storehouse, extracts and produces the recommendation of raw information at least one original information data storehouse, to assist user to set up note Recall network.

Memory network comprises multidimensional network.Multidimensional network at least includes time dimension and with longitude, latitude and height above sea level structure The Spatial Dimension become.User temporal information based on raw information and spatial information can complete the structure of memory network, thus Auxiliary user adds the Associated Memory of strong correlation raw information.

User in the present invention includes patient, adult, child, study personnel and the robot (AI) that memory is weak.

The raw information in the original information data storehouse in the present invention comprises basic raw information and additional raw information, described Basic raw information is at least the one in image or sound, described additional raw information at least to basic raw information time Between, the additional description that carries out of place, personage, a class in content.Image includes still image, dynamic image and video image.

The psychographic information of the present invention includes mood and emotion.Mood refers to without specific, universal and can extensively affect cognition A kind of affective state with behavior.Emotion refers to the experience of the attitude of things to external world produced along with cognitive and process of consciousness, It is human brain to the reaction of relation between objective extraneous things and subject demands, is that a kind of psychology with individual need as intermediary is lived Dynamic.

The present invention forms the uniqueness of user by the psychographic information of image and relevant information and user being associated together Memory network, can excite image and the phase thereof of positive psychology effect according to the change selectively display of the psychographic information of user Pass information so that user strengthens memory in the positive mental status such as happy, warm.

Embodiment 1

The present invention is described in further detail by the present embodiment.

As it is shown in figure 1, a kind of constructive memory network and use it for strengthening the method for memory and include step:

S1: set up original information data storehouse；

S2: set up the related information data base relevant to respective image；

S3: set up information database, it is achieved the recommendation of at least one raw information, to assist user to set up memory network.

Step S1: set up original information data storehouse.

The original information data storehouse set up includes basic raw information storehouse and relevant information storehouse.Base in basic raw information storehouse This raw information can be the information such as image, sound and word.The present embodiment illustrates with basic raw information for image.Base This original information bank is for storing the image relevant to recall info.Relevant information storehouse is for storing the literary composition relevant to each image Word information, graphical information and markup information.

Basic raw information storehouse and relevant information storehouse are associated together in the way of mapping.Every in basic raw information storehouse At least one relevant information in one image correspondence relevant information storehouse.Relevant information includes the word letter describing picture material Breath, time, place, event content, the personage related to, the name of personage and the identity that image occurs.Relevant information can adopted Inputted by user or related personnel during collection image, it is also possible to the mistake of each image in user checks graphical information storehouse Cheng Zhong, is inputted according to recall info by user.According to a preferred implementation, relevant information also includes by user or relevant people Member is record the voice messaging inputted and graphical information in the way of voice, figure or word.

Special to that acquire a special sense and important image labeling according to a preferred implementation, user and related personnel Different label.Special tag is easy to user and is checked image emphasis during checking each image and remember.Special mark Label can be the figure with multiple color.The significance level of different color table diagram pictures.Difform figure represents not Same Special Significance.Such as, red expression is extremely important to user, and blue expression is the most important to user.The figure of five-pointed star Represent that the relevant image of family, circular figure represent the image relevant to friend.

And stored the image relevant with recall info and relevant information collection thereof to the most former by user or related personnel Beginning information bank.

According to a preferred implementation, the mode gathering image includes picture or filming image being become by camera head Image stores to basic raw information storehouse.Gather the mode of image also include by the image of electronic digital form by wired or Wirelessly transmit and store to basic raw information storehouse.

Can also revise and the image in basic raw information storehouse according to a preferred implementation, user or related personnel Corresponding relevant information, revises the mistake in relevant information or supplementary relevant information.The relevant information corresponding with figure is first It is likely to occur mistake when of secondary input.User or related personnel are during follow-up checking, it is possible to authentication Mistake in relevant information is modified by mode.The mode of authentication include password authentification, voice authentication, fingerprint authentication, Cheilogramma checking, pupil checking.

According to one preferred embodiment, the relevant information that the image in basic raw information storehouse is corresponding can be same Time display.When user checks image, image information associated therewith is simultaneously displayed in screen.

According to one preferred embodiment, the idsplay order that corresponding with image relevant information sends based on user shows Out.Relevant information can show in the form of a label.When the content of image is recalled unclear by user, click on and represent relevant letter The label of breath, relevant information shows based on the instruction clicked on.Preferably, in relevant information the name of character image with relative Identity in user is labeled on image.Preferably, in relevant information, by the replicating head picture of personage or the face-image of animal Mark personage or the identity information of animal.Replicating head picture is arranged on around image.

Basic raw information lab setting is in the storage module of display device.Relevant information lab setting is at remote server In.Owing to the committed memory space of image is relatively big, it is arranged in remote server, when needing to cache longer during transmission Between, therefore it is arranged in the storage module of display device time and the pressure that small data transmission with fast displaying images, can be subtracted.And The memory headroom that relevant information takies is less, does not have bigger transmission pressure during transmission.Therefore it is arranged on remotely Server will not have an impact.Image and relevant information are respectively stored in basic raw information storehouse and phase with corresponding mapping relations Close in information bank.Needs display image information when, extract image from basic raw information storehouse and relevant information storehouse respectively With synthesize complete image information display after relevant information to user.

During each image in user checks basic raw information storehouse, user can be by image information in the way of forwarding Send and show on the Webpage allowing at least one friend to browse or social software, sharing this image information with friend.

User can check each image in basic raw information storehouse by least one mode.If user does not limit The content of image, then according to the time of origin of event in image be sequence arrangement check image information.If user specifies image event The time period occurred, then can check the image information in the appointment time period.If user specifies picture material, then can check with Specify the image information that picture material is relevant.If user specifies image place, then can check relevant with specifying image place Image information.If user's designated person, then can check the image information relevant with designated person.

Step S2: set up related information data base.When checking raw information in described original information data storehouse according to user Different mental statuss carries out described raw information is carried out data renewal, and the data updated are the institute carrying out raw information The emotion represented is described, and such as active mood or negative feeling, and the data of renewal is stored in related information data In storehouse.

Related information refers to the information associated with each image in basic raw information storehouse.When user checks image, Its psychology can produce fluctuation, mood or emotion and can change.Therefore, when user checks image produce psychographic information be with The psychographic information of image association, i.e. related information.Related information mainly includes the mood information of user, the emotion associated with image Information, emotion changes information, to the favorable rating of image information, express the point liked and praise number of times, share number of times, express and do not like The information such as bat brick number of times.Related information is user's heart of active feedback when each image checked in basic raw information storehouse Reason phase information or the psychographic information obtained by micro-expression of monitoring user by relevant device.Related information and image are set up that The mapping relations of this correspondence.

Can produce a feeling during each image in user checks basic raw information storehouse fluctuation, thus cause the heart of user End of love.Emotion includes active mood and negative feeling.Active mood includes peace and quiet, happiness.Passive emotion include frightened and Grieved.The most different according to the emotion classification that the difference of user, active mood and negative feeling specifically include.

According to a preferred implementation, obtained the emotion class of user by micro-Expression analysis of the face of monitoring user Not.This mode is primarily adapted for use in the mankind with facial micro-expression.Each image in user checks basic raw information storehouse Time, Emotion expression can be formed micro-expression at face by user.Learn user's by micro-expression of user is carried out data analysis Emotion belongs to active mood or negative feeling.Micro-expression at least can express happiness, sad, fear, indignation, detest, surprised and The emotions such as contempt.The active mood that belongs to glad, surprised, sad, fear, indignation, detest and contempt belongs to negative feeling.Micro-expression Miss, tranquil emotion can also be expressed.

Glad face action includes: the corners of the mouth tilts, and buccal lifts wrinkle, and eyelid shrinks, and eyes afterbody can form " fish tail Stricture of vagina "；

Sad face action includes: narrow eye, and eyebrow tightens up, and the corners of the mouth is drop-down, and chin lifts or tightens up；

The face action feared includes: face and eyes open, and eyebrow raises up, and nostril is magnified；

The face action of indignation includes: eyebrow is sagging, and forehead is knitted tightly, and eyelid and lip are nervous；

The face action detested includes: sneering nose, upper lip is lifted, eyebrow is sagging, narrows eye；

Surprised face action includes: lower jaw is sagging, and lip and face loosen, and eyes magnify, eyelid and eyebrow is micro-lifts；

The face action of contempt includes: corners of the mouth side is lifted, and ridicules or proud laughs at shape.

When user is when checking an image information, and its face occurs that the corners of the mouth tilts simultaneously, buccal lifting wrinkle, eyelid is received Contracting, eyes afterbody forms actions such as " crows-feet ", represents the happiness of user's emotion this moment.By the image in this image information with Emotion classification happiness in related information sets up mapping relations, i.e. this image is associated with active mood happiness.

When next image information occurs, the face of user occurs narrowing eye simultaneously, eyebrow tightens up, the corners of the mouth is drop-down, chin The action such as lift or tighten up, then emotion changes when user checks this image is sad.It is sad that this image easily triggers user Recall.Then set up mapping relations by sad with the emotion classification in related information for this image, i.e. this image is sad with negative feeling It is associated.

When the emotion of user is sad, if next image is the image associated with negative feeling, then the most aobvious Show.If next image does not has related information record, or next image has the related information note associated with active mood Record, then show next image.This avoid user's emotion during strengthening memory and continue low, be absorbed in the heart of pessimism Reason state.

According to a preferred implementation, when each image checked in basic raw information storehouse, user is with optional The formal character of button emotion now or mood.User feeds back emotion when checking this image by clicking on button.By happiness, Sad, fear, indignation, detest, the emotion such as surprised and miss shows position near image with the form of button respectively.Position Below the top of image display area, the discernible position of user in image, the right and image display area.User only needs The emotion button of psychology before wanting selector to be fated.Button can be represented by the figure of different colours.

According to a preferred implementation, when each image checked in basic raw information storehouse, user is with optional The emotion that image information is liked or disliked by the formal character of button.Like representing active mood, dislike representing negative feeling. Or, button and/or " bat brick " button that a point is praised only are set near image display area." point is praised " button represents likes this Image, represents the emotion seeing that this image is glad." bat brick " button represent do not like this image, see this image produce sad, Miss, the uncomfortable negative feeling such as angry, sad.User praises expression by point and oneself likes image, i.e. expresses Oneself is experienced as active mood or negative feeling to image.In the case of only " point is praised " button, user is by not point Praise oneself not liking image of expression, i.e. express and oneself image is experienced as negative feeling.It is being provided with " bat brick " button In the case of, user expresses oneself dislike emotion to image by clicking on " bat brick " button." point is praised " button and " bat brick " are pressed Button is to express the title that image is liked and disliked by user.Button can also express user's support to image with other titles The attitude do not supported, the emotion liked and dislike.

The number of times that user clicks on " praising " for image is the most, represents that this image is the biggest on the impact of the active mood of user, tool There is positive psychology effect.The number of times that user clicks on " bat brick " button for image is the most, represents this image negative feeling to user Impact the biggest, there is passive attitude effect.The number of clicks of " point is praised " button and " bat brick " button is as the pass of correspondence image Connection information stores to related information data base.

According to a preferred implementation, when each image checked in basic raw information storehouse, user by selecting The number of the length of bar paten, the color depth of pattern or figure is expressed and image is liked degree.

The length of bar paten is the longest, represents that user is much to the favorable rating of this image, i.e. this image can be user Bring positive psychological effect the biggest.Otherwise, the length of bar paten is the least, then this image can bring the positive heart for user Reason effect is the least.Or, user clicks on the button once " praised ", and the length of bar paten is increased by certain length.

It is provided with in image display area and expresses the graphic button liked.Resolution chart is clicked on once, the face of graphic button Color just deepens once.The color of image button represents the point of user and praises number of times, positive to user of this image of secondary indication The influential effect of emotion.

Image display area is provided with at least one figure representing active mood.Such as figure can be pentalpha Shape.User, when checking each image in basic raw information storehouse, is expressed this image by the number clicking on five-pointed star figure Favorable rating or mood level of happiness.The number that then five-pointed star image is clicked is as the related information record of this image and stores up Deposit to related information data base.The shape of figure is not limited to five-pointed star, it is also possible to be circle, rectangle, triangle, hexagon etc. Shape.

According to a preferred implementation, when each image checked in basic raw information storehouse, user is to input language The impression to image information of the mode record of sound, word or figure.Perception record according to user, analyzes the emotion obtaining user It is active mood or negative feeling.The present invention is according to the audio frequency of user, pitch, the emotional information of sonic analysis user, by feelings Thread information associates with the image checked and related information as this image stores to related information data base.Or, this Invent according to the Word Input user representing active mood such as happy, happy, warm, happy occurred in the word of user record Active mood information；Or, the present invention according to the word of user record occurs gloomy, feel bad, the generation such as awkward, uncomfortable The message emotional information of the Word Input user of table negative feeling.The emotion that the present invention represents according to the pictograph of user record Extract the emotional information of user.Such as, the Fructus Persicae heart represents the active mood of sweetness, and the heart of division represents sad negative feeling.This Invent the emotion extracted the information of record in the way of input voice, word or figure when user checks this image from user to believe Breath, using emotional information as this image and related information record storing to related information data base.

User's emotion classification when each image checked in basic raw information storehouse, emotion changes curve, mood become Change curve, the favorable rating of image information or disagreeable degree, point are praised number of times exist with each image with sharing number of times and constituting The related information of corresponding mapping relations.Related information is stored in association according to positive related information and negative relation information classification In information database.Related information data base be arranged in remote server.User in checking basic raw information storehouse During each image, image information shows with corresponding related information simultaneously.Or, user in checking basic raw information storehouse Each image time, related information is based on user checks that instruction shows.

During each image information in checking basic raw information storehouse of user, the association relevant to psychographic information of feedback Information changes, then related information database root is updated according to the feedback information that user is up-to-date.

Such as, the related information of an image in basic raw information storehouse is that its point " is praised " four times by user.User exists Button is once when this checks this image, to click " bat brick ".Be more than the number of times of " bat brick " owing to putting the number of times praised, this image is still So it is associated with active mood.If along with the increased frequency of checking of user, the number of times that the point of this image is praised by user is less than " clapping Brick " number of times, then the active mood in this image and related information data base cancels mapping association, by this image and negative feeling Set up mapping association.

The emotion changes of each image in basic raw information storehouse is entered by the data of related information data base based on user Row updates.

Feedback emotional information during each image in checking basic raw information storehouse user every day, therefore feelings for a long time The thread message reflection emotion changes of user's every day.If user forgets to check image information thus do not record emotional information, then User is reminded to carry out emotional information record in the way of prompting.

The emotional information of user feedback is also analyzed and predicts the emotion of user by the present invention.By user's record every day Emotional information analyze mood coefficient, obtain user's emotion changes curve within a period of time and mood change curve.

Such as, mood coefficient Y is that history emotional information based on described user predicts that described user works as in a probabilistic manner Front emotion, current emotional information be p (s | E_t-1, E_t-2..., E_t-n),

Wherein s represents the emotional information that described user is current, E_t-1For previous emotional information, E_t-nFor front n-th Emotional information, E_t-iThe emotional information of the expression front i & lt relative to current time t.Described emotional information comprise categories of emotions and Emotion numerical value.

According to one preferred embodiment, described mood coefficient Y is carried out point according to the history emotional information of neighbouring n time Analysis, note t represents current time, t_iRepresent the time point that neighbouring i-th emotion is corresponding, t_iEmotion numerical value be e_t-i, then t and t_iIt Between time difference be Δ t=t-t_i, then e_t-iEmotion numerical value in current time is: E_t-i=e_t-i ^(t)=f (e_t-i, Δ t)= e_t-i* exp (-Δ t/ (24*60*60)), above formula considers emotion value by the time Decay Rate of exponential damping, wherein e_t-iIt is 1；

According to the history emotion numerical value of passing n time, it is calculated as follows and predicts mood coefficient:

Wherein to be combined into S={ happy, light, tranquil, sad for emotion collection Wound, frightened, surprised, angry, envy }；If result is the active mood such as Y=is happy, light or tranquil, then the value of Y is defined as 1, If to be Y=sad, frightened, surprised, angry or the negative feeling such as envy for result, then the value of Y is defined as-1；If the change of mood coefficient Change and meet Markov character, have The most current mood depends on the emotion of a time point.

When being calculated the mood coefficient Y ＞ 0 of user, the mood of user is positive mental status.Now need not Consider the psychological factor of user, it is only necessary to display image information.When being calculated the mood coefficient Y ＜ 0 of user, user Mood be passive mental status.The image information with positive related information is now needed to present actively to adjust user Mental status.

It is illustrated in figure 2 a kind of emotional information recording mode of user.The emotion changes of record user in the way of calendar. According to a preferred implementation, in the way of at least one color, figure and/or color are combined, represent the kind of emotion with image Class.Such as, emotion classification is represented with the same color that depth degree is different, the color on the date on user by selecting same day The degree of depth represents the classification of emotion.Color A represents happy, and color B represents miss, and color C represents sadness, and color D represents indignation. See the degree of depth of date color in calendar, it is possible to intuitively observe classification and the change of user emotion.

As it is shown on figure 3, with time t as transverse axis, emotion classification is that the longitudinal axis forms emotion changes curve.The curve that Fig. 3 shows It is respectively the morning, noon, the emotion changes curve in evening.Emotion A represents anger, and emotion B represents miss, and emotion C represents calmness, Emotion D represents happy, and emotion E represents no record..The line segment that three kinds different is represented 8 a.m., 12 noon, afternoon or evening On emotion.As it is shown on figure 3, observe the emotion changes of user with time period 2015.12.25-2016.1.3 for the testing time.With The emotion changes of family 8 a.m. is happy-tranquil-tranquil-tranquil-happy-happy-no record-no record-no record.User The emotion changes of 12 is happy-miss-tranquil-happy-calmness-miss-calmness-no record-no record at noon.Under user The emotion changes at noon is tranquil-tranquil-happy-calmness-calmness-calmness-no record-miss-miss.

According to a preferred implementation, with time t as transverse axis, mood coefficient is that the longitudinal axis forms mood change curve.

The feelings of user can be got information about according to emotion changes curve and mood change curve, user or related personnel Thread changes.When finding negative feeling occur in continuous several days, related personnel can guide user to select to participate in some positive families Outer activity, or increase the time accompanying user, the mental status of regulation memory personnel.

Step S3: set up trigger message data base, completes trigger condition and original information data storehouse and related information data The association in storehouse, completes the trigger message based on user provides simultaneously and realizes image information at least one original information data storehouse Recommend.

In trigger message data base, data message includes trigger condition data that different images information shows and triggers bar Part and image information or the mapping relations data of related information.Trigger message that trigger message data base provides based on user and pass The data message of connection information database, extracts and produces the recommendation of raw information at least one original information data storehouse.

According to one preferred embodiment, the trigger condition data of image information display include Time Triggered data, Point trigger data, content trigger data, personage's trigger data and emotion trigger data.Described Time Triggered data include that user exists Special time, checks the image information in special time period.Such as, on same day March 1, can trigger and check institute in 1 day March in former years Corresponding image information.It is aobvious that described place trigger data includes that user's image information in implementation feature place, appointed place triggers Show.Described content trigger data include that user realizes the image information triggering display of corresponding event when experiencing particular event.Institute The task trigger data of stating includes that user realizes the image information triggering display of designated person when touching particular persons.Described feelings Thread trigger data includes that the image information that the specific emotional that user realizes when being in specific emotional is correlated with triggers display.

In described trigger message data base the mapping relations data of trigger condition and image information refer to by with each image The corresponding relation data that the related information that information is relevant is set up according to trigger condition.In trigger condition data, Time Triggered data are Time conditions describes with the time of image information in original information data storehouse and is associated, and place trigger data is that site condition is with former In beginning information database, the place of image information describes and is associated, and content trigger data are event content and original information data storehouse The event content of middle image information describes and is associated, and personage's trigger data is personage's condition and image letter in original information data storehouse The description of person of breath is associated, and emotion trigger data is that emotion condition is associated with emotional information in related information data base.And Each image in basic raw information storehouse is associated with the emotional information in related information data base.

According to one preferred embodiment, assist user to set up memory network and include that the psychographic information according to user adjusts The display state of each image in basic raw information storehouse, thus avoid the mental status of user that negative feeling occurs, make user The memory to relevant information is strengthened in positive mental status.Multiple images that psychographic information according to user is formed after adjusting Information information in time carries out arranging thus constitutes the dynamic memory network of user.Memory network carries to be had user The recall info of positive psychology effect.When the emotion of user changes, and the image information in memory network can dynamically be adjusted Whole.

As the mood coefficient Y ＜ 0 of user, when mood is passive state, extract and related information data according to mapping relations Image information that in storehouse, active mood is corresponding also shows, the image information that shielding associates with negative feeling.

Specifically, when the history emotional information analysis according to user obtain its mood be negative feeling time, according to the most former In beginning information bank, image information and the mapping relations of related information in related information data base, select and in related information data base Active mood association image information.By associate with active mood endure an image information according to graphical content occur time Between order show to tester, make at least one image information constitute the memory network with positive recall info.With The image information of negative feeling association is not displayed to tester, then tester will not recall or remember the memory letter of passiveness Breath, from the emotion passive without Chen Sheng.Tester remembers in emotion energetically, and memory effect is more preferable.

As the mood coefficient Y ＞ 0 of user, when mood is positive state or tranquility, extracts according to mapping relations and close In connection information database, active mood and/or image information corresponding to negative feeling, be shown to user.

Specifically, when the history emotional information analysis according to user obtain its mood be active mood or tranquil emotion time, Need not carry out selecting display to image information in basic raw information storehouse according to the related information in related information data base.Base The order of the time that at least one image information in this original information bank occurs according to graphical content shows to tester, makes At least one image information constitutes the unique memory network shown for tester sequentially in time.Tester During checking image information, tester is simultaneously in the dynamical feedback emotion classification to each image, related information data Related information in storehouse is updated according to the emotional information of user feedback.Basis while tester checks image information The emotional information of tester's dynamical feedback analyzes the mood change of tester.When the mood analyzing tester is changed to During negative feeling, according to the related information updated in related information data base, mask the image information associated with negative feeling, The most do not show the image information associated with negative feeling.Until the emotion changes monitoring tester is active mood, just take Disappear the shielding behavior to the image information associated with negative feeling.So, image letter is adjusted according to the emotion changes of tester The display rule of breath, defines the memory network dynamically changed for the emotion changes of tester.

Even if user specifies the conditions such as the event in image, time, personage, place, at the mood coefficient Y ＜ 0 of user In the case of, it is first according to mapping relations and extracts the image information associated with active mood in positive related information data base, so After select display to meet the image information of tester's specified requirements from the image information associated with active mood.

The image information being respectively associated with the emotion classification of user forms the note solely belonging to user according to time sequencing arrangement Recall network.The memory network of active mood and the memory network of negative feeling emotion changes based on user and change and need display Image information, strengthen user memory.Present invention, avoiding user and produce the situation of conflict owing to forcing to strengthen memory.

Embodiment 2

The present embodiment provides a kind of constructive memory network and uses it for strengthening the system of memory, as it is shown in figure 5, this system Including mobile terminal 10 and service end 20.Mobile terminal 10 is applicable to user and related personnel.Mobile terminal 10 is arranged on mobile terminal and sets On standby or computer.Mobile terminal device includes smart mobile phone, panel computer or notebook computer.Mobile terminal device passes through WiFi, bluetooth, ZigBee, mobile 2G, mobile 3G or mobile 4G realize the data transmission of mobile terminal 10 and service end 20.

Mobile terminal 10 includes MIM message input module 101, psychographic information acquisition module 102, original information data library module 103, raw information display module 104 and trigger message DBM 105.Service end 20 includes data analysis module 201 He Related information library module 202.Service end 20 is arranged in remote server.MIM message input module 101 for user check former During each image in beginning information data library module 103, express image information in the way of inputting voice, word or image Impression.MIM message input module 101 is additionally operable to user and feeds back mood, emotion class when checking each image in original information data storehouse Not, the favorable rating of image information or disagreeable degree, point are praised and shared.

According to a preferred implementation, MIM message input module 101 is additionally operable to user or related personnel and is inputted by image former Beginning information data library module 103 thus update original information data storehouse.

Psychographic information acquisition module 102 is for gathering the psychographic information of user.Psychographic information include user check original The mood produced during each image in information database and emotional information.

According to a preferred implementation, psychographic information acquisition module 102 is divided by the micro-expression gathering the face of user Analysis obtains the psychographic information of user.The psychographic information acquisition module 102 micro-expression by camera head collecting test personnel, and will Micro-expression transmission of user is analyzed to micro-Expression analysis module 203 of mobile terminal 20, obtains user and checks each image Time emotional information.

Original information data library module 103 is used for storing original information data storehouse, original information data storehouse for store with The image information that the memory of user is correlated with.Image information includes image and relevant information.Original information data storehouse includes the most former Beginning information bank and the relevant information storehouse relevant to image.Basic raw information storehouse needs the information phase of memory for storage and user At least one image closed.Relevant information includes the information such as time that each picture material occurs, place, personage, event.

Raw information display module 104 is for displaying to the user that the image information meeting display condition.Raw information shows Module 104 selects and the related information in corresponding related information library module 202 according to the analysis result of data analysis module 201 Association image information and be shown to user.

Trigger message DBM 105 is used for storing trigger message data base, data message in trigger message data base The trigger condition data shown including different images information and trigger condition and image information or the mapping relations of related information Data.Trigger message DBM 105 completes and trigger message number through the information that MIM message input module 101 provides based on user According to the coupling of trigger condition information in storehouse, and matching result is sent to data analysis module 201.Through data analysis module 201 After being analyzed to identify, extract and produce the recommendation of raw information at least one original information data storehouse.

Data analysis module 201 is for carrying out data analysis to the psychographic information of user.Preferably, data analysis module 201 analyze the mood of user according to the emotional information of the emotional information gathered or user feedback, and predict the real-time heart of user Feelings.

The related information database purchase of related information library module 202 has each image with original information data storehouse to associate Related information.Related information includes user's mood when checking each image in original information data storehouse, emotion classification, feelings Thread change curve, mood change curve, the favorable rating of image information or disagreeable degree, point are praised number of times and the letter such as share number of times Breath.

Micro-Expression analysis module 203, for being analyzed the micro-expression information received, extracts the emotion letter in micro-expression Breath.Micro-Expression analysis module 203, according to the face action of user in micro-expression, analyzes the emotion classification obtaining user.Emotion bag Include glad, sad, fear, indignation, detest, the emotion such as surprised and miss.The image that user is checked by micro-Expression analysis module 203 Associate with corresponding emotional information, and the related information of emotional information Yu image is stored to related information library module 202, from And make related information data base be updated.

A kind of constructive memory network that the present embodiment provides and use it for strengthening the operation principle of system of memory and be:

Original information data library module 103 is set up in mobile terminal 10 by user or related personnel, and by image and phase thereof Basic raw information storehouse that pass information stores respectively to original information data library module 103 and relevant information storehouse.Such as, by phase Electronic digital image is transmitted and stores to basic raw information storehouse by pass personnel in a wired or wireless manner.Or, by being correlated with The information that personnel's picture pick-up device pair based on mobile terminal is relevant to recall info shoots and stores to basic raw information Storehouse.

According to a preferred implementation, related information library module 202 is arranged on long-range server, with wired or nothing The mode of line and raw information display module 104 and MIM message input module data information.The number taken due to related information Less according to internal memory, it is simple to teletransmission.And datarams that image information takies is the most, if using teletransmission to be easily caused Image information needs the phenomenon that the long period carries out caching.Therefore, in original information data storehouse 103 is arranged on mobile terminal 10.

Test related personnel inputted by MIM message input module 101 relevant information of image and store to relevant information Storehouse.There is relation one to one in image and relevant information.Raw information display module 104 is based in original information data storehouse Image is arranged and shows by the Time To Event of each image sequentially in time, and what formation user checked initially remembers net Network.

When user checks each image in initial memory network, psychographic information acquisition module 102 collecting test image exists Check micro-expression during each image information.Micro-expression of user is labeled as and corresponding figure by psychographic information acquisition module 102 As association micro-expression and send the micro-Expression analysis module 203 to mobile terminal 20.Micro-Expression analysis module 203 is according to reception Face action analysis in micro-expression obtains user's emotional information when checking the image of correspondence.Micro-Expression analysis module 203 The incidence relation of the emotional information of analysis and corresponding image information is stored in related information data base.Therefore, user When checking each image in initial memory network, the emotional information associated with each image is constantly formed and stores to association letter In breath library module 202.

According to a preferred implementation, when user checks each image in initial memory network, optional by clicking on The mode selecting button feeds back the emotion classification associated with image, and emotion classification is the related information associated with image.Such as, use Family image information is carried out point " praise " or " clap brick " button, the emotion feeding back oneself is active mood or negative feeling.Or, Image information is shared by user, shares and represents that associate with image is active mood.MIM message input module 101 by user with Select button form input emotional information, share number of times, point praise number of times or clap brick number of times be associated with corresponding image Form relation information, and related information is stored in related information library module 202.

The emotional information of user feedback is the related information associated with image, also form the emotional information note of every day Record.

Data analysis module 201 predicts real-time emotional information according to the history emotional information of user.

Mood coefficient Y is that history emotional information based on described user predicts that described user works as cause in a probabilistic manner Thread, current emotional information be p (s | E_t-1, E_t-2..., E_t-n),

Wherein s represents the emotional information that described user is current, E_t-1For previous emotional information, E_t-nFor front n-th Emotional information, E_t-iThe emotional information of the expression front i & lt relative to current time t.

According to one preferred embodiment, described mood coefficient Y is carried out point according to the history emotional information of neighbouring n time Analysis, note t represents current time, t_iRepresent the time point that neighbouring i-th emotion is corresponding, t_iEmotion numerical value be e_t-i, then t and t_iIt Between time difference be Δ t=t-t_i, then e_t-iEmotion numerical value in current time is: E_t-i=e_t-i ^(t)=f (e_t-i, Δ t)= e_t-i* exp (-Δ t/ (24*60*60)), above formula considers emotion value by the time Decay Rate of exponential damping, wherein e_t-iIt is 1；

According to the history emotion numerical value of passing n time, it is calculated as follows and predicts mood coefficient:

Wherein to be combined into S={ happy, light, tranquil, sad for emotion collection Wound, frightened, surprised, angry, envy }；If result is the active mood such as Y=is happy, light or tranquil, then the value of Y is defined as 1, If to be Y=sad, frightened, surprised, angry or the negative feeling such as envy for result, then the value of Y is defined as-1；If the change of mood coefficient Change and meet Markov character, have The most current mood depends on the emotion of a time point.

As the mood coefficient Y ＜ 0 of user, the mood of user is passive state.Data analysis module 201 is by the mood of user Classification sends to raw information display module 104.Raw information display module 104 extracts and related information number according to mapping relations According at least one image information that active mood in storehouse is corresponding, and by least one image information according to Time To Event Order is shown to user.Mood according to user selects and the image information that shows defines corresponding with the psychographic information of user Brand-new memory network.

As the mood coefficient Y ＞ 0 of user, mood is positive state.The mood classification of user is sent out by data analysis module 201 Deliver to raw information display module 104.Now the mental status of user is fine, can accept the image information of passiveness, the most former Beginning information display module 104 need not select image information.Raw information display module 104 is by original information data storehouse 103 Image information all show according to the order of image time of origin.

User checks each image information that image information module 104 shows when, psychographic information module 102 is simultaneously Gathering the psychographic information of user, or user is simultaneously at feedback related information.Related information library module 202 is according to the heart of user The related information of reason information and feedback constantly updates related information data base.Data analysis module 201 is according to related information storehouse mould Data after block 202 renewal dynamically analyze the mood of user.When data analysis module 201 analyzes the mood coefficient Y ＜ of user 0, mood is changed to being suitable for of passive state, and the mood classification transmission of user is shown by data analysis module 201 to raw information Module 104.The image information of display in original information data storehouse is adjusted by raw information display module 104 again, will be with The not display of the image information of negative feeling association, forms brand-new memory network.Therefore, the image information base in memory network Mental status in user is changed, and image information is remembered in positive mental status by user, and memory effect is bright Aobvious lifting.

Such as, when the mood of user is happy when, raw information display module 104 will not shield and close with negative feeling The image information of connection, but show image information according to the requirement of user.When the mood of user is sad when, raw information Display module 104 can shield the image information associated with negative feeling, and the image information that will associate with active mood, including user The image information praised of point, user expressed the image information of favorable rating and showed in a certain order, looked into for user See, strengthen the memory in terms of user's active mood further, so that the mental status of user is more positive.

Embodiment 3

The present embodiment is to embodiment 1 and the improvement further of embodiment 2 and illustrates, the present embodiment is artificial with user for old age Example illustrates.

Set up original information data storehouse.The present embodiment illustrates with raw information for image information.The family members of old people Or non-electronic photo once is stored as electronic image by the form of shooting by caregiver or old people oneself.Or, The electronic image stored by other electronic equipments transmits in a wired or wireless manner to original information data storehouse.The family of old people The relevant information of image can be inputted original information data storehouse by genus or caregiver or old people oneself.Relevant information includes The time that image occurs, place, personage and event.Such as, " 2015, second son carries granddaughter to sprout the Mid-autumn Festival of going home ".

Raw information display module 104 is by each image in original information data storehouse and relevant information sequentially in time Display.The time of every image spacing, by user setup, can be 10S, it is also possible to for 30S.User moves in the way of touch-control Image.Image removes image information display screen according to the movement locus of user.According to a preferred implementation, when limiting In, if user does not has flip through images information, image information is changed automatically to next image information.

According to the side that psychographic information during each image checked to relative users in described original information data storehouse is relevant Formula creates and updates the related information of respective image, sets up the related information data base relevant to respective image.

As shown in Figure 4, raw information display module 104 shows two image P sequentially in time₁With image P₂.Image P₁Time t₁Early than image P₁Time t₂.Relevant information A₁With relevant information A₂It is separately positioned on image P₁With image P₂Attached Closely.According to a preferred implementation, relevant information A₁Can also be arranged on the top of image, lower section, the left side and the right, or The vacant position of image.According to a preferred implementation, relevant information can synthesize one with image and be accompanied with word Image.

Button B₁And B₂Button is praised for point.When old people is when checking image, the operation being praised button by clicking point is expressed certainly Oneself emotion.According to a preferred implementation, when old people is when checking image, by clicking on the behaviour of different expression buttons Make to express the emotion classification of oneself.Old people puts the emotion classification related information storage as this image of number of times and the selection praised To related information data base.

Old people, when checking each image in original information data storehouse, passes through letter with the form of voice, word or image Breath input module inputs the impression oneself checking image information and the recall info recalled.

If old people does not the most check image information for one day and provides emotion record information.MIM message input module 101 is with sound The mode of sound reminds old people to record emotion or mood.

The history emotional information of old people is analyzed by data analysis module 201, draws the emotion of old people in time The emotion changes curve of change, as shown in Figure 3.Emotion changes curve shows the children parent of old people in an intuitive fashion Belong to the emotion changes situation of old people.When finding negative feeling occur in continuous several days, can be suitable increase accompanies old man's Time, or system is according to the mood label condition of a photo, and multidirectional old man shows some photos associated with active mood, This can preferably cause the memory of old man, the emotion of regulation old man, increases the sense of pride and the happiness of old man to a certain extent.

Meanwhile, data analysis module 201 predicts real-time emotion according to the history emotional information of old people.

The number of times that the point of image is praised by data analysis module 201 and click thread classification number of times are added up, by data message Send to related information data base, make related information data base be updated.

Such as, by have selected four kinds artificial for the emotion of old man: happy, tranquil, miss, angry.Above two kinds belong to long-pending Pole emotion, latter two then belongs to negative feeling.It is diversified owing to affecting the factor of people's emotion, therefore in analysis of history feelings On the basis of thread, it is contemplated that real-time influence factor.Mood coefficient Y is that history emotional information based on described user is with probability Mode predicts described user's current emotional, current emotional information be p (s | E_t-1, E_t-2..., E_t-n), wherein s represents described use The emotional information that family is current, E_t-1For previous emotional information, E_t-nFor the emotional information of front n-th, E_t-iRepresent relative to working as The emotional information of the front i & lt of front moment t.

According to one preferred embodiment, described mood coefficient Y is carried out point according to the history emotional information of neighbouring n time Analysis, note t represents current time, t_iRepresent the time point that neighbouring i-th emotion is corresponding, t_iEmotion numerical value be e_t-i, then t and t_iIt Between time difference be Δ t=t-t_i, then e_t-iEmotion numerical value in current time is: E_t-i=e_t-i ^(t)=f (e_t-i, Δ t)= e_t-i* exp (-Δ t/ (24*60*60)), above formula considers emotion value by the time Decay Rate of exponential damping, wherein e_t-iIt is 1；

According to the history emotion numerical value of passing n time, it is calculated as follows and predicts mood coefficient:

Wherein emotion collection be combined into that S={ is happy, tranquil, miss, raw Gas }；If result is time to be Y=happy or tranquil, then the value of Y is defined as 1, if result is Y=miss or angry, then and the value definition of Y For-1.

When taking care to be with one's heart at several Y ＜ 0, the mood of old people is more low, and raw information display module 104 will show With the image that today, occurrence was recorded in the former years of active mood information association, old people is showed to leaf through, system meeting Give up those more passive photos.The image information of the active mood of display forms the positive memory network of old people.This Sample can help old man to recall, and stimulates their memory ability, to a certain extent, can regulate again the emotion of old man.

When taking care to be with one's heart at several Y ＞ 0, the mood of old people is glaier, then can ignore old man's when extracting image information Mood factor, only need to consider time factor.And as Y ＜ 0, then the image extracted must meet time factor with old simultaneously People's mood factor.Therefore, show different memory network according to the emotion changes of old people, make the life of old people both away from disappearing Pole emotion hypermnesis again.

The image acquired a special sense can be marked according to a preferred implementation, old people and related personnel thereof Note.The most special red-letter day occurrence image.Raw information display module has the image information of special mark in display Time, the button of display " remember/forget ".Old people is by clicking on whether button feedback oneself remembers this specific event.If it is old Year people's selection is to forget, then can proceed over time to remind.If but remember, then can not remind, or Just remind after the longer interval time.

According to a preferred implementation, raw information display module 104 show in the way of time shaft image information and Its related information.Old people, when checking image information, mainly checks image, relevant information, time of origin and emotional information four Individual important content.Simple information shows that being more beneficial for old people accepts and understand.The present embodiment combines the mood of old people, has It is associated reminding to old people targetedly, the old man memory of effective reinforcement.

According to a preferred implementation, raw information display module 104 by image information according to single with age for the time The time sequencing of position shows.Such as, old people specifies the image information checking the Mid-autumn Festival.Raw information display module 104 basis The specified requirements of old people, by with the Mid-autumn Festival about and the image information of applicable old people mental status this moment with the age as time Unit shows.As shown in Figure 4, t₁Time is the eighties in 20th century, t₂Time is the nineties in 20th century.

Embodiment 4

According to another aspect of the present invention, the present embodiment provides a kind of constructive memory network and uses it for strengthening memory Method include step:

S11: set up multimedia information lib；

S12: according to psychographic information phase when checking each image in described multimedia information lib with corresponding test object The mode closed creates and updates the related information of respective image；

S13: set up the memory correlation database relevant to respective image；

S14: set up memory network for corresponding test object.

Step S11: set up multimedia information lib.

The multimedia information lib set up includes image library and relevant information storehouse.Image library is relevant to recall info for storage Image.Relevant information storehouse is for storing Word message, graphical information and the markup information relevant to each image.

Image library and relevant information storehouse are associated together in the way of mapping.Each image correspondence in image library is correlated with At least one relevant information in information bank.Relevant information includes the Word message describing picture material, and picture material occurs Time, place, the personage related to, the name of personage and identity and the time of generation.Relevant information can be in the mistake gathering image By test object or related personnel's input in journey, it is also possible to check the process of each image in graphical information storehouse at test object In, test object input according to recall info.

According to a preferred implementation, the mode gathering image includes picture or filming image being become by camera head Image stores to multimedia information lib.The mode gathering image also includes the image of electronic digital form by wired or nothing The mode of line is transmitted and is stored to multimedia information lib.Preferably, test object or related personnel can also revise and many matchmakers The relevant information that image in body information bank is corresponding, revises the mistake in relevant information or supplementary relevant information.

According to one preferred embodiment, the relevant information that the image in multimedia information lib is corresponding can be simultaneously Display.When testing object and checking image, image information associated therewith is simultaneously displayed in screen.Preferably, corresponding with image Relevant information show based on the test idsplay order that sends of object.Relevant information can show in the form of a label.Survey Examination object can check each image in multimedia information lib by least one mode.If test object does not limit image Content, then according to the time of origin of event in image be sequence arrangement check image information.If test object specifies image event Occur time period, content, place, personage, then can check appointment the time period in, content, place, the image information of personage.

Step S12: according to psychographic information phase when checking each image in multimedia information lib with corresponding test object The mode closed creates and updates the related information of respective image.

Related information refers to the information associated with each image in multimedia information lib.Image is checked at test object Time, its psychology can produce fluctuation, mood or emotion and can change.The psychographic information produced when testing object and checking image is The psychographic information associated with image, i.e. related information.Related information mainly includes the emotion letter of the test object associated with image Breath, emotion information, emotion changes information, to the favorable rating of image information, express the point liked and praise number of times, share number of times, table Reach the information such as the bat brick number of times that do not likes.Related information is test object master when each image checked in multimedia information lib The dynamic psychographic information fed back or the psychographic information obtained by micro-expression of monitoring and test object by relevant device.By related information The mapping relations corresponded to each other are set up with image.One image at least one related information corresponding.

According to a preferred implementation, in the way of gathering micro-expression of described test object, analyze described test object Emotion information when each image checked in described multimedia information lib.When image information occurs, the face of test object Micro-expression actions such as portion occurs narrowing eye simultaneously, eyebrow tightens up, the corners of the mouth is drop-down, chin lifts or tightens up, then test object checks this Emotion changes during image is sad.Then this image is set up mapping relations with the sad emotion in related information, i.e. this image Sad with negative feeling it is associated.

According to a preferred implementation, when each image checked in multimedia information lib, test object is with optional Select the formal character of button emotion now or mood or image information liked or disagreeable emotion.Test object passes through a little Hit button and feed back emotion when checking this image.According to a preferred implementation, each in checking multimedia information lib During image, the record impression to image information in the way of input voice, word or figure of test object.

The emotion information of test object feedback is also analyzed and predicts the emotion of test object by the present invention.By test The emotion information of object record every day analyzes emotion coefficient, obtains testing object emotion changes curve within a period of time and the heart Feelings change curve.

According to a preferred implementation, the history emotion of test object decays in time, so that test object Current emotion change according to the change of history emotion information.The current emotion information of test object is based on described test object History emotion information be analyzed in a probabilistic manner, current emotion information Y is Y=max_s∈S(p(s|E_t-1, E_t-2..., E_t-n)), wherein, emotion set S={S₁、S₂、…S_i, S_iRepresent emotional category, E_t-1For previous emotional information, E_t-nTable Show the history emotional information of front n-th, n >=1, and E_t-n∈ S, then emotion information Y is to analyze the described test object obtained Emotion information.Such as, S₁Represent happiness, S₂Represent sadness, S₃Represent fear, S₄Express surprise, S₅Represent indignation.

Preferably, if the emotion information change of test object meets Markov speciality, then current emotion information depends on The most limited history emotion information, i.e. Y=p (E_t|E_t-1, E_t-2..., E_t-n).Such as, as n=2, current emotion information Y =max_s∈S(p(s|E_t-1, E_t-2)；As n=1, current emotion information Y=max_s∈S(p(s|E_t-1)。

History emotion information E_t-nHaving Decay Rate, index is decayed in time, i.e.

Wherein e_t-nThe emotion numerical value of n-th before representing, Δ t represents the time t that the emotion of front n-th occurs_nWith present time t Time difference.Current emotion information depends on history emotion information attenuation change in time.According to the side of being preferable to carry out Formula, e_t-nInitial value the emotion scale of standard can be used to measure, or acquiescence compose initial value be 1.Such as, artificially set Put emotion scale as shown in table 1.

Table 1: emotion scale

Emotional category	Value
		Happy	2
Sad	2
		Frightened	2
Surprised	2
		Indignation	2

Such as, front primary history emotion information is recorded as happiness, n=1, and the record time with d current time difference is 24 hours, e_t-1Initial value be 2.The happy value of the current time then testing object is

$\begin{array}{c}{E}_{t-1}=e_{t-1}^{\left(t\right)}=e_{t-1}*\exp (-(12*60*60)/(24*60*60))\\ =2*\exp (-1)=0.5\end{array}$

Current emotion information Y=max_s∈S(p(s|E_t-1)=0.5, the current emotion information i.e. testing object is happiness, happiness Happy value is 0.5.

Before secondary history emotion information be recorded as sadness, n=2, record time and d current time difference are 48 little Time, if e_t-2Default value is 2.The sad value of the current time then testing object is

$\begin{array}{c}{E}_{t-2}=e_{t-2}^{\left(t\right)}=e_{t-2}*\exp (-(48*60*60)/(24*60*60))\\ =2*\exp (-2)=0.25\end{array}$

Then test the emotion information value of object current time

Y=max_s∈S(p(s|E_t-1, E_t-2)=max_s∈S(p (s | 0.5,0.25)=0.5, emotional category is happy.

Step S13: set up the memory correlation database relevant to respective image.

Test the object emotion classification when each image checked in multimedia information lib, emotion changes curve, mood Change curve, the favorable rating of image information or disagreeable degree, point are praised number of times deposit with each image with sharing number of times and constituting Related information in corresponding mapping relations.Related information is stored in note according to positive related information and negative relation information classification Recall in correlation database.Memory correlation database is arranged in remote server.At test each in checking multimedia information lib of object During image, image information shows with corresponding related information simultaneously.Or, at test object in checking multimedia information lib During each image, related information is based on test object checks that instruction shows.

When testing object each image information in checking multimedia information lib, the pass relevant to psychographic information of feedback Connection information changes, then memory correlation database is updated according to the feedback information that test object is up-to-date.The number of memory correlation database According to based on test object, the emotion changes of each image in multimedia information lib is updated.

Step S14: set up memory network for corresponding test object.

Each image in multimedia information lib is associated with the emotion information in memory correlation database.Therefore according to test The psychographic information of object adjusts the display state of each image in multimedia information lib, thus avoids testing the mental status of object Negative feeling occurs, makes test object strengthen the memory to relevant information in positive mental status.According to test object Multiple image informations information in time that psychographic information is formed after adjusting carries out arranging thus constitutes the dynamic of test object Memory network.Memory network carries the recall info to test object with positive psychology effect.Emotion when test object Changing, the image information in memory network can dynamically adjust.When the emotion testing object is Negative Affect, according to Mapping relations are extracted the image information corresponding with active mood in memory correlation database and show, the figure that shielding associates with negative feeling As information.

Specifically, when according to test object history emotion information analysis obtain its mood be negative feeling time, according to many Image information and the mapping relations of related information in memory correlation database in media information storehouse, select positive with remember in correlation database The image information of emotion association.By the order of the time that the image information associated with active mood occurs according to graphical content Show to tester, make at least one image information constitute the memory network with positive recall info.With negative feeling The image information of association is not displayed to tester, then tester will not recall or remember the recall info of passiveness, thus The emotion of passiveness will not be produced.Tester remembers in emotion energetically, and memory effect is more preferable.

When the emotion testing object is positive emotion, extract and active mood in memory correlation database according to mapping relations And/or the image information that negative feeling is corresponding, it is shown to test object.

Specifically, when according to test object history emotion information analysis obtain its mood be active mood time, it is not necessary to Carry out selecting display to image information in multimedia information lib according to the related information in linked database.In multimedia information lib The order of time that occurs according to graphical content of at least one image information show to tester, make at least one image believe Breath constitutes the unique memory network shown for tester sequentially in time.Image information is checked tester During, tester simultaneously in the dynamical feedback emotion classification to each image, the related information in memory correlation database according to The emotion information of test object feedback is updated.While tester checks image information the most anti-according to tester The emotion information of feedback analyzes the mood change of tester.When the mood analyzing tester is changed to negative feeling, root According to the related information updated in memory correlation database, mask the image information associated with negative feeling, the most do not show and passive feelings The image information of thread association.Until the emotion changes monitoring tester is active mood, just cancels and closing with negative feeling The shielding behavior of the image information of connection.So, adjust the display rule of image information according to the emotion changes of tester, formed The memory network that dynamically changes for the emotion changes of tester.

Even if test object specifies the conditions such as the event in image, time, personage, place, in the emotion of test object In the case of Negative Affect, it is first according to mapping relations and extracts the image letter associated with active mood in actively memory correlation database Breath, then selects display to meet the image information of tester's specified requirements from the image information associated with active mood.

The image information being respectively associated with the emotion classification of test object solely belongs to test according to time sequencing arrangement formation The memory network of object.The memory network of active mood and the memory network of negative feeling emotion changes based on test object and Change the image information needing display, strengthen the memory of test object.Present invention, avoiding test object due to force add hypermnesia Recall and produce the situation of conflict.

It should be noted that above-mentioned specific embodiment is exemplary, those skilled in the art can be open in the present invention Find out various solution under the inspiration of content, and these solutions also belong to disclosure of the invention scope and fall into this Within bright protection domain.It will be understood by those skilled in the art that description of the invention and accompanying drawing thereof be illustrative and not Constitute limitations on claims.Protection scope of the present invention is limited by claim and equivalent thereof.

Claims (10)

1. a constructive memory network and use it for strengthen memory method, it is characterised in that described method at least include with Lower step:

Psychology different when setting up original information data storehouse and check raw information in described original information data storehouse according to user State carries out data renewal to described raw information, and the data of renewal is stored in related information data base, sets up simultaneously Trigger message data base；

Trigger message that described trigger message data base provides based on user and the data message of related information data base, extract and produce The recommendation of raw information at least one original information data storehouse raw, to assist user to set up memory network.

2. constructive memory network as claimed in claim 1 and the method using it for strengthening memory, it is characterised in that described touch The mental status data of trigger condition and described related information data base and/or described original information data in photos and sending messages data base The raw information in storehouse sets up mapping relations.

3. constructive memory network as claimed in claim 2 and the method using it for strengthening memory, it is characterised in that described touch Trigger condition kind in photos and sending messages data base at least includes Time Triggered, place triggering, personage's triggering, content trigger and emotion Trigger；

Wherein said emotion triggers and triggers and related information number for trigger message data base mood based on user coefficient Y, emotion The mapping relations of mental status data and the mapping relations of mental status data and raw information according to storehouse are extracted and are produced at least The recommendation of raw information in one original information data storehouse.

4. constructive memory network as claimed in claim 3 and the method using it for strengthening memory, it is characterised in that the described heart Being with one's heart at several Y is that history emotional information based on described user predicts described user's current emotional information, currently in a probabilistic manner Emotional information be p (s | E_t-1, E_t-2..., E_t-n),

Wherein s represents the emotional information that described user is current, E_t-1For previous emotional information, E_t-nEmotion for front n-th Information, E_t-iThe emotional information of the expression front i & lt relative to current time t.

5. constructive memory network as claimed in claim 4 and the method using it for strengthening memory, it is characterised in that the described heart Being with one's heart at several Y to be analyzed according to the history emotional information of neighbouring n time, note t represents current time, t_iRepresent neighbouring i-th emotion Corresponding time point, t_iEmotion numerical value be e_t-i, then t and t_iBetween time difference be Δ t=t-t_i, then e_t-iWhen current Between emotion numerical value be,

E_t-i=e_t-i ^(t)=f (e_t-i, Δ t)=e_t-i ^*exp(-Δt/(24*60*60))

Above formula considers emotion value by the time Decay Rate of exponential damping, wherein e_t-iIt is 1；

According to the history emotion numerical value of passing n time, it is calculated as follows and predicts mood coefficient:

Y=max_s∈S(p(s|E_t-1, E_t-2..., E_t-n)), wherein emotion collection is combined into that S={ is happy, sad, frightened, surprised, anger Anger, envy }；

If the change of mood coefficient meets Markov character, there is Y=max_s∈S(p(s|E_t-1), the most current mood depends on The emotion of one time point.

6. constructive memory network as claimed in claim 4 and the method using it for strengthening memory, it is characterised in that according in advance The value of the mood coefficient Y recorded, extracts and produces the recommendation of raw information at least one original information data storehouse.

7. constructive memory network as claimed in claim 1 and the method using it for strengthening memory, it is characterised in that described pass The data of connection information database are that user checks mental status data different during raw information in described original information data storehouse, Can be by record the facial expression described mental status data of acquisition analyzing user.

8. constructive memory network as claimed in claim 7 and the method using it for strengthening memory, it is characterised in that the described heart Reason status data also includes described user mental status data based on raw information actively typing, described mental status data bag Include positive state and passive state, and set up mapping relations with corresponding raw information.

9. constructive memory network as claimed in claim 1 and the method using it for strengthening memory, it is characterised in that add hypermnesia The step recalled at least includes: set up original information data storehouse, completes user to raw information basic in raw information with to substantially The typing of the relevant information that information is described, it is achieved the user's first review to raw information；

The trigger message provided based on user and the data message of related information data base, trigger message data base extracts generation extremely The recommendation of raw information in a few original information data storehouse, it is achieved user's review again to raw information；

Based on user's impression degree of depth to raw information, raw information display device is capable of carrying for described raw information Wake up and show, to realize user's looking back again raw information, thus realize strengthening the purpose of user's memory.

10. constructive memory network as claimed in claim 1 and the method using it for strengthening memory, it is characterised in that described The raw information in original information data storehouse comprise basic raw information and describe basic raw information relevant information, described substantially Raw information is at least the one in image or sound, and the relevant information of the basic raw information of described description is at least the most former The additional description that a class in the time of beginning information, place, personage, content is carried out.