JP2018189682A - Information presentation system, program and information presentation method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information presentation system for performing information presentation corresponding to individuals having a difference in cognitive ability.SOLUTION: An information presentation system is constructed by using: event processing means for receiving arbitrary event registration including a message content and generating a message transmission notice on an event satisfying a condition; message selection means for selecting a presented message following the message content by adjusting the message to a cognitive function of an individual becoming a transmission target on the registered event; and message presentation means for voice-synthesizing the presented messages selected by the message selection means and voice-outputting the presented message selected on the basis of the message transmission notice to a terminal of the individual being the transmission target.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information presentation system for presenting various types of information to be notified to a user in accordance with individual information.

  In recent years, many things such as information appliances, smartphones, and IoT devices (Internet of Things device) are connected to a communication network. In addition, a mechanism for setting an event notification desired by an individual person on a smartphone or the like has become widespread. The event notification function according to the schedule is implemented in, for example, a mailer application, a calendar application, and an alarm application. This event notification function executes a specified operation at a specified date, notifies other applications of a predetermined event notification, presents a message, and sounds an alarm. In addition, an alarm application or the like has a mechanism that operates so that an event once notified is re-notified after a predetermined time has elapsed.

  In addition, the reminder application can receive an event notification at a desired terminal on the condition of any time or place. In addition, the reminder is also provided with a function that allows other persons (terminals) in a predetermined group such as a family to perform event notification.

  As described above, there is an information presentation system that notifies various types of information to be notified to the user by appropriately setting conditions. For example, a mailer or a message application can be used to immediately notify a required message to a destination designated as a destination. Similarly, there is an information presentation system in which various types of information desired to be notified to the user are designated by time and place as conditions, and notified when the conditions are achieved.

  The following patent documents are listed as techniques related to the present invention.

  Patent Document 1 discloses an autonomous support system (information presentation system) that assists a user in performing a scheduled action. This information presentation system is a mechanism in which an information processing system and a plurality of sensor nodes cooperate to promote user autonomy support. Specifically, the information processing system sends a voice message prompting the user to take action, monitors the output of the sensor for recognizing the achievement of the predetermined action, and if the desired sensor output is not obtained, the information processing system again Send out a voice message prompting the user to act.

  Japanese Patent Application Laid-Open No. 2004-228867 describes an information presentation apparatus that allows a user to more reliably perform a scheduled action. In this information presentation device, physical state management information that predicts the physical state of each user's time zone, and presentation management information that is presented for each piece of presentation information that presents the physical state of the user who can implement the presentation content. It memorizes and presents the presentation information in a time zone in which the user can implement the presentation information.

  Patent Document 3 discloses a human behavior determination device that determines a behavior taken by a person through image analysis. This person behavior determination device converts the information into a trajectory (person trajectory) traced by the same person, and determines (estimates) the action taken by the person based on the person trajectory.

  Patent Document 4 discloses a method for obtaining behavior information favorably with a general-purpose portable terminal. In this method, based on the output of an acceleration sensor that is mounted on a mobile terminal or the like for general purposes, highly accurate behavior information such as walking / running, climbing up / down stairs, as well as stationary / moving of the user Can be obtained.

JP 2014-38512 A Japanese Patent Application No. 2016-120899 Japanese Patent No. 5285575 JP 2011-206274 A

  The event notification received from the information presentation system includes user's own settings and settings other than the users. As described above, time and place can be used as the conditions set for event notification. Further, the event notification condition may be that a certain terminal is in the vicinity, or a plurality of conditions may be combined.

  By the way, the inventors are examining a mechanism for transmitting an arbitrary message to a user in a voice message format in accordance with an event. At this time, when the message is read as it is, there are cases where the message content is difficult to be transmitted due to the individual's cognitive ability.

  With the technique disclosed in Patent Document 1, it is possible to determine whether the message content has been transmitted by sensing the user's behavior with respect to the message. Further, according to the technique disclosed in Patent Document 2, it is possible to present a required message in a time zone of a physical state where the message content can be grasped more reliably.

  Therefore, the inventors have studied a mechanism for providing information in a voice that is more convenient and suitable for each individual. In addition, based on the differences in individual cognitive abilities, we examined a mechanism for more accurately transmitting message content.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide an information presentation system, a program, and an information presentation method for presenting information corresponding to individuals with different cognitive abilities.

  An information presentation system according to an embodiment of the present invention receives an arbitrary event registration including a message content, generates an event processing means for generating a message transmission notification for an event that satisfies a condition, and the event registered event, Based on the message transmission notification, a message selection means for selecting and processing a presentation message in accordance with the message content in accordance with the cognitive function of an individual who is a transmission target, and a voice synthesis of the presentation message selected by the message selection means And a message presenting means for outputting the selected presentation message to a personal terminal as a transmission target.

  A program according to an embodiment of the present invention includes an event processing unit that receives an event registration including a message content and generates a message transmission notification for an event that satisfies a condition. For the event, the message selection means for selecting and processing the presentation message according to the message content in accordance with the recognition function of the individual as the transmission target, and the message transmission notification by synthesizing the presentation message selected by the message selection means The present invention is characterized by operating as a message presenting means for outputting a presentation message selected on the basis of a message to a personal terminal of a transmission target.

  An information presentation method by an information presentation system according to an embodiment of the present invention accepts an arbitrary event registration including a message content, and converts the event registered into the message content according to an individual's cognitive function as a transmission target. The presenting message selected by the message selecting means is synthesized, the message transmission notification is generated for the event that satisfies the condition, and the selected presentation message is selected based on the message transmission notification. A voice is output to a personal terminal of a transmission target.

  ADVANTAGE OF THE INVENTION According to this invention, the information presentation system, program, and information presentation method which perform the information presentation corresponding to the individual with a difference in cognitive ability can be provided.

It is the block diagram which showed roughly the operation system of the information presentation system 1 which concerns on the 1st Embodiment of this invention. It is the block diagram which showed the structural example of the information presentation system 1 which concerns on 1st Embodiment. It is explanatory drawing which visualized the example of a structure and content of the database 40 used with the information presentation system 1. FIG. It is explanatory drawing which visualized the confirmation message group used with the information presentation system. 6 is a sequence diagram showing an example of a preliminary setting operation of the information presentation system 1. FIG. It is the sequence figure which showed the operation example which notifies the voice message (presentation message) of the information presentation system. It is explanatory drawing which showed the flow and example sentence of one information transmission model with which possibility of transmitting a message content correctly with an audio | voice was raised. It is explanatory drawing which showed the table information which showed the alerting and the preceding chain | strand which comprise a part of presentation message visually. It is explanatory drawing which showed the table information which showed visually the presentation message group comprised using the model matched with cognitive ability for every message content. 5 is an example of a flowchart when messages are exchanged interactively by the message presentation unit 30. It is the block diagram which showed the structural example of the information presentation system 2 which concerns on 2nd Embodiment. It is an example of the flowchart at the time of exchanging a message interactively of the message presentation unit 30 of the second embodiment. It is the block diagram which showed one structural example of the information presentation system of this invention. It is the block diagram which showed another structural example of the information presentation system of this invention.

  Embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a block diagram schematically showing an operation system of the information presentation system 1 according to the first embodiment. FIG. 2 is a block diagram illustrating a configuration example of the information presentation system 1 according to the first embodiment. 3 and 4 are explanatory diagrams visualizing a configuration example and contents of the database 40 used in the information presentation system 1.

  As shown in FIGS. 1 and 2, the information presentation system 1 according to the present embodiment includes an event processing unit 10, a message selection unit 20, a message presentation unit 30, and a database 40. The information presentation system 1 is connected to various terminals such as an administrator terminal 100 and a user terminal 200 via a communication network such as a dedicated line or an Internet line. The administrator terminal 100 and the user terminal 200 may appropriately employ a personal computer, a smartphone, a tablet, a smart home appliance, a robot, an IoT device (speaker, various sensors, a camera, and the like). The administrator terminal 100 and the user terminal 200 establish a connection with the information presentation system 1 by using an optical line or a mobile communication line as a medium via a device such as an STB (Set Top Box) or a router, if necessary. It is constructed so that various messages and event notifications can be sent and received as appropriate. In the information presentation system 1, the user terminal 200 is generally allocated to one user. However, a user terminal 200 shared by a plurality of users may be provided, or one user may have a plurality of user terminals 200. The operation system to be used may be used.

  The event processing unit 10 accepts event registration that is an event for sending an arbitrary voice message. Thereafter, when the registered event satisfies the condition, the event processing unit 10 generates a message transmission notification for the event as a trigger.

  This event registration includes message contents and trigger conditions. The event registration may be notified to the information presentation system 1 in any format. This event registration is, for example, a message notification that immediately presents a message to a specified user, an alarm notification that presents a message to a specified user at a predetermined time, or a message when a predetermined condition is satisfied for a specified user. Reminder notifications, etc. This event registration may be an event that presents a message to all service users, all specific groups, or a plurality of designated users. Although not particularly limited, for example, an arbitrary message notified from the administrator terminal 100 to the user terminal 200, an event such as a calendar function or an alarm function registered in the user terminal 200, or a broadcast message such as disaster prevention information is registered as an event registration. Accept it. As described above, the event processing unit 10 may appropriately receive an event notification that is a source of a voice message transmission event, and register and hold the received event notification for each user.

  Note that the notification event is not limited to an external source, and the information presentation system 1 itself has an arbitrary plurality of types of event processing programs (calendar function, alarm function, reminder function, etc.), and the message presenting unit 30 receives a voice message. You may comprise so that the message transmission notification which notifies transmission may be notified.

  When an event is registered, the message selection unit 20 selects a presentation message according to the message content according to the index of the cognitive function of the user (individual person as a transmission target). In other words, the optimum presentation message suitable for the state of the individual's cognitive function is selected from the database 40, and the optimum message can be provided to the user when the event condition is achieved. The index indicating the user's cognitive function is registered in the database 40 (user information). By this selection process, the message selection unit 20 determines a presentation message that is converted into voice by the message presentation unit 30 and output.

The presentation message that is selected by the message selection unit 20 and is more easily recognized can often be generated by any one or combination of the following.
a) Select a presentation message whose contents are decomposed for each operation.
b) Select a presentation message whose content is changed to a short message.
c) Selecting a presentation message with a content that repeats the message content a plurality of times. A plurality of types of presentation messages according to the selection or combination of a) to c) are preliminarily determined by the administrator or the like in accordance with the user's cognitive function. Can be created. For example, when the content of one message is transmitted to a plurality of users, the administrator may input a plurality of presentation messages matched with an index indicating each cognitive function into the database 40.

  In addition, the cognitive ability of individuals changes with the time of day and year. For this reason, in order to select and process a presentation message suitable for the cognitive ability of each individual at the transmission timing of the presentation message by information processing, the presentation message matched with an index indicating a plurality of cognitive functions for one message content is stored in the database 40. It is preferable to hold. The presentation message may be stored in association with the statistically calculated reaction time for each cognitive ability.

  This mechanism for sharing a presentation message allows the same type of presentation message to be transmitted to individual users who have the same kind of cognitive function, and there is also a presentation message that appropriately responds to fluctuations in the cognitive ability of an individual. It becomes possible to provide. The presentation message group may be held in any format, but as one method, it may be registered in the database 40 in the text information format.

  The presentation message group stored in the database 40 may be stored so that it can be used by other users, or may be stored exclusively for individual users, groups, and service providers. Also, the information presentation system 1 may be constructed so that both the common presentation message that is open to other users and the dedicated presentation message that is kept secret can be properly used.

  Each message content is preferably modeled for each type of message content and stored in the database 40. In each information transmission model, the order for generating a presentation message that is easier to recognize for each cognitive function, decomposition method, paraphrase, number of repetitions, etc. are registered. By adopting this modeling structure, common use and reuse of each presentation message can be promoted. This model will be described later with reference to FIG.

  In addition, as an index indicating the cognitive function, an individual person's cognitive function may be expressed by a plurality of parameters as necessary, so that an appropriate combination can be selected by the individual user. As the individual parameters, for example, each degree of comprehension, short-term memory retention, attention, and orientation can be used. Furthermore, user attributes such as age, gender, regionality (dialect), medical condition, and disease name are used together with indicators and individual parameters that indicate cognitive functions, so that appropriate combinations can be selected by individual users. Good. That is, it is possible to promote message selection processing methods (model selection) and attribute correction methods (replacement of words, replacement of proper nouns of objects, dialectization, etc.) according to attributes.

  In this way, the message selection unit 20 identifies the message selection processing method and the correction method according to the personal recognition function and attribute of the transmission target, and receives the received event according to the identified message selection processing method and correction method. It is good also as selecting the presentation message and correction method for.

  In addition, the message selection unit 20 adds additional information that indicates the voice output method of the presentation message to the presentation message based on the user's reaction and / or response to the outputted presentation message, and sends it to the message presentation unit 30. It is good also as notifying.

  The information included in the additional information (parameter setting) includes, but is not limited to, inflection correction / volume correction / pitch correction / speed correction.

  In addition, the additional information may include reading a name or adding a pretend, which is a voice message frequently repeated. It is not always necessary for the message presentation unit 30 to convert the voice of the name reading and pre-translated additional information. For example, a voice message with a high repetition frequency may be stored as a voice message on the user terminal 200 side and called when necessary.

  The message presenting unit 30 includes a speech synthesizing unit and synthesizes the presentation message selected by the message selecting unit 20, and outputs the synthesized message to the individual user who is the transmission target. Moreover, the message presentation part 30 should just output an audio | voice content with respect to the terminal preset for every transmission target individual. In addition, the message presentation unit 30 preferably has a voice recognition unit. Similarly, it is desirable that the message presentation unit 30 includes a behavior determination unit that determines a user's behavior and a cognitive ability measurement unit that measures a user's cognitive function. Although the cognitive ability measurement unit is not particularly limited, it may have a mechanism for determining an individual's cognitive ability based on, for example, a user's response or response to a confirmation message (voice message) prepared in advance. The cognitive ability test by the confirmation message may be performed for each parameter of the cognitive function. Further, the cognitive ability measuring unit may determine the cognitive ability based on the degree of establishment of interactive conversation, response / response time, and the like. In addition, the cognitive ability measurement unit may provide a mechanism that allows a user to input a general cognitive function test (application) using the user terminal 200.

  For the speech synthesis / speech recognition / behavior determination unit / cognitive ability measurement, the structure shown in FIG. 2 includes a speech synthesis unit, a speech recognition unit, a behavior determination unit, and a cognitive ability measurement unit in the message presentation unit 30. However, the speech synthesis unit, speech recognition unit, behavior determination unit, and cognitive ability measurement unit may be provided outside the message presentation unit 30, or the speech synthesizer / speech recognition device / behavior determination unit outside the information presentation system 1 A cognitive ability measurement device (for example, a voice synthesis server, a voice recognition server, a behavior determination server, or a cognitive ability measurement server) that operates in cooperation with the present system may be used.

  When the user has a plurality of audio output destination terminals, the output destination terminal may be changed for each message content or each presentation message. The voice synthesis method, the voice data format, and the voice transmission method are not particularly limited. For example, streaming distribution or MP3 file (MPEG-1 Audio Layer-3 File) or WAVE file (RIFF waveform Audio Format File) may be used. Further, it is desirable that a voice message (synthesized voice) once voice-synthesized is stored in the database 40 as it is and linked to a presentation message for management. For this voice message, the information presentation system 1 may include a mechanism for deleting a voice message that has already been voice synthesized from the database 40 after a certain period of time. By providing this mechanism, it is possible to reuse and discard a voice message obtained by voice synthesis of a presentation message based on the frequency of use.

  Further, the message presenting unit 30 may adjust the speech synthesis method according to an index indicating the cognitive function of the individual of the transmission target and output the presented message to the individual of the transmission target. For example, the user with low cognitive function may perform intonation enhancement correction, adjustment for slowing down the reading speed, and the like. The cognitive function and the voice output destination (destination) may be acquired with reference to the database 40. As described above, the correction instructed as additional information by the message selection unit 20 may be performed. Further, the message presenting unit 30 may be configured to output, as additional information, additional information for instructing the user terminal 200 on the voice file already present on the terminal side together with the voice synthesized presentation message.

  The database 40 may be constructed in any way, but as shown in FIGS. 2, 3, and 4, the index (cognitive function information) indicating the individual's cognitive function and the cognitive ability for each message content are matched. In addition, it is possible to adopt a configuration in which a plurality of presentation messages (presentation message group) and a synthesized voice group synthesized by speech are held separately. The database configuration shown in FIG. 2 is divided into a user information database 41 and a common information database 42. In the user information database 41, an index indicating an individual's cognitive function and an individual event are registered, and in the common information database 42, a presentation message group and a synthesized voice group are registered. An attribute may be added to the group of presentation messages, and limited items such as groups, services, individuals, service providers, and message senders may be registered. In addition, in the database 40 (common information database 24), voice adjustment parameter information used for voice synthesis and correction may be held in correspondence with an index indicating a cognitive function or individual parameters. The cognitive ability shown in FIG. 3A is assumed to be in a state of decreasing in the order of (high) cognitive ability 1> cognitive ability 2> cognitive ability 3 (low). In FIG. 3A, the individual parameters of the cognitive function are set only for the user 4. In this way, there may be a mixture of users who register subdivided parameters and users who do not register. FIG. 3B shows a database structure in which attributes are assigned to messages. FIG. 3C shows a database structure in which each message is associated with a presentation message for each indicator of cognitive function. It is also possible to construct a database format that manages information in these databases on the same table. The database 40 may use a storage resource outside the information presentation system 1 (for example, a storage server that can operate in cooperation with the system).

  Moreover, the database 40 is good also as holding | maintaining the confirmation message group used when confirming an individual's cognitive ability each time, as shown in FIG. It is desirable to prepare a large number of confirmation messages for each individual parameter of the cognitive function. The confirmation message prepared for each parameter of the cognitive function is a question for determining a sub-item of the user's cognitive function. In the example shown in FIG. 4, “Cognitive function confirmation (composite)” used when comprehensively determining the user's cognitive function, and four parameters (understanding ability, short-term memory, attention, and orientation) are made to correspond. Many cognitive function confirmation messages have been prepared.

  In the configuration illustrated in FIG. 2, event-related setting information that holds events (such as alarms), reminder conditions, past presentation history, and the like that are notified to each user later in the user information database of the database 40. Is provided for each user together with the user's cognitive function information. On the other hand, it is also possible to configure the system so that common event management information used by the event processing unit 10 is used without providing event-related settings for each individual user.

  With this configuration, the information presentation system 1 enables information presentation corresponding to individuals who have different cognitive abilities.

  Next, the present invention will be described by showing an operation example of the information presentation system 1.

  FIG. 5 is a sequence diagram illustrating an example of a preliminary setting operation of the information presentation system 1.

  The information presentation system 1 accepts registration of individual user information from the administrator terminal 100 (S101). At this time, an index of an individual's cognitive function is set. This personal recognition function may be set by dividing into a plurality of parameters for each item, as exemplified by the user 4 in FIG. Moreover, what is necessary is just to register a user attribute as needed at this timing.

  Further, the information presentation system 1 receives and registers information (type, IP address, usable function, etc.) regarding the user terminal 200 for each user (S102). When a plurality of user terminals 200 are assigned to a certain user, the setting may be made at this point.

  Similarly, the information presentation system 1 accepts and registers a default event setting for each user (S103). This specified event is an event that generates an arbitrary voice message, and although there is no particular limitation, for example, an alarm time spoken by the user can be set, or an event shared by service providers can be registered. That's fine. In this registered event, a message to be notified (message content) is input, and when the conditions such as time and place are satisfied, the event processing unit 10 of the information presentation system 1 sends a message transmission notification to the event presenting unit. 30 will be notified. Then, at the timing of receiving this message transmission notification, the event presentation unit 30 synthesizes the presentation message selected by the message selection unit 20 in advance or immediately before and outputs the synthesized message to the individual (terminal) as a transmission target. It will be.

  Event registration and message registration are always accepted, and updates (addition / change / deletion etc.) of various items in the database may be accepted as needed (S104). If there is the same kind of presentation message already registered in the database 40, the information presentation system 1 may present the presentation message to the registrant and select whether to update or not. This event registration may be automatically executed by an event notification including message contents from outside the system. For example, a system may be constructed so that short message service notifications and e-mails including message contents are handled as events to be executed immediately.

  Further, as illustrated, various setting registrations may be received from the user terminal 200 so that the user himself or his family can be set (S105).

  It should be noted that the registration and update of the presentation message for each cognitive ability with respect to the message content is not necessarily performed from the administrator terminal 100 or the user terminal 200, and the database 40 may be adjusted from the outside. In this way, it is possible to construct a system in which messages such as message content and cognitive ability can be represented by more appropriate content, and professionals such as linguistics, social welfare workers, and volunteers can act on behalf. It is also desirable to be able to compile presentation messages used for events that have already been processed. This makes it possible to adjust to a more appropriate presentation message before notifying each user of the same type of message content next time.

  FIG. 6 is a sequence diagram illustrating an operation example of notifying the voice message of the information presentation system 1.

  The information presentation system 1 (event processing unit 10) appropriately receives event registration from the inside or outside of the system (S201). At this time, registration of a presentation message for each cognitive ability from the registrant is accepted as necessary. The information presentation system 1 may disclose a confirmation message to a registrant by presenting a group of presentation messages already registered in the database 40.

  Next, when the event is registered, the information presentation system 1 (message setting unit 20) inquires an index of the cognitive function of the destination user (S202), and selects a presentation message that matches the cognitive function ( S203).

  Next, the information presentation system 1 (message presentation unit 30) prepares (voice synthesis) at least the selected presentation message (S204). It should be noted that information processing resources can be reduced if a message once synthesized by speech is stored and managed in the database 40 as it is.

  The processing steps from S202 to S204 are referred to as recognition support processing steps. By providing this cognitive support processing step, it becomes possible for the event registrant to transmit the message contents (contents to be transmitted, contents to be requested, etc.) with contents that would be more accurate for each individual addressee.

  Next, the information presentation system 1 (the event processing unit 10 and the message presentation unit 30) generates a message transmission notification when the event condition is satisfied (S205), and uses the message transmission notification as a trigger as a destination user terminal. Connected to 200, the voice-synthesized presentation message is output as a voice (S206). Although the voice of the presentation message may be output to the user alone, it is desirable to transmit the message content interactively by combining voice messages that call the user.

  The mechanism for outputting the voice-synthesized presentation message is not particularly limited. For example, a speaker such as a personal computer, a tablet, or an IoT terminal having a speaker function registered as the user terminal 200 may be used. . Further, if registered as the user terminal 200, a smart home appliance or a speaker of a robot may be used to output the presentation message synthesized by voice on the system side. Further, for example, the information presentation system 1 may select a user terminal 200 with a user in the vicinity and output the voice-combined presentation message with the terminal as a destination.

  Next, the information presentation system 1 (message presentation unit 30) collects the user's response / reaction / result obtained through the user terminal 200 as necessary, and records the result (S207).

  Here, a model of an information transmission method related to an exchange using a voice synthesized presentation message corresponding to S206 in FIG. 6 will be described. This information transmission model is a model used for a user who has been confirmed to have a decline in cognitive ability. Here, an index representing the cognitive function of the user in this state is “cognitive ability 3”. The information transmission method is not limited to this model, and may be appropriately constructed based on the user's cognitive ability, the user's preference, the importance of the message content, and the like.

  FIG. 7 shows a flow and example sentence of an information transmission model in which the possibility of correctly transmitting the message contents by voice is increased. The message content to be transmitted to the user of this example sentence is “Please bring XX to the day service”.

This information transmission model is configured by arranging the following items in order. The brackets indicate the expected interactive conversation.
1. Alert (Mr. XX, are you okay?)
2. Confirm user response / response (what?)
3. Leading chain (Today is a day to go to day service)
4). Information transmission (Since you will be picked up, how about putting XX in your bag?)
5. Confirmed user's response / reaction (Thank you, I put XX in my bag)
By using this information transmission model, even if the cognitive ability is lowered, the message content to be actually transmitted is transmitted and the possibility that the message content is executed is increased.

  In this information transmission model, the registered message content “Please bring XX to the day service” is registered as “Welcome soon, so why not put XX in your bag?”. In other words, based on the message content, the transmission information is modified according to the cognitive ability. In addition, attention, response confirmation, and subsequent confirmation (cognition confirmation, action confirmation) are added. In addition, a leading chain is added to support memory derivation based on cognitive ability.

  By modeling in this order, it is possible to execute information transmission that would be optimal for each cognitive ability.

  Next, an example of processing in which the message presentation unit 30 executes exchange of presentation messages according to the information transmission model illustrated in FIG. 7 will be described.

  FIG. 8 is table information that visually shows a reminder and a preceding chain that form part of the presentation message. FIG. 9 is table information visibly showing a group of presentation messages configured using a model in association with the cognitive ability for each message content. Note that individual texts such as a reminder and a preceding chain, which are presented messages, are prepared by being converted into speech by the message presentation unit 30.

  As in the example of FIG. 7, the message (message content) registered in the event used in the following description is assumed to be “Please bring XX to the day service” in FIG. 9A. This message content is registered in the information presentation system 1 as an event addressed to the user. This registered event is triggered on the condition of time, day service vehicle position information, etc. (toward the event triggering of the flow shown in FIG. 6). Note that the alerting and the preceding chain that form a part of the presentation message may be stored in, for example, common information in the database 40, but there is no particular limitation on the storage format, storage location, and the like. The example of transmitting the message contents of FIG. 9B and FIG. 9C is omitted, but the ability to recognize the message contents via the voice message according to the registered information transmission model as in the following explanation. Communicate to users according to

  The information presentation system 1 prepares a text to be read in accordance with the message content in accordance with the information transmission model (a model suitable for each cognitive ability) associated with the cognitive ability index, and in advance or when an event is triggered. Speech synthesis. This text-to-speech can be reused by dividing it into appropriate phrases and synthesizing them. In the above example, at least “Mr. XX, are you okay?”, “Today is the day to go to the day service”, “Since you will be picked up, how about putting XX in your bag?” To do.

  Thereafter, the information presentation system 1 operates as follows when interactively exchanging messages with the user (S205 in FIG. 6).

  FIG. 10 is an example of a flowchart illustrating a process in which the message presentation unit 30 executes exchange of presentation messages along the information transmission model illustrated in FIG.

  The message presentation unit 30 receives a message transmission notification from the event detection unit 10, refers to relevant information (destination, cognitive ability, presentation message, etc.) in the database 40, and first alerts a voice message as a part of the presentation message. (Notice 1) is sent out by voice (S301), and the user's responses and reactions are collected to confirm the response intention (S302). Note that the response intention may be implemented using information collected from the user terminal 200 itself or a sensing device installed in the vicinity, such as voice recognition, image analysis, behavior monitoring, predetermined operation of the user terminal 200, and the like. One or a combination of these may be implemented. For example, by using the techniques described in Patent Document 3 and Patent Document 4, the response intention may be determined from the user's behavior.

  Next, the message presentation unit 30 sends out a voice message including the preceding chain information (preceding chain 1) as a part of the presented message in accordance with the response / reaction of the user (S303), and then the message content is displayed. The voice message including the actual message is sent out (S304).

  Subsequently, the message presentation unit 30 collects user responses and reactions and confirms recognition and behavior (S305). Recognition and action confirmation may be performed by the same method as the previous confirmation of response intention, or may be switched to another method, or may be performed in combination with voice recognition technology or the like.

  In addition, as shown in S306, when the message presenting unit 30 incorporates the process of confirming the response intention (S302) or confirming the recognition or action (S305), the message presenting unit 30 predicts the presentation message already output in each process. Collecting the responses and / or responses to be performed, returning each step based on the presence / absence of the response / response and the degree of the response / response, measuring the current user's cognitive ability, terminating the dialogue, It is desirable to notify an alert to a predetermined organization or the like.

  For example, when the message presentation unit 30 fails to obtain a predicted response and / or response to the output presentation message, the message presentation unit 30 measures the user's cognitive ability with the cognitive ability measurement unit and sends the message selection unit 20 to the message What is necessary is just to comprise so that a re-selection process may be requested. Upon receiving this request for reselecting the presentation message, the message selection unit 20 reselects the presentation message corresponding to the measurement result, and notifies the message presentation unit 30 of the request result. Thereafter, the message presentation unit 30 resumes the flow from, for example, S304, and outputs a presentation message that can be easily recognized by the user at the present time.

  In addition, regarding the timing of additional cognitive ability measurement based on the presence / absence of response / response and the degree of reaction / response, make the setting to measure cognitive ability when sending the same message content next time. Good. For the setting to measure the cognitive ability next time, for example, an arbitrary cognitive ability measurement flag may be provided in the user information, and this flag may be set when a desired response / response to arbitrary information presentation is not obtained. By providing this flag, the user's cognitive ability can be identified (confirmed) before the process of selecting the message content when the same type of message content is sent next time.

  As mentioned above, in this interactive message exchange, the intention of the message content accepted by event registration “Please bring XX to the day service” is incorporated in accordance with cognitive ability . In this way, by selecting and sending out the presentation message in accordance with the individual's cognitive function as a transmission target, the message content is transmitted and the execution probability can be increased. That is, it is possible to present information corresponding to individual persons having a difference in cognitive ability.

[Second Embodiment]
Next, a second embodiment of the present invention will be described. FIG. 11 is a block diagram illustrating a configuration example of the information presentation system 2 according to the second embodiment.

  The configuration of the information presentation system 2 of the second embodiment is the same as that of the first embodiment as shown in FIG. The second embodiment includes a mechanism for providing an appropriate presentation message to each individual user while determining a change in the cognitive function of the user in real time. Hereinafter, the difference with respect to the information presentation system 1 of the information presentation system 2 is demonstrated in detail, and description is simplified or abbreviate | omitted about a common part.

  The information presentation system 2 (message presentation unit 30) of the second embodiment includes a cognitive ability measurement unit that measures (confirms) a user's cognitive function at the time of message presentation using a confirmation message.

  In the information presentation system 2, the confirmation message illustrated in FIG. 4 is prepared in advance, and during the interactive message exchange with the user, the question and behavior grasping that confirms (measures) the user's cognitive function is performed. To do. The cognitive ability test by the confirmation message may be performed for each parameter of the cognitive function.

  As one aspect, the message presenting unit 30 presents a confirmation message used for confirming the cognitive function at the timing of transmitting the presentation message in accordance with the individual's cognitive function as a transmission target (the timing of receiving the message transmission notification). It is sufficient to send it as a pretend. This confirmation message is used for confirming (measuring) the individual's cognitive ability each time. Confirmation (measurement) of the cognitive ability may be performed by sensing the user's response / response after sending a confirmation message to confirm whether the cognitive function is within an allowable range.

  As a method for determining a pre-post message (confirmation message) by the message presentation unit 30, as disclosed in Patent Document 1, a desired sensor output can be obtained after sending a voice message prompting the user to act. It is only necessary to select a specific presentation message that satisfies a certain condition of frequency and frequency when there are none. For example, there is a method of pretending a presentation message with the smallest number of times when a desired sensor output cannot be obtained after sending out a voice message that prompts an action. Conversely, there may be a method of pretending a presentation message having the largest number of times when a desired sensor output cannot be obtained after sending out a voice message that prompts an action.

  In accordance with the result, the value of the cognitive ability previously set for the user is changed (corrected) so as to match the current cognitive ability. As a result of checking and correcting the cognitive ability, it is possible to select a more suitable presentation message (ie, a presentation message that is easier to recognize at the present time) by re-selecting the current appropriate cognitive ability. A presentation message that is easier to recognize can be selected if, for example, a parameter of cognitive ability or related cognitive ability is adjusted to the measurement result or operates so as to be further lowered.

  Moreover, it is good also as setting a condition to implement the question and action grasp which confirm (measure) a user's cognitive function. For example, as a condition for confirming (measuring) a user's cognitive function and behavior grasping, as disclosed in Patent Document 1, a desired sensor output is obtained after sending a voice message prompting the user to act. What is necessary is just to carry out when the frequency | count and frequency when not obtaining satisfy | fills fixed conditions. As a specific example, if a desired sensor output is not obtained three times after sending a voice message that prompts an action, a method may be used in which a cognitive ability test using a confirmation message is performed.

  Here, the operation flow of the information transmission model described above will be described.

  FIG. 12 is a flowchart example when the message presenting unit 30 of the second embodiment interactively exchanges messages. Similar to FIG. 10 described above, a presentation message or the like is transmitted by voice in accordance with the flow of the set information transmission model according to the user's cognitive function. The type of confirmation message and the confirmation method may be appropriately included in the conversation content by changing the model registered in the database 40, for example. A plurality of confirmation messages may be used as necessary.

  First, the message presentation unit 30 receives a message transmission notification, refers to the database 40, and sends an alerting voice message (S401).

  Next, the message presentation unit 30 outputs a confirmation message in speech during the conversation with the user, identifies the response / reaction of the user, and measures the cognitive ability (confirmation) along with confirming the response intention ( S402). The measurement of cognitive ability may reflect the establishment of a conversation, response / response time, and the like. In the measurement of the cognitive ability, the cognitive ability of the user is confirmed (discriminated) in real time, and the message selection unit 20 reselects the message content as a presentation message that makes it easier to recognize the message as necessary. At this time, the message selection unit 20 may additionally send a confirmation message from one or a plurality of terminals set in advance for each individual of the transmission target, or collect a reaction and / or a response.

  Next, in response to the user's response / reaction, the message presenting unit 30 sends out a voice message including the preceding chain information (preceding chain 1) as a part of the presented message (S403), and subsequently the message content. The voice message including the actual message (presentation message suitable for the user's cognitive ability) is sent out (S404).

  Subsequently, the message presentation unit 30 collects the user's responses and reactions and confirms recognition and behavior (S405).

  Thereafter, the message selection unit 20 and the message presentation unit 30 move together to shift to a routine that would be appropriate for the current state of the user (S406). For example, re-sending of a presentation message, measurement of cognitive ability, intention confirmation, etc. may be performed.

  In this way, it is possible to determine in real time whether to switch to the optimal cognitive ability index by incorporating user response, response, and behavior measurement from interactive establishment and behavior characteristics during interactive conversation. It becomes possible. It is also possible to adopt a mechanism for measuring the fluctuation amount of the cognitive ability without determining the cognitive ability itself. For measurement / judgment of fluctuation amount, the fluctuation amount value can be acquired in a short time as appropriate from the establishment rate of the conversation, the content of the answer to the question, the response time to the answer, etc. without imposing an excessive burden on the user become.

  In addition, when the message selection unit 20 cannot obtain a predicted reaction and / or response to the presentation message output by the message presentation unit 30, the message selection unit 20 can select an optimum presentation message that is easier to recognize for the received transmission event. Selection (re-selection processing) becomes possible.

  The predicted response and / or response to the presentation message may be collected by directly using one or a plurality of sensor outputs as disclosed in, for example, Patent Document 1 and Patent Document 2, or Patent Document 3 As in the technology disclosed in Japanese Patent Application Laid-Open No. H11-133707 and Patent Document 4, user actions may be collected using functions installed in a terminal such as a smartphone.

  Further, the above-described processing for confirming (correcting) the user's cognitive ability in real time using a confirmation message may be performed for each parameter of the cognitive function. For example, when the cognitive function is expressed by four parameters of comprehension, short-term memory retention, attention, and orientation, a confirmation message and behavior characteristics corresponding to each parameter are prepared in advance and interactive with the user. While exchanging messages, the user's cognitive function may be confirmed using the presence / absence of response to the confirmation message, the response time, and the behavioral characteristics.

  Each parameter of the cognitive function can be determined more accurately by adding a dialogue with the voice recognition function together with sensing and behavior grasping as appropriate.

  In accordance with the result, the value of the cognitive ability previously set for the user is changed (corrected) so as to match the current cognitive ability. As a result of the confirmation and correction of the cognitive ability, it is possible to select a presentation message that is more suitable for the user (ie, a presentation message that is easier to recognize) by reselecting the current appropriate cognitive ability.

  As described above, the message content is transmitted and the execution probability can be further increased by selecting the presentation message according to the cognitive function at that time of the individual who is the transmission target and transmitting it by voice.

  As described above, the information presentation system to which the present invention is applied can perform information presentation corresponding to individuals who have different cognitive abilities. In the prior art, the cognitive function of the target user was screened, but the content of information presentation to the user was not changed using the result. On the other hand, by confirming the cognitive ability by voice conversation or sensing the reaction, it is possible to realize a low burden on the user and a short time for the cognitive ability test, thereby improving the convenience of the system. Further, in the present invention, the content of information presentation to the user can be changed to an appropriate content using the result of the question for determining the subordinate items of the cognitive function. Therefore, it can be assumed that the content of information presentation is transmitted accurately. Furthermore, it is possible to deal with both short-term and medium- to long-term fluctuations in cognitive functions of multiple users using this mechanism.

  Each unit of the information presentation system may be realized by using a combination of hardware and software of a computer system illustrated in FIGS. The computer system includes one or more processors and memory tailored to the desired form. Further, in this computer system form, each unit is configured such that an information presentation system program is developed in the memory, and hardware such as one or more processors is operated by an execution instruction group or a code group based on the program. What is necessary is to realize. At this time, this program may realize each unit in cooperation with functions provided by software such as an operating system, a microprogram, and a driver, as necessary.

  The program data expanded in the memory appropriately includes an execution instruction group, a code group, a table file, content data, and the like that cause the processor to operate as one or more of the above-described units.

  In addition, this computer system does not necessarily need to be constructed as a single device, and is constructed by so-called thin clients, distributed computing, or cloud computing by combining a plurality of servers / computers / virtual machines. Also good. Further, a part / all of the computer system may be replaced with hardware or firmware (for example, one or a plurality of LSI: Large-Scale Integration, FPGA: Field Programmable Gate Array, a combination of electronic elements). Similarly, only a part of each part may be replaced with hardware or firmware.

  Further, this program may be recorded non-temporarily on a recording medium and distributed. The program recorded on the recording medium is read into the memory via wired, wireless, or the recording medium itself, and operates a processor or the like.

  In this specification, the recording medium includes storage media, memory devices, storage devices, and the like having similar terms. Examples of this recording medium include an optical disk, a magnetic disk, a semiconductor memory device, a hard disk device, and a tape medium. The recording medium is desirably non-volatile. The recording medium may be a combination of a volatile module (for example, RAM: Random Access Memory) and a nonvolatile module (for example, ROM: Read Only Memory).

  In other words, the information processing resource that causes the processor to operate as an information presentation system is operated as an event processing unit, a message selection unit, and a message presentation unit based on an information presentation program expanded in a memory. As a result, an information presentation system can be realized.

  Similarly, if the above-described form is described in another expression, the recording medium includes an information presentation program that is expanded in a memory and operates on an information processing resource. The information processing resource includes an event processing step, a message selection step, and a message presentation. The information presentation system can be constructed by executing this in a timely manner.

  It should be noted that the present invention has been described by exemplifying embodiments. However, the specific configuration of the present invention is not limited to the above-described embodiment, and modifications within a range not departing from the gist of the present invention are included in the present invention. For example, changes such as separation and merging of block configurations and replacement of procedures in the above-described embodiments are free as long as they satisfy the gist of the present invention and the functions described, and the above description does not limit the present invention.

In addition, a part or all of the above-described embodiments can be described as follows. Note that the following supplementary notes do not limit the present invention.
[Appendix 1]
Event processing means for accepting any event registration including message content and generating a message transmission notification for an event that satisfies the condition;
For the event registered event, a message selection means for selecting and processing a presentation message in accordance with the message content according to the cognitive function of an individual who is a transmission target;
A message presenting means for synthesizing the presentation message selected by the message selecting means and outputting the selected presentation message based on the message transmission notification to a personal terminal as a transmission target;
An information presentation system comprising:

[Appendix 2]
When the message presenting unit cannot obtain a predicted response and / or response to the output presented message, the message presenting unit determines the individual cognitive ability of the transmission target for each individual parameter of the cognitive function, and the message selecting unit Notify the re-selection process of the presented message,
The message selection means selects a presentation message that is easier to recognize for the message content of the received transmission event,
The information presentation system as described in the above supplementary note, wherein the message presentation means outputs a presentation message that is easily recognized by an individual who is a transmission target at present.

[Appendix 3]
The information presentation system according to the above-mentioned supplementary note, further comprising a database that holds a plurality of presentation messages that match the cognitive ability for each message content.

[Appendix 4]
The message presenting means collects a predicted response and / or response to a presentation message that has already been output, and sends the same type of message content next time based on the presence / absence of the reaction / response and the degree of the response / response. The information presentation system according to the above supplementary note, wherein the setting for performing the measurement of cognitive ability is performed.

[Appendix 5]
The message selection means puts the confirmation message used for confirmation of the cognitive function into a conversation using a presentation message,
The message presenting means measures an individual's cognitive ability of the transmission target based on a predicted response and / or response to the output confirmation message, and presents the message selection means to make the message content easier to recognize at the present time. The information presentation system described in the above supplementary note, wherein the message is subjected to selection processing.

[Appendix 6]
The said message selection means adds a confirmation message to the front of a presentation message, when selecting a presentation message according to the cognitive function of the individual used as a transmission target, The information presentation system of the said supplementary note characterized by the above-mentioned.

[Appendix 7]
The information presentation system according to the above supplementary note, wherein the message presentation unit corrects the voice of the presentation message to be output to the individual of the transmission target according to the cognitive function and attribute of each individual of the transmission target.

[Appendix 8]
The information presentation system according to the above supplementary note, wherein the message selection unit is built on a cloud system.

[Appendix 9]
Information processing system
Event processing means for accepting any event registration including message content and generating a message transmission notification for an event that satisfies the condition;
For the event registered event, a message selection means for selecting and processing a presentation message in accordance with the message content according to the cognitive function of an individual who is a transmission target;
A message presenting means for synthesizing the presentation message selected by the message selecting means and outputting the presented message selected based on the message transmission notification to a personal terminal as a transmission target;
A program characterized by operating as

[Appendix 10]
When the message presenting unit cannot obtain a predicted response and / or response to the output presented message, the message presenting unit determines the individual cognitive ability of the transmission target for each individual parameter of the cognitive function, and the message selecting unit Notify the re-selection process of the presented message,
The message selection means selects a presentation message that is easier to recognize for the message content of the received transmission event,
The program according to the above-mentioned supplementary note, wherein the message presenting means operates to output a presentation message that can be easily recognized by an individual who is a transmission target at the present time.

[Appendix 11]
The message presenting means collects a predicted response and / or response to a presentation message that has already been output, and sends the same type of message content next time based on the presence / absence of the reaction / response and the degree of the response / response. The program according to the above-mentioned supplementary note, which is operated so as to perform a setting for performing measurement of cognitive ability.

[Appendix 12]
The message selection means puts the confirmation message used for confirmation of the cognitive function into a conversation using a presentation message,
The message presenting means measures an individual's cognitive ability of the transmission target based on a predicted response and / or response to the output confirmation message, and presents the message selection means to make the message content easier to recognize at the present time. The program according to the above supplementary note, wherein the program is operated so as to cause the message to be selected.

[Appendix 13]
The message selecting means operates so as to add a confirmation message to the front of the presentation message when selecting the presentation message in accordance with the cognitive function of the individual as a transmission target. program.

[Appendix 14]
The program according to the above-mentioned supplementary note, wherein the message presenting means operates to correct the sound of the presentation message to be output to the individual of the transmission target according to the cognitive function and attribute of each individual of the transmission target. .

[Appendix 15]
Accept any event registration including message content,
For the event registered event, the presentation message along the message content is selected according to the cognitive function of the individual who is the transmission target,
Speech synthesis of the presentation message selected by the message selection means,
A message transmission notification is generated for an event that satisfies the conditions, and the presentation message selected based on the message transmission notification is output to the personal terminal of the transmission target by voice.
An information presentation method by an information processing system.

[Appendix 16]
The information processing system includes:
When the predicted response and / or response to the output presentation message cannot be obtained, the individual cognitive ability of the transmission target is determined for each parameter of the cognitive function, and the message selection means reselects the presentation message. Notice
Select and process a presentation message that is easier to recognize for the message content of the received sending event,
Output a presentation message that can be easily recognized by the individual whose communication target is currently being transmitted,
The information presentation method as described in the above supplementary note.

[Appendix 17]
The information processing system collects predicted responses and / or responses to the presentation messages that have already been output, and sends the same type of message content next time based on the presence / absence of the response / response and the degree of the response / response. The information presentation method according to the above-mentioned supplementary note, wherein the setting for performing the measurement of cognitive ability is performed.

[Appendix 18]
The information processing system includes:
Put the confirmation message used for confirmation of the cognitive function into the conversation using the presentation message,
Measuring the individual's cognitive ability of the target of transmission based on the predicted response and / or response to the output confirmation message, and causing the message selection means to select and process a presentation message that is more easily recognized at the present time;
The information presentation method as described in the above supplementary note.

[Appendix 19]
The information processing method according to the above supplementary note, wherein the information processing system adds a confirmation message to the front of the presentation message when selecting the presentation message in accordance with the cognitive function of the individual as a transmission target.

[Appendix 20]
The information processing method according to the above supplementary note, wherein the information processing system corrects the voice of the presentation message to be output to the individual of the transmission target in accordance with the cognitive function and attribute of each individual of the transmission target.

  The present invention, for example, supports the elderly's autonomous behavior in an aging society, and makes it possible to prolong the life of the elderly. In addition, the present invention can provide a life support solution for patients with congenital / progressive dementia of cognitive function.

  The decline in cognitive function due to age often decreases overall over the long term, varying from day to day. On the other hand, people who have already been diagnosed with a specific case often have the same tendency. According to the present invention, it is possible to provide a presentation message suitable for a plurality of cognitive functions prepared for each message content in accordance with a user's cognitive function as appropriate, and in addition, it is possible to share the presentation message.

1, 2 Information presentation system 10 Event processing section (event processing means)
20 Message selection section (message selection means)
30 Message presenting part (message presenting means)
40 Database 100 Administrator terminal 200 User terminal

Claims (10)

Event processing means for accepting any event registration including message content and generating a message transmission notification for an event that satisfies the condition;
For the event registered event, a message selection means for selecting and processing a presentation message in accordance with the message content according to the cognitive function of an individual who is a transmission target;
A message presenting means for synthesizing the presentation message selected by the message selecting means and outputting the selected presentation message based on the message transmission notification to a personal terminal as a transmission target;
An information presentation system comprising: When the message presenting unit cannot obtain a predicted response and / or response to the output presented message, the message presenting unit determines the individual cognitive ability of the transmission target for each individual parameter of the cognitive function, and the message selecting unit Notify the re-selection process of the presented message,
The message selection means selects a presentation message that is easier to recognize for the message content of the received transmission event,
2. The information presentation system according to claim 1, wherein the message presentation means outputs a presentation message that can be easily recognized by an individual who is a transmission target at present.   The information presentation system according to claim 1, further comprising a database that holds a plurality of presentation messages according to cognitive ability for each message content.   The message presenting means collects a predicted response and / or response to a presentation message that has already been output, and sends the same type of message content next time based on the presence / absence of the reaction / response and the degree of the response / response. The information presentation system according to any one of claims 1 to 3, wherein a setting for performing measurement of cognitive ability is performed. The message selection means puts the confirmation message used for confirmation of the cognitive function into a conversation using a presentation message,
The message presenting means measures an individual's cognitive ability of the transmission target based on a predicted response and / or response to the output confirmation message, and presents the message selection means to make the message content easier to recognize at the present time. The information presentation system according to claim 1, wherein the message is subjected to selection processing.   The message selection means adds a confirmation message to the front of the presentation message when selecting the presentation message in accordance with an individual's cognitive function as a transmission target. The information presentation system according to item.   The said message presentation means correct | amends the audio | voice of the presentation message voice-outputted to the individual of the transmission target according to the cognitive function and attribute for every individual of the transmission target. Information presentation system described in 1.   The information presentation system according to claim 1, wherein the message selection unit is built on a cloud system. Information processing system
Event processing means for accepting any event registration including message content and generating a message transmission notification for an event that satisfies the condition;
For the event registered event, a message selection means for selecting and processing a presentation message in accordance with the message content according to the cognitive function of an individual who is a transmission target;
A message presenting means for synthesizing the presentation message selected by the message selecting means and outputting the presented message selected based on the message transmission notification to a personal terminal as a transmission target;
A program characterized by operating as Accept any event registration including message content,
For the event registered event, the presentation message along the message content is selected according to the cognitive function of the individual who is the transmission target,
Speech synthesis of the presentation message selected by the message selection means,
A message transmission notification is generated for an event that satisfies the conditions, and the presentation message selected based on the message transmission notification is output to the personal terminal of the transmission target by voice.
An information presentation method by an information processing system.

Images