JP4988463B2 - Diary creation support system - Google Patents

Description

  The present invention relates to a diary creation support system using sensor nodes constituting a sensor network, and in particular, an input support method, an information analysis method, and a user analysis method for performing diary creation support based on information that does not appear in a user's action result. The present invention relates to an information providing method according to the situation, and an electronic device having a sensor function, a portable terminal, an information analysis device, and a diary creation support system including a computer program.

  Conventionally, as a system for collecting user information using a mobile terminal and creating a diary from the user information, various information related to personal behavior using functions (GPS, camera, barcode reader, etc.) provided in the mobile terminal There is a system that automatically creates a blog from places that have been collected and liked (GPS, photographs), products (barcodes), people (QR codes of business cards), and the like (for example, see Patent Document 1).

JP 2007-148503 A

  User information handled by a conventional diary creation support system is information (photographing, etc.) and attribute information (gender, age, address, etc.) obtained as a result of the user's active behavior.

  Therefore, user information during active action and before and after that cannot be collected. This information is likely to contain factors that cause the user's active behavior, and therefore, it is considered that "potential demand" is included, and can be important information for marketing. There are diaries and blogs as means for describing user information during and before active action. However, in the conventional diary creation support system, only a list of active action results is generated, and the user information during active action such as active action and fatigue and before and after that must be manually input. Don't be. Therefore, with conventional systems, it is difficult to maintain the granularity, accuracy, and immediacy of user information during and before active action. Since such information is often forgotten over time, it is automatic to some extent, that is, by means other than conscious and active actions by the user, during and after the active action. It is necessary to have a method that can directly input user information.

  The present invention has been made in view of such circumstances, and its purpose is to provide a sensor node having a sensor function capable of observing acceleration, pulse, temperature, etc., during active action and before and after the user information. To provide a system that supports the creation of a diary by collecting data with as little burden on the user as possible, and analyzing the collected results, or providing effective information for potential user demand It is to provide a distribution method and a computer system.

  An example of a representative one of the present invention is as follows. That is, the diary creation support system of the present invention includes an electronic device including a sensor that observes a user's behavior, and a communication unit that transmits information on the observed behavior of the user as data. A portable terminal configured to be able to communicate with the electronic device via one network and configured to be able to receive the data transmitted by the electronic device; and a second network different from the first network And a management device configured to be communicable with the mobile terminal and configured to be able to perform various types of analysis related to the data, information relating to the property belonging to the user, and The present invention is characterized in that latent information that is information that does not appear in the result of the user's action is collected and a diary creation support for the user is performed using the latent information.

  According to the present invention, it is possible to reduce a user's burden such as an operation amount required for creating a diary.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<First Embodiment>
FIG. 1 is a block diagram of a computer system according to the first embodiment of the present invention. The computer system of FIG. 1 collects information observed by a sensor function of an electronic device (for example, a sensor node constituting a sensor network) carried by a user (user) with a mobile terminal (for example, a mobile phone) owned by the user, An example of a system configuration for transmitting them to a management device (for example, a management server), which analyzes the received information, and supports diary creation together with user information collected by the mobile terminal owned by the user. is there.

  Specifically, an electronic device 101 including a sensor 201 that observes the behavior of the user 100 and a communication unit 204 that transmits information relating to the observed behavior of the user 100 to the outside as data, a first A portable terminal 102 configured to be communicable with the electronic device 101 via the network 105 and configured to be able to receive data transmitted by the electronic device 101, and a second network 106 different from the first network 105 And a management device 103 configured to be communicable with the mobile terminal 102 and configured to be able to execute various analyzes related to the data, and is information related to the property belonging to the user 100, and A diary that collects latent information, which is information that does not appear in the result of the action of the user 100, and uses the latent information to support creation of a diary related to the user It is an adult support system.

  Another way of understanding is an electronic device including a sensor 201 that observes latent information that potentially exists in the behavior of the user 100, and a communication unit 204 that transmits the observed latent information to the outside as data. The mobile terminal 102 configured to be able to communicate with the electronic device 101 via the device 101 and the first network 105 and configured to be able to receive data transmitted by the electronic device 101, and the first network 105 A latent image observed by the sensor 201, including a management device 103 configured to be communicable with the mobile terminal 102 via a different second network 106 and configured to be able to perform various analyzes relating to the data. A diary creation support system that supports creation of a diary for the user 100 using data corresponding to the information and input data input from the user 100. It is a non.

  This diary creation support system is preferably configured to include a latent information definition function for the user 100 to arbitrarily define the meaning of the latent information. The sensor 201 is preferably configured using at least one of an acceleration sensor and a pulse sensor.

  The computer system communicates via a sensor node 101 that observes information of the user 100, a mobile terminal 102 that communicates with the sensor node via the network 105 and collects observation information of the sensor node, and a mobile terminal via the network 106. And a management server 103 that receives and analyzes observation information from a large number of users' portable terminals. For example, the network 105 is preferably a wireless network that connects wireless communication devices. In addition, as the network 106, for example, another wireless network that employs a communication method different from that of the network 105 is preferable.

  The sensor node 101 includes, for example, a sensor 201 that observes user information, a storage unit 202 that temporarily stores sensor observation values, a display unit 203 that displays sensor observation value information, sensor node information, and the like. A communication unit 204 that communicates with the portable terminal 102 via the network 105, an operation unit 205 for performing various operations, a control unit 206 that controls the functions, and a battery 207 that is a power source for the functions. It is preferable to do so.

  The portable terminal 102 can be used for settlement, for example, a first communication unit 301 that communicates via the management server 103 and the network 106, and a second communication unit 302 that communicates via the sensor node 101 and the network 105. IC chip 303, display unit 304 for displaying various information, call unit 305 capable of making a call with another person, and a web browsing unit for connecting to a network such as the Internet and performing web browsing processing 306, a mail transmission / reception unit 307 that transmits / receives mail, a location information acquisition unit 308 that performs acquisition processing of location information of the mobile terminal, a scheduler 309 that allows a user 100 to input and manage a schedule, and a sensor node The data analysis unit 310 that analyzes the observed values of 101 and the data analysis result by the user In the diary editing unit 311 that enables assignment / editing of an event, the operation unit 312 that performs voice input, text input, item selection, and other various inputs, the processing history of each processing unit, and the data analysis unit It is preferable to include a DB 313 that holds basic information and the like when performing analysis processing, and a terminal control unit 314 that controls the above functions.

  For example, the management server 103 analyzes a trend / feature from the communication unit 401 that performs communication via the mobile terminal 102 and the network 106, the scene collection unit 402 that collects information on a large number of users, and the information on the large number of users. A scene analysis unit 403, a diary management unit 404 that manages each user's diary, a control unit 405 that controls the above functions, each user's diary, access control policy, information on many users, and trend / feature analysis results. It is preferable to provide the DB 406 to be held.

  Next, the processing of the present invention will be described. Generally speaking, the processing of the present invention includes behavior time-series information collection processing, diary creation support processing, user information analysis processing, and sensor node management processing.

  The action time series information collection process collects observation values of the sensor 201 of the sensor node 101 and usage history information of the IC card 303, the call unit 305, the web browsing unit 306, the mail transmission / reception unit 307, and the operation unit 312 of the mobile terminal 102. And it registers into DB313 of a portable terminal as action time series information.

  FIG. 2 is a time chart showing the procedure of the observation value collection process of the sensor node 101.

  First, the control unit 206 of the sensor node 101 acquires an observation value using the sensor 201 (S100, S101). Next, the observation value is sent to the terminal control unit 314 of the portable terminal 102 via the communication unit 204 (S102 to S104). The terminal control unit 314 that has received the observation value requests position information from the position information acquisition unit 308 in order to obtain a place where the observation value is observed (S105). The position information acquisition unit 308 acquires the position information and returns the position information to the terminal control unit 314 (S106, S107). The terminal control unit 314 acquires the time (S108), and registers the observation value, the position information, and the time in the DB 313 as action time series information (S109). Here, the position information is acquired every time it is observed, but it may be acquired every few minutes. FIG. 4 shows an example of action time series information obtained from the observation values of the sensor 201 stored in the DB 313.

  FIG. 3 is a time chart showing the procedure of usage history information collection processing of the IC card 303, the calling unit 305, the web browsing unit 306, the mail transmission / reception unit 307, and the operation unit 312. In FIG. 3, only the example of the IC card 303 is shown, but the same processing is performed for the other calling unit 305, web browsing unit 306, mail transmission / reception unit 307, and operation unit 312. When the IC card 303 is used (S110), the IC card use history (usage contents, etc.) is sent to the terminal control unit 314 (S111). The terminal control 314 that has received the usage history requests location information from the location information acquisition unit 308 in order to obtain a location where the observed value is observed (S112). The position information acquisition unit 308 acquires the position information and returns the position information to the terminal control unit 314 (S113, S114). The terminal control unit 314 acquires the time (S115), and registers the observation value, position information, and time in the DB 313 as action time series information (S116). FIG. 5 shows an example of action time series information obtained from usage history information of the IC card 303, the call unit 305, the web browsing unit 306, the mail transmission / reception unit 307, and the operation unit 312 stored in the DB 313.

  Here, only the usage history information of the sensor 201, the IC card 303, the calling unit 305, the web browsing unit 306, the mail transmission / reception unit 307, and the operation unit 312 is targeted, but all information that can be collected by the mobile terminal is action time-series information. Can be the target of

  The diary creation support process is a process for supporting diary creation using the action time series information of the user 100 collected in the action time series information collection process. This process includes three processes (scene division process, diary editing support process, diary generation process).

  In the scene division processing, the action time series information of the user 100 collected using the sensor 201 of the sensor node 101, the IC card 303 of the mobile terminal 102, the call unit 305, the web browsing unit 306, the mail transmission / reception unit 307, and the operation unit 312 is collected. It is divided into several time zones (hereinafter, this time zone is called a scene). The diary editing support process performs comment input support by the user regarding the content of the user's action in each divided scene, what it felt at that time, what remained in the impression, etc., and comment input support by estimating the scene. Is generated. The diary generation process generates information that can be disclosed to an unspecified number of people from the personal diary generated by the diary editing process.

  The scene division process is a process of dividing the user's action time-series information into several scenes at action change points. The behavior change points are behavior change points (sleep start / end, walk start / end, etc.) obtained from the observation value of the sensor node 101, the IC card 303, the call unit 305, the web browsing unit 306 of the mobile terminal 102, A behavior change point obtained from information on the start / end of use of the mail transmission / reception unit 307 and the operation unit 312 is used.

  FIG. 6 is a time chart showing the procedure of scene division processing. First, the terminal control unit 314 of the mobile terminal acquires a scene division rule from the DB 313 (S201, S202), and confirms the scene unit time and the scene division processing execution time (S203). Lastly, it is confirmed whether or not the scene unit time has elapsed since the scene division processing was performed (S204), and if it has elapsed, a scene division request is sent to the data analysis unit 310 (S205). The data analysis unit 310 acquires action time series information and scene division rules that have not yet been divided into scenes from the DB 313 (S206 to S208). Next, the action time series information is converted into action change point time series information (S209). The data analysis unit 310 acquires schedule information belonging to the time zone of the action time series information from the scheduler 309 (S210, S211). A partial sequence that matches the conditions of the scene division rule and the schedule information is searched in the time series information of the behavior change points (S212). At this time, the rule having the highest importance of the scene division rule is adopted as the partial sequence whose condition matches the plurality of scene division rules. If there are a plurality of rules having the highest importance, they are presented as candidates to the user for selection.

  When the time of the generated partial sequence is larger than the scene unit time, the partial sequence is registered as a scene in the DB 313 (S213). If the time of the partial sequence is smaller than the scene unit time, the previous and next action change points are added to the partial sequence until the time of the partial sequence becomes larger than the scene unit time (S214). At this time, if the preceding and following action change points belong to a partial sequence that matches another scene division rule, the behavior change points are not added, and the partial sequence is registered in the DB 313 as a scene (S215). The partial sequence thus generated is registered in the DB 313 as a scene (S215). The partial sequences that are not registered as scenes by the above processing are registered as unconfirmed scenes (S216).

  The scene unit time, the scene identification condition of each rule, and the importance of each rule are described in the scene division rule. The scene unit time, the scene identification condition, and the importance of each rule are determined using predetermined values. It does not matter, and the user may set it independently. FIG. 7 shows an example of the time series conversion result of the behavior change point, the scene division rule, and the scene division result.

  The diary editing support process is a process for performing support when inputting the contents of a scene. The scene contents are estimated in consideration of the schedule, whereabouts, information about the place, scene occurrence time, action time series information, scene estimation rules, etc., and prioritized candidates (options) are presented and studied. A pictograph is prepared for a scene evaluation, emotions such as emotions and typical events such as birthdays, and the like can be input.

  FIG. 8 is a time chart showing the procedure of the diary editing support process.

  First, the user 100 activates the diary editing unit 311 using the operation unit 312 of the mobile terminal 102 and inputs the edited date and time zone (S301, S302). Next, the diary editing unit 311 acquires scene information corresponding to the date and time zone from the DB 313 and schedule information corresponding to the date and time zone from the scheduler 309 (S303 to S306). Then, the diary editing unit 311 generates a personal diary 601 from the acquired scene information (S307). At this time, the scene estimation rule is applied to the portion where the scene contents cannot be determined from the scene information and schedule information (S308). The application method of the scene estimation rule is as follows. If there is an undecided content, the diary editor 311 searches for a scene estimation rule that matches the conditions of the scene estimation rule. If a matching rule is found, the contents of the scene described in the rule are automatically displayed in the scene portion of the personal diary 601 or displayed as a candidate when the scene candidate display button 603 is pressed. For a scene that does not match the conditions of the scene estimation rule, the user 100 inputs the contents of the scene using the operation unit, and at least the contents and conditions of the scene (the contents of the preceding and following scenes, the time zone, etc.), the location, The action time series information and the importance are registered as rules in the scene estimation rule. Here, the importance is a value determined by the number of times the rule is applied, the assignment by the user 100, and the like.

  Next, a schedule 602 is generated from the schedule information (S309). A diary editing screen including the personal diary 601 and the schedule 602 generated by at least the above processing is generated (S310). Next, the user 100 selects a part to be edited from items included in the personal diary 601 of the diary editing screen, and adds a comment such as a scene content, an emotion, and a supplement of the scene content (S311). The diary editing unit 311 reflects the assigned comment, and registers the edited personal diary in the DB 313 (S312 and S313).

  FIG. 9 is a diagram showing an outline of the diary editing screen displayed on the display unit 304 of the mobile terminal 102 in S308. On the diary editing screen, at least a personal diary 601 and a schedule 602 are displayed. The personal diary 601 displays time, scenes, places, and comments, and includes a scene candidate display button 603 and a comment candidate display button 604. When the scene candidate display button 603 is pressed, a scene candidate is displayed on the scene candidate display unit 605, and when a scene candidate on the scene candidate display unit 605 is selected, the selected candidate is displayed on a corresponding portion of the scene of the personal diary 601. . When the comment candidate display button 604 is pressed, comment candidates are displayed in the comment candidate display unit 606. When a comment candidate in the comment candidate display unit 606 is selected, the selected candidate is displayed in the corresponding part of the comment in the personal diary 601. . Candidates for comments include evaluations of scenes such as studying, doing new things (being started), meeting people, talking up, impressed, having fun, exercising, emotions and commemoratives such as emotions Pictograms representing typical events such as days and birthdays, comments input by the user 100 in the past, and the like are selected. If the scene is determined, the candidate rank of the comment is changed in consideration of the depth related to the scene.

  FIG. 10 shows the contents of the comment candidates displayed in the comment candidate display section 606 of FIG. The comment candidates are not all shown in FIG. 9 and FIG. 10, but include various things such as those showing emotions.

  FIG. 11 shows an example of scene estimation rules and scene estimation rule application results.

  FIG. 12 shows a screen configuration of a search screen for searching a scene from the personal diary created. The search screen includes at least a search button 607, a keyword input field 608, and a search result display unit 609. A comment, a place, a scene content, a date, and the like indicating a scene to be searched are input as keywords in the keyword input field 608, and a corresponding scene is extracted from the DB 313 by pressing the search button 607 and displayed on the search result display unit 609. Is done.

  The diary generation process is a process of generating information that can be disclosed to an unspecified number of people from the personal diary generated by the diary editing process.

  FIG. 13 is a time chart showing the procedure of the diary generation process.

  The terminal control unit 314 acquires the personal diary from the DB 313, and sends the personal diary to the control unit 405 via the first communication unit 301 and the communication unit 401 of the management server 103 (S314 to S318). The control unit 405 sends a diary generation request to the diary management unit 404 (S319). The diary management unit 404 acquires an access control policy set in advance by the user 100 from the DB 406 (S320, S321). The diary management unit 404 extracts information that can be disclosed from the personal diary according to the access control policy, generates a diary, and registers it in a table for each user in the DB 406 (S322, S323).

  FIG. 14 shows an example of access control policy conditions, and FIG. 15 shows an example of access control parameters. The access control policy may be created by combining conditions prepared in advance, or a new condition may be created by a set of parameters and values.

  FIG. 16 shows an example of the result of applying the access control policy to the access control policy and the personal diary and the diary.

  The user information analysis process is a process for extracting tendencies / features of a large number of users using personal diaries sent by the large number of users to the management server 103.

  FIG. 17 is a time chart showing the procedure of the user information analysis process.

  First, the scene collection unit 402 requests each user's scene sequence from the DB 406 (S401). The DB 406 extracts a scene sequence that can be disclosed according to the access control policy of each user, and returns it to the scene collection unit 402 (S402, S403). The scene collection unit 402 that acquired the scene sequence group of each user sends the scene sequence group to the scene analysis unit 403 and requests the scene analysis (S404). The scene analysis unit 403 extracts partial scene sequences common to several scene sequences from the received scene sequence group (S405). Next, tendencies and features of the common partial scene sequence are extracted (S406). Here, the tendency / feature is extracted in consideration of the relationship between the contents of the common partial scene sequence, the duration of the common partial scene sequence, the location, and the scenes appearing before and after the common partial scene sequence. Finally, the common partial scene sequence and the extracted tendency / feature are registered in the DB 406 (S407).

  FIG. 18 shows the trend / feature extraction results. Here, the condition represents the relationship between the contents of the common partial scene sequence, the duration and location of the common partial scene sequence, and the scenes that appear before and after the common partial scene sequence. The number of times it appeared in the group. Using this count, a scene estimation rule is generated from the tendency / feature. FIG. 19 employs a trend / feature having a count of 10,000 or more among the tendencies / features of FIG. 18 as a scene estimation rule. Each user can download the scene estimation rule generated in this way to the mobile terminal and use it.

  The sensor node management process is a process for managing the sensor node 101 from the mobile terminal 102.

  A command is sent from the mobile terminal 102 to the sensor node 101, the state of the sensor node 101 is displayed on the display unit 304 of the mobile terminal 102, management of communication status between the sensor node 101 and the mobile terminal 102, authentication, secrecy, and sending data verification Security management such as security information update, IC card 303 of mobile terminal 102, display unit 304, call unit 305, web browsing unit 306, mail transmission / reception unit 307, location information acquisition unit 308, scheduler 309 and sensor node cooperation management , Etc.

  FIG. 21 shows an example of a sensor node management screen that displays the state of the sensor node 101 displayed on the display unit 304 of the mobile terminal 102. The sensor node management screen displays at least sensor node management information communicable with the mobile terminal 102, a sensor node management information display unit 610 for displaying radio wave intensity, etc., and individual information of sensor nodes communicable with the mobile terminal 102 And a menu display button 612 for displaying a menu screen on the display unit 304.

  The sensor node state information displayed on the sensor node state information display unit 611 is changed by selecting the “Communicable sensor node” item displayed on the sensor node management information display unit 610 using the operation unit 312. It is also possible to do.

  FIG. 22 shows a menu screen displayed on the display unit 304 when the menu display button 612 is operated using the operation unit 312. The menu screen displays sensor node management items of “security information update”, “sensor node authentication”, “radio wave intensity adjustment”, “intermittent time adjustment”, and “cooperation function setting”. These items are not limited to the above items, and may be increased or decreased depending on the relationship between the mobile terminal 102 and the sensor node 101.

  FIG. 23 shows a screen display example of the “security information update” menu. Here, the security information means information such as an encryption key exchanged between the sensor node 101 and the mobile terminal 102. A new encryption key is exchanged between the sensor node 101 and the portable terminal 102 by updating the security information.

  FIG. 24 shows a screen display example of the “sensor node authentication” menu. Here, sensor node authentication means re-authentication of a sensor node that can already communicate, or authentication of a sensor node that is to be newly communicable.

  FIG. 25 shows a screen display example of the “communication distance adjustment” menu. The “communication distance adjustment” menu screen includes at least a communication distance operation unit 613 for setting a communication distance using the operation unit 312 of the mobile terminal 102. Here, the communication distance is a distance that can be communicated by the communication unit 204 of the sensor node 101 and can be changed by adjusting the output of the communication unit 204. Here, it is possible to adjust manually or automatically by an operation using the operation unit 312 of the user 100.

  FIG. 26 shows a screen display example of the “intermittent time adjustment” menu. The “intermittent time adjustment” menu screen includes at least an intermittent time setting unit 614 for setting the intermittent time using the operation unit 312 of the mobile terminal 102. Here, the intermittent time is a time interval at which the sensor 201 of the sensor node 101 is activated.

  FIG. 27 shows a screen display example of the “cooperative function setting” menu. At least a list of functions that can be linked is displayed on the “link function setting” menu screen, and individual settings can be made by selecting each item in the list. Here, the cooperation function setting is from the sensor 201 of the sensor node 101, the IC card 303 of the mobile terminal 102, the display unit 304, the call unit 305, the web browsing unit 306, the mail transmission / reception unit 307, the location information acquisition unit 308, and the scheduler 309. Based on the obtained action time series information and action change point time series information, the sensor 201 of the sensor node 101, the display unit 203, the communication unit 204, the IC card 303 of the mobile terminal 102, the display unit 304, the call unit 305, and web browsing This is a setting for controlling the functions of the unit 306, the mail transmission / reception unit 307, the position information acquisition unit 308, and the scheduler 309. This control includes starting and stopping of the above functions, output adjustment, and the like.

  For example, when the behavior change point: the end of walking is extracted, the position information acquisition unit 308 is activated to acquire the position information. This makes it possible to acquire position information in a necessary situation without always starting the position information acquisition unit 308, and to reduce the battery consumption of the mobile terminal 102.

  When the position information acquisition unit 308 acquires the position information, if the position is a place where congestion is expected, such as a station, the output of the communication unit 204 of the sensor node 101 is lowered or the communication unit 204 is stopped. Thereby, it is possible to prevent the observation value of the sensor node 101 from being intercepted by another person.

  Furthermore, by linking the scheduler 309 and the display unit 203 of the sensor node 101, when the start time of the schedule registered in the scheduler 309 is reached, that fact is displayed on the display unit 203 of the sensor node 101, or It is possible to notify the user 100 by blinking the display unit 203 or the like. If the sensor node 101 has a function for generating a sound or a vibration function, the user 100 can be notified by these functions.

  FIG. 28 shows a screen configuration example of the cooperation function setting screen related to the position information acquisition unit 308. On the cooperation function setting screen, at least an action change point setting unit 615 for setting a condition related to an action change point for controlling the function, and an operation for setting the behavior of the function when the above condition is satisfied A setting unit 616 is provided. The behavior change point setting unit 615 and the operation setting unit 616 can be operated by the operation unit 312 of the mobile terminal 102, respectively. The setting method of the action change point setting unit 615 and the operation setting unit 616 may be a method in which the user 100 directly inputs, or a mode in which candidates are determined in advance for each setting unit and the user 100 selects from the candidates. Absent. In the illustrated example of FIG. 28, “walking end” is set as the behavior change point in the behavior change point setting unit 615, and “activation” is set in the motion setting unit 616. It is possible to realize a cooperative function of “start up and acquire location information”.

  FIG. 29 shows a screen configuration example of the linkage function setting screen related to the scheduler 309. In the example shown in FIG. 29, “beginning time of schedule” is set as the action change point in the action change point setting unit 615, and “display on the display unit of the sensor node 1” is set in the operation setting unit 616. It is possible to realize a cooperation function of “displaying the fact on the display unit of the sensor node 1 at time”.

  FIG. 28 shows a screen configuration example of the cooperative function setting screen related to the position information acquisition unit, and FIG. 29 shows a screen configuration example of the cooperative function setting screen related to the scheduler, but the sensor 201 of the sensor node 101, the communication unit 204, mobile phone The IC card 303, the display unit 304, the call unit 305, the web browsing unit 306, and the mail transmission / reception unit 307 of the terminal 102 have the same screen configuration.

<Second Embodiment>
FIG. 20A is a block diagram of a computer system according to the second embodiment of this invention. The difference from the computer system of the first embodiment shown in FIG. 1 is that the service providing server 104 is connected to the network 106 together with the management server 103 and the portable terminal 102.

  The computer system of FIG. 20A collects information observed by a sensor function of an electronic device (for example, a sensor node constituting a sensor network) carried by a user (user) with a mobile terminal (for example, a mobile phone) owned by the user, They are sent to the management device (for example, the management server), the management server analyzes the received information, and the information distribution device (for example, the service providing server) acquires the analysis result from the management server and collects it on the mobile terminal owned by the user It is an example of the system configuration | structure for determining the information suitable for a user with the information of a user who performed, and delivering the information to a user.

  Specifically, an electronic device 101 including a sensor 201 that observes the behavior of the user 100 and a communication unit 204 that transmits information relating to the observed behavior of the user 100 to the outside as data, a first A portable terminal 102 configured to be communicable with the electronic device 101 via the network 105 and configured to be able to receive data transmitted by the electronic device 101, and a second network 106 different from the first network 105 Connected to the second network 106 in addition to the management device 103 configured to be communicable with the mobile terminal 102 and configured to execute various types of analysis related to the data, and the mobile terminal 102 and the management device 103 is a diary creation support system that further includes an information distribution device 104 configured to be communicable with the network 103. This system collects latent information that is information related to the property belonging to the user 100 and does not appear in the result of the action of the user 100, and uses the latent information to inform the user 100. Provide support for creating such diaries. The information distribution apparatus 104 receives the analysis result related to the data transmitted from the electronic device 101 to the mobile terminal 102 from the management apparatus 103 and receives the attribute information of the user 100 from the mobile terminal 102, and includes the analysis result and the attribute information. Based on the distribution information, the distribution information is transmitted to the mobile terminal 102.

  Another way of understanding is an electronic device including a sensor 201 that observes latent information that potentially exists in the behavior of the user 100, and a communication unit 204 that transmits the observed latent information to the outside as data. The mobile terminal 102 configured to be able to communicate with the electronic device 101 via the device 101 and the first network 105 and configured to be able to receive data transmitted by the electronic device 101, and the first network 105 Connected to the second network 106 in addition to the management device 103 configured to be communicable with the mobile terminal 102 via a different second network 106 and capable of executing various analyzes relating to the data; and A diary creation support system further comprising an information distribution device 104 configured to be communicable with the mobile terminal 102 and the management device 103, And data corresponding to the latent information observed by 201, a diary generation support system for the creation support diary according to user 100 by using the input data inputted by the user 100.

  This diary creation support system is preferably configured to include a latent information definition function for the user 100 to arbitrarily define the meaning of the latent information. The sensor 201 is preferably configured using at least one of an acceleration sensor and a pulse sensor.

  The computer system communicates via the mobile terminal and the network 106 with the sensor node 101 that observes the information of the user 100, the mobile terminal 102 that communicates via the sensor node and the network 105, and collects the observation information of the sensor node. Management server 103 that receives and analyzes observation information from a large number of users' mobile terminals, receives analysis results from the management server, determines appropriate information together with the information of users 100 obtained from the mobile terminals 102, and It is preferable to include a service providing server 104 that distributes information to the portable terminal 102. For example, the network 105 is preferably a wireless network that connects wireless communication devices. In addition, as the network 106, for example, another wireless network that employs a communication method different from that of the network 105 is preferable.

  The sensor node 101 includes a sensor 201 that observes user information, a storage unit 202 that temporarily stores sensor observation values, a display unit 203 that displays sensor observation value information, sensor node information, and the like. A communication unit 204 that communicates with the terminal 102 via the network 105, an operation unit 205 for performing various operations, a control unit 206 that controls the function, and a battery 207 that is a power source for the function. It is preferable to do this.

  The mobile terminal 102 includes a first communication unit 301 that performs communication via the management server 103, the service providing server 104, and the network 106, a second communication unit 302 that performs communication via the sensor node 101 and the network 105, payment, etc. IC chip 303 that can be used for various purposes, a display unit 304 that displays various information, a call unit 305 that can make a call with another person, and a web that performs browsing processing by connecting to a network such as the Internet A browsing unit 306, a mail transmission / reception unit 307 that transmits / receives emails, a location information acquisition unit 308 that performs acquisition processing of location information of a mobile terminal, a scheduler 309 that allows a user's 100 schedule to be input and managed, A data analysis unit 310 that analyzes the observation value of the sensor node 101, and a user A diary editing unit 311 that enables adding / editing comments to data analysis results, etc., an operation unit 312 for performing voice input, text input, item selection, and other various inputs, and processing history of each processing unit In addition, it is preferable to include a DB 313 that holds basic information and the like when performing analysis processing in the data analysis unit, and a terminal control unit 314 that controls the above functions.

  The management server 103 includes a communication unit 401 that communicates via the mobile terminal 102, the service providing server 104, and the network 106, a scene collection unit 402 that collects information on a large number of users, and trends / features from the information on a large number of users. A scene analysis unit 403 that analyzes the user's diary, a diary management unit 404 that manages each user's diary, a control unit 405 that controls the above functions, each user's diary, access control policy, information on many users, trends and features It is preferable to provide a DB 406 that holds the analysis result.

  The service providing server 104 receives the analysis result from the management server 103, and determines the service information suitable for the user by combining the communication unit 501 that receives the user information from the mobile terminal 102 and the analysis result and the user information. An information distribution unit 502 that sends service information to the user's portable terminal 102, a control unit 503 that controls the above functions, the analysis results, user information, service information, and service information and user information sent by the information distribution unit It is preferable to provide a DB 504 that holds the history information.

  Next, the processing of the present invention will be described. Generally speaking, the processing of the present invention includes behavior time-series information collection processing, diary creation support processing, user information analysis processing, service information distribution processing, and sensor node management processing.

  Among these, the service information distribution process refers to the user's current scene and the next scene that can be estimated from the user's current scene or the tendency / feature obtained as a result of the user information analysis process. This is a process of distributing service information suitable for the service.

  FIG. 20B is a time chart illustrating a procedure of service information distribution processing according to the second embodiment.

  First, the terminal control unit 314 of the mobile terminal 102 of the user 100 sends the current scene of the user 100 to the service providing server 104 through the first communication unit 301 (S501, S502). Upon receiving the current scene of the user 100 through the communication unit 501 of the service providing server 104, the control unit 503 requests the information distribution unit 502 to distribute information (S503, S504). Next, the information distribution unit 502 requests the DB 504 to search for information suitable for the current scene of the user 100 (S505). The DB 504 extracts a common partial scene sequence that matches the current scene of the user 100 and a trend / feature corresponding to the common partial scene sequence from the common partial scene sequence and the trend / feature received from the management server 103 in advance ( S506). Next, the distribution information suitable for the tendency / feature is searched (S507). If there is suitable distribution information in the DB 504, the distribution information is returned to the information distribution unit 502 (S508). The information distribution unit 502 sends the distribution information to the mobile terminal 102 of the user 100 via the control unit 503 and the communication unit 501 (S509 to S512). If the information distributed at this time is an email, the terminal control unit 314 sends the information to the email transmission / reception unit 307.

  In FIG. 20B, the user's current scene is sent starting from the mobile terminal 102 of the user 100, but even if the user's current scene is requested to the mobile terminal 102 starting from the service providing server 104. I do not care.

  In addition, about each process of action time series information collection processing, diary creation support processing (including scene division processing, diary editing support processing, and diary generation processing), user information analysis processing, and sensor node management processing, All can be performed in the same manner as in the first embodiment.

  As described above, according to the present embodiment, it is possible to reduce a user's burden such as an operation amount required for creating a diary, and to effectively provide information according to the user's situation.

<Third Embodiment>
FIG. 30 is a block diagram of a computer system according to the third embodiment of the present invention. In the first embodiment illustrated in FIG. 1 and the second embodiment illustrated in FIG. 20A, the sensor node 101 includes the storage unit 202, the display unit 203, and the operation unit 205. In the embodiment, the configuration of the sensor node 101 is changed by sharing these functions with the DB 313, the display unit 304, and the operation unit 312 of the mobile terminal 102.

  The computer system shown in FIG. 30 collects information observed by a sensor function of an electronic device (for example, a sensor node constituting a sensor network) carried by the user by a portable terminal (for example, a mobile phone) owned by the user, and manages them. The management server analyzes the received information, the service providing server obtains the analysis result from the management server, and determines information suitable for the user together with the user information collected by the mobile terminal owned by the user. 1 is an example of a system configuration for delivering the information to a user.

  The computer system communicates via the mobile terminal and the network 106 with the sensor node 101 that observes the information of the user 100, the mobile terminal 102 that communicates via the sensor node and the network 105, and collects the observation information of the sensor node. Management server 103 that receives and analyzes observation information from a large number of users' mobile terminals, receives analysis results from the management server, determines appropriate information together with the information of users 100 obtained from the mobile terminals 102, and It is preferable to include a service providing server 104 that distributes information to the portable terminal 102.

  The sensor node 101 includes a sensor 201 that observes user information, a communication unit 204 that performs communication via the mobile terminal 102 and the network 105, a control unit 206 that controls the function, and a battery 207 that is a power source for the function. Is preferably provided. In this case, the sensor node 101 is intentionally provided with a storage unit that temporarily holds sensor observation values, a display unit that displays sensor observation value information and sensor node information, and an operation unit for performing various operations. Do not.

  On the other hand, the mobile terminal 102 includes a first communication unit 301 that communicates with the management server 103 and the service providing server 104 via the network 106, a second communication unit 302 that communicates via the sensor node 101 and the network 105, An IC chip 303 that can be used for settlement, a display unit 304 that displays various information, a call unit 305 that enables calls with other people, and a web browsing process connected to a network such as the Internet. A web browsing unit 306, a mail transmission / reception unit 307 for transmitting / receiving mail, a location information acquisition unit 308 for acquiring location information of the portable terminal, and a scheduler that allows a user 100 to input and manage a schedule 309, the data analysis unit 310 that analyzes the observation value of the sensor node 101, and the user A diary editing unit 311 that enables adding / editing comments to data analysis results, etc., an operation unit 312 for performing voice input, text input, item selection, and other various inputs, and processing history of each processing unit In addition, a DB 313 that holds basic information and the like when performing an analysis process in the data analysis unit, and a terminal control unit 314 that controls the above functions are provided. Among these functional parts, the DB 313, the display unit 304, and the operation unit 312 are a storage unit in which the sensor node 101 temporarily holds sensor observation values, sensor observation value information, and various types of sensor nodes 101, respectively. It is commonly used as a display unit for displaying information and an operation unit for performing various operations on the sensor node 101.

  The management server 103 includes a communication unit 401 that communicates with the mobile terminal 102 and the service providing server 104 via the network 106, a scene collection unit 402 that collects information on a large number of users, and trends / features from the information on a large number of users. A scene analysis unit 403 that analyzes the user's diary, a diary management unit 404 that manages each user's diary, a control unit 405 that controls the above functions, each user's diary, access control policy, information on many users, trends and features It is preferable to provide a DB 406 that holds the analysis result.

  The service providing server 104 receives the analysis result from the management server 103, and determines the service information suitable for the user by combining the communication unit 501 that receives the user information from the mobile terminal 102 and the analysis result and the user information. An information distribution unit 502 that sends service information to the user's portable terminal 102, a control unit 503 that controls the above functions, the analysis results, user information, service information, and service information and user information sent by the information distribution unit It is preferable to provide a DB 504 that holds the history information.

  In the third embodiment, similarly to the configuration shown in FIG. 1, the mobile terminal (owned by the user) that has information observed by the sensor function of an electronic device carried by the user (for example, a sensor node constituting the sensor network). System configuration for collecting data with a mobile phone), transmitting them to a management server, analyzing the received information, and supporting diary creation together with user information collected by a mobile terminal owned by the user That is, a system configuration that does not include the service providing server 104 is possible.

  As described above, according to the third embodiment of the present invention, it is possible to reduce the size of the sensor node 101 by sharing the functional blocks of the sensor node 101 and the mobile terminal 102.

<Fourth Embodiment>
FIG. 31 is a block diagram of a computer system according to the fourth embodiment of the present invention.

  In the first to third embodiments, the mobile terminal 102 includes the second communication unit 302 for communicating with the sensor node 101, but the mobile terminal 102 does not include the second communication unit 302 and is mobile. A second communication unit for communicating with the sensor node 101 may be provided in a base station that is carried separately from the terminal or installed in the home of the user 100.

  In this case, the procedure of the observation value collection process of the sensor node 101 in the action time series information collection process is as shown in FIG. FIG. 32 is a time chart showing the procedure of the observation value collection process of the sensor node 101.

  First, the control unit 206 of the sensor node 101 acquires an observation value using the sensor 201 and stores the observation value in the storage unit 202 (S600 to S602). Next, the control unit 206 confirms whether communication with the base station 107 is possible via the communication unit 204 (S603). When communication is possible, the observation value is acquired from the storage unit 202, and the observation value is sent to the control unit 703 of the base station 107 via the communication unit 204 and the second communication unit 702 of the base station 107 (S604 to S608). The control unit that has received the observation value sends it to the terminal control unit 314 of the mobile terminal 102 via the first communication unit 701 of the base station 107 and the first communication unit 301 of the mobile terminal 102 (S609 to S611). The terminal control unit 314 acquires the time (S612), and registers the observation value and the time in the DB 313 as action time series information (S613).

  Here, in the first embodiment, the position information is collected in the course of the observation value collection process. However, in the third embodiment, the position information may not be collected in the process of the observation value sleeve processing. In that case, the position information is acquired and stored at a preset time interval.

  FIG. 33 is a time chart showing the procedure of position information observation processing.

  The terminal control unit 314 confirms whether the set time has elapsed (S614), and if it has elapsed, acquires position information from the position information acquisition unit 308 (S615 to S617). Thereafter, the time is acquired, and the position information and time are registered in the DB 313 (S618, S619).

  In the fourth embodiment, similarly to the configuration shown in FIG. 1, the mobile terminal (the user owns information observed by the sensor function of the electronic device carried by the user (for example, a sensor node constituting the sensor network)). System configuration for collecting data with a mobile phone), transmitting them to a management server, analyzing the received information, and supporting diary creation together with user information collected by a mobile terminal owned by the user That is, a system configuration that does not include the service providing server 104 is possible.

  As described above, according to the fourth embodiment of the present invention, even when the mobile terminal 102 does not have a function of communicating with the sensor node 101, it is possible to realize the same effect as that of the first embodiment.

<Fifth Embodiment>
FIG. 34 is an example of a weight prediction screen display according to the fifth embodiment. In the first embodiment, the personal diary is generated based on the scene obtained from the action time series information. In the present embodiment, based on the relationship between the action time series information obtained from the sensor 201 and the weight of the user 100, the predicted weight of the user 100 is displayed on the predicted weight display unit 617 of the display unit 304 of the mobile terminal.

  FIG. 35 is a time chart showing the procedure of the weight prediction process of the fifth embodiment.

The user 100 displays the weight prediction screen, and inputs the current weight to the weight input unit 618 using the operation unit 312 of the mobile terminal 102 (S700). Receiving the current weight, the terminal control unit 314 sends a weight prediction request to the data analysis unit 310 (S701). The data analysis unit 310 requests, from the DB 313, the weight prediction coefficient, the predicted weight value of the day, and the action time series information for the time required for weight prediction (S702, S703). The weight prediction coefficient is a coefficient reflecting the relationship between the behavioral properties obtained from the behavior time series information and the increase or decrease in weight. It is possible to predict the weight of the next day with a certain degree of accuracy from the weight prediction coefficient and the action time series information for the time required for weight prediction. Next, the predicted weight value of the day is compared with the current weight, and the weight prediction coefficient is updated (S704). Then, the increase / decrease value of the weight of the next day is predicted using the action time series information and the updated weight prediction coefficient, and the predicted weight of the next day is calculated in addition to the current weight (S705). The updated predicted weight coefficient and the predicted weight value of the next day are registered in the DB 313 (S706). Thereafter, the current body weight, the predicted body weight, and the predicted body weight increase / decrease value are displayed on the predicted body weight display unit 617 of the display unit 304, and the transition of the body weight in the past several days is displayed on the body weight transition display unit 619 (S707 to S709).

  The weight prediction process is predicted on a daily basis, but it may be performed on a daily basis for several hours or several days. Although the current weight is input manually, it may be input by communication between the weight scale and the portable terminal.

  As described above, according to the fifth embodiment of the present invention, it is possible to predict the weight of the user 100 by calculating the relationship between the action time series information obtained from the sensor 201 of the sensor node 101 and the weight, It is possible to add a health management function based on weight to the diary creation support system.

  Although the best mode for carrying out the present invention has been described above, the diary creation support system of the present invention is not limited to the above-described illustrated examples, and various types can be made without departing from the gist of the present invention. Of course, changes can be made.

It is a block diagram which shows the structure of the computer system of the 1st Embodiment of this invention. It is a time chart which shows the procedure of the observation value collection process of the sensor node of the 1st Embodiment of this invention. It is a time chart which shows the procedure of the usage history information collection process of the IC card of the 1st Embodiment of this invention, a telephone call part, a web browsing part, a mail transmission / reception part, and an operation part. It is an example of the action time series information obtained from the sensano observation value of the 1st Embodiment of this invention. It is an example of action time series information obtained from use history information of an IC card, a telephone call part, a web browsing part, a mail transmission / reception part, and an operation part of a 1st embodiment of the present invention. It is a time chart which shows the procedure of the scene division | segmentation process of the 1st Embodiment of this invention. It is an example of the time series conversion result of the action change point of the 1st Embodiment of this invention, a scene division | segmentation rule, and a scene division | segmentation result. It is a time chart which shows the procedure of the diary edit assistance process of the 1st Embodiment of this invention. It is an example of the screen structure of the diary edit screen of the 1st Embodiment of this invention. It is an example of the comment candidate of the 1st Embodiment of this invention. It is an example of the scene estimation rule of the 1st Embodiment of this invention, and a scene estimation rule application result. It is an example of the screen structure of the search screen for searching a scene from the personal diary of the 1st Embodiment of this invention. It is a time chart which shows the procedure of the diary production | generation process of the 1st Embodiment of this invention. It is an example of the conditions of the access control policy of the 1st Embodiment of this invention. It is an example of the access control parameter of the 1st Embodiment of this invention. It is an example of the result of having applied the access control policy to the access control policy and personal diary of the first embodiment of the present invention, and generating the diary. It is a time chart which shows the procedure of the user information analysis process of the 1st Embodiment of this invention. It is an example of the tendency and characteristic extraction of the user information analysis processing result of the 1st Embodiment of this invention. It is an example of the scene estimation rule production | generation of the user information analysis process result of the 1st Embodiment of this invention. It is a block diagram which shows the structure of the computer system of the 2nd Embodiment of this invention. It is a time chart which shows the procedure of the service information delivery process of the 2nd Embodiment of this invention. It is an example of the sensor node management screen of the 1st Embodiment of this invention. It is an example of the screen display of the menu of the sensor node management process of the 1st Embodiment of this invention. It is an example of the screen display of the security information update menu of the sensor node management process of the 1st Embodiment of this invention. It is an example of the screen display of the sensor node authentication menu of the sensor node management process of the 1st Embodiment of this invention. It is an example of the screen display of the communication distance adjustment menu of the sensor node management process of the 1st Embodiment of this invention. It is an example of the screen display of the intermittent time adjustment menu of the sensor node management process of the 1st Embodiment of this invention. It is an example of the screen display of the cooperation function setting menu of the sensor node management process of the 1st Embodiment of this invention. It is an example of the screen display of the cooperation function setting screen regarding the positional information acquisition part of the sensor node management process of the 1st Embodiment of this invention. It is an example of the screen display of the cooperation function setting screen regarding the scheduler of the sensor node management process of the 1st Embodiment of this invention. It is a block diagram of a computer system concerning a 3rd embodiment of the present invention. It is a block diagram of a computer system concerning a 4th embodiment of the present invention. It is a time chart which shows the procedure of the observation value collection process of the sensor node 101 of the 4th Embodiment of this invention. It is a time chart which shows the procedure of the positional information observation process of the 4th Embodiment of this invention. It is a figure which shows an example of the screen structure of the weight prediction process of the 5th Embodiment of this invention. It is a time chart which shows the procedure of the weight prediction process of the 5th Embodiment of this invention.

Explanation of symbols

100 User 101 Sensor node 102 Mobile terminal 103 Management server 104 Service providing server 201 Sensor 304 Display unit 601 of mobile terminal 102 Personal diary 603 Scene candidate display button 604 Comment candidate display button 605 Scene candidate display unit 606 Comment candidate display unit

Claims (8)

A diary creation support system that includes an electronic device, a portable terminal, and a management device.
And
The electronic device includes an observation unit for observing a user's behavior and communication for communicating with the portable terminal.
With
The portable terminal communicates with the electronic device and a first communication unit that communicates with the management device.
The second communication unit, the observed values observed by the electronic device and the usage history of the portable terminal are collected.
Information collecting unit, an analyzing unit for analyzing information collected by the information collecting unit, and a solution of the analyzing unit
A display unit for displaying the user's diary created using the analysis result, and an operation unit for performing input to the mobile terminal and operation for the mobile terminal,
The analysis unit extracts behavior change points from the observed values of the electronic device and the usage history of the mobile terminal, and divides the user's behavior time series information into scenes based on the time series information of the behavior change points A scene dividing unit that extracts a scene candidate that is a candidate for the scene using a scene estimation rule, and a comment candidate extracting unit that extracts a comment candidate that is a candidate for an annotation related to the contents of the diary And
The display unit includes a diary display unit that displays the diary, a scene candidate display unit that displays the scene candidate when a scene candidate display button is pressed using the operation unit, and a comment that uses the operation unit. A comment candidate display unit that displays a comment candidate when the candidate display button is pressed,
Displayed in the scene candidate displayed in the scene candidate display section and the comment candidate display section
The user is allowed to select an arbitrary scene and comment from the comment candidates, and the user is engaged based on selection of the arbitrary scene and comment by the user.
A diary creation support system characterized by creating a diary. In claim 1,
The comment candidates represent at least emotions and representative events in the scene.
A diary creation support system characterized by being able to input using pictograms. In claim 1,
The management device includes a communication unit that communicates with the portable terminal, and a plurality of uses including the user
A storage unit that stores user information that is information of the user, an analysis unit that analyzes the user information,
A diary management unit that manages the diary of multiple users,
Analyzing the user information of the plurality of users and managing the diary of the plurality of users
A diary creation support system characterized by management. In claim 3,
The mobile terminal and the management device are configured to be communicable via a common network.
Further comprising an information distribution device,
The first communication unit of the portable terminal and the communication unit of the management device are configured to transmit the information distribution device.
Configured to communicate with the device,
The information distribution device includes a communication unit that communicates with the portable terminal and the management device;
The distribution information relating to the user is determined from the user information and the analysis result of the analysis unit of the management device, the information distribution unit transmitting the distribution information, the analysis result of the analysis unit of the management device, and the
A storage unit for holding distribution information;
Using information analysis results concerning the plurality of users, the situation of each user of the plurality of users
A diary creation support system characterized by providing corresponding information. In claim 4,
The portable terminal is configured to connect the electronic device and the portable terminal via a network.
A diary creation support system characterized by being configured to control an electronic device. In claim 1,
The mobile terminal has the network via a network connecting the electronic device and the mobile terminal
A functional part is configured to be shared between the portable terminal and the electronic device, and a part of the electronic device
Is realized by the shared functional part of the portable terminal.
Diary creation support system. In claim 1,
Further comprising a communication device different from the mobile terminal,
A diary creation support system, wherein observation information of the electronic device is transmitted to the mobile terminal via the communication device. In claim 1,
The behavior change point of the usage history of the mobile terminal is obtained from information on the start and end of use of at least one of the IC card, the calling unit, the web browsing unit, the mail transmitting / receiving unit, and the operation unit of the mobile terminal A diary creation support system.

Images