JP6618492B2 - Data processing apparatus, data processing method, and program - Google Patents

Description

  The present invention relates to a data processing device, a data processing method, and a program.

There has been known a chatbot in which a computer executes a conversation with a user using text (see, for example, Patent Document 1).
[Prior art documents]
[Patent Literature]
[Patent Document 1] Japanese Patent Application Laid-Open No. 2015-115892

  It is desirable to be able to assist the user appropriately by enhancing the content of the conversation with the user.

  According to a first aspect of the present invention, a data processing apparatus is provided. The data processing apparatus may include a state management data storage unit that stores state management data for managing a user state. The data processing apparatus may include an action determination unit that determines an action for the user with reference to the state management data. The data processing apparatus may include a history data collection unit that collects user activity history data acquired by the user's mobile terminal. The data processing apparatus may include a history data transmission unit that transmits activity history data collected by the history data collection unit to the history analysis unit. The data processing apparatus may include a state data acquisition unit that acquires user state data indicating a user state specified by the history analysis unit analyzing the activity history data. The data processing apparatus may include a state management data update unit that updates the user state management data based on the user state data.

  The data processing device includes: an identification data generation unit that generates identification data for identifying the user state data to be acquired based on the state management data; The data acquisition unit may receive the user status data transmitted in response to the history analysis unit receiving the identification data. The history data transmission unit may transmit the activity history data collected by the history data collection unit to a plurality of the history analysis units, and the data processing device may transmit the identification data to the plurality of history analysis The identification data transmission unit may transmit the identification data to the history analysis unit selected by the target selection unit.

  The state management data may include a plurality of items used for a conversation with the user, and the identification data generation unit generates identification data for identifying an item whose content is not specified among the plurality of items. The data acquisition unit may receive the item indicated by the identification data from the history analysis unit, and the state management data update unit updates the state management data based on the item indicated by the identification data. The data processing apparatus may further include a conversation control unit that causes the conversation application of the portable terminal to execute a conversation with the user according to an action determined by the action determination unit with reference to the state management data. It's okay. The conversation control unit may cause the conversation application to execute a conversation for inquiring the item to the user when the data acquisition unit cannot receive the item indicated by the identification data from the history analysis unit. The action determination unit may determine an action of outputting music corresponding to the user's state with reference to the state management data, and the data processing device may determine the action according to the action determined by the action determination unit. You may further provide the music output control part which controls the music output with respect to a user.

  The history data collection unit may collect the activity history data in association with the location information of the mobile terminal acquired by the mobile terminal and the time when the location information is acquired. The history data collection unit may collect data input to the mobile terminal by the user as the activity history data. The history data collection unit may collect activity history data of the user acquired by the IoT device.

  According to the second aspect of the present invention, there is provided a program for causing a computer to function as the data processing device.

  According to a third aspect of the present invention, a data processing method is provided. The data processing method may include an action determination step of determining an action for the user with reference to the state management data stored in the state management data storage unit that stores state management data for managing the state of the user. The data processing method may include a history data collection step of collecting user activity history data acquired by the user's mobile terminal. The data processing method may include a history data transmission step of transmitting the activity history data collected in the history data collection step to the history analysis unit. The data processing method may include a state data acquisition step of acquiring user state data indicating a user state specified by the history analysis unit analyzing the activity history data. The data processing method may include a state management data update step of updating the user state management data based on the user state data.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

An example of assist server 100 is shown roughly. An example of the functional composition of assist server 100 is shown roughly. An example of the state management data 180 is shown schematically. An example of the flow of the process which updates the state management data 180 by the assist server 100 is shown schematically. An example of state management data 182 is shown roughly. An example of the flow of the process which updates the state management data 182 by the assist server 100 is shown schematically. The example of a display by the portable terminal 200 is shown schematically. An example of the hardware constitutions of the computer 1000 which functions as the assist server 100 is shown schematically.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 schematically shows an example of the assist server 100. The assist server 100 according to the present embodiment assists the user 210 of the mobile terminal 200. For example, the assist server 100 provides information suitable for the state of the user 210 to the user 210 via the mobile terminal 200. For example, the assist server 100 provides the user 210 with music suitable for the state of the user 210 via the music system 500. The assist server 100 may be an example of a data processing device.

  The assist server 100 stores state management data for managing the state of the user 210. The state management data includes a plurality of items used for assisting the user 210, for example. Examples of items include the current location of the user 210, whether the user 210 is at home, the home location of the user 210, the weather at the current location of the user 210, the weather at the home location of the user 210, the health status of the user 210, and For example, the fatigue level of the user 210 may be mentioned. These are examples, and arbitrary items may be adopted.

  The assist server 100 collects the activity history data of the user 210 acquired by the mobile terminal 200. The mobile terminal 200 may transmit the activity history data to the assist server 100 according to a predetermined timing. The predetermined timing may be regular or irregular. Examples of the activity history data include the position, time, and the content of conversation between the mobile terminal 200 and the user 210. These are examples, and the activity history data may include any information regarding the activity of the user 210.

  The assist server 100 may collect activity history data of the user 210 acquired by an IoT (Internet of Things) device 400. The assist server 100 may collect activity history data corresponding to the type of the IoT device 400 from the plurality of IoT devices 400.

  For example, the assist server 100 collects body data such as the body temperature, blood pressure, and heart rate of the user 210 from the IoT device 400 worn by the user 210. Further, for example, the assist server 100 collects environmental data such as temperature and humidity from the IoT device 400 installed in the vicinity of the user 210. These are examples, and the assist server 100 may collect arbitrary information regarding the activity of the user 210 from the IoT device 400.

  The assist server 100 updates the state management data of the user 210 using the collected activity history data. In addition, the assist server 100 acquires user status data indicating the status of the user 210 specified based on the collected activity history data, and updates the status management data based on the user status data.

  For example, the assist server 100 transmits the collected activity history data to the plurality of sites 300 via the network 10. The network 10 may include the Internet and a telephone network. Examples of the site 300 include a map site, a gourmet site, a schedule management site, a route guidance site, a weather site, and a FAQ site. These are examples, and the site 300 may be any type of site.

  The assist server 100 may receive the user status data specified by the site 300 using the activity history data from the site 300. For example, the assist server 100 receives the home position of the user 210 identified by analyzing the position of the user 210 included in the activity history data by the map site, the FAQ site, and the like.

  Conventionally, data such as the home position of the user 210 has to be accepted by the user 210 and may be complicated for the user 210. However, according to the assist server 100 according to the present embodiment, the collected activity history data is transmitted to the plurality of sites 300, and the user status data specified by each of the plurality of sites 300 is received, whereby the user 210 It is possible to acquire information such as the home position of the user 210 without accepting the registration by.

  The assist server 100 may identify the user status data by analyzing the activity history data. For example, the assist server 100 may include at least one history analysis unit that analyzes activity history data and identifies user status data.

  The assist server 100 updates the state management data of the user 210 based on the user state data. For example, when the home position of the user 210 is acquired as the user status data, the assist server 100 registers the home position of the user 210 in the status management data.

  The assist server 100 determines an action for the user 210 with reference to the state management data. For example, the assist server 100 refers to the state management data and determines the conversation content for the user 210. The assist server 100 may transmit the determined conversation content to the mobile terminal 200. The mobile terminal 200 may output the received conversation content to the user 210.

  Further, the assist server 100 determines music to be provided to the user 210 with reference to the state management data, for example. The assist server 100 may transmit the determined music data to the music system 500. The assist server 100 may transmit identification data for identifying the determined music to the music system 500. When the music system 500 receives music data, the music system 500 may provide music to the user 210 using the received data. When the music system 500 receives the identification data identifying the music, the music system 500 may provide the user 210 with the music identified by the identification data.

  FIG. 2 schematically shows an example of the functional configuration of the assist server 100. The assist server 100 includes a conversation control unit 102, a history data collection unit 104, a state management data storage unit 106, a state management data update unit 108, an action determination unit 110, a collector unit 120, a history analysis unit group 130, a processing unit 140, a state A data acquisition unit 150 and a music output control unit 160 are provided. In addition, it is not necessarily essential that the assist server 100 has all these configurations.

  The conversation control unit 102 controls the conversation with the user 210 by the mobile terminal 200. For example, a conversation application that executes a conversation with the user 210 may be installed in the mobile terminal 200. The mobile terminal 200 may converse with the user 210 using at least one of characters and voice. The conversation control unit 102 receives the speech of the user 210 from the mobile terminal 200. The conversation control unit 102 transmits a remark to the user 210 to the mobile terminal 200.

  The history data collection unit 104 collects activity history data of the user 210. The history data collection unit 104 may receive activity history data transmitted from the mobile terminal 200 at a predetermined timing. For example, the mobile terminal 200 transmits the position and time to the assist server 100 according to a predetermined timing. The predetermined timing may be regular or irregular. The history data collection unit 104 may acquire the content of the conversation controlled by the conversation control unit 102 from the conversation control unit 102 as activity history data.

  Further, the history data collection unit 104 receives the activity history data of the user 210 from the IoT device 400. The IoT device 400 may transmit the activity history data to the assist server 100 via the network 10. The IoT device 400 may transmit activity history data to the assist server 100 via the mobile terminal 200. The history data collection unit 104 receives body data such as the body temperature, blood pressure, and heart rate of the user 210 from the IoT device 400, for example. Further, the history data collection unit 104 receives environmental data such as temperature and humidity around the user 210 from the IoT device 400, for example.

  The state management data storage unit 106 stores state management data of the user 210. The state management data storage unit 106 may store state management data for each of the plurality of users 210. The state management data storage unit 106 may store a plurality of types of state management data for one user 210.

  For example, the state management data storage unit 106 stores state management data for each conversation scenario. Examples of scenarios include weather scenarios, television scenarios, article scenarios, train scenarios, shopping scenarios, drinking parties scenarios, walk scenarios, company food scenarios, questionnaire scenarios, and chat scenarios. It is done. These are examples, and the state management data storage unit 106 may store state management data of an arbitrary scenario.

  The state management data update unit 108 updates the state management data of the user 210 stored in the state management data storage unit 106. The state management data update unit 108 may update the state management data using the activity history data collected by the history data collection unit 104.

  The action determination unit 110 refers to the state management data stored in the state management data storage unit 106 and determines an action for the user 210. For example, the action determination unit 110 causes the conversation control unit 102 to execute a conversation suitable for the state of the user 210 with reference to the state management data.

  The collector unit 120 includes a history data acquisition unit 122 and a history data transmission unit 124. The history data acquisition unit 122 acquires the activity history data collected by the history data collection unit 104 from the history data collection unit 104. The history data transmission unit 124 transmits the activity history data acquired by the history data acquisition unit 122 to the history analysis unit group 130.

  The history analysis unit group 130 includes a plurality of history analysis units 132. Each of the plurality of history analysis units 132 receives and stores the activity history data transmitted by the history data transmission unit 124. The plurality of history analysis units 132 may analyze the activity history data from different viewpoints, methods, algorithms, etc., and derive user state data. The assist server 100 may include one history analysis unit 132 instead of the history analysis unit group 130.

  The history analysis unit 132 may be the site 300. That is, the assist server 100 may not include the history analysis unit group 130 but the assist server 100 may transmit the activity history data to the external site 300 for analysis. Further, the history analysis unit group 130 may include at least one history analysis unit 132 and at least one site 300 included in the assist server 100.

  The processing unit 140 includes an identification data generation unit 141, a target selection unit 142, an identification data transmission unit 143, a state data reception unit 144, and a processing processing unit 145. It is not essential that the processing unit 140 has all these configurations.

  The identification data generation unit 141 generates identification data for identifying user status data to be acquired in accordance with an instruction from the action determination unit 110. The action determination unit 110 may specify user status data to be acquired based on the status management data. For example, the action determination unit 110 specifies an item whose content is not specified among a plurality of items included in the state management data as user state data to be acquired. As a specific example, when the item of the home position of the user 210 is included in the state management data, but the content of the home position is not registered, the action determination unit 110 determines the home position as the user state data to be acquired. As specified.

  The target selection unit 142 selects the transmission target of the identification data generated by the identification data generation unit 141 from the plurality of history analysis units 132. The object selection unit 142 stores, for example, association data that associates each of the plurality of history analysis units 132 with the type of identification data in advance, and by referring to the association data, the identification data generation unit 141 is stored. The history analysis unit 132 corresponding to the identification data generated by may be selected.

  The identification data transmission unit 143 transmits the identification data generated by the identification data generation unit 141 to the history analysis unit 132 selected by the target selection unit 142. Note that the identification data transmission unit 143 may transmit the identification data generated by the identification data generation unit 141 to the history analysis unit group 130. In this case, the history analysis units 132 included in the history analysis unit group 130 receive the identification data, and the history analysis unit 132 that can provide the user status data indicated by the identification data transmits the user status data to the processing unit 140. The other history analysis unit 132 may discard the identification data.

  The status data receiving unit 144 receives user status data transmitted in response to the history analysis unit 132 receiving identification data. The processing unit 140 may transmit the user status data received by the status data receiving unit 144 to the status data acquiring unit 150.

  When the state data receiving unit 144 cannot receive the user state data indicated by the identification data transmitted by the identification data transmitting unit 143, the action determining unit 110 acquires the user state data from the user 210 to the conversation control unit 102. As described above, the conversation control unit 102 may be controlled. For example, when the state data receiving unit 144 cannot receive the home position of the user 210, the action determination unit 110 controls the conversation control unit 102 to perform inquiry processing for inquiring the mobile terminal 200 about the home position of the user 210. Let it run. As a result of the inquiry process, the conversation control unit 102 may receive the home position acquired by the mobile terminal 200. The action determination unit 110 may transmit the home position received by the conversation control unit 102 to the state data acquisition unit 150.

  The state data acquisition unit 150 may transmit the user state data received from the processing unit 140 or the action determination unit 110 to the state management data update unit 108. The state management data update unit 108 may update the state management data stored in the state management data storage unit 106 based on the user state data received from the state data acquisition unit 150.

  The action determination unit 110 may determine an action for the user 210 with reference to the updated state management data. The action determining unit 110 may transmit the conversation content to the conversation control unit 102 when the conversation content for the user 210 is determined. The conversation control unit 102 may cause the mobile terminal 200 to output the received conversation content.

  When determining the music to be provided to the user 210, the action determination unit 110 may transmit the determined music to the music output control unit 160. For example, when the state management data includes the fatigue level of the user 210, the action determination unit 110 determines music corresponding to the fatigue level. For example, when the action determination unit 110 includes a history of music viewed by the user 210, the action determination unit 110 may determine music based on the history.

  The music output control unit 160 provides the user 210 with the music determined by the action determination unit 110. For example, the music output control unit 160 transmits the music data determined by the action determination unit 110 to the music system 500 and causes the music system 500 to output the music data. The music output control unit 160 may transmit music identification data for identifying music determined by the action determination unit 110 to the music system 500. In this case, the music system 500 may acquire and output music data identified by the received music identification data from its own music data storage unit or network.

  The action determination unit 110 may transmit at least a part of the updated state management data to the processing unit 145. The processing unit 145 may generate data used for an action for the user 210 based on at least a part of the received state management data. For example, the processing unit 145 generates conversation contents for the user 210. Further, the processing unit 145 determines music to be provided to the user 210, for example.

  The processing unit 145 may generate data used for an action for the user 210 in cooperation with the history analysis unit 132. For example, when generating the conversation content about the weather of the user 210 at home, the processing unit 145 receives the home weather history from the history analysis unit 132 and based on the current home weather and the weather history Generate conversation content. As a specific example, if the weather history indicates that the current home weather is rain and the weather of the previous day and the day before the previous day is also rain, Conversation content such as “It's raining and bad” including the nuances of the history is generated.

  FIG. 3 schematically shows an example of the state management data 180. The state management data 180 illustrated in FIG. 3 corresponds to a scenario of “Today's home weather”. The state management data 180 includes items of a user ID, a location, a time, whether or not the user is at home, a home location, and the weather at home today. FIG. 3 illustrates a state in which the user ID, the current position, and the current time are registered, and whether or not the user is now home, the home position, and the weather content of today's home are not registered.

  FIG. 4 schematically shows an example of the flow of processing for updating the state management data 180 by the assist server 100. Here, the flow of processing when controlling the push-type conversation processing in which the mobile terminal 200 speaks to the user 210 is schematically shown.

  In step (step may be abbreviated as S) 402, the history data collection unit 104 receives the position and time of the mobile terminal 200 from the mobile terminal 200. In S <b> 404, the history data collection unit 104 transmits the position and time received in S <b> 402 to the state management data update unit 108 and the collector unit 120.

  In S406, the state management data update unit 108 updates the state management data stored in the state management data storage unit 106 using the position and time received in S404. When there are a plurality of state management data including items of position and time, the state management data update unit 108 may update the plurality of state management data. In S <b> 408, the collector unit 120 transmits the position and time received in S <b> 404 to the processing unit 140 and the history analysis unit group 130.

  In S410, the action determination unit 110 refers to the state management data. The action determination unit 110 determines a conversation scenario with the user 210 based on the state management data. Here, the description will be continued by taking as an example a case where the scenario of “today's home weather” is determined. The action determination unit 110 refers to the state management data 180 as the state management data corresponding to the scenario “Today's home weather”.

  In the example shown in FIG. 3, whether or not it is the current home, the home position, and the weather of today's home are not specified. The action determination unit 110 transmits the user ID and the current position to the processing unit 140 in S414 as a process for confirming whether or not the user is currently at home. The process executed by the action determination unit 110 when the content of the item of the state management data is not specified may be registered in advance. The action determination unit 110 may specify an item whose content is not specified with reference to the state management data, and execute a process corresponding to the item.

  In S416, the processing unit 140 transmits the user ID and the current position received in S414 to the history analysis unit group 130. The processing unit 140 may transmit the user ID and the current position to all the history analysis units 132 included in the history analysis unit group 130, and the user ID and the current position are transmitted only to the history analysis unit 132 selected by the target selection unit 142. The location may be transmitted.

  Based on the received user ID and the current position, the history analysis unit 132 specifies whether the user 210 is now at home and the home position of the user 210. For example, the history analysis unit 132 derives in advance the home position of the user 210 from a plurality of periodically received positions and times, and depends on the distance between the home position corresponding to the received user ID and the received current position. , It may be specified whether the user 210 is now at home.

  In S <b> 418, the history analysis unit 132 that specifies whether or not the user is at home and the home position transmits the information to the processing unit 140. Here, the description will be continued by taking as an example a case where the user 210 is identified as being at home.

  In S420, the processing unit 140 transmits whether or not it is the current home and the home position received in S418 to the state management data update unit 108 via the state data acquisition unit 150. In S422, the state management data update unit 108 updates the state management data 180. Specifically, the state management data update unit 108 registers the received information in the items of whether or not it is the current home and the home position of the state management data 180.

  In S424, the action determination unit 110 refers to the state management data 180. In S <b> 426, the action determination unit 110 transmits the home position to the processing unit 140 as a process of confirming the weather at home today.

  In S428, the processing unit 140 transmits the home position received in S426 to the history analysis unit group 130. The processing unit 140 may transmit the home position to all the history analysis units 132 included in the history analysis unit group 130, or may transmit the home position only to the history analysis unit 132 selected by the target selection unit 142. Good.

  The history analysis unit 132 identifies today's home weather based on the received home position. The history analysis unit 132 may be a weather site, for example. In S430, the history analysis unit 132 transmits the identified weather of today's home to the processing unit 140. Here, the description will be continued by taking as an example the case where the weather at home today is rainy.

  In S432, the processing unit 140 transmits the weather of today's home received in S430 to the state management data update unit 108 via the state data acquisition unit 150. In S434, the state management data update unit 108 updates the state management data 180 using the received weather at home today. Specifically, the state management data update unit 108 registers the received information in the item of weather of today's home in the state management data 180.

  In S436, the action determination unit 110 refers to the state management data 180. In S438, the action determination unit 110 transmits the weather of today's home to the processing unit 140 in response to the contents of all items in the state management data 180 being specified. The execution contents executed by the action determination unit 110 in response to the identification of all items of the state management data 180 may be registered in advance.

  The processing unit 145 of the processing unit 140 generates conversation content according to today's home weather received in S438. The processing unit 145 receives, for example, the home weather history from the history analysis unit 132, and the conversation contents corresponding to today's home weather and the weather history are “rainy and bad” or the like. Generate conversation content.

  In S440, the processing unit 140 transmits the conversation content generated by the processing processing unit 145 to the action determination unit 110. The processing unit 140 may also transmit the generated conversation content to the collector unit 120 for the purpose of learning log.

  In S442, the action determination unit 110 transmits the conversation content received in S440 to the conversation control unit 102. In S444, the conversation control unit 102 controls the conversation application of the portable terminal 200 so that the conversation content received in S442 is output to the portable terminal 200.

  FIG. 5 schematically shows an example of the state management data 182. The state management data 182 corresponds to the “company weather” scenario. The state management data 182 includes items of user ID, position, time, intention, place, location of the place, and weather. FIG. 5 illustrates a state in which the user ID, the position, the time, and the intention are registered, and the location, the location of the place, and the weather content are not registered.

  FIG. 6 schematically shows an example of the processing flow for updating the state management data 182 by the assist server 100. Here, the flow of processing when controlling pull-type conversation processing spoken by the user 210 is schematically shown.

  In step S <b> 602, the mobile terminal 200 transmits the message “Tell me the weather” input by the user 210 to the conversation control unit 102. The conversation control unit 102 may interpret the user 210's statement and specify a weather question as the intention of the statement. In S <b> 606, the conversation control unit 102 transmits the specified intention (weather question) to the history data collection unit 104.

  In S606, the history data collection unit 104 transmits the intention (weather question) received in S604 to the state management data update unit 108 and the collector unit 120. In S608, the state management data update unit 108 updates the state management data stored in the state management data storage unit 106 using the intention (weather question) received in S606. When there are a plurality of state management data including the intended item, the state management data update unit 108 may update the plurality of state management data. For example, the state management data 182 registers a weather question in the intended item of the state management data 182.

  In S610, the collector unit 120 transmits the intention (weather question) received in S606 to the processing unit 140 and the history analysis unit group 130.

  In S612, the action determination unit 110 refers to the state management data. The action determination unit 110 determines a conversation scenario with the user 210 based on the state management data. Here, the description is continued by taking as an example a case where the scenario of “company weather” is determined on the condition that the intention is a weather question and the current time is in the morning time zone.

  In the example shown in FIG. 5, the location, the location of the location, and the content of the weather are not specified. In S616, as a process for confirming the location, the action determination unit 110 transmits a question for confirming the location “weather near the company?” To the conversation control unit 102.

  In S618, the conversation control unit 102 controls the conversation application of the portable terminal 200 so that the question received in S616 is output to the portable terminal 200. In S <b> 620, the mobile terminal 200 transmits the message “house” input by the user 210 in response to the question output in S <b> 618 to the conversation control unit 102. The conversation control unit 102 acquires home as a place.

  In S <b> 622, the conversation control unit 102 transmits the location (home) to the history data collection unit 104. In S624, the history data collection unit 104 transmits the location (home) to the state management data update unit 108. In S626, the state management data update unit 108 updates the state management data 182 using the place (home) received in S624. Specifically, the state management data update unit 108 registers home in the item of the location of the state management data 182. Note that the state management data update unit 108 may also transmit the location (home) to the collector unit 120 for the purpose of learning log.

  In S628, the action determination unit 110 refers to the state management data 182. In S630, the action determination unit 110 transmits the user ID and the location (home) to the processing unit 140 as a process of confirming the location of the location.

  In S632, the processing unit 140 transmits the user ID and location (home) received in S630 to the history analysis unit group 130. The processing unit 140 may transmit these information to all the history analysis units 132 included in the history analysis unit group 130, and transmits these information only to the history analysis unit 132 selected by the target selection unit 142. May be.

  The history analysis unit 132 identifies the position of the place (home) based on the received user ID and the place (home). The history analysis unit 132 specifies the latitude and longitude of the home of the user 210, for example. In S634, the history analysis unit 132 that has identified the location of the place transmits the location of the location to the processing unit 140.

  In S636, the processing unit 140 transmits the position of the place received in S634 to the state management data update unit 108. In S638, the state management data update unit 108 updates the state management data 182 using the location of the location received in S636. Specifically, the state management data update unit 108 registers the latitude and longitude of the home of the user 210 in the item of the location of the location of the state management data 182.

  In S640, the action determination unit 110 refers to the state management data 182. In S642, as a process of confirming the weather, the action determination unit 110 transmits the location position to the processing unit 140.

  In S644, the processing unit 140 transmits the position of the place received in S642 to the history analysis unit group 130. The processing unit 140 may transmit the location of the place to all the history analysis units 132 included in the history analysis unit group 130, and transmits the location of the location only to the history analysis unit 132 selected by the target selection unit 142. May be. The history analysis unit 132 identifies the weather at the received location. Here, the case where the history analysis unit 132 specifies rain as the weather at the location will be described as an example.

  In S646, the history analysis unit 132 that has identified the weather at the location transmits the identified weather to the processing unit 140. In S648, the processing unit 140 transmits the weather received in S646 to the state management data update unit 108. In S650, the state management data update unit 108 updates the state management data 182 using the weather received in S648. Specifically, the state management data update unit 108 registers rain in the weather item of the state management data 182.

  In S652, the action determination unit 110 refers to the state management data 182. In S654, the action determination unit 110 transmits the weather (rain) to the processing unit 140 in response to all items of the state management data 182 being specified. The processing unit 145 of the processing unit 140 generates conversation contents according to the weather (rain) received in S654. For example, the processing unit 145 generates conversation contents such as “It seems to be raining”.

  In S656, the processing unit 140 transmits the generated conversation content to the action determination unit 110. The processing unit 140 may also transmit the generated conversation content to the collector unit 120 for the purpose of learning log.

  In S658, the action determination unit 110 transmits the conversation content received in S656 to the conversation control unit 102. In S660, the conversation control unit 102 controls the conversation application of the mobile terminal 200 so that the mobile terminal 200 outputs the conversation content received in S658.

  In addition, here, the case where the intention is a weather question and the current time is in the morning time zone and the scenario of “company weather” is selected has been described as an example. As an example, if the intention is a weather question and the current time indicates a weekday evening time zone, the user's 210 at the office has the tacit knowledge that the question may be about the way home, and the weather at home Or a home weather scenario that includes a conversation that asks if you are listening to the weather at home.

  FIG. 7 schematically shows a display example 202 by the mobile terminal 200. FIG. 7 shows a display example 202 by the mobile terminal 200 when the assist server 100 executes the process shown in FIG. Here, a case where a chat-based interface is used is illustrated.

  FIG. 8 schematically illustrates an example of a computer 1000 that functions as the assist server 100. The computer 1000 according to this embodiment includes a CPU peripheral unit including a CPU 1010, a RAM 1030, and a graphic controller 1085 connected to each other by a host controller 1092; a ROM 1020 connected to the host controller 1092 by an input / output controller 1094; An input / output unit having F1040, a hard disk drive 1050, a DVD drive 1070, and an input / output chip 1080 is provided.

  The CPU 1010 operates based on programs stored in the ROM 1020 and the RAM 1030 and controls each unit. The graphic controller 1085 acquires image data generated by the CPU 1010 or the like on a frame buffer provided in the RAM 1030 and displays the image data on the display 1090. Alternatively, the graphic controller 1085 may include a frame buffer that stores image data generated by the CPU 1010 or the like.

  The communication I / F 1040 communicates with other devices via a network by wire or wireless. The communication I / F 1040 functions as hardware that performs communication. The hard disk drive 1050 stores programs and data used by the CPU 1010. The DVD drive 1070 reads a program or data from the DVD-ROM 1072 and provides it to the hard disk drive 1050 via the RAM 1030.

  The ROM 1020 stores a boot program that the computer 1000 executes at startup, a program that depends on the hardware of the computer 1000, and the like. The input / output chip 1080 connects various input / output devices to the input / output controller 1094 via, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

  A program provided to the hard disk drive 1050 via the RAM 1030 is stored in a recording medium such as a DVD-ROM 1072 or an IC card and provided by a user. The program is read from the recording medium, installed in the hard disk drive 1050 via the RAM 1030, and executed by the CPU 1010.

  A program installed in the computer 1000 and causing the computer 1000 to function as the assist server 100 may work on the CPU 1010 or the like to cause the computer 1000 to function as each part of the assist server 100. The information processing described in these programs is read into the computer 1000, whereby the conversation control unit 102 and the history data collection unit 104, which are specific means in which the software and the various hardware resources described above cooperate. , The state management data storage unit 106, the state management data update unit 108, the action determination unit 110, the collector unit 120, the history analysis unit group 130, the processing unit 140, the state data acquisition unit 150, and the music output control unit 160. And the specific assist server 100 according to the intended purpose is constructed | assembled by implement | achieving the calculation or processing of the information according to the intended purpose of the computer 1000 in this embodiment by these specific means.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly "before" It should be noted that it can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first,” “next,” etc. for convenience, it means that it is essential to carry out in this order It is not a thing.

10 network, 100 assist server, 102 conversation control unit, 104 history data collection unit, 106 status management data storage unit, 108 status management data update unit, 110 action determination unit, 120 collector unit, 122 history data acquisition unit, 124 history data Transmission unit, 130 History analysis unit group, 132 History analysis unit, 140 Processing unit, 141 Identification data generation unit, 142 Target selection unit, 143 Identification data transmission unit, 144 Status data reception unit, 145 Processing processing unit, 150 Status data acquisition Unit, 160 music output control unit, 180 state management data, 182 state management data, 200 portable terminal, 202 display example, 210 user, 300 sites, 400 IoT device, 500 music system, 1000 computer, 1010 CPU, 1020 OM, 1030 RAM, 1040 a communication I / F, 1050 hard drive, 1070 DVD drive, 1072 DVD-ROM, 1080 output chip 1085 graphics controller, 1090 a display, 1092 host controller, 1094 output controller

Claims (6)

A data processing device,
A state management data storage unit for storing state management data for managing the user state;
An action determination unit that refers to the state management data and determines an action for the user;
The content of the conversation between the mobile terminal and the user, acquired by the mobile terminal of the user and transmitted regularly or irregularly by the mobile terminal, the physical data of the user acquired by an IoT device, A history data collection unit for collecting activity history data of the user including environmental data around the user acquired by an IoT device ;
A history data transmitting unit that transmits the activity history data collected by the history data collecting unit to a plurality of external sites via a network ;
Based on the state management data, an identification data generation unit that generates identification data for identifying user state data indicating the state of the user to be acquired;
The target selection unit that selects the transmission target of the identification data from the plurality of external sites, by referring to the association data that associates each of the plurality of external sites with the type of the identification data, A target selection unit that selects an external site corresponding to the identification data as a transmission target of the identification data;
An identification data transmission unit that transmits the identification data to an external site selected by the target selection unit among the plurality of external sites;
In response to receiving the identification data, the external site is identified by the identification data identified and transmitted by analyzing the activity history data received and stored from the history data transmission unit. a state data acquisition unit that acquires the user state data that,
Based on said user status data, Ru and a status management data updating unit for updating the state management data of the user, the data processing device. The action determining unit refers to the state management data, determines an action for outputting music corresponding to the state of the user,
The data processing device includes:
The data processing apparatus according to claim 1, further comprising: a music output control unit that controls music output to the user according to the action determined by the action determination unit. The history data acquisition unit, as the activity history data, and the location information of the mobile terminal which the mobile terminal has acquired, collected in association with time obtained the position information, according to claim 1 or 2 Data processing device. The history data acquisition unit, as the activity history data, to collect data that is input to the mobile terminal by the user, the data processing apparatus according to any one of claims 1 to 3. The program for functioning a computer as a data processor as described in any one of Claim 1 to 4 . A data processing method comprising:
An action determining unit that refers to the state management data stored in the state management data storage unit that stores state management data for managing the state of the user, and determines an action for the user;
The history data collection unit is acquired by the user's mobile terminal and transmitted regularly or irregularly by the mobile terminal, and the content of the conversation between the mobile terminal and the user, and the user acquired by the IoT device Collecting historical data of the user's activity data including physical data of the user and environmental data of the user's surroundings acquired by the IoT device ;
A history data transmitting unit transmits the activity history data collected in the history data collecting step to a plurality of external sites via a network ; and
An identification data generating step for generating identification data for identifying user status data indicating the user status, which is an acquisition target, based on the status management data;
The target selection unit is a target selection stage in which the transmission target of the identification data is selected from the plurality of external sites, and association data that associates each of the plurality of external sites with the type of the identification data A target selecting step of selecting an external site corresponding to the identification data as a transmission target of the identification data by referring to;
An identification data transmitting unit that transmits the identification data to an external site selected by the target selection unit among the plurality of external sites;
In response to receiving the identification data, the external site is identified by the identification data identified and transmitted by analyzing the activity history data received and stored from the history data transmission unit. The state data acquisition step in which the state data acquisition unit acquires the user state data.
State management data updating unit, based on said user status data, Ru and a status management data updating step of updating the state management data of the user, the data processing method.

Images