JP6728259B2 - INFORMATION PROVIDING DEVICE, INFORMATION PROVIDING METHOD, AND INFORMATION PROVIDING PROGRAM - Google Patents

Description

The present embodiment relates to an information providing device, an information providing method, and an information providing program.

2. Description of the Related Art Conventionally, a technique for providing a cooking recipe that integrates a plurality of cooking recipes in response to a request for providing a plurality of cooking recipes from a user has been disclosed.

JP-A-2002-56077

However, the technique of providing the contents of the cooking recipe to the user in the initially set work order is not sufficient for providing appropriate information. For example, if some kind of error or trouble occurs such as the user making a mistake in the work order, it is difficult to satisfy the user even if the information is provided according to the work order originally set.

One aspect of the embodiment is made in view of the above, and provides an information providing device, an information providing method, and an information providing program capable of providing appropriate information according to a progress state of a user's cooking work. The purpose is to provide.

An information providing apparatus according to the present application, an acquisition unit that acquires a cooking recipe, a notification unit that notifies a user of a work item in accordance with the work order of the cooking recipe acquired by the acquisition unit, and the user with respect to the notification of the work item. And a recipe creation unit that creates a provisional recipe in which the work order of the cooking recipe is changed according to the response from the user, and the notification unit is the recipe creation unit. When the work order of the cooking recipe is changed by, the user is notified of the work item based on the changed work order.

According to the aspect of the embodiment, it is possible to provide appropriate information according to the progress state of the cooking work of the user.

FIG. 1 is an explanatory diagram showing an outline of an information providing method performed by the information providing apparatus according to the embodiment. FIG. 2 is a diagram illustrating an example of the configuration of the information providing system according to the embodiment. FIG. 3 is a block diagram showing an example of the configuration of the information providing apparatus according to the embodiment. FIG. 4 is a flowchart showing an example of processing executed by the control unit of the information providing apparatus according to the embodiment. FIG. 5 is an operation explanatory diagram of the information providing apparatus according to the embodiment. FIG. 6 is a flowchart showing an example of processing executed by the control unit of the information providing apparatus according to the embodiment. FIG. 7 is a diagram showing an example of the provisional recipe. FIG. 8 is an operation explanatory diagram of the information providing apparatus according to the embodiment. FIG. 9 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information providing apparatus according to the embodiment.

Hereinafter, modes (hereinafter, referred to as “embodiments”) for implementing an information providing apparatus, an information providing method, and an information providing program according to the present application will be described in detail with reference to the drawings. Note that the information providing apparatus, the information providing method, and the information providing program according to the present application are not limited by this embodiment. Further, in the following embodiments, the same parts are designated by the same reference numerals, and duplicated description will be omitted.

[1. Overview of information provision method]
FIG. 1 is an explanatory diagram showing an outline of an information providing method performed by the information providing apparatus according to the embodiment.

The information providing apparatus 100 according to the embodiment is, for example, a so-called smart speaker used in a house or the like, and when receiving a request for providing information by voice from the user 200, converts the information desired by the user 200 into a voice language. Device provided to the user 200.

The information providing device 100 has an AI (Artificial Intelligence) assistant function, and is communicatively connected to a server device (not shown) that distributes various information via a communication network.

When the information providing apparatus 100 receives the cooking information providing request from the user 200, the information providing apparatus 100 acquires the cooking information that the user 200 desires to provide from, for example, a server apparatus connected via a communication network.

The information providing apparatus 100 according to the embodiment receives a cooking information providing request from the user 200, and outputs a response to the received providing request by voice.

For example, as shown in the upper diagram of FIG. 1, when the user 200 utters the spoken language M1 “Tell me the work procedure for cooking XX.”, the information providing apparatus 100 activates the AI assistant function, and ”” is recognized by voice. In this case, "tell me" is a request to provide information. Alternatively, a predetermined activation word may be registered and the AI may be activated in response to the registered activation word.

When the information providing apparatus 100 receives the cooking information providing request, the information providing apparatus 100 acquires the information of the corresponding cooking recipe by the acquisition unit 132 described below. The information of the cooking recipe may be the information stored in the information providing device 100 itself, or may be obtained from the server device via the communication network.

The information providing apparatus 100 starts providing information by the response message AN1 in accordance with the work order 101 of the acquired original cooking recipe. For example, according to the cooking recipe, the procedure information corresponding to the work item A is converted into voice and provided as the response message AN1. The information providing apparatus 100, for example, utters a response message AN1 "I understand. Here, the work item A may include a plurality of work items and their work order, but in FIG. 1, it is shown as the work item A for convenience. In the following, the terms “procedure” and “order” may be synonymous with each other.

As shown in the lower part of FIG. 1, in the work item A, when there is a response indicating an accident from the user 200, the information providing apparatus 100 provides a work order different from the original work order. .. For example, this is the case when the user 200 receives a response “I can't do XXX” from the provided work item A. In this case, the information providing apparatus 100 sends a response message AN2 that recommends execution of the work item Y that supplements the work item A. As a result, the original work order 101 is changed to the work order 102.

For example, in the case of the work item A, the predetermined work item is not completed within the originally scheduled time, for example, “the hot water has not yet spouted”. In this case, the information providing device 100 provides information such as "OK, let's increase the firepower."

In addition, in preparation for the case where the work does not proceed smoothly, for example, the supposed work content may be prepared in advance, and the information may be provided to the user 200 according to the progress of the work of the user 200.

As described above, when the user 200 speaks the spoken language M2 that notifies the occurrence of the accident, the information providing apparatus 100 provides the work order 102 changed according to the utterance.

As a result, the information providing apparatus 100 can provide appropriate work item information according to the work status of the user 200.

The user 200 can receive the information provision according to the progress status from the information providing apparatus 100 by responding the work status in the spoken language M2. Further, the user 200 can flexibly deal with various accidents only by following the work order provided by the information providing apparatus 100.

In this way, even when an accident occurs, the user 200 need only follow the information provided by the information providing apparatus 100 by voice. Therefore, the user 200 can proceed with the cooking work according to the voice from the information providing apparatus 100 without interrupting the work.

[2. Information provision system configuration]
Next, the configuration of the information providing system 1 will be described with reference to FIG. FIG. 2 is a diagram showing a configuration example of the information providing system 1 according to the embodiment. As shown in FIG. 2, the information providing system 1 according to the embodiment includes an information providing device 100, a mobile terminal 10, and a server device 50. The information providing device 100, the mobile terminal 10, and the server device 50 are communicably connected via a communication network N. The information providing system 1 illustrated in FIG. 2 may include a plurality of mobile terminals 10 and a plurality of server devices 50.

For example, the information providing device 100 includes a so-called smart speaker. For example, the information providing apparatus 100 is a device (voice assist terminal) that detects the utterance of the user 200 around the information providing apparatus 100 and performs various processes according to the detected sound. For example, the information providing device 100 is a terminal device that processes a utterance of the user 200. For example, the information providing apparatus 100 collects not only the utterance of the user 200 but also environmental sounds around the information providing apparatus 100.

Further, the information providing apparatus 100 may have a voice recognition function. Further, the information providing apparatus 100 may be able to acquire information from a voice recognition server that provides a voice recognition service. In this case, the information providing system 1 may include a voice recognition server. Note that, in the example of FIG. 2, the information providing apparatus 100 and the server apparatus 50 recognize the utterance of the user 200 by appropriately using various conventional techniques, and a description thereof will be appropriately omitted.

Further, the information providing device 100 may include an image sensor or the like. For example, the information providing apparatus 100 has various functions such as an infrared sensor, a human sensor, a temperature sensor, and an atmospheric pressure sensor, and can detect and acquire environmental information around the information providing apparatus 100 such as temperature and atmospheric pressure. It may be.

The information providing apparatus 100 may be integrated with the mobile terminal 10 used by the user 200, for example. That is, in the information providing system 1, any device may be the information providing device.

Further, for example, the information providing device 100 may transmit the collected sensor information to the server device 50. For example, the information providing apparatus 100 may be a device capable of communicating with the server device 50 or the mobile terminal 10 via a predetermined communication network N, that is, a so-called IoT (Internet of Things) device.

The mobile terminal 10 is an information processing device used by the user 200. For example, the mobile terminal 10 is a terminal device used by the user 200. The mobile terminal 10 is realized by, for example, a smartphone, a tablet terminal, a notebook PC (Personal Computer), a desktop PC, a mobile phone, a PDA (Personal Digital Assistant), or the like.

The server device 50 is an information processing device that provides various services to the user 200. For example, the server device 50 is a service providing device that provides various services such as distribution of cooking recipe information, music and weather information.

For example, the server device 50 provides the information providing device 100 with various contents. For example, the server device 50 provides the information providing device 100 with various contents such as cooking recipe information, music and weather information. Note that the server device 50 may acquire information regarding services from external devices that provide various services such as cooking recipe information, music distribution, and weather information, and provide the information to the information providing device 100.

The server device 50 may collect various types of information from the information providing device 100 and the mobile terminal 10. For example, the server device 50 may acquire sensor information and the like detected by the information providing device 100 from the information providing device 100.

As described with reference to FIG. 1, for example, the user 200 utters the voice language M1 around the information providing apparatus 100, “Tell me the work procedure for cooking XX”. Then, the information providing apparatus 100 detects the audio language M1 "Tell me the work procedure for cooking XX." with the sound sensor.

Then, the information providing apparatus 100 extracts the recipe of cooking XX using the detected voice of the speech language M1 and notifies the work procedure based on the cooking recipe.

[3. Configuration of information providing device]
Next, the configuration of the information providing apparatus 100 according to the embodiment will be described with reference to FIG. FIG. 3 is a diagram illustrating a configuration example of the information providing apparatus 100 according to the embodiment. As shown in FIG. 3, the information providing device 100 includes a communication unit 110, a sensor unit 111, a voice output unit 112, a storage unit 120, and a control unit 130. The information providing apparatus 100 may include an input unit (for example, a keyboard or a mouse) that acquires various operations from the user 200, and a display unit (for example, a liquid crystal display) for displaying various information. ..

(Communication unit 110)
The communication unit 110 is realized by, for example, a NIC (Network Interface Card) or the like. The communication unit 110 is connected to the communication network N (see FIG. 2) in a wired or wireless manner, and transmits/receives information to/from the server device 50 and the mobile terminal 10. Further, the communication unit 110 may send and receive information to and from the server device 50 or the mobile terminal 10 that provides the cooking recipe service.

(Sensor unit 111)
The sensor unit 111 detects various kinds of information. For example, the sensor unit 111 has a sound sensor such as a microphone. For example, the sensor unit 111 detects ambient sound with a sound sensor. For example, the sensor unit 111 detects various audio information such as a user's utterance using a sound sensor.

Further, for example, the sensor unit 111 may include an image sensor such as a camera. For example, the sensor unit 111 detects the surrounding image by the image sensor. Note that, for example, the sensor unit 111 may have various sensors other than the above.

For example, the sensor unit 111 may include a position sensor such as a GPS (Global Positioning System) sensor. The sensor unit 111 may be able to detect a plurality of sensor information. The sensor unit 111 may include various sensors such as an illuminance sensor, a temperature sensor, a humidity sensor, a heartbeat (pulse) sensor, an acceleration sensor, a perspiration sensor, and an exhalation (gas) sensor. The information acquired by the sensor unit 111 is supplied to the reception unit 131.

(Voice output unit 112)
The voice output unit 112 is an output device for outputting various information as voice. For example, the audio output unit 112 is realized by a speaker or the like. For example, the voice output unit 112 outputs various kinds of information as voice according to the instruction from the notification unit 133.

(Storage unit 120)
The storage unit 120 is realized by, for example, a semiconductor memory device such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as a hard disk or an optical disk. As shown in FIG. 3, the storage unit 120 according to the embodiment includes a user information storage unit 121, a recipe storage unit 122, a user recipe storage unit 123, and an estimated information storage unit 124. Although not shown, the storage unit 120 may store information regarding conditions for determining the timing at which the audio output unit 112 outputs audio.

(User information storage unit 121)
The user information storage unit 121 according to the embodiment stores various kinds of information regarding the user. For example, the user information storage unit 121 stores various information regarding the user 200. The user information storage unit 121 stores information such as “cooking skill”, “attribute information”, “family structure information” of the user 200.

The “cooking skill” can be freely registered according to the number of years of cooking experience of the user 200 and the like. In the “attribute information”, various kinds of information regarding the attributes of the user 200 are stored. For example, the “attribute information” includes items such as “age”, “sex”, and “preference”. The "family structure information" includes items such as the number of family members of the user 200, "age", "sex", and "preference". The “taste” includes food preferences such as “I like sweets” and “I like spicy foods”.

For example, when there is a request from the user 200 to provide food-related information, the acquisition unit 132 acquires, from the user information storage unit 121, information about the target person to whom the user 200 provides food, and the acquired information. Can be supplied to the recipe creating unit 135, and the recipe creating unit 135 can create a cooking recipe based on the acquired information.

For example, when providing food to a family, a cooking recipe is created in which the timing of “sorting” and the timing of adding “seasoning” are adjusted according to the “preference” of the family, and the work item is set to the user 200 at the adjusted timing. Can be provided to. According to the adjusted timing, for example, by notifying the user 200 of a work item such as “Let's add seasoning XX soon”, it is possible to provide a dish that suits the taste of the family. Further, it is possible to reduce work mistakes by appropriately notifying the user 200 of work items at the adjusted timing.

Further, by acquiring the information on the cooking skill of the user 200, it is possible to provide a recommended cooking recipe according to the level. For example, when the information that the skill of the user 200 is high is acquired, the cooking recipe based on the working time shortened with respect to the standard working time is provided. Alternatively, in response to a provision request from the user 200 "cook in 20 minutes.", it is estimated that the user 200 work time is shorter than the standard work time, and the standard work time is "25 minutes". Can be recommended and provided.

Further, when the work time of the user 200 is shorter or longer than the work time of the provided food recipe for the work item of the provided food recipe, the skill of the user 200 is estimated based on the information and the next time to provide the skill. Reflect in the cooking recipe. Thereby, the cooking recipe according to the skill of the user 200 can be provided. Alternatively, the skill of the user 200 may be estimated for each field of cooking and scored. The estimated score can be stored in the estimated information storage unit 124, for example.

(Recipe storage unit 122)
The recipe storage unit 122 according to the embodiment stores information about cooking recipes. For example, the user 200 can register and store a recipe for a favorite dish. The recipe stored in the recipe storage unit 122 may be a cooking recipe acquired from the server device 50.

(User recipe storage unit 123)
The user recipe storage unit 123 according to the embodiment stores information on cooking recipes customized according to the user 200. For example, it includes information such as the work order, work items, and work time of the dishes that the user 200 actually executed. By storing the work order and the like actually executed by the user 200 as a user recipe, it is possible to efficiently prepare food for the next time and thereafter. The acquisition unit 132 can acquire the user recipe stored in the user recipe storage unit 123 when the user 200 requests the provision of the cooking procedure.

(Estimated information storage unit 124)
The estimated information storage unit 124 according to the embodiment stores information used when estimating the progress status of the work of the user 200. For example, the information of “sound” corresponding to each work item is stored. Specifically, the “sound of water from the faucet” corresponding to the work item “washing”, the “ignition sound of the stove” corresponding to “heating”, and the like can be stored. Incidentally, in case the work of the user 200 does not proceed smoothly, for example, the work content assumed due to the work delay may be stored in the estimated information storage unit 124.

By referring to the “sound” information detected by the sensor unit 111 and the “sound” information stored in the estimated information storage unit 124, it is possible to more appropriately grasp the progress status of the work of the user 200. For example, the reception unit 131 supplies the information of the received response in the spoken language from the user 200 to the estimation unit 134. The estimation unit 134 estimates the progress status of each work of the user 200 from the information of the response from the user 200 and the information stored in the estimated information storage unit 124.

For example, in the work item “heating”, the information of the response of the user 200 in the spoken language “Ready for heating” and the “cooking sound of the stove” obtained from the sensor unit 111 are displayed. When detecting, the estimation unit 134 estimates that the “heating” work item has started based on the “sound” information stored in the estimated information storage unit 124. In addition, the estimation unit 134 can estimate that the work item “warming” by the microwave is completed by detecting the sound of the “chin” of the microwave.

(Control unit 130)
As illustrated in FIG. 3, the control unit 130 includes a reception unit 131, an acquisition unit 132, a notification unit 133, an estimation unit 134, a recipe creation unit 135, and an output unit 136, which will be described below. Realizes or executes information processing functions and information provision. The internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 3 and may be another configuration as long as it is a configuration for performing the information providing process described later. Further, the connection relationship between the processing units included in the control unit 130 is not limited to the connection relationship illustrated in FIG. 3 and may be another connection relationship.

(About the reception unit 131)
The reception unit 131 receives the request for providing the cooking recipe of the user 200. In addition, the reception unit 131 may receive a request for providing information regarding cooking recipes from the mobile terminal 10.

When the reception unit 131 receives a request for providing a cooking recipe from the user 200, the reception unit 131 supplies the information to the acquisition unit 132. Further, when the accepting unit 131 accepts the cancellation of the provision request from the user 200, the accepting unit 131 performs a process of ending the information provision based on the accepted cancellation response. Furthermore, the reception part 131 performs the process which complete|finishes information provision, when the information provision about all the work items of a cooking recipe is completed.

In addition, the reception unit 131 receives, from the user 200, a change in information regarding information provision. Specifically, the reception unit 131 receives information such as the scheduled meal time being delayed and the increase/decrease in the number of people who perform cooking work.

The reception unit 131 sends the received information to the acquisition unit 132, the estimation unit 134, and the recipe creation unit 135. In addition, the reception unit 131 may update the information regarding the cooking recipe stored in the storage unit 120 based on the received information.

(About the acquisition unit 132)
The acquisition unit 132 acquires various kinds of information. For example, the acquisition unit 132 acquires information on the cooking recipe provided to the user 200.

For example, the acquisition unit 132 acquires a cooking recipe for each dish when the user 200 requests information provision regarding a plurality of dishes.

In addition, the acquisition unit 132 acquires not only the information on the cooking recipe but also information on various services. For example, the acquisition unit 132 acquires music information, weather information, etc. from the server device 50 via the communication network N.

In addition, the acquisition unit 132, when the user 200 requests the provision of information regarding cooking, information necessary in advance for providing information, for example, information about a target person to whom the user 200 provides cooking, such as information about a family member. (For example, the number of people, sex, age, preference), scheduled finish time, work environment, and other information are acquired in a conversational format via the sensor unit 111, the voice output unit 112, the reception unit 131, the notification unit 133, etc. Information of various cooking recipes may be acquired via the recipe storage unit 122, the user recipe storage unit 123, or the communication network N. When the corresponding cooking recipe cannot be acquired, the acquisition unit 132 supplies the information acquired in advance to the recipe creation unit 135, and the acquisition unit 132 acquires the new cooking recipe created by the recipe creation unit 135. be able to.

(About notification unit 133)
The notification unit 133 notifies the user 200 of the work item according to the cooking recipe acquired by the acquisition unit 132 or the cooking recipe created by the recipe creating unit 135. The notification of the work item is output as voice by the voice output unit 112.

(Estimation unit 134)
The estimation unit 134 estimates the context related to the surrounding situation of the user 200 based on the response in the spoken language from the user 200, or with reference to the response from the user 200 and the “sound” information detected by the sensor unit 111. The context mentioned here is information indicating the situation around the information providing apparatus 100, and is information indicating the progress of the work of the user 200. That is, the estimation unit 134 estimates the progress status of the work of the user 200 based on the information detected by the sensor unit 111.

The estimation unit 134 estimates the progress status of the work of the user 200 with reference to the information of “sound” detected by the sensor unit 111, and outputs the output signal indicating the estimated result, for example, to the notification unit 133 and the recipe. It is supplied to the creating unit 135. For example, the notification unit 133 notifies the user 200 of the next work item in response to the output signal from the estimation unit 134.

For example, the estimation unit 134 determines that the user 200 has started the work of “heating” based on the “sound” “click” detected by the sensor unit 111 and the “sound” information stored in the estimated information storage unit 124. presume. The estimation unit 134 outputs the estimation result to the notification unit 133 and the recipe creation unit 135.

The recipe creation unit 135 creates a work item and a work order in response to the output signal from the estimation unit 134, and sends a response message such as "let's boil for 5 minutes. A timer has been set." The sound is output from the sound output unit 112 via the notification unit 133 as sound.

(About the recipe creation unit 135)
The recipe creation unit 135 uses the response of the user 200 received by the reception unit 131, the information of the cooking recipe acquired by the acquisition unit 132, the information acquired from the user information storage unit 121, the estimation result estimated by the estimation unit 134, and the like. Based on this, a cooking recipe to be provided to the user 200 is created.

For example, in response to a request from the user 200 who wants to cook a plurality of dishes, the respective cooking recipes stored in the recipe storage unit 122 are integrated to create a new cooking recipe. A specific example will be described later.

The recipe creating unit 135 changes the work item according to the work status of the user 200 and creates a new cooking recipe. For example, as described above, when the user 200 receives the voice language M2 indicating that the work according to the notified work order cannot be executed, based on the voice language M2, that is, the progress of the work. Create a cooking recipe whose work order is changed according to the state.

The recipe creating unit 135 creates a work sequence so that each dish can be provided at an optimum timing. In response to the response from the user 200 that "the scheduled meal time is late.", the recipe creation unit 135 changes the work order so as to delay the completion time, for example. For example, for cooks that require warming because cooking that can be cooked is completed first and warming is important, change the work order so that the work item for warming is aligned with the scheduled meal time. I do.

In addition, when the “scheduled meal time” is delayed, if there is a vacant time, for example, the recipe creation unit 135 interrupts the information provision regarding the cooking recipe, and the server device 50 transmits the information via the communication network N. The work order is changed so as to obtain and provide various contents such as music information and weather information.

In this case, for example, the work order changed by the recipe creation unit 135 is output to the acquisition unit 132, and the content such as music information acquired by the acquisition unit 132 is output from the audio output unit 112. For example, a response message "Play music during free time" is output.

Information on the cooking recipe created by the recipe creating unit 135 is sent to the acquisition unit 132 and the notification unit 133 and stored in the user recipe storage unit 123.

(About the output unit 136)
The output unit 136 outputs the work procedure executed by the user 200 according to the work order of the cooking recipe created by the recipe creating unit 135 as a new cooking recipe. A new cooking recipe output by the output unit 136 may be stored in the user recipe storage unit 123.

By storing the new cooking recipe output by the output unit 136 in the user recipe storage unit 123, the user recipe storage unit 123 can be a customized cooking recipe database. Accordingly, it is possible to provide a learning function in which the cooking recipe is changed according to the skill improvement of the user 200.

[4. Processing of information providing device]
Next, an example of the process executed by the control unit 130 of the information providing apparatus 100 according to the embodiment will be described with reference to FIG. FIG. 4 is a flowchart showing an example of processing executed by the control unit 130 of the information providing apparatus 100 according to the embodiment.

The control unit 130 acquires information about the cooking recipe (step S401). For example, according to the voice language M1 of “Tell me about the work procedure for cooking XX” of the user 200, a cooking recipe for “cooking XX” is sent from the server device 50 via the communication network N or the information providing device. It is acquired from the 100 recipe storage unit 122.

In addition, you may acquire the prior information provided from the user 200 beforehand, such as the number of people who provide a dish, taste, and age.

The control unit 130 starts notification of work items (step S402). The work item to be notified is, for example, a work item according to a cooking recipe acquired by the acquisition unit 132 in response to a request from the user 200, or a work according to a cooking recipe stored in the user recipe storage unit 123 as a user recipe. It is an item.

The timing of notifying the work item is, for example, based on the standard work time of each work item in the work order of the cooking recipe acquired by the acquisition unit 132. It is preferable to notify each work item after receiving a response from the user 200 indicating that the work for the previous work item is completed. For example, after receiving a response from the user 200 that "work item XX has finished", the next work item is notified.

The user 200 notifies the next work item according to the progress status of the work to be sequentially processed, so that the cooking procedure can be provided according to the progress status of the user 200.

When there is a response from the user 200 indicating that the work has been completed for all work items (step S403: Yes), the notification of the work items is ended (step S407).

If there is no response for completion of all work items (step S403: No) and if the user 200 has any accident (step S404: Yes), the work order is changed (step S405). When there is a response that the work item could not be processed within the scheduled time in the initially provided cooking procedure, for example, the work item is notified based on the work order in which the work time is extended (step S406).

When no accident occurs in the user 200 (step S404: No), the user 200 is continuously notified of the work item in the work order.

In this way, the information providing apparatus 100 can provide the user 200 with cooking information according to the progress status of the work of the user 200. Moreover, when the user 200 has some kind of accident, the stress of the user 200 can be reduced by changing the work order according to the situation and providing the information.

[5. Operation example of information providing device]
FIG. 5 shows another specific operation example of the information providing apparatus 100 according to the embodiment. FIG. 5 is an operation explanatory diagram of the information providing apparatus 100 according to the embodiment.

For example, as shown in the upper diagram of FIG. 5, when the user 200 utters the spoken language M1 “Tell me the work procedure for cooking XX.”, the information providing apparatus 100 activates the AI assistant function and “Teach”. Voice recognition of the provision request "". In such a case, the request sentence "Tell me" becomes a request for providing information. The AI may be activated in response to a predetermined activation word.

When the information providing apparatus 100 receives the request for providing cooking information, the information providing apparatus 100 acquires information on the corresponding cooking recipe. The information on the cooking recipe may be information stored in the information providing device 100 itself, or may be obtained from the server device 50 via the communication network N.

The information providing apparatus 100 starts providing information in accordance with the original work order 101 of the acquired cooking recipe. For example, the procedure information corresponding to the work item A is converted into a voice and provided according to the cooking recipe. The information providing apparatus 100, for example, utters a response message AN1 “I understand.

As shown in the lower part of FIG. 5, in the work item A, when there is a response from the user 200 in the voice language M3 such as “a child came to help,” the information providing apparatus 100 initially The work item information is provided in a work order 103 different from the work order.

For example, for work item C, a work procedure for the child 201 who came to help is provided. For example, utter a response message AN3 in an interactive manner, "OK, let's do it. Let's do it. Let your child do ○○". Thereby, for example, the work procedure 103 in which the work item B and the work item C are performed in parallel is provided. By receiving the information on the change in the work environment of the user 200, it is possible to provide the work order according to the change in the work environment.

The work environment is not limited to the increase/decrease in the number of people who perform the work, but includes various elements such as the increase/decrease in the number of cookware that can be used. By appropriately accepting these changes in the work environment as a response from the user 200, it is possible to provide a work order according to the change in the work environment.

(Processing of information providing device)
FIG. 6 is a flowchart showing an example of a process performed by the information providing apparatus 100 when the work order is changed. This flow is executed in addition to the above-described flow of FIG. 4, for example.

The control unit 130 extracts, in the work order executed by the user 200, a work order in which the initially set work order is changed (step S601). The changed work order can be extracted by acquiring the change data of the work order changed by the recipe creation unit 135 and the initially set work order by the acquisition unit 132 and comparing the contents of both.

A new cooking recipe is created based on the change in the extracted work order (step S602). The recipe creation unit 135 creates a new cooking recipe. The new cooking recipe that has been changed and created can be stored in the user recipe storage unit 123. The user recipe storage unit 123 can be used as a database customized according to the user 200.

By preparing in advance a cooking recipe created based on the work sequence changed according to the work progress of the user 200, the information providing apparatus 100 provides appropriate information according to the progress status of the work of the user 200. be able to.

In addition, the cooking recipe changed by the recipe creating unit 135 is a cooking recipe that reflects the work item and the work order executed by the user 200 each time the user 200 cooks, and thus the cooking recipe according to the skill of the user 200 is selected. The information providing apparatus 100 to be provided can be constructed.

Note that the configuration may be such that the acquisition unit 132 preferentially acquires information from the user recipe storage unit 123 when the audio language M1 for providing cooking information from the user 200 is received.

In addition, a new recipe can be created by the recipe creating unit 135 using the information in the user information storage unit 121 and the information in the recipe storage unit 122, and the customized cooking recipe can be stored in the user recipe storage unit 123. ..

(Integrated recipe)
FIG. 7 is a diagram showing an outline of the integrated recipe. FIG. 7 shows an example of an integrated recipe created based on the cooking recipe 1 and the cooking recipe 2. For example, it is provided when the user 200 requests provision of a procedure for a dish (hereinafter referred to as dish 1) prepared based on the cooking recipe 1 and a dish (hereinafter referred to as dish 2) prepared based on the cooking recipe 2 The outline of the integrated recipe is shown below.

In the integrated recipe, when the reception unit 131 receives the provision request from the user 200, the acquisition unit 132 acquires the cooking recipe stored in the recipe storage unit 122 or the food acquired from the server device 50 via the communication network N. The recipe creation unit 135 creates based on the recipe.

For convenience of description, the cooking recipe 1 is the work item A1 corresponding to the work item A, the work item C1 corresponding to the work item C, and the work item corresponding to the work item D among the work items A to D for the material 1. The case where it is included as D1 is shown. The same applies below.

The recipe creating unit 135 creates a temporary recipe shown in the lower part of the table in FIG. 7 as an integrated cooking recipe. Here, the term “provisional” is taken into consideration that the work order may be changed depending on the progress status of the work of the user 200, as described above.

The recipe creating unit 135 creates the temporary recipe so that the common work items in the cooking recipe 1 and the cooking recipe 2 are continuous.

That is, for the common work item A, the temporary recipe is created so that the work items A1 to A4 are continuous for the materials 1 to 4. For example, when the work item A is "wash", the frequency of getting the hand wet can be reduced thereafter by continuously performing the "wash" work on the materials 1 to 4.

The work order of work item A is not limited to the work order of work items A1 to A4, and can be changed according to the type, size, etc. of the material such as material 4 to material 1.

The work efficiency of the user 200 can be improved by creating a temporary recipe so that common work items in a plurality of dishes are continuous.

A plurality of dishes are integrated to create a cooking recipe, and the work procedure is provided to the user 200. The user 200 can prepare a plurality of dishes in parallel by cooking according to the work procedure.

Further, for example, by setting a cooking recipe in which the last work item D is prepared for the dishes 1 and 2 at the final timing, the timings at which the dishes 1 and 2 are completed can be aligned.

(Processing example 3 of the information providing device)
FIG. 8 shows another example of a specific operation of the information providing apparatus 100 according to the embodiment. FIG. 8 is an operation explanatory diagram of the information providing apparatus 100 according to the embodiment.

For example, as shown in the upper diagram of FIG. 8, when the user 200 speaks the spoken language M1 “Tell me about the work procedure for cooking XX.”, the information providing apparatus 100 activates the AI assistant function and “Teach”. Voice recognition of the provision request "". In such a case, the spoken language "tell me" is a request for providing information. The AI may be activated in response to a predetermined activation word.

When the information providing apparatus 100 receives the request for providing cooking information, the information providing apparatus 100 acquires information on the corresponding cooking recipe. The information on the cooking recipe may be information stored in the information providing device 100 itself, or may be obtained from the server device 50 via the communication network N.

The information providing apparatus 100 starts providing information in accordance with the original work order 101 of the acquired cooking recipe. For example, the procedure information corresponding to the work item A is converted into a voice and provided according to the cooking recipe. The information providing apparatus 100, for example, utters a response message AN1 “I understand.

As shown in the lower part of FIG. 8, in the work item B, when the user 200 responds with the spoken language M4 of “I don't know how to use XX.”, the information providing apparatus 100 determines the initial work order. The work items having different contents from 101 are provided.

For example, for the work item in the provided work item B, for example, for the voice language of the user 200 “I don't know how to chop”, the work item Z information about “chopped” is provided.

After accepting a response from the user 200 indicating that the “chopped up” work has been completed, the user returns to the work item B and provides the work procedure 104 information. Thereby, information can be provided according to the progress of the user 200. Regarding the work item Z, image information may be provided to the mobile terminal 10 of the user 200, for example.

[6. Modification example)
The information providing device according to the above-described embodiment may be implemented in various different forms other than the above-described embodiment. In the above-described embodiment, the case where the information providing device is the smart speaker has been described as an example, but the information providing device according to the embodiment is not limited to the smart speaker.

The information providing apparatus according to the embodiment may be a terminal device such as a smartphone, a tablet type terminal, a PDA (Personal Digital Assistant), or the like, as long as the information providing apparatus has the same functions as the components shown in FIG.

Further, in the above-described embodiment, the case has been described in which the information providing apparatus 100 receives a request for providing information from a user in a voice language, but this is an example. The information providing apparatus 100 according to the embodiment may be configured to accept an information providing request by operating a keyboard, a mouse, or a touch panel as long as the information can be output by the voice output unit 112. Alternatively, the image may be received. As a result, the information providing apparatus 100 can provide information even to a user who has difficulty speaking.

[7. effect〕
As described above, the information providing apparatus 100 according to the embodiment includes an acquisition unit 132 that acquires a cooking recipe, a notification unit 133 that notifies the user of work items in accordance with the work order of the cooking recipe acquired by the acquisition unit 132, It has a reception unit 131 that receives a response from the user to the notification of the work item, and a recipe creation unit 135 that creates a provisional recipe in which the work order of the cooking recipe is changed according to the response from the user. When the work order of the cooking recipe is changed by the recipe creating unit, the notification unit 133 notifies the user 200 of the work item based on the changed work order.

As described above, the information providing apparatus 100 according to the embodiment is configured to notify the user of the work item in accordance with the work order changed according to the response of the user, so that the work progress status of the user 200 can be met. Information can be provided.

The information providing apparatus 100 also includes a sensor unit 111, and the recipe creation unit 135 changes the work order based on the context estimated from the sensor information detected by the sensor unit 111.

As described above, the information providing apparatus 100 according to the embodiment can more appropriately grasp the progress status of the work of the user by referring to the sensor information detected by the sensor unit 111 together with the response of the user 200. Therefore, it is possible to provide appropriate information according to the progress status of the work of the user 200.

In addition, the recipe creating unit 135 changes the work order based on the information on the cooking skill of the user 200.

As described above, the information providing apparatus 100 according to the embodiment can provide appropriate information according to the skill of the user 200 by changing the work procedure according to the cooking skill of the user 200.

Further, the recipe creating unit 135 changes the work order based on the information on the work environment of the user 200.

As described above, the information providing apparatus 100 according to the embodiment can provide appropriate information according to the work environment of the user 200 by changing the work procedure according to the information of the work environment of the user 200.

In addition, when the receiving unit 131 receives a response indicating that a plurality of cooking recipes are selected from the user 200, the recipe creating unit 135 creates a temporary recipe so that common work items in the plurality of cooking recipes are continuous. To do.

As described above, the information providing apparatus 100 according to the embodiment can improve the work efficiency of the user 200 by creating the temporary recipe so that the common work items in a plurality of dishes are continuous.

The information providing apparatus 100 also includes a voice output unit 112, and the notification unit 133 causes the voice output unit 112 to voice output the work item.

In this way, the information providing apparatus 100 according to the embodiment provides work items by voice, so that the user 200 can prepare a dish according to the work order information by voice from the information providing apparatus 100 without interrupting the work. You can proceed with the work.

Further, the reception unit 131 receives a response in the spoken language of the user 200.

As described above, since the information providing apparatus 100 according to the embodiment receives the response of the user 200 in the spoken language, the user 200 can easily request the information providing apparatus 100 to provide information.

Further, when the reception unit 131 receives a response indicating the end of the work item from the user 200, the notification unit 133 notifies the next work item.

As described above, the information providing apparatus 100 according to the embodiment notifies the next work item in response to the response indicating the end of the work item from the user 200, thereby providing information according to the progress status of the work of the user 200. It can be carried out.

The information providing apparatus 100 also includes an output unit 136 that outputs the work order executed by the user 200 according to the provisional recipe created by the recipe creating unit 135 as a new cooking recipe.

As described above, the information providing apparatus 100 according to the embodiment includes the output unit 136 that outputs the work order actually executed by the user 200, so that the cooking recipe according to the work order is used as the customized cooking recipe for the user 200. It can be used in subsequent dishes.

Further, the acquisition unit 132 acquires various contents, and the recipe creation unit 135 changes the work order including provision of various contents according to the response from the user 200.

As described above, the information providing apparatus 100 according to the embodiment provides various contents in response to the response from the user 200, so that, for example, the idle time is effectively used according to the progress status of the work of the user 200. Various information can be provided.

Moreover, the acquisition part 132 acquires the information of the target person who the user 200 provides a dish, and the recipe preparation part 135 changes a work order based on the information of the target person.

As described above, the information providing apparatus 100 according to the embodiment changes the work procedure based on the information of the target person to whom the user 200 provides food. As a result, information can be provided according to the taste of the target person.

In addition, the information providing apparatus 100 is configured to include the estimated information storage unit 124 that stores the related information for estimating the context of the work environment of the user 200, thereby more appropriately estimating the work progress status of the user 200. Therefore, it is possible to provide information according to the progress of the user 200.

[8. Hardware configuration]
Further, the information providing apparatus 100 according to the above-described embodiment is realized by, for example, a computer 1000 configured as shown in FIG. FIG. 9 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information providing apparatus 100 according to the embodiment. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, an HDD 1400, a communication interface (I/F) 1500, an input/output interface (I/F) 1600, and a media interface (I/F) 1700.

The CPU 1100 operates based on a program stored in the ROM 1300 or the HDD 1400, and controls each part. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 starts up, a program dependent on the hardware of the computer 1000, and the like.

The HDD 1400 stores programs executed by the CPU 1100, data used by the programs, and the like. The communication interface 1500 receives data from another device via the communication network N such as the Internet, sends the data to the CPU 1100, and transmits the data generated by the CPU 1100 to the other device via the communication network N.

The CPU 1100 controls an audio output unit 112 (see FIG. 3), an output device such as a display and a printer, a sensor unit 111 (see FIG. 3), an input device such as a keyboard and a mouse via the input/output interface 1600. The CPU 1100 acquires data from the input device via the input/output interface 1600. Further, the CPU 1100 outputs the generated data to the output device via the input/output interface 1600.

The media interface 1700 reads a program or data stored in the recording medium 1800 and provides the program or data to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700, and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) and a PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. Etc.

For example, when the computer 1000 functions as the information providing apparatus 100 according to the embodiment, the CPU 1100 of the computer 1000 realizes the function of the control unit 130 by executing the program loaded on the RAM 1200. The CPU 1100 of the computer 1000 reads these programs from the recording medium 1800 and executes them, but as another example, these programs may be acquired from another device via the communication network N.

As described above, some of the embodiments of the present application have been described in detail based on the drawings, but these are examples, and various modifications based on the knowledge of those skilled in the art, including the modes described in the section of the disclosure of the invention, It is possible to implement the present invention in other forms with improvements.

[9. Other]
Further, of the processes described in the above-described embodiment and modification, all or part of the processes described as being automatically performed may be manually performed, or described as being manually performed. It is also possible to automatically carry out all or part of the above processing by a known method.

In addition, the processing procedures, specific names, and information including various data and parameters shown in the above-mentioned documents and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.

Further, each component of each device shown in the drawings is functionally conceptual and does not necessarily have to be physically configured as shown. That is, the specific form of distribution/integration of each device is not limited to that shown in the figure, and all or part of the device may be functionally or physically distributed/arranged in arbitrary units according to various loads and usage conditions. It can be integrated and configured.

For example, the reception unit 131 and the acquisition unit 132 may be connected as an external device of the information providing apparatus 100 via a network. Alternatively, the reception unit 131 and the acquisition unit 132 may be included in different devices, respectively, and the functions of the information providing device 100 may be realized by network connection and cooperation.

That is, the information providing apparatus 100 may be realized by a plurality of server computers, and depending on the function, it may be realized by calling an external platform or the like with an API (Application Programming Interface) or network computing. Can be changed to

Further, the above-described embodiments and modified examples can be appropriately combined within a range in which the processing content is not inconsistent. Further, the "section (module, unit)" described above can be read as "means" or "circuit". For example, the reception unit 131 can be read as a reception unit or a reception circuit.

1 Information Providing System 10 Mobile Terminal 50 Server Device 100 Information Providing Device 130 Control Unit 131 Receiving Unit 132 Acquisition Unit 133 Notification Unit 134 Estimating Unit 135 Recipe Creating Unit 136 Output Unit 120 Storage Unit 121 User Information Storage Unit 122 Recipe Storage Unit 123 User Recipe storage unit 124 Estimated information storage unit

Claims (13)

An acquisition unit that acquires a cooking recipe,
A storage unit for storing the cooking recipe,
A notification unit that is acquired by the acquisition unit and that notifies the user of work items in accordance with the work order of the cooking recipe stored in the storage unit;
A reception unit that receives a response from the user to the notification of the work item,
When the response from the user is a request involving a change in the work order and work items of the cooking recipe, a recipe for creating a temporary recipe in which the work order and work items of the cooking recipe stored in the storage unit are changed The creation department,
Equipped with
The acquisition unit is
When the response from the user is a request for information regarding a specific work item among the work items notified by the notification unit, information corresponding to the request is acquired,
The recipe creation unit,
Changing the work order of the temporary recipe to a work order including the provision of the information according to the response from the user,
The notification unit,
In accordance with the response from the user, the information is notified to the user, and in response to the response from the user indicating the end of the specific work item for which the information is notified, a work sequence including provision of the information is provided. An information providing apparatus characterized in that a work item next to the specific work item is notified according to the changed work order of the temporary recipe . Equipped with a sensor,
The recipe creation unit,
The information providing apparatus according to claim 1, wherein the work order is changed based on a context estimated by the sensor information detected by the sensor unit. The recipe creation unit,
The information providing apparatus according to claim 1, wherein the work order is changed based on information on the cooking skill of the user. The recipe creation unit,
The information providing apparatus according to claim 1, wherein the work order is changed based on information on a work environment of the user. The recipe creation unit,
When the reception unit receives the response indicating that the plurality of cooking recipes are selected from the user, the provisional recipe is created so that the work items common to the plurality of cooking recipes are continuous. The information providing apparatus according to any one of claims 1 to 4, characterized in that: Equipped with a voice output unit,
The notification unit,
The information providing device according to any one of claims 1 to 5, wherein the work item is output by voice to the voice output unit. The reception unit,
The information providing apparatus according to claim 1, wherein a response in the voice language of the user is accepted. The output part which outputs the said work order which the said user performed according to the said temporary recipe which the said recipe preparation part produced as the said new cooking recipe is provided, Any one of Claims 1-7 characterized by the above-mentioned. Information providing device. The recipe creation unit,
The information providing apparatus according to claim 1, wherein the skill of the user is estimated from the work time performed by the user, and the temporary recipe is created based on the estimated skill. .. The acquisition unit is
Get the content,
The recipe creation unit,
The information providing apparatus according to any one of claims 1 to 9, wherein the work order is changed to include the provision of the content according to the response from the user. The acquisition unit is
The user obtains information on the target person who provides food,
The recipe creation unit,
The information providing apparatus according to claim 1, wherein the work order is changed based on the information of the target person. A method for providing information performed by a computer,
An acquisition process for acquiring a cooking recipe,
A notification step of notifying the user of a work item in accordance with the work order of the cooking recipe stored in the storage unit that stores the cooking recipe in the acquisition step;
An acceptance step of accepting a response from the user to the notification of the work item,
When the response from the user is a request involving a change in the work order and work items of the cooking recipe, a recipe for creating a temporary recipe in which the work order and work items of the cooking recipe stored in the storage unit are changed The creation process,
Including
The acquisition step is
When the response from the user is a request for information regarding a specific work item of the work items notified in the notification step, information corresponding to the request is acquired,
The recipe creation process is
Changing the work order of the provisional recipe to a work order including provision of the information according to the response from the user,
The notification step is
In response to the response from the user, the information is notified to the user, and in response to the response from the user indicating the end of the specific work item for which the information is notified, in a work order including provision of the information. An information providing method comprising: notifying a work item next to the specific work item according to the changed work order of the temporary recipe . The acquisition procedure to acquire the cooking recipe,
A notification procedure that notifies the user of work items in accordance with the work order of the cooking recipe stored in the storage unit that stores the cooking recipe, which is acquired by the acquisition procedure,
An acceptance procedure for accepting a response from the user to the notification of the work item,
When the response from the user is a request involving a change in the work order and work items of the cooking recipe, a provisional recipe in which the work order and work items of the cooking recipe stored in the storage unit are changed is created. Recipe creation procedure,
To the computer,
The acquisition procedure is
When the response from the user is a request for information regarding a specific work item of the work items notified in the notification procedure, information corresponding to the request is acquired,
The recipe creation procedure is
Changing the work order of the temporary recipe to a work order including the provision of the information according to the response from the user,
The notification procedure is
In accordance with the response from the user, the information is notified to the user, and in response to the response from the user indicating the end of the specific work item for which the information is notified, a work sequence including provision of the information is provided. An information providing program, which notifies a work item next to the specific work item in accordance with the changed work order of the temporary recipe .

Images