WO2019171618A1

WO2019171618A1 - Cooking information system and server

Info

Publication number: WO2019171618A1
Application number: PCT/JP2018/030663
Authority: WO
Inventors: 夏季福士; 麻里吉田; 貞彦樋上; 弓子西面; 陽祐伊賀; 智晃西村
Original assignee: シャープ株式会社
Priority date: 2018-03-09
Filing date: 2018-08-20
Publication date: 2019-09-12
Also published as: JPWO2019171618A1; TW201939416A

Abstract

Provided is a cooking information system (1) provided with a communication terminal (300) for acquiring a speech, and a server (100) for creating a first recipe on the basis of the speech acquired by the communication terminal (300). The server (100) inquires of a user about information required to create the first recipe via the communication terminal (300).

Description

Cooking information system and server

The present invention relates to a technique for creating a recipe using a cooking device or a technique for using a recipe.

Conventionally, techniques relating to the use of recipes for cooking equipment such as microwave ovens are known. For example, Japanese Patent Laying-Open No. 2006-329455 (Patent Document 1) discloses a recipe creation kitchen system and a cooking appliance. According to Patent Literature 1, each cooking appliance is configured to be able to transmit a cooking control signal to a home terminal. The home terminal includes a control circuit that creates recipe data by associating cooking control information with a recipe procedure together with elapsed time. When the cooking operator operates each cooking device, cooking control information given to each cooking device by the operation is transmitted to the home terminal. The control circuit of the home terminal associates the received cooking control information with the procedure of the recipe together with the elapsed time, and the recipe data to which the operation content performed on each cooking appliance and the timing when the operation is performed are added. Is automatically created.

Japanese Patent Laid-Open No. 2003-120938 (Patent Document 2) discloses a cooking device and a cooking device program. According to Patent Document 2, for example, in the standard data of the cooking recipe of “meat potato”, when the total amount is instructed to be changed from 4 people to 1 person, the control device displays other data such as the amount of each material and cooking time. , Calculate and change based on the conversion coefficient suitable for each, and display on the display. In addition, for example, when the potato has only 200 g, if the potato amount is instructed to be changed from the standard amount of 600 g to 200 g, the control device gives other data such as the total amount and the amount of other materials to each. Calculate and change based on the appropriate conversion factor and display.

Japanese Patent Laid-Open No. 2007-128305 (Patent Document 3) discloses a cooking support apparatus. According to Patent Document 3, the skill information of a cook, the type and number of cooking utensils are input, and the stored recipe information is combined with the work schedule, work procedure, work procedure image or video according to the cook's skill. The scheduled end time of cooking is displayed on the display unit.

JP 2006-329455 A Japanese Patent Laid-Open No. 2003-120938 JP 2007-128305 A

There is a need for a system that can create recipes more easily than before, or a system that can use recipes more efficiently than before. Accordingly, an object of the present invention is to provide a system that can create a recipe more easily than in the past or a system that can use a recipe more efficiently than in the past.

According to a certain aspect of this invention, a cooking information system provided with the communication terminal which acquires an audio | voice, and the server which produces a 1st recipe based on the audio | voice acquired by the communication terminal is provided. The server inquires the user about information necessary for creating the first recipe via the communication terminal.

As described above, according to the present invention, a system capable of creating a recipe more easily than in the past or a system capable of using a recipe more efficiently than in the past is provided.

It is an image figure which shows the whole structure and operation | movement outline | summary of the cooking information system 1 concerning 1st Embodiment. It is an image figure which shows the use case of the cooking information system 1 concerning 1st Embodiment. It is a block diagram showing the structure of the server 100 concerning 1st Embodiment. It is a block diagram showing the structure of the user data 123 concerning 1st Embodiment. It is a flowchart which shows the recipe creation process of the server 100 concerning 1st Embodiment. It is a sequence diagram which shows the 1st recipe creation process concerning 1st Embodiment. It is a sequence diagram which shows the 2nd recipe creation process concerning 1st Embodiment. It is a sequence diagram which shows the 3rd recipe creation process concerning 1st Embodiment. It is a sequence diagram which shows the 4th recipe creation process concerning 1st Embodiment. It is a flowchart which shows the recipe utilization process of the server 100 concerning 1st Embodiment. It is an image figure which shows the recipe conversion process of the server 100 concerning 1st Embodiment. It is an image figure which shows the 1st recipe conversion process concerning 1st Embodiment. It is an image figure which shows the 2nd recipe conversion process concerning 1st Embodiment. It is a block diagram showing the structure of the cooking appliance 200 concerning 1st Embodiment. It is a block diagram showing the structure of the communication terminal 300 concerning 1st Embodiment. It is an image figure which shows the recipe conversion process concerning 2nd Embodiment. It is an image figure which shows the recipe conversion process concerning 3rd Embodiment. It is an image figure which shows the recipe conversion process concerning 4th Embodiment. It is an image figure which shows the recipe creation process concerning 5th Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.
<First Embodiment>
<Overall configuration of cooking information system 1>

First, the overall configuration of the cooking information system 1 according to the present embodiment will be described with reference to FIG. The cooking information system 1 according to the present embodiment mainly communicates with the server 100, cooking equipment such as microwave ovens 200 </ b> A and 200 </ b> B that can communicate with the server 100 via the Internet, a carrier network, a router, and the like. And communication terminals such as a speaker 300A and a robot 300B.

The cooking device is not limited to the

microwave ovens

200A and 200B, but may be other devices such as an automatic cooking pan, a rice cooker, or an IH cooking heater. The microwave oven 200A may be a cooking utensil that does not use electricity, such as a frying pan or a normal cooking pan. Hereinafter, these are also collectively referred to as a cooking device 200. The communication terminal is not limited to the speaker 300A or the robot 300B, but may be another device such as a smartphone, a tablet, a personal computer, or a game device. Hereinafter, these are also collectively referred to as a communication terminal 300.
<Operation outline of cooking information system 1>

Next, an outline of the operation of the cooking support service realized by the cooking information system 1 according to the present embodiment will be described with reference to FIG. For example, the user A cooks using the microwave oven 200A. At this time, the user A inputs sound for explaining the cooking method to the speaker 300A (step S100). The speaker 300A uploads the input voice to the server 100 (step S102). For example, while cooking, the user A uploads the cooking method to the server 100 by inputting a message such as “First, 3 cups are heated in a pan. During that time, a carrot is cut into strips” to the speaker 300A. .

The server 100 converts the sound received from the speaker 300A into text data or converts it into a recipe format (step S104).

Particularly in the present embodiment, the server 100 has registered in advance the types of information necessary as recipes. Then, the server 100 checks the information necessary for creating the recipe at the present time, a standard moisture amount, the amount and type of seasoning, and a method for selecting the material. An inquiry is made to 300A (step S106). The speaker 300A requests the user for necessary data by voice.

When the user speaks necessary information to the speaker 300A, the speaker 300A transmits the information to the server 100 (step S108). The server 100 converts the sound received from the speaker 300A into text data or converts it into a recipe format (step S110). When all the information related to cooking is uploaded, the server 100 stores the information accumulated regarding the current cooking of the user A as a neutral recipe in the database (step S112). Note that the recipe of the user A may be disclosed, or may be disclosed only to a specific authorized user such as a family.

Next, user B cooks using the recipe created by user A using microwave oven 200B. For example, a user B who is a daughter uses a recipe of the user A who is a mother, a user B of a friend uses a recipe of the user A, or a user B uses a recipe of the user A based on a word of mouth. Can do.

User B inquires of the server 100 about a desired recipe via the microwave oven 200B or its own communication terminal 300 (step S122). In the present embodiment, the microwave oven 200B provides the server 100 with the model and model number of the microwave oven 200B together with the user B ID and password.

The server 100 converts the neutral recipe of the user A into a customized recipe adapted to the model based on the model of the cooking device 200 used by the user B (step S124). For example, the server 100 converts a neutral recipe into a customized recipe that uses less water for an automatic cooking pan, or converts a neutral recipe into a customized recipe that reduces cooking time for a pressure cooker. To do.

The microwave oven 200B downloads the converted customized recipe from the server 100 (step S126). The microwave oven 200B automatically cooks according to the downloaded customized recipe, or explains the customized recipe to the user by voice or video (step S128).

As described above, the cooking information system 1 according to the present embodiment registers the user A's original cooking method as a neutral recipe in the cooking support service as shown in FIG. Since the recipe can be converted into a customized recipe suitable for the device 200, the recipe can be used more efficiently than a normal cooking support service. Hereinafter, the specific structure of the cooking information system 1 for implement | achieving such a function is explained in full detail.
<Configuration of Server 100>

First, an aspect of the configuration of the server 100 configuring the cooking information system 1 according to the present embodiment will be described. Referring to FIG. 3, server 100 includes a central processing unit (CPU) 110, a memory 120, a display 130, an operation unit 140, and a communication interface 160 as main components.

CPU 110 controls each unit of server 100 by executing a program stored in memory 120. For example, the CPU 110 executes programs stored in the memory 120 and executes various processes described later by referring to various data.

The memory 120 is realized by various types of RAM (Random Access Memory), various types of ROM (Read-Only Memory), etc., and may be included in the server 100 or detachable from various interfaces of the server 100. Or a recording medium of another device accessible from the server 100. The memory 120 stores a program executed by the CPU 110, data generated by the execution of the program by the CPU 110, input data, and other databases used for the cooking support service according to the present embodiment.

For example, the memory 120 stores data such as a plurality of neutral recipes 121 registered by a plurality of users and a customized recipe 122 obtained by converting the neutral recipe 121 according to the model. In addition, the memory 120 also stores user data 123 as shown in FIG.

The display 130 displays text and images based on signals from the CPU 110. The operation unit 140 receives a command from a service manager and the like and inputs the command to the CPU 110.

The communication interface 160 transmits data from the CPU 110 to other devices such as the cooking device 200 and the communication terminal 300 via the Internet, a carrier network, a router, or the like. Conversely, the communication interface 160 receives data from other devices such as the cooking device 200 and the communication terminal 300 via the Internet, a carrier network, a router, etc., and passes them to the CPU 110.

Next, a neutral recipe creation process (corresponding to steps S102 to S112 in FIG. 1) by the server 100 according to the present embodiment will be described. Referring to FIG. 5, CPU 110 of server 100 receives a user ID and a password from communication terminal 300 via communication interface 160 and starts creating a recipe (step S <b> 132). CPU110 receives the audio | voice data for demonstrating the cooking method from the communication terminal 300 (step S134).

CPU 110 converts the voice data into text data suitable for the recipe (step S136). CPU110 judges whether the information required for preparation of a recipe is input for every step of cooking (step S138). For example, it is determined whether or not the heating intensity, the heating time, the amount of seasoning, the cutting method, and the like have been provided by the user. When the information is insufficient, the CPU 110 requests the information from the communication terminal 300 via the communication interface 160, thereby acquiring information necessary for each step of the recipe (step S140).

If the information is sufficient (YES in step S138), or if necessary information is supplemented, the CPU 110 accumulates the provided recipe information in the memory 120 (step S142). CPU110 judges whether cooking was completed based on a user's voice etc. (Step S144). If cooking has not been completed (NO in step S144), CPU 110 repeats the processing from step S134. When cooking is completed (YES in step S144), CPU 110 registers the previous recipe as neutral recipe 121 in memory 120.

More specifically, the CPU 110 uses the communication interface 160, for example, as shown in FIGS. 6 to 9, to confirm the user's utterance content or confirm the setup based on the voice input to the user. While creating, create a neutral recipe.

Next, a customization recipe providing process (corresponding to steps S122 to S128 in FIG. 1) by the server 100 according to the present embodiment will be described. Referring to FIG. 10, CPU 110 of server 100 receives a user ID, a password, and the like from cooking appliance 200 or communication terminal 300 via communication interface 160 and starts recipe conversion (step S152). CPU110 receives the selection command of the recipe which a user desires from the cooking appliance 200 or the communication terminal 300 via the communication interface 160 (step S154).

CPU110 acquires the model, model number, etc. of cooking appliance 200 via communication interface 160 (step S156). CPU 110 reads out the selected neutral recipe from memory 120 (step S158). As shown in FIG. 11, the CPU 110 converts the neutral recipe into a customized recipe suitable for the cooking device 200 based on the model and model number of the cooking device 200 (step S160).

Specifically, when the cooking device 200 is an automatic cooking pan, as shown in FIG. 12, the CPU 110, based on the selected neutral recipe, out of a plurality of heating patterns for the cooking of the automatic cooking pan. Choose the one with the closest CPU110 corrects the selected heating pattern based on the said neutral recipe. It is preferable that the CPU 110 corrects the sequence according to the material included in the neutral recipe.

Or when cooking appliance 200 is a microwave oven for automatic cooking, as shown in Drawing 13, CPU110 is based on a selected neutral recipe from a plurality of basic heating patterns of a microwave oven for automatic cooking. Select one pattern. The CPU 110 adjusts the amount of steam of the selected heating pattern or adjusts the heating time according to the material included in the neutral recipe.

Returning to FIG. 10, the CPU 110 transmits the customized recipe to the cooking appliance 200 and the communication terminal 300 via the communication interface 160 (step S <b> 162). Accordingly, the cooking device 200 can execute the cooking process according to the customized recipe, or the user can perform cooking while watching the video of the customized recipe or listening to the sound using the communication terminal 300.
<Configuration of cooking appliance 200>

Next, with reference to FIG. 14, one aspect of the hardware configuration of the cooking appliance 200 that constitutes the cooking information system 1 will be described. The cooking device 200 includes a CPU 210, a memory 220, a display 230, an operation unit 240, a communication interface 260, a speaker 270, a microphone 280, and a device driving unit 290 as main components.

The CPU 210 controls each part of the cooking appliance 200 by executing a program stored in the memory 220 or an external storage medium.

The memory 220 is realized by various RAMs, various ROMs, and the like. The memory 220 stores cooking programs or other programs executed by the CPU 210, data generated by execution of the programs by the CPU 210, data received from the server 100, data input via the operation unit 240, and the like.

Display 230 outputs characters, images, etc. based on signals from CPU 110. The operation unit 240 is realized by a button, a touch panel, and the like, receives a command from the user, and inputs the command to the CPU 210. In addition, you may comprise as the touchscreen 250 containing the display 230 and the operation part 240. FIG.

The communication interface 260 is realized by a communication module such as wireless LAN communication or wired LAN. The communication interface 260 exchanges data with other devices by wired communication or wireless communication. That is, the CPU 210 receives various types of information from other devices such as the server 100 and the communication terminal 300 via the communication interface 260, and transmits various types of information to other devices such as the server 100 and the communication terminal 300. Or In addition, the cooking appliance 200 may communicate using a retrofit communication adapter.

Speaker 270 outputs sound based on a signal from CPU 210. The microphone 280 creates a sound signal from the sound and inputs it to the CPU 210.

The device drive unit 290 controls each unit (motor, heating coil, light, etc.) of the electric device based on a signal from the CPU 210.
<Configuration of communication terminal 300>

Next, with reference to FIG. 15, one aspect of the configuration of the communication terminal 300 configuring the cooking information system 1 will be described. The communication terminal 300 according to the present embodiment includes a CPU 310, a memory 320, a communication interface 360, a speaker 370, and a microphone 380 as main components. Note that the communication terminal 300 may include a display 330, an operation unit 340, various sensors 390 such as a camera, and the like.

CPU 310 controls each unit of communication terminal 300 by executing a program stored in memory 320.

The memory 320 is realized by various RAMs, various ROMs, and the like. The memory 320 is a program executed by the CPU 310 such as a cooking support application, data generated by execution of the program by the CPU 310, data received from the server 100 or the cooking appliance 200, data input via the operation unit 340, Information for specifying the user of the communication terminal 300 is stored.

Display 330 displays images and text based on data from CPU 310. The operation unit 340 includes a pointing device, a switch, and the like, and inputs various commands from the user to the CPU 310. Note that the user terminal may include a touch panel 350 including the display 330 and the operation unit 340.

The communication interface 360 transmits / receives data to / from other devices such as the server 100 via the Internet, a carrier network, a router, or the like. For example, the CPU 310 receives user voice via the microphone 380 or acquires image data via the camera 390 and transmits the user voice and image data to the server 100 via the communication interface 360. Conversely, the CPU 110 receives audio data, image data, and the like from the server 100 via the communication interface 360, and outputs audio from the speaker 370 and outputs video from the display 330.
<Second Embodiment>

In the first embodiment, the server 100 converts the neutral recipe into a customized recipe corresponding to the type of the cooking device 200. In the present embodiment, the server 100 further converts the neutral recipe into a customized recipe according to the number of people, gender, and age.

More specifically, in step S160 of FIG. 10, as shown in FIG. 16, the CPU 110 determines not only the model and model number of the cooking device 200, but also the number, sex, age, etc. Convert neutral recipes to customized recipes. For example, the CPU 110 calculates an approximate total amount from the family structure. Also, the total amount setting may change depending on the age structure of the family. For example, when there is a high school student who is growing up, the CPU 110 calculates 1.5 adults for the high school student. The CPU 110 also changes the amount depending on whether there is a multiple meal / small meal or diet. As described above, the server 100 according to the present embodiment calculates the optimum user standard total amount based on the personal information of the user, and changes the standard data of the user standard total amount, so that it is suitable for the user. Designed to provide cooking recipes.

In this case, in step S154, the cooking device 200 or the communication terminal 300 needs to receive the number, sex, and age of the person who plans to eat food from the user and provide the information to the server 100.
<Third Embodiment>

Further, in step S160 of FIG. 10, as shown in FIG. 17, the CPU 110 sets the neutral in accordance with not only the model and model number of the cooking device 200 but also the physical condition of the person who plans to eat food, the state of the stomach, and the like. Recipes may be converted into customized recipes. In this case, in step S154, the cooking device 200 or the communication terminal 300 needs to accept the physical condition of the person who plans to eat food from the user and the empty state of the stomach, and provide the information to the server 100.
<Fourth embodiment>

Furthermore, in step S160 of FIG. 10, as shown in FIG. 18, the CPU 110 responds not only to the model and model number of the cooking device 200, but also to the region and hometown of the person who intends to eat food, my family style, the weather, etc. The neutral recipe may be converted into a customized recipe. In this case, in step S154, the cooking device 200 or the communication terminal 300 receives the area, zip code, address, etc. of the person who plans to eat from the user and provides the information to the server 100, or the server 100 pre- Get the registered user's area, postal code, address, hometown, and so on.
<Fifth embodiment>

In the above embodiment, the server 100 creates a neutral recipe by the speaker 300A uploading the user's voice to the server 100. In the present embodiment, the CPU 100 of the communication terminal 300 uploads not only the user's voice but also an image captured by the camera 390 to the server 100, so that the server 100 creates a neutral recipe.

More specifically, in step S102 or step S108 of FIG. 1, the communication terminal 300 uses the camera 390 to create a recipe, periodically, or when a user who is cooking performs a new work. A surrounding moving image or still image is captured, and the image data is uploaded to the server 100. That is, in step S134 and step S140 in FIG. 5, the CPU 110 of the server 100 creates a neutral recipe by combining the text data converted from the audio data from the communication terminal 300 and the image data from the communication terminal 300.

Thus, in the present embodiment, CPU 110 of server 100 creates a customized recipe including image data, audio data, and text data based on the neutral recipe (step S160 in FIG. 10), and via communication interface 160. The said customization recipe is transmitted to the cooking appliance 200 and the communication terminal 300 (step S162 of FIG. 10). Accordingly, the cooking device 200 and the communication terminal 300 can understand the recipe efficiently or accurately by watching, listening, and reading.

In addition, you may utilize the data acquired not only by the image by a camera but the other sensor for the creation of a neutral recipe. For example, the CPU 310 of the communication terminal 300 uploads the temperature acquired by the temperature sensor 390 to the server 100, so that the server 100 can add the temperature information to the neutral recipe or the customized recipe.

Alternatively, when the CPU 310 of the communication terminal 300 uploads the odor and taste acquired by the odor sensor 390 and the taste sensor 390 to the server 100, the server 100 adds the odor and taste information to the neutral recipe and the customized recipe. it can.
<Sixth Embodiment>

Other devices may execute part or all of the roles of the devices of the cooking information system 1 according to the above-described embodiment. For example, another device may play a part or all of the roles of the server 100, the cooking device 200, and the communication terminal 300, or a part or all of the role of each of these devices may be shared by a plurality of devices. Or you may. Specifically, the recipe is uploaded to the server 100 via the cooking device 200 instead of the communication terminal 300, the communication terminal 300 plays a part of the role of the server 100, or the role of the server 100 is plural in the cloud. May be distributed to the servers.
<Summary>

In the above-described embodiment, there is provided a cooking information system 1 including a communication terminal 300 that acquires voice and a server 100 that creates a first recipe based on the voice acquired by the communication terminal 300. The server 100 inquires of the user about information necessary for creating the first recipe via the communication terminal 300.

Preferably, the cooking information system 1 further includes a cooking device 200. The server 100 creates a second recipe corresponding to the type of the cooking device 200 based on the first recipe.

Preferably, the server 100 creates the second recipe according to the number of people who eat based on the first recipe.

Preferably, the server 100 creates the second recipe according to the physical condition of the person who eats based on the first recipe.

Preferably, the server 100 creates the second recipe according to the region of the person who eats based on the first recipe.

Preferably, the communication terminal 300 acquires an image. The server 100 associates the image from the communication terminal 300 with the first recipe.

In the above embodiment, the communication interface 160 for communicating with the communication terminal 300 and the voice acquired by the communication terminal 300 using the communication interface 160 are acquired, and the first recipe is obtained based on the voice. A server 100 is provided that includes a processor 110 that creates and inquires a user via the communication terminal 300 for information that is missing from information necessary for creating the first recipe using the communication interface 160.

The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1: Cooking information system 100: Server 110: CPU
120: Memory 121: Neutral recipe 122: Customized recipe 123: User data 130: Display 140: Operation unit 160: Communication interface 200: Cooking device 200A: Microwave oven 200B: Microwave oven 210: CPU
220: Memory 230: Display 240: Operation unit 260: Communication interface 270: Speaker 280: Microphone 290: Device drive unit 300: Communication terminal 300A: Speaker 300B: Robot 310: CPU
320: Memory 330: Display 340: Operation unit 350: Touch panel 360: Communication interface 370: Speaker 380: Microphone 390: Camera (sensor)

Claims

A communication terminal that acquires audio;
A server for creating a first recipe based on the voice acquired by the communication terminal,
The said server is a cooking information system which inquires a user about the information required for preparation of a said 1st recipe via the said communication terminal.
Further equipped with cooking equipment,
The cooking information system according to claim 1, wherein the server creates a second recipe corresponding to a type of the cooking appliance based on the first recipe.
3. The cooking information system according to claim 2, wherein the server creates the second recipe according to the number of people eating based on the first recipe.
The cooking information system according to claim 2 or 3, wherein the server creates the second recipe according to a physical condition of a person who eats based on the first recipe.
The cooking information system according to any one of claims 2 to 4, wherein the server creates the second recipe according to a region of a person who eats based on the first recipe.
The communication terminal obtains an image;
The cooking information system according to claim 1, wherein the server associates an image from the communication terminal with the first recipe.
A communication interface for communicating with a communication terminal;
The voice acquired by the communication terminal using the communication interface is acquired, the first recipe is created based on the voice, and the missing information of the information necessary for creating the first recipe is obtained. And a processor that inquires a user via the communication terminal using the communication interface.