JP6395965B1 - Recipe submission support server, recipe submission support method, recipe submission support program, and recipe submission support system - Google Patents

Abstract

[PROBLEMS] To facilitate the creation of a recipe. A recipe posting support server includes a communication unit that communicates with a poster terminal, a storage unit that stores recipe information including a posted recipe received by the communication unit from the poster terminal, and a communication unit that receives the poster terminal from the poster terminal. A recipe posting support server comprising: a dish identification unit that identifies a dish that appears in a cooked image; and a recipe information acquisition unit that acquires recipe information related to the dish identified by the dish identification unit from a storage unit. Transmits the recipe information acquired by the recipe information acquisition unit to the poster terminal, and receives the posted recipe created based on the transmitted recipe information from the poster terminal. [Selection] Figure 1

Description

  The present disclosure relates to a recipe posting support server, a recipe posting support method, a recipe posting support program, and a recipe posting support system.

  In recent years, with the spread of mobile terminals such as smartphones and the improvement of image recognition technology, services have been provided that allow easy acquisition of cooking recipes using the ingredients based on the captured images of the ingredients. For example, Patent Document 1 discloses an automatic recipe creation device that automatically creates a recipe from a food material image.

  On the other hand, an increasing number of people publish their own recipes via a network such as the Internet, along with the cooking images they have taken.

JP 2010-61382 A

  Recipe creators often create recipes by relying on their own memory for cooking procedures and ingredients. Therefore, when trying to create a recipe after cooking, it may be forgotten how it was cooked.

  With the apparatus disclosed in Patent Document 1, a recipe can be created based on an image obtained by photographing food before cooking, but it is difficult to create a recipe from an image obtained by photographing cooked food. Therefore, it is necessary for the recipe creator to remember the cooking procedure, the amount of ingredients, and the like during cooking, and it is not easy to create a recipe casually after cooking.

  Then, this indication aims at providing assistance so that a recipe can be created easily in view of such a situation.

To achieve the above object, a recipe posting support server according to the present disclosure includes a communication unit that communicates with a poster terminal, a storage unit that stores recipe information including a posted recipe received by the communication unit from the poster terminal, and a communication A communication unit including: a dish identification unit that identifies a dish reflected in the dish image received from the poster terminal by the unit; and a recipe information acquisition unit that acquires recipe information related to the dish identified by the dish identification unit from the storage unit. Is configured based on at least one of the cooking procedure, ingredients, and cooking utensils of the recipe information acquired by the recipe information acquisition unit and the cooking image received from the poster terminal, and can be edited by the poster. It sends the template of that post recipes to the post's terminal.

In order to achieve the above object, a recipe posting support method according to the present disclosure includes a step of communicating with a poster terminal, a step of storing recipe information including a posted recipe received from a poster terminal, and a poster terminal A step of identifying the dish shown in the received dish image, a step of acquiring from the recipe information storing the recipe information of the identified dish , at least one information of a cooking procedure, ingredients, and cooking utensils of the acquired recipe information ; It was created on the basis of the dish image received from the post terminal, comprising the steps you send template editable configured post recipe contributor to post terminal, a.

  Moreover, in order to achieve the said objective, the recipe contribution assistance program which concerns on this indication makes a computer perform the above-mentioned recipe contribution assistance method.

Moreover, in order to achieve the said objective, the recipe contribution assistance system which concerns on this indication is a system which assists creation of the contribution recipe transmitted from a contributor terminal via a network, Comprising: Cooking image acquisition which acquires a cooking image A dish identifying unit for identifying a dish shown in the dish image, a storage unit for storing recipe information including a posted recipe, and a recipe information acquiring unit for acquiring recipe information for the dish identified by the dish identifying unit from the storage unit; The recipe information acquisition unit is configured to be editable by the poster created based on at least one of the recipe information cooking procedure, ingredients, cooking utensils and the cooking image received from the poster terminal. comprising a communication unit you send template post recipe contributor terminal.

  According to the present disclosure, a recipe can be easily created.

1 is a configuration diagram of a recipe posting support system 100. FIG. It is a sequence diagram which shows the flow of a process in the recipe contribution assistance system. It is a flowchart which shows the process which identifies a cooking image. It is a figure which shows an example of the recipe information transmitted to the poster terminal 201. FIG. It is a figure which shows an example of the recipe information transmitted to the poster terminal 201. FIG. It is a figure which shows an example of the recipe information transmitted to the poster terminal 201. FIG. 2 is a block diagram illustrating a hardware configuration of a server apparatus 101. FIG.

  Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In all the drawings for explaining the embodiments, common constituent elements are denoted by the same reference numerals, and repeated explanation is omitted. The following embodiments do not unduly limit the contents of the present disclosure described in the claims. In addition, all the components shown in the embodiments are not necessarily essential components of the present disclosure.

  FIG. 1 is a configuration diagram of a recipe posting support system 100. With reference to FIG. 1, the outline | summary and structure of the recipe contribution assistance system 100 are demonstrated.

  The recipe posting support system 100 includes a server device 101, contributor terminals 201-1 to 201-n (n is a natural number greater than 1), and viewer terminals 301-1 to 301-n, and includes a network NW. It is connected so that communication is possible via. The network NW includes a WAN (World Area Network), a LAN (Local Area Network), and the like. In the following description, when there is no need to particularly distinguish individual users, poster terminals 201-1 to 201-n and browser terminals 301-1 to 301-n are referred to as poster terminal 201 and browser terminal 301, respectively. .

(Outline of recipe submission support system 100)
The recipe posting support system 100 is a system that facilitates creation of recipe information that a poster posts to the server apparatus 101 via a network NW. Specifically, when creating the recipe information of the cooked food, the poster transmits a food image obtained by photographing the food to the server apparatus 101. The server device identifies the dish shown in the received dish image, and transmits recipe information related to the identified dish to the poster terminal 201. The contributor can easily create recipe information of a dish cooked by the poster based on the received recipe information.

(Configuration of server apparatus 101)
The server device 101 corresponds to a recipe posting support server, and includes a communication unit 110, a storage unit 120, and a control unit 130.

  The communication unit 110 is a communication interface for communicating with the poster terminal 201 and the browser terminal 301 via the network NW. For example, the communication unit 110 receives recipe information from the poster terminal 201 or distributes recipe information to the viewer terminal 301.

  The storage unit 120 has a recipe database 121 and stores recipe information. The recipe information is, for example, cooking information that is an image of cooking after cooking and a state of cooking, and / or information about cooking including cooking procedures, ingredients, cooking utensils, and the like. In the present embodiment, the “image” includes the concept of a still image and a moving image, and the cooking image is a photograph of a dish (cooking photograph) or a moving picture (cooking animation) of a cooking state.

  The recipe information includes recipe information posted from the poster terminal 201 (hereinafter sometimes referred to as “posted recipe”). The recipe information may include comments and photos added by the poster terminal 201 and the viewer terminal 301, corrected text, and the like, and may be configured to be editable by the poster and the viewer.

  The recipe database 121 is a database that manages recipe information. The recipe information is associated with the name of the dish indicated by the recipe information, the ingredients used, the cooking utensils, the type of dish, and the like, and the recipe information can be searched from the name of the dish.

  The recipe database 121 stores a history of posted recipes posted by the poster in the past. From the history of posted recipes, it is possible to know what kind of recipe information the poster has created in the past, and it is possible to estimate the tendency and preference of the dishes that the poster has cooked.

  The control unit 130 functions as a dish identification unit, and identifies the dish being shot from the dish image received from the poster terminal 201. For example, a dish image is cut out in a predetermined unit area, and a feature amount such as an outline of an object in the unit area is extracted. Using a database (not shown) in which the feature quantity and the dish name are associated in advance, the dish name associated with the extracted feature quantity is searched. Alternatively, a dish template image may be prepared in advance, and the dish name may be searched by comparing the template image and the dish image. The dish identification method is not limited to this, and a known image recognition technique can be applied. In addition, as long as a dish can be identified, such as a dish name and a combination of ingredients, it may be determined in any format.

  In addition, when identifying a dish, the control unit 130 may control the communication unit 110 to estimate a dish name searched as described above as a dish candidate and transmit it to the poster terminal 201. The contributor selects a received food candidate that matches or is close to the food cooked by the poster and transmits it to the server apparatus 101. The control unit 130 may identify the dish shown in the dish image from the estimated dish candidates based on the information transmitted from the poster terminal 201.

  In addition, the control unit 130 functions as a recipe information acquisition unit, and retrieves and acquires recipe information related to the dish identified as described above from the recipe information stored in the recipe database 121. For example, the recipe information associated with the name of the identified dish and the type of the dish is searched.

  Further, the control unit 130 may function as a posted recipe history acquisition unit and acquire from the recipe database 121 the posted recipe history of the poster who has transmitted the dish image. Then, based on the history of the posted recipe, the preference of the dish cooked by the poster and the dish that the poster has not posted yet are extracted. The control unit 130 may acquire recipe information related to the extracted dish out of the recipe information searched as recipe information related to the identified dish.

  Then, the control unit 130 controls the communication unit 110 so as to transmit the acquired recipe information to the poster terminal 201 that has transmitted the dish image. The contributor can create recipe information of a dish cooked by the poster based on the recipe information transmitted from the server apparatus 101.

  Since the recipe information transmitted from the server apparatus 101 is recipe information associated with the dish identified from the dish image transmitted by the poster, the dish cooked by the poster is similar to the cooking procedure, cooking material, ingredients, and the like. There is a high possibility. For this reason, the recipe information of the cooked food can be easily created by adding or correcting the transmitted recipe information as a template of the posted recipe with respect to a portion different from the cooking procedure of the recipe. That is, a contributor can easily create a posted recipe rather than creating all recipe information based on his / her memory.

(Configuration of contributor terminal 201 and browser terminal 301)
The poster terminal 201 and the viewer terminal 301 are terminal devices having a communication function such as a personal computer, a tablet terminal, and a smartphone. In the present embodiment, the poster terminal 201 is used by a poster who posts recipe information, and the browser terminal 301 is used by a viewer who browses information distributed from the server device 101. However, the poster and the viewer may be the same person, and the poster terminal 201 and the browser terminal 301 may be terminals having the same configuration.

  The poster terminal 201 includes a terminal operation unit 210, a terminal communication unit 211, a terminal imaging unit 212, and a terminal control unit 213.

  The terminal operation unit 210 is an input interface for a poster to give an instruction to the poster terminal 201 such as a keyboard, a touch panel, and a microphone for voice input.

  The terminal communication unit 211 is a communication interface for performing communication with the server apparatus 101 via the network NW.

  The terminal imaging unit 212 is a camera or the like that functions as a cooking image acquisition unit, and takes pictures of cooked food and cooking.

  The terminal control unit 213 controls the poster terminal 201 as a whole. For example, the terminal control unit 213 controls the terminal communication unit 211 to transmit the dish image captured by the terminal imaging unit 212 to the server device 101. Further, the terminal communication unit 211 is controlled so that a posting recipe created by the poster via the terminal operation unit 210 is transmitted to the server device 101.

(Processing flow in the recipe submission support system 100)
FIG. 2 is a sequence diagram showing the flow of processing in the recipe posting support system 100. With reference to FIG. 2, the processing of the recipe posting support system 100 will be described.

  In step S <b> 201, the terminal imaging unit 212 of the contributor terminal 201 photographs the cooked food according to an instruction via the contributor's terminal operation unit 210.

  In step S <b> 202, the terminal control unit 213 controls the terminal communication unit 211 to transmit the dish image photographed in step S <b> 201 to the server device 101.

  In step S <b> 203, the control unit 130 of the server apparatus 101 identifies a dish shown in the transmitted dish image. This process will be described in detail with reference to FIG.

  In step S204, the control unit 130 of the server device 101 searches the recipe database 121 for recipe information related to the identified dish.

  In step S205, the control unit 130 of the server apparatus 101 controls the communication unit 110 to transmit the recipe information searched and acquired in step S204 to the poster terminal 201 that transmitted the dish image in step S202.

  In step S <b> 206, the terminal control unit 213 of the contributor terminal 201 displays the received recipe information on a display unit (not shown), and accepts a contributor's input via the terminal operation unit 210. The poster edits the received recipe information and creates a posted recipe. This process will be described in detail with reference to FIGS.

  In step S <b> 207, the terminal control unit 213 of the contributor terminal 201 controls the terminal communication unit 211 to transmit the created posting recipe to the server device 101.

  In step S <b> 208, the control unit 130 of the server apparatus 101 stores the transmitted posted recipe in the recipe database 121.

  In step S <b> 209, the browser terminal 301 makes an acquisition request for arbitrary recipe information to the server apparatus 101.

  In step S210, the control unit 130 of the server apparatus 101 searches the recipe database 121 for the requested recipe information.

  In step S <b> 211, the control unit 130 of the server apparatus 101 controls the communication unit 110 to transmit the retrieved recipe information to the viewer terminal 301 that has made the acquisition request.

  In step S212, the browser terminal 301 displays the received recipe information on a display unit (not shown). Thereby, the browsing person can browse recipe information.

  FIG. 3 is a flowchart showing processing for identifying a dish image. With reference to FIG. 3, the process which the control part 130 of the server apparatus 101 in step S203 of FIG. 2 performs is demonstrated. In addition, the process which identifies the dish image demonstrated below is only an example, and you may identify a dish image with another method.

  In step S <b> 301, the control unit 130 acquires a dish image from the poster terminal 201.

  In step S302, the control unit 130 cuts out the obtained dish image for each unit area.

  In step S <b> 303, the control unit 130 extracts a feature amount such as a contour of an object in the cut unit area. And the dish name linked | related with the extracted feature-value is searched using the database (not shown) with which the feature-value and the dish name were linked | related previously.

  In step S304, the control unit 130 determines a dish name from the search result in step S303, and identifies the dish in the dish image.

  4-6 is a figure which shows an example of the recipe information transmitted to the poster terminal 201. FIG. With reference to FIGS. 4-6, the recipe information transmitted to the poster terminal 201 in step S205 of FIG. 2 and the posted recipe created based on the recipe information in step S206 of FIG. 2 will be described.

  As described in FIG. 2, based on the dish image transmitted from the poster terminal 201, the server apparatus 101 identifies the dish shown in the dish image. Then, the recipe information related to the identified dish is searched using the recipe database 121, and the recipe information obtained as a result of the search is transmitted to the poster terminal 201. Note that there may be a plurality of pieces of recipe information obtained from the search results. In the present embodiment, an example in which three pieces of recipe information are obtained will be described as shown in FIGS.

  FIG. 4 shows a screen 40 displayed on the poster terminal 201. In FIG. 4, a screen 40 is one of the recipe information obtained from the search result, that is, recipe information of “green beans with sesame” presented as the recipe candidate 1, and includes a recipe area A 1 and a comment area A 6. including.

  The recipe area A1 includes a cooking image area A2, an ingredient information area A3, a cooking procedure area A4, and a cooking utensil area A5. Although the dish image transmitted from the poster terminal 201 is displayed in the dish image area A2, an image stored in advance in the recipe database 121 may be displayed.

  In the material information area A3, the cooking procedure area A4, and the cooking utensil area A5, materials, cooking procedures, and cooking utensils that are used in “salling of green beans” are displayed. These can be edited and edited by the contributor. Moreover, you may comprise so that a cooking image can be attached to each cooking procedure.

  In addition, the comment area A6 is configured such that the poster can write cooking points, impressions, and the like. An image may be attached.

  5 and 6 show screens 50 and 60 displayed on the poster terminal 201, respectively, as in FIG. The screen 50 shows the recipe information of “green beans and carrots with sesame seeds” presented as the recipe candidate 2, and the screen 60 shows recipe information of “green beans and tuna with sesame seeds” presented as the recipe candidates 3.

  The contributor selects recipe information describing a recipe close to the dish cooked by the user from the recipe information (recipe candidates) transmitted from the server apparatus 101. With reference to the selected recipe information, it is possible to add or modify a portion different from the dish cooked by itself. In addition, there is no need to further input a portion that is desired to be used as it is. Thereby, recipe information of the cooked food can be easily created.

(Hardware configuration diagram)
FIG. 7 is a block diagram illustrating a hardware configuration of the server apparatus 101. The server apparatus 101 is mounted on a computer 701. The computer 701 includes a CPU 702, a main storage device 703, an auxiliary storage device 704, and an interface 705.

  The operation of each component of the server apparatus 101 is stored in the auxiliary storage device 704 in the form of a program. The CPU 702 reads the program from the auxiliary storage device 704, develops it in the main storage device 703, and executes the above processing according to the program. Further, the CPU 702 secures a storage area in the main storage device 703 according to the program. Specifically, the program is a recipe posting support program for assisting the computer 701 in creating a posted recipe.

  The auxiliary storage device 704 is an example of a tangible medium that is not temporary. Other examples of the tangible medium that is not temporary include a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, and a semiconductor memory connected via the interface 705. When this program is distributed to the computer 701 via a network, the computer 701 that has received the distribution may develop the program in the main storage device 703 and execute the processing.

  The program may be for realizing a part of the functions described above. Further, the program may be a so-called difference file (difference program) that realizes the above-described function in combination with another program already stored in the auxiliary storage device 704. The hardware configuration shown in FIG. 7 may be the same for the poster terminal 201 and the viewer terminal 301. The operation of each component of the poster terminal 201 and the viewer terminal 301 is also realized by a CPU according to a program stored in the auxiliary storage device, as in the server device 101 described above.

(Explanation of effect)
In the recipe posting support system 100 according to the present embodiment, based on the dish image transmitted from the poster terminal 201, the server apparatus 101 transmits recipe information related to the dish image to the poster terminal 201. The poster terminal 201 can create recipe information using the recipe information transmitted from the server device 101 as a template. That is, the contributor can acquire from the server apparatus 101 recipe information that is close to the recipe of the dish that the cooker has cooked, and create recipe information based on the recipe information. This makes it easier to create recipe information than to input all recipe information by yourself.

  Further, the poster does not need to be conscious of creating recipe information before cooking, and can easily create recipe information after cooking.

  Further, since the dish image transmitted from the poster terminal 201 is taken into the recipe information transmitted from the server device 101, the poster does not need to re-shoot the image again for posting the recipe, and the burden is reduced. Is done.

  In addition, when the server apparatus 101 identifies a dish shown in the dish image, the server apparatus 101 presents a dish candidate estimated to the poster. The contributor selects a dish candidate that is close to the cooked dish from the presented dish candidates and transmits the selected dish candidate to the server apparatus 101. The server apparatus 101 identifies a dish based on the poster's information. Accordingly, the dish can be accurately identified, and the poster can receive from the server apparatus 101 recipe information closer to the dish cooked by the poster.

  In addition, the server apparatus 101 extracts a poster's cooking preference from the posted recipe history, and acquires recipe information based on the poster's cooking preference among the recipe information related to the identified dish. , Send to poster terminal. Thereby, the contributor can receive from the server apparatus 101 recipe information that is closer to the dish cooked by the poster.

  In addition, the server apparatus 101 extracts dishes that are not included in the posted recipe history, that is, dishes that have not been posted by the poster, and the poster has not yet posted the recipe information related to the identified dishes. Get recipe information for no dishes. This is because there is a higher possibility of creating recipe information for dishes that have not been posted in the past than dishes that have been posted in the past. Thereby, the contributor can receive recipe information closer to the dish cooked by himself / herself.

  The present embodiment can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the invention described in the claims and equivalents thereof, as long as they are included in the scope and gist of the invention.

DESCRIPTION OF SYMBOLS 100 Recipe support system, 101 Server apparatus, 110 Communication part, 120 Storage part, 121 Recipe database, 130 Control part, 201 Contributor terminal, 210 Terminal operation part, 211 Terminal communication part, 212 Terminal imaging part, 213 Terminal control part , 301 Browser terminal, 701 Computer, 702 CPU, 703 Main storage device, 704 Auxiliary storage device, 705 interface

Claims (10)

A communication unit that communicates with the poster terminal;
A storage unit for storing recipe information including a posted recipe received by the communication unit from the poster terminal;
A dish identifying unit for identifying the dish shown in the dish image received by the communication unit from the poster terminal;
A recipe posting support server comprising: a recipe information acquisition unit that acquires recipe information related to the dish identified by the dish identification unit from the storage unit;
The communicator is created based on the cooking information of the recipe information acquired by the recipe information acquisition unit , at least one of the ingredients, the cooking utensils, and the cooking image received from the poster terminal. chicks type of editing configured so as to be able to post recipes you sent to the contributor terminal, recipe submission support server.   The recipe posting support server according to claim 1, wherein the communication unit distributes the posting recipe stored in the storage unit via a network.   The recipe posting support server according to claim 1, wherein the dish image is a dish photograph taken by a poster.   The recipe posting support server according to claim 1, wherein the cooking image is a cooking video shot by a poster.   The said dish identification part estimates the dish candidate from the said dish image which the said communication part received, The said dish is identified based on the information from the said contributor terminal with respect to the said estimated dish candidate. 5. The recipe posting support server according to any one of 4. The recipe information acquisition unit includes a posted recipe history acquisition unit that acquires a history of the posted recipe posted from the poster terminal from the storage unit,
6. The recipe information acquisition unit according to claim 1, wherein the recipe information acquisition unit acquires recipe information related to the identified dish based on a poster's preference extracted from the acquired posted recipe history. Recipe submission support server according to item. The recipe information acquisition unit includes a posted recipe history acquisition unit that acquires a history of the posted recipe posted from the poster terminal from the storage unit,
The said recipe information acquisition part acquires the recipe information of the dish relevant to the dish which is not contained in the log | history of the acquired said contribution recipe among the recipe information relevant to the said identified dish. Recipe contribution support server given in any 1 paragraph of. Communicating with the poster terminal,
Storing recipe information including a posted recipe received from the poster terminal;
Identifying a dish shown in the dish image received from the poster terminal;
Obtaining recipe information of the identified dish from the stored recipe information;
Posting recipe chicks that are created based on at least one of the cooking procedure, ingredients, and cooking utensils of the acquired recipe information and the cooking image received from the contributor terminal and that can be edited by the contributor. And a step of transmitting a mold to the poster terminal. A program for causing a computer to execute the recipe posting support method according to claim 8 . A recipe posting support system that supports creation of a posting recipe transmitted from a poster terminal via a network,
A dish image acquisition unit for acquiring a dish image;
A dish identification unit for identifying dishes reflected in the dish image;
A storage unit for storing recipe information including the posted recipe;
A recipe information acquisition unit that acquires recipe information of the dish identified by the dish identification unit from the storage unit;
A recipe created based on at least one of recipe information , cooking ingredients, cooking utensils and cooking images received from the poster terminal of the recipe information acquired by the recipe information acquisition unit is configured to be editable by the poster. A communication unit that transmits a template of a posting recipe to the poster terminal;
A recipe submission support system.

Images