KR101754372B1 - System and method of food reserves management - Google Patents

Abstract

 Receiving a refrigerator image from a first user terminal, pushing a refrigerator image to a plurality of previously registered second user terminals, receiving food ingredient information corresponding to a refrigerator image from at least one second user terminal, Recognizing at least one food material stored in the refrigerator using the food material information received from one second user terminal and generating a food material map composed of information on the kind and quantity of the food material stored in each area of the refrigerator, Comprising: providing a map to a first user terminal; analyzing the similarity of the ingredient information received from the food material map and the at least one second user terminal, and accumulating points to a second user according to the degree of similarity; Provide a management method.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a food material management system,

The present invention relates to a food material management system and a food material management method, and more particularly, to a food material management system and a food material management method that recognize a food material based on an image input by a user and provide a food material map.

The refrigerator, which stores food at low temperatures to prevent food corruption and deterioration, began to be supplied to general households in the early 1900s, and most households use refrigerators to store food or food. The refrigerator is divided into a refrigerator room and a freezer room. The refrigerator room is kept at about 3 ~ 4 ° C to store various foods such as vegetables and fruits for a long time, and the freezer room stores food such as meat To keep the temperature below zero.

As the size of the refrigerator increases and more variety of food or food becomes available for storage through the refrigerator, it becomes difficult to manage the ingredients stored in the refrigerator.

Korean Patent Laid-Open No. 10-2014-0139738 (Dec. 20, 2014)

 It is an object of the present invention to provide a food material management system and a food material management method for providing a food material map for efficient food material management in order to solve the above-mentioned problems.

According to another aspect of the present invention, there is provided a method of managing a foodstuff comprising: receiving a refrigerator image from a first user terminal; pushing a refrigerator image to a plurality of registered second user terminals; Receiving at least one food ingredient information corresponding to an image of a refrigerator from a second user terminal, and recognizing at least one food ingredient stored in the refrigerator using the food ingredient information received from the at least one second user terminal, The method comprising the steps of: generating a food ingredient map comprising information on the type and quantity of the ingredients of the food, and providing a food ingredient map to the first user terminal; and comparing the food ingredient map with the food ingredient information received from the at least one second user terminal And accumulating the points to the second user according to the degree of similarity .

In addition, the method of managing a foodstuff includes analyzing a consumption pattern of a user's foodstuff using a past foodstuff map generated in the past and a foodstuff map generated using the foodstuff information received from the second user terminal, and based on the foodstuff consumption pattern, And transmitting the generated purchase information to the first user terminal.

Also, the step of generating the ingredient map may include the steps of: classifying the ingredient information received from the at least one second user terminal into a plurality of groups according to the degree of similarity, determining an effective group according to the number of samples, and using the ingredient information And creating a food ingredient map.

The method may further include receiving a food image from the first user terminal and pushing the plurality of second user terminals, receiving cooking information corresponding to the food image from the plurality of second user terminals, Generating recipe information including food ingredient information, recipe, and calorie information based on the information, and transmitting the recipe information to the first user terminal and the second user terminal. The method may further include comparing the ingredients corresponding to the ingredient map and the recipe information, analyzing the ingredients that require additional purchase to generate purchase information, and transmitting the purchase information to the first user terminal.

According to an aspect of the present invention, there is provided a food material management system including a food material management server, a first user terminal for transmitting a refrigerator image to a food material management server, and a refrigerator image receiving and displaying image from the food material management server, And a plurality of second user terminals for receiving the food ingredient information corresponding to the food ingredient information and transmitting the information to the food ingredient management server.

At this time, the food material management server recognizes at least one food material stored in the refrigerator using the food material information received from the plurality of second user terminals, and recognizes the food material contained in the information on the type and quantity of the food material stored in each area of the refrigerator A food material management unit for generating a map and transmitting the generated map to the first user terminal; And a point management unit for analyzing the similarity of the food ingredient information received from the food material maps and the plurality of second user terminals and accumulating points to each user of the plurality of second user terminals according to the similarity.

In addition, the food material management server analyzes the food ingredient consumption pattern of the user using the food ingredient map generated by using the previous food ingredient map generated in the past and the food ingredient information received from the second user terminal, and analyzes the food ingredient consumption pattern based on the food ingredient consumption pattern And a purchasing manager for generating purchase information about the purchaser and transmitting the purchase information to the first user terminal.

The food material management unit may classify the food material information received from the at least one second user terminal into a plurality of groups according to the degree of similarity, determine an effective group according to the number of samples, and use the food material information in the determined effective group Can be generated.

In addition, the food material management apparatus may further include means for, when receiving the food image from the first user terminal, pushing the food image to the plurality of second user terminals to receive the cooking information corresponding to the food image, And a cooking information manager for generating recipe information including the calorie information and transmitting the recipe information to the first user terminal.

Also, the cooking information management unit may analyze the ingredients that require additional purchase using the ingredients corresponding to the ingredients map and the recipe information, generate purchase information, and transmit the purchase information to the first user terminal.

 A food material map is generated and provided by using a refrigerator image input from a user terminal, thereby providing information for efficient food material management information.

Further, by generating recipe information using the food image input from the user terminal, information necessary for cooking can be efficiently provided.

Further, by providing the purchase information based on the change of the food material map or the recipe information, the user can improve the food material management efficiency.

1 is a diagram illustrating a food management system according to one embodiment.
2 is a control block diagram for explaining an example of a user terminal of the food management system according to one embodiment.
3 is a view for explaining an example of refrigerator image collection.
4 is a control block diagram for explaining an example of a food material management server of the food management system according to one embodiment.
5 is a view for explaining an example of a food material map.
6 is a view for explaining another example of the ingredient map.
7 is a diagram illustrating an example of a screen for providing purchase information.
8 is a diagram illustrating an example of a screen for providing recipe information.
FIG. 9 is an exemplary screen view showing another embodiment of providing purchase information.
10 is a flowchart illustrating a method of managing a foodstuff according to an embodiment of the present invention.
11 is a flowchart for explaining a method of managing a foodstuff according to another embodiment.

Brief Description of the Drawings The advantages and features of the present invention, and how to accomplish them, will become apparent with reference to the embodiments described hereinafter with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term, not on the name of a simple term, but on the entire contents of the present invention.

Hereinafter, the food ingredient information is information for identifying food ingredients contained in the image such as the type and quantity of the food ingredient, and the food ingredient map is information for storing the kinds and quantity of the food ingredients stored in each area of the refrigerator.

Further, the cooking information means information corresponding to the food image, for example, a food name, a cooking method and the like, and the recipe information means a method of cooking food. The cooking information, the cooking method, And the like can be recipe information.

Hereinafter, the present invention will be described in detail with reference to the drawings.

1 is a diagram illustrating a food management system according to one embodiment.

Referring to FIG. 1, a food management system according to an embodiment includes a user terminal 100 and a food material management server 200.

The user terminal 100 is connected to the food material management server 200 via the communication network 300 and can transmit predetermined information necessary for food management or receive predetermined information necessary for food management.

1, the user terminal 100 may be a smart phone having high portability and easy access to the communication network 300, but is not limited thereto. For example, the user terminal 100 may be an information processing device used in a fixed position such as a desktop or a portable information processing device such as a portable media player (PMP), a personal digital assistant (PDA), a tablet PC, It should be understood that the term " device "

Also, the user terminal 100 may be a refrigerator. That is, the refrigerator includes a camera 140 for acquiring an internal image, a communication device capable of communicating with the food material management server 200 to transmit and receive predetermined information, an input / output (I / O) Device, etc., the refrigerator may be the user terminal 100. Hereinafter, the user terminal 100 will be described separately from the refrigerator for convenience of explanation.

Meanwhile, the user terminal 100 can be divided into a first user terminal 101 and a second user terminal 102 according to its operation and function. The first user terminal 101 is a terminal for uploading a refrigerator image to the food material management server 200 to request a food material map creation or a food image to be uploaded to the food material management server 200 to request recipe information, The terminal 102 uploads the food ingredient information about the refrigerator image uploaded by the first user terminal 101 to the food material management server 200 or uploads the cooking information on the food image to the food material management server 200 .

That is, when the user terminal 100 requests the food ingredient map or the recipe information by uploading the refrigerator image or the food image, the user terminal 100 operates as the first user terminal 101, and uploads the food ingredient information or uploads the cooking information. And operates as the terminal 102.

The food material management server 200 collects food ingredient information on the refrigerator image received from the user terminal 100 and generates a food ingredient map corresponding to the refrigerator image based on the collected reception information.

Specifically, the food material management server 200 pushes the refrigerator image received from the first user terminal 101 to the plurality of second user terminals 102 to request the input of the food ingredient information corresponding to the refrigerator image, The first user terminal 101 generates a food ingredient map corresponding to the refrigerator image using the received food ingredient information and provides the same to the first user terminal 101. [ At this time, the food material management server 200 may provide a point to the user corresponding to the second user terminal 102 that has input the ingredient information corresponding to the ingredient map.

The reliability of the ingredient map can be improved by generating the ingredient map using the ingredient information inputted through the plurality of user terminals 100 as described above.

The food material management server 200 analyzes the food consumption pattern based on the change of the food material map of the first user terminal 101 and generates purchase information for the food and provides the information to the first user terminal 101 can do.

By providing the purchase information together with the food material map in this way, the user can easily manage the food.

The food material management server 200 pushes the food image received from the first user terminal 101 to the plurality of second user terminals 102 to receive the cooking information corresponding to the food image, And provides the generated recipe information to the first user terminal 101. [0050] At this time, the first user terminal 101 receiving the recipe information may display the ingredients corresponding to the recipe information in the previously stored food ingredient map and provide the same to the user, or may purchase the ingredients necessary for cooking the food received from the ingredient management server 200 Information can be provided to the user.

Hereinafter, the operation and structure of each device constituting the food management system will be described in detail with reference to the drawings.

FIG. 2 is a control block diagram for explaining an example of the user terminal 100 of the food management system according to one embodiment. FIG. 3 is a view for explaining an example of refrigerator image collection.

2, the user terminal 100 may include a first communication unit 110, an input / output unit 120, a first storage unit 130, a camera 140, and a controller 150.

The first communication unit 110 is connected to the communication network 300 and can exchange data with the food material management server 200. The first communication unit 110 may be connected to the communication network 300 through a GSM / 3GPP communication scheme (GSM, HSDPA, LTE Advanced), a 3GPP2 communication scheme (CDMA, etc.), or a wireless communication protocol such as WiMAX, The first communication unit 110 may be connected to the communication network 300 through a communication protocol to be developed according to development of a conventional communication protocol or a future technology.

Specifically, the first communication unit 110 can transmit and receive the refrigerator image, the food ingredient information, the food ingredient map, the purchase information, and the like to the food material management server 200 under the control of the control unit 150.

The input / output unit 120 displays various information required for the user to manage food, and receives various inputs from the user. Specifically, the input / output unit 120 may provide an interface for acquiring a refrigerator image, inputting food ingredient information, or providing a food ingredient map or purchase information through a predetermined interface.

The input / output unit 120 may be a display panel (PDP), a liquid crystal display (LCD) panel, a light emitting diode (LED) panel, or an organic light emitting diode An organic light emitting diode (OLED) panel, an active-matrix organic light-emitting diode (AMOLED) panel, and the like.

In order to input information from a user, the input / output unit 120 may include a touch input means such as a button input means such as a keypad, a push button, or a membrane button, a touch pad, And may be implemented as a touch screen capable of both input and output.

The first storage unit 130 may store an operating system for driving the user terminal 100 or various data necessary for food management, for example, an interface for inputting information, and a management application required for using the food management service . Here, the management application refers to a program for using the food management service, which is connected to the food material management server 200 to be described below, and may be distributed by the manager of the food material management server 200.

The camera 140 may obtain a refrigerator image. The image of the refrigerator means an image of the inside of the refrigerator, which may be obtained so as to display the food stored in the refrigerator.

That is, the user can input the refrigerator image using the camera 140 provided in the user terminal 100 as shown in FIG. At this time, the refrigerator image may be one image, but it may be composed of a plurality of images as needed. For example, the refrigerator image may be composed of a refrigerator room image, a freezer room image, and a door image.

The control unit 150 controls the user terminal 100 as a whole. The controller 150 may include a CPU, a micro CPU, and the like, but is not limited thereto. The operations and functions of the first user terminal 101 and the second user terminal 102 are different from each other so that the operation and the function of the control unit 150 when the first user terminal 101 is operated, The operation and the function of the control unit 150 in the case of the control unit 102 will be described separately.

When the user terminal 100 operates as the first user terminal 101, the control unit 150 transmits the obtained refrigerator image to the food material management server 200, And can provide the user with purchase information on the food ingredient map or the food received from the food material management server 200 by controlling the input / output unit 120. [

When the food image is obtained, the control unit 150 transmits the obtained food image to the food material management server 200, requests recipe information of the food corresponding to the food image, and transmits the food image to the food material management server 200 Recipe information can be provided to the user.

At this time, the food image may be obtained by the camera 140 described above, but is not limited thereto. For example, the food image may be an image obtained through the communication network 300 or an image obtained through the SNS. Further, the recipe information may further include purchase information on a material that requires additional purchase for cooking food.

On the other hand, when the recipe information is inputted from the food material management server 200, the controller 150 searches the material corresponding to the recipe information in the previously stored food material map, and provides the retrieved material to the user.

By thus obtaining the recipe information based on the food image, displaying the ingredients corresponding to the recipe information or providing the purchase information, the user can easily manage the food.

When the user terminal 100 operates as the second user terminal 102, the control unit 150 controls the input / output unit 120 to display the refrigerator image received from the food material management server 200 to the user, And transmits the food ingredient information inputted by the user to the food material management server 200.

Also, the control unit 150 controls the input / output unit 120 to display the food image received from the food material management server 200 to the user, and transmits the cooking information input by the user to the food material management server 200.

FIG. 4 is a control block diagram for explaining an example of the food material management server 200 of the food management system according to an embodiment, FIG. 5 is a view for explaining an example of a food material map, and FIG. FIG. 7 is a view showing a screen showing an embodiment of providing purchase information, FIG. 8 is a view showing a screen showing an embodiment of providing recipe information, FIG. 9 is a view showing an example of providing purchase information Fig. 8 is a view showing a screen showing another embodiment of the present invention.

4, the food material management server 200 includes a second communication unit 210, a second storage unit 220, a food material management unit 230, a point management unit 240, a purchase management unit 250, a cooking information management unit 260).

The second communication unit 210 is connected to the communication network 300 and is capable of transmitting and receiving data to and from a plurality of user terminals 100. The second communication unit 210 may be connected to the communication network 300 through a GSM / 3GPP communication scheme (GSM, HSDPA, LTE advanced), a 3GPP2 communication scheme (CDMA, etc.), or a wireless communication protocol such as WiMAX, The first communication unit 110 may be connected to the communication network 300 through a communication protocol to be developed according to development of a conventional communication protocol or a future technology.

Specifically, the second communication unit 210 may receive a refrigerator image or a food image from the first user terminal 101, or may transmit a food ingredient map, purchase information, recipe information, and the like to the first user terminal 101.

The second communication unit 210 transmits the refrigerator image or the food image to the second user terminal 102 and the cooking information corresponding to the refrigerator image or the cooking image corresponding to the food image from the second user terminal 102 .

The second storage unit 220 stores information necessary for operation of the ingredients management server 200. Specifically, the second storage unit 220 may include an operating system of the food material management server 200, various data necessary for driving the food material management server 200, and a database for generating a food material map from the food material information , But is not limited thereto.

The food material management unit 230 generates a food material map based on the refrigerator image received from the first user terminal 101. [ The food ingredient map indicates the kinds and quantity of the food ingredients stored in each area of the refrigerator. The food ingredient map may be composed of information on the kind, quantity, and storage area of the food ingredients.

Specifically, when the refrigerator image is received from the first user terminal 101, the food material management unit 230 pushes the received refrigerator image to the plurality of second user terminals 102 to request input of the food ingredient information. The second user terminal 102 receives the types and quantities of the ingredients corresponding to the respective regions of the refrigerator from the user, generates the ingredients information, and transmits the information to the ingredients management server 200.

When the food ingredient information is received, the food ingredient management unit 230 verifies the validity of the food ingredient information received from the at least one second user terminal 102, and generates the food ingredient map using the validated food ingredient information.

In one embodiment of the validity verification, the food material management unit 230 determines the validity of the ingredients information transmitted from the plurality of second user terminals 102 using the similarity between the ingredients information transmitted from the plurality of second user terminals 102 Can be verified. For example, the food material management unit 230 classifies a plurality of groups of food ingredients information transmitted from the plurality of second user terminals 102 according to the degree of similarity, determines a group having the largest number of samples among a plurality of groups as effective groups, The ingredient map can be generated using only the ingredient information corresponding to the effective group.

In another embodiment of the validity check, the food material management unit 230 compares the similarity of the image of the food material corresponding to the food material information input by the second user terminal 102 with the image of the refrigerator. If the similarity degree is equal to or greater than a predetermined threshold value, It is determined that the food ingredient information inputted by the terminal 102 is valid. If the similarity is less than the preset threshold value, it is determined that the food ingredient information inputted by the second user terminal 102 is not valid and transmitted from the second user terminal 102 It is possible to generate a food ingredient map without reflecting the food ingredients information.

Meanwhile, the refrigerator image may be divided into a plurality of areas and transmitted to the second user terminal 102. Generally, since different ingredients are stored in each region of the refrigerator, corresponding ingredients information is different for each region.

The food material management unit 230 separates the refrigerator image into a plurality of areas A1 to A10 as shown in FIG. 3, and generates a plurality of divided images. A plurality of divided images may be transmitted to the second user terminal 102 to request input of ingredients information corresponding to each region.

At this time, the divided image may be generated according to a predetermined reference (for example, a shelf, a refrigerator frame, or the like) set in advance, but is not limited thereto. for example. The food material management unit 230 may analyze the refrigerator image to classify the areas having similar color and shape characteristics into the same area and generate a divided image according to areas having similar image characteristics.

In the case where the food ingredient information is collected by each divided image, the validity of the food ingredient information described above can be performed for each area.

The ingredient management unit 230 transmits the ingredient map to the first user terminal 101 when the ingredient map generation is completed. The first user terminal 101 receiving the food ingredient map displays the food ingredient map using the input / output unit 120 described above. The food ingredient map may be provided in the form of displaying the kind and quantity of the ingredients in each area as shown in FIG. 5, or may be provided in the form of displaying a specific icon prepared for each kind of the ingredients as shown in FIG. 6, The method of providing the food ingredients is not limited thereto.

The point management unit 240 determines a point to be accumulated to the user who has input the ingredient information, and accumulates the determined point to each user. Specifically, the point management unit 240 calculates the similarity between the food ingredient map generated by the food ingredient management unit 230 and the food ingredient information transmitted from the second user terminal 102, and calculates the degree of similarity between each of the second user terminals 102 To be accumulated to the user corresponding to the point.

When the point accumulation is completed, the point management unit 240 transmits the accumulation information of points to the second user terminal 102, for example, information about accumulated points and available points.

The purchase management unit 250 generates food ingredient purchase information using the food ingredient map generated based on the refrigerator image and the food ingredient map transmitted to the first user terminal 101 in the past and can transmit the food ingredient purchase information to the first user terminal 101 have.

Specifically, the purchase management unit 250 analyzes the food ingredient consumption pattern of the user by using the food ingredient map generated by the food ingredient management unit 230 and the previously generated food ingredient map, and determines the ingredients required to be purchased according to the food ingredient consumption pattern Purchase information can be generated. At this time, the food consumption pattern may be generated based on the amount of change of each ingredient during the generation time of the past food map and the current food map, and the purchase information may include price information of the ingredients.

In this way, the purchase information generated in the purchase management unit 250 can be transmitted together with the food material map, but can be transmitted to the first user terminal 101 at a time when the user is expected to purchase according to the above- have.

For example, the purchase management unit 250 may transmit the purchase information of the eggs to the first user terminal 101 two days later, if it is determined that the purchase of the eggs is required after three days according to the food consumption pattern.

Also, the purchase management unit 250 generates the shelf life information of the ingredients contained in the ingredient map using the past food material map and the currently-generated food material map, and transmits the shelf life information together with the purchase information to the first user terminal 101 ).

Specifically, the purchase management unit 250 searches for the ingredients included in the past food material map in the currently-generated food material map, creates a management candidate group, and determines whether the shelf life of the ingredients in the management candidate group corresponds to the past food material map and the current food material map Time can be searched for ingredients to generate shelf life information.

On the other hand, the first user terminal 101 receiving the purchase information and the expiration date information from the purchase management unit 250 can display the purchase information and the expiration date information as shown in FIG.

By providing the purchase information and the expiration date information of the ingredients according to the change of the food map over time, the user can easily manage the ingredients of the food.

4, the cooking information management unit 260 collects cooking information corresponding to the food image transmitted from the first user terminal 101, and stores recipe information corresponding to the food image using the collected cooking information And provides it to the first user terminal 101.

Specifically, the cooking information management unit 260 pushes the food image transmitted from the first user terminal 101 to the second user terminal 102, and requests the second user terminal 102 to input cooking information. The cooking information management unit 260 may generate recipe information based on the cooking information received from the second user terminal 102 and transmit the recipe information to the first user terminal 101. [

Recipe information may be generated based on the cooking information that is made available from the second user terminal 102. [ Specifically, the cooking information management unit recognizes the food corresponding to the food image based on the cooking information input from the second user terminal 102, and searches the cooking method, the cooking material, the heat amount corresponding to the recognized food, Information can be generated.

For this, a database storing recipe information according to the food may be provided in the storage unit, recipe information of a specific food may be added through internet search, if necessary, and the cooking information transmitted from the second user terminal 102 The recipe information may be added to reflect the cooking method, the cooking material, and the like.

The recipe information of the food may also be transmitted to the second user terminal 102 that has input the cooking information and the recipe information of each food may be transmitted to the first user terminal 101 or the second user terminal 102 And the updated recipe information may be provided to the first user terminal 101 or the second user terminal 102 that has input the cooking information when the recipe information is updated.

For example, if feedback is input through the first user terminal 101 that the taste of the food can be improved by adding a food, the recipe information is updated using the feedback information, and the updated recipe information is transmitted to the second user terminal 102).

On the other hand, the first user terminal 101 or the second user terminal 102, which has received the recipe information, can provide recipe information to the user and compares the recipe information with the previously stored food ingredient information, And the ingredients necessary for the cooking of the food can be displayed on the ingredient map as shown in Fig. For example, if the recipe information includes beef and fish in the ingredients, the first user terminal 101 can search beef and fish in the ingredient map to display the area in which beef and fish are stored.

Also, the cooking information management unit 260 compares the food ingredients included in the recipe information with the food ingredient map of the first user terminal 101 stored in advance, analyzes the ingredients required for cooking the food, To the first user terminal (101). The first user terminal 101 receiving the purchase information can display the purchase information as shown in FIG.

In summary, the first user terminal 101 can not only receive food recipe information corresponding to a food image from the food material management server 200 by uploading a food image, You can get all of the information about the storage location of the ingredients needed for cooking and the ingredients you need to purchase to prepare the food.

Thus, by providing the user with all the information necessary for cooking the food on the basis of the food image, it is possible to facilitate the management of the food.

On the other hand, the point management unit 240 also determines the point to be paid for the second user terminal 102 that has input the cooking information in the same manner as described above, and stores the determined point in the user of the second user terminal 102 can do.

10 is a flowchart illustrating a method of managing a foodstuff according to an embodiment of the present invention.

Referring to FIG. 10, the first user terminal 101 obtains a refrigerator image and pushes it to the food material management apparatus (501).

The food material management device receiving the refrigerator image from the first user terminal 101 may register 502 the refrigerator image and push the refrigerator image to the second user terminal 102 (503). Although a refrigerator image is shown as being pushed to one second user terminal 102 in FIG. 10, a refrigerator image may be transmitted to a plurality of second user terminals 102. At this time, the refrigerator image may be a plurality of divided images divided into the respective areas as described above.

The second user terminal 102 receiving the refrigerator image displays the refrigerator image to the user, and when the user inputs the food ingredient information corresponding to the refrigerator image, the second user terminal 102 can transmit the food ingredient information to the food material management server 200 (504).

The food material management server 200 generates a food ingredient map using the food ingredient information received from the second user terminal 102 (step 505) and transmits it to the first user terminal 101 (step 506). Specifically, the ingredient management server 200 can verify the validity of the ingredient information transmitted from the second user terminal 102, and generate the ingredient information using only the ingredient information that is proved to be valid.

When the generation of the food ingredient map is completed, the food material management server 200 accumulates the points to the user of the second user terminal 102 that has input the food ingredient information (507) and sends the point accumulation information to the second user terminal 102 (508). At this time, the points accumulated in each user of the second user terminal 102 can be determined according to the similarity between the food ingredient map and the inputted food ingredient information. That is, a high point is accumulated for a user who inputs food ingredient information having a high degree of similarity with the finally generated food ingredient map, and a low point is accumulated for a user who inputs food ingredient information with a low degree of similarity.

Meanwhile, the food material management server 200 generates purchase information (509) and transmits it to the first user terminal 101 (510). Purchase information may be generated in the same manner as described above, and may be transmitted together with a food material map unlike in FIG.

11 is a flowchart for explaining a method of managing a foodstuff according to another embodiment.

Referring to FIG. 11, the first user terminal 101 obtains a food image and pushes it to the food material management apparatus (601). At this time, the food image may have been photographed through the camera 140, but it is not limited thereto, and it may be downloaded through sns or the like.

The food material management device that has received the food image from the first user terminal 101 may register the food image (602) and push (603) the food image to the second user terminal (102). Although a food image is shown as being pushed to one second user terminal 102 in FIG. 11, a food image may be transmitted to a plurality of second user terminals 102.

The second user terminal 102 receiving the food image displays the food image to the user, and when the user inputs the cooking information corresponding to the food image, the user can transmit the food image to the food material management server 200 (604).

The food material management server 200 generates recipe information (605) using the cooking information received from the second user terminal (102) and transmits it to the first user terminal (101) (606). The recipe information generation method is the same as the above-described method and the system generation method, and thus a detailed description thereof will be omitted. When the food material management server 200 receives the recipe information, it can also transmit it to the second user terminal 102 (611).

When the creation of the recipe information is completed, the food material management server 200 accumulates the points to the user of the second user terminal 102 that has input the cooking information (607) and transmits the point accumulation information to the second user terminal 102 (608).

Meanwhile, the food material management server 200 generates purchase information (609) and transmits it to the first user terminal (610). The purchase information may be generated by comparing the recipe information with the food ingredient map of the first user terminal 101 stored in advance as described above, and the first user terminal 101 stores the position of the ingredients corresponding to the recipe information in FIG. 8 Or may be provided as shown.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed methods should be considered in an illustrative rather than a restrictive sense. It is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

100: user terminal
110: first communication section
120: input / output unit
130: First storage unit
140: camera
150:
200: Foodstuff management server
210:
220: second storage unit
230:
240: Point management unit
250: Purchasing Manager
260: Cooking information management section
300: Network

Claims (10)

The food material management server receiving a refrigerator image from a first user terminal;
The food material management server pushing the refrigerator image to a plurality of second user terminals registered in advance;
Receiving the food ingredient information corresponding to the refrigerator image from the at least one second user terminal;
Wherein the food material management server recognizes at least one food material stored in the refrigerator using the food material information received from the at least one second user terminal and stores the food material constituted by information on the type and quantity of the food material stored in each area of the refrigerator Generating a map;
The food material management server providing the ingredient map to the first user terminal;
A point accumulation step of the food material management server analyzing the similarity between the ingredient map and the ingredient information received from the at least one second user terminal and accumulating points to each user of the second user terminal according to the similarity; And
The food material management server compares the current food material map generated by using the previous food material map generated in the past with the food material information received from the second user terminal to calculate the change amount of each food material during the generation period of the current food material map, The method comprising: analyzing a consumption pattern of food ingredients of a user based on a change amount of the calculated food ingredients; generating purchase information on the ingredients based on the food consumption pattern and transmitting the information to the first user terminal, And transmitting the predicted point of time at the point of time,
Wherein the step of generating the ingredient map comprises:
Classifying the food ingredients information received from the at least one second user terminal into a plurality of groups according to the degree of similarity, determining an effective group according to the number of samples, generating the food ingredient map using the food ingredient information in the determined effective group, Comparing the image of the food material corresponding to the food material information received from the at least one second user terminal with the similarity of the image of the refrigerator and determining that the food ingredient information received from the at least one second user terminal is valid if the similarity degree is equal to or greater than a predetermined threshold And determining the food ingredient information received from the at least one second user terminal as being ineffective if the value is less than or equal to the threshold value and generating the ingredient map using the ingredient information determined to be valid. delete delete The method according to claim 1,
The food material management server receiving a food image from the first user terminal;
The food material management server pushing the food image to the plurality of second user terminals;
Receiving the cooking information corresponding to the food image from the plurality of second user terminals, and generating recipe information including the food information, the recipe, and the calorie information based on the cooking information; And
And the food material management server transmitting the recipe information to the first user terminal and the second user terminal. 5. The method of claim 4,
The food material management server compares the ingredients map with the ingredients corresponding to the recipe information to generate purchase information by analyzing the ingredients required for additional purchase and transmitting the purchase information to the first user terminal; Further comprising the step of: A first user terminal for transmitting a refrigerator image to the food material management server, and a second user terminal for receiving and displaying the refrigerator image from the food material management server, receiving food ingredient information corresponding to the refrigerator image, And a plurality of second user terminals for transmitting the first user terminal,
The food material management server comprises:
Recognizing at least one food ingredient stored in the refrigerator using the food ingredient information received from the plurality of second user terminals to generate a food ingredient map composed of information on the kind and quantity of the food ingredient stored in each region of the refrigerator, 1) a food material management unit for transmitting to a user terminal; And
A point management unit for analyzing the similarity between the food ingredient map and the food ingredient information received from the plurality of second user terminals and for accumulating points to each user of the plurality of second user terminals according to the similarity; And
The current food ingredient map generated by using the previous food ingredient map generated in the past and the food ingredient information received from the second user terminal is compared to calculate the change amount of each food ingredient during the generation period of the current food ingredient map, The method comprising: analyzing a consumption pattern of a user's food based on the food consumption pattern of the user, generating purchase information on the foodstuff based on the food consumption pattern, and transmitting the purchase information to the first user terminal, And a purchase management unit that transmits the purchase management information at the time point,
The food material management unit,
Classifying the food ingredients information received from the at least one second user terminal into a plurality of groups according to the degree of similarity, determining an effective group according to the number of samples, generating the food ingredient map using the food ingredient information in the determined effective group, Comparing the image of the food material corresponding to the food material information received from the at least one second user terminal with the similarity of the image of the refrigerator and determining that the food ingredient information received from the at least one second user terminal is valid if the similarity degree is equal to or greater than a predetermined threshold And determines the food ingredient information received from the at least one second user terminal to be invalid if it is less than or equal to the threshold value and generates the ingredient map using the ingredient information determined to be valid. delete delete The method according to claim 6,
Receiving a food image from the first user terminal, pushing the food image to the plurality of second user terminals to receive cooking information corresponding to the food image, and storing the food information, the recipe, and the calories And a cooking information management unit for generating recipe information including information on the recipe information and transmitting the recipe information to the first user terminal. 10. The method of claim 9,
The cooking information management unit,
Wherein the purchase information is generated by analyzing the ingredients that require additional purchase using the ingredients map and the ingredients corresponding to the recipe information and transmits the purchase information to the first user terminal.

Images