KR20140094761A - Method for checkweighing food and apparatus thereof - Google Patents

Abstract

The objective of the present invention is to make users properly select food depending on the own amount of the food and to set a reasonable price according to the amount of the food. Thus, the present invention can protect domestic natural environment and can save resources by effectively reducing the amount of food wastes approaching 8,000 billion won per year. A restaurant needs fast and accurate calculation due to the constraints of time and space since there are a lot of people coming in all at the same time. To solve the problem, adopting a method using a computer vision is essential. The system divides the image of a food tray obtained by a distance camera for providing distance information and a color camera into each food section by analyzing the image of the food tray, and determines the kinds of the food in each divided section by matching the food with a today′s set menu. Then, the system measures the volume of the food tray using the distance camera to calculate the volume of the food. Accordingly, the system obtains weight information from the volume information on the food and calculates and displays the calorie and price of the food.

Description

{METHOD FOR CHECKWEIGHTING FOOD AND APPARATUS THEREOF}

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to metering of foods, and more particularly, to a method and apparatus for calculating the type and amount of foods contained in a plate using a computer vision system.

In general, in factory automation, defective products are automatically classified using a computer vision technology using a camera in an object moving on a conveyor belt.

In the case of courier companies, courier items to be delivered to an automation system using computer vision technology are classified by volume.

The problem with the conventional buffet-type method is that the user pays the same amount regardless of the amount of the food selected by the user, so that the food is often put on the plate more than necessary and the waste of the residue is also severe.

 In addition, there is an indication that it is unreasonable to pay for the consumption of food due to the difference in food quantity of users.

In order to solve these problems, a method of estimating the price per unit of food by packaging the food separately has been proposed. However, in this case, the cost of washing dishes is increased

SUMMARY OF THE INVENTION It is an object of the present invention to provide a method for determining and measuring the type and amount of food contained in an integral plate using a computer vision system.

It is another object of the present invention to solve the above problems and provide a device for determining and measuring the type and amount of food contained in an integral plate using a computer vision system.

According to an aspect of the present invention, there is provided a method of constructing a plate inspection system using a computer vision system including a distance camera and a color camera.

According to another aspect of the present invention, there is provided a method of determining a type of a food by extracting feature information from a color image.

In order to achieve the above object, the present invention provides a method for measuring the volume and weight of a food using a 3D vision system.

In order to achieve the above object, the present invention provides a method for calculating the price of food using a computer vision system.

According to an aspect of the present invention, there is provided a method of calorie calculation of a food using a computer vision system.

In the case of using the automatic food metering and calculating system according to the present invention as described above, since the users eat only what they eat, the amount of food left can be reduced. As a result, the amount of food waste reaching 8 trillion won a year can be reduced nationwide, which is expected to greatly contribute to resource conservation and conservation of nature.

Also, despite the differences in the amount of food between men and women in general, it is possible to correct the unreasonable point of paying the same food expenses in the past. The user is required to pay a proper meal amount corresponding to the amount of food stored in the plate, which is effective for a reasonable food expenditure.

 In addition, a computer vision system can be used to calculate the total calories of the food and display it on the LCD output, which can lead users to calorie intake modestly. In particular, diabetic patients who need calorie control or diet-sensitive women can help control the diet.

In addition, in a restaurant, the result of the present invention system can be connected to an external interface instead of selling a meal ticket, so that it can be calculated in a card-like manner, so that fast and accurate food expenses can be stored.

1 is a conceptual diagram showing a configuration of an apparatus for automatically calculating a plate-like food according to an embodiment of the present invention.
FIG. 2 is a flowchart illustrating a setup mode of a method for automatically measuring a food item according to an embodiment of the present invention.
FIG. 3 is a flowchart for explaining an inspection mode of a method for automatically measuring a food of a plate according to an embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

The terms first, second, A, B, etc. may be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

According to an embodiment of the present invention,

The restaurant users are encouraged to choose the appropriate food for each meal and develop reasonable pricing according to the amount of food. As a result, by effectively reducing the amount of garbage of foodstuffs of 8 trillion won per year, it is possible to expect the effect of conservation of domestic natural environment and resource saving at the same time.

In restaurants, fast and precise calculations are needed because of the temporal and spatial constraints that many people collect at the same time. To solve these problems, it is necessary to introduce a method using computer vision.

The food images obtained by the combination of the distance camera (camera providing distance information) and the color camera are analyzed to divide each food area. The food of each divided area judges the food type through the 1: 1 matching with the predetermined menu that day. Use a distance camera to measure the volume of the plate, and calculate the volume for each dish. Then, weight information can be obtained from the volume information of each food, and calorie and corresponding price of the corresponding food are calculated and outputted.

The present invention is a device designed to judge and measure the type and quantity of foods contained in an integral plate using a computer vision system. The image of the plate containing the food is obtained by using a combination of the distance camera and the color camera, and the position and position of the food contained in the plate are determined by analyzing the image obtained using the image processing algorithm. Also, the volume of food is measured by acquiring three - dimensional information of a plate using a three - dimensional recognition system using a distance camera. The information obtained from this is used in combination to calculate the price and calorie of food on the plate, and the result is output

In the case of food distribution companies, the food to be fed (food) can be automatically measured using the proposed system, and the food value can be automatically calculated and processed using a system for billing.

The present invention can be utilized in food restaurants, food-related companies, large-scale restaurants of large corporations and government offices, restaurants having a certain size or higher, and the like.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a conceptual diagram showing a configuration of an apparatus for automatically calculating a plate-like food according to an embodiment of the present invention.

Referring to FIG. 1, an apparatus for automatic calculation of a plate-like food according to an embodiment of the present invention is as follows.

 <System Configuration>

 -1 shooting section

 -2 LCD output

 -3 plate inspection table

-4 cabinet

 Role of each system <Main components>

 -1 shooting section

      i) a combination of a distance camera and a color camera.

ii) The shooting unit consists of a computer vision system for 3D volume measurement and color image acquisition. The information obtained here is transmitted to a computer.

 -2 LCD output

i) Used for outputting data processing results in setup mode and test mode.

 -3 plate inspection table

      i) Place the plate to be inspected. Using the sensor to detect if the plate has come up and send a signal to the computer, the computer starts the test.

 -4 cabinet

i) Store computer, power supply and other accessories. A built-in keyboard and mouse (or trackball) for use in setup mode, and buttons for receiving simple input from the user.

FIG. 2 is a flowchart illustrating a setup mode of a method for automatically measuring a food item according to an embodiment of the present invention.

Referring to FIG. 2, the setup mode is intended to input the type of food and information (calories, prices, etc.) provided on that day. It is set to be accessible by entering a password so that it can be operated only by the administrator. When the manager divides the food provided on the day and puts the reference quantity on the plate and puts it on the inspection machine and operates the program using the keyboard / mouse, the program analyzes the three-dimensional image and the color image to extract the feature value for each type of food . After that, the administrator inputs the name, calorie, and price of each food by keyboard / mouse, stores the information in the database, and finishes the setup.

FIG. 3 is a flowchart for explaining an inspection mode of a method for automatically measuring a food of a plate according to an embodiment of the present invention.

In the test mode, when the actual user puts the plate containing the food, the price is calculated using the vision system. When the user places the plate on the tester, the measurement is started in the most stable state using the sensor and color image information at the bottom of the tester. The 3D vision system measures the type of food and the volume of each food, and outputs the result to the LCD monitor in front of the tester.

The following effects can be obtained by using the automatic food metering and calculation system of the plate food according to the present invention.

1) Reduction of wasted food waste

When the user can freely eat food after paying a certain amount of food expenses in the past, there is a practice of storing the food in abundance. However, when the present invention is introduced, users can eat only enough food to eat. As a result, the amount of food waste reaching 8 trillion won a year can be reduced nationwide, which is expected to greatly contribute to resource conservation and conservation of nature.

2) Reasonable food expenses for meals

 In spite of the differences in the amount of food between men and women in general, it is possible to correct the irrational point of paying the same food expenses in the past. The user is required to pay a proper meal amount corresponding to the amount of food stored in the plate, which is effective for a reasonable food expenditure.

 3) Effect of dietary adjustment due to real calorie indication

 The system of the present invention can calculate the total calories of the food using the computer vision system and display it on the LCD output unit, thereby enabling users to calorie their calories properly. In particular, diabetic patients who need calorie control or diet-sensitive women can help control the diet.

4) Fast and accurate food expenses in restaurant

In the restaurant, the result of the present invention system can be connected to an external interface instead of selling a meal ticket, so that it can be calculated in a card-like manner, so that fast and accurate food expenses can be stored.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the present invention as defined by the following claims It can be understood that

Claims (5)

A method of constructing a plate inspection system using a computer vision system consisting of a distance camera and a color camera. A method of determining the type of food by extracting feature information from a color image.  A method of measuring the volume and weight of a food using a 3D vision system. A method of calculating the price of food using a computer vision system. A method of calculating the calories of a food using a computer vision system.

Images