WO2018008686A1

WO2018008686A1 - Management system for managing nutritional component in meal

Info

Publication number: WO2018008686A1
Application number: PCT/JP2017/024663
Authority: WO
Inventors: 貴則武部; 良成松田
Original assignee: 株式会社ＥｇｇＳｔｅｌｌａｒ
Priority date: 2016-07-06
Filing date: 2017-07-05
Publication date: 2018-01-11
Also published as: JP2018005720A

Abstract

This calorie management system is a management system for managing nutritional components in a user's meal over a network and is provided with: a tray 1 for measuring the mass of a meal including tableware; an imaging device 22 for capturing an image of the meal including tableware placed on the tray 1 to obtain an image; and a management server 3 for managing the nutritional components. The management server 3 is provided with: a storage means 35 for storing recipes for meals; an analysis means 32 for analyzing the mass and the image of the meal; and a calculation means 31 for identifying, on the basis of the analysis result by the analysis means 32, the recipe for the meal from the recipes stored in the storage means 35, and calculating the nutritional components of the meal corresponding to the identified recipe.

Description

Management system to manage the nutritional components of the diet

The present invention relates to a management system for managing nutritional components of a meal, and more particularly to a management system for managing calories accurately from the mass of a meal.

BACKGROUND In recent years, there is a system for automatically calculating a nutrient component such as a calorie of a meal by acquiring an image of a meal with a portable terminal such as a smartphone. In addition, in particular, for example, people suffering from diabetes etc. need to perform calorie management strictly. Therefore, for example, Patent Document 1 discloses a technique for measuring the intake of food using a camera and a scale. Moreover, in patent document 2, the technique which calculates a nutrient component based on the image which image | photographed meal with the camera is disclosed.

Patent No. 4838383 gazette JP, 2011-28382, A

However, in Patent Document 1, although it is possible to measure the mass of a meal, if it is intended to calculate a nutritional component such as a calorie from the measured intake of the meal, it is difficult to calculate accurately according to the cooking method. Moreover, in patent document 2, although a nutrition component is calculated from the meal image | photographed with the camera, it is difficult to calculate an exact calorie and a nutrition component only with an image without knowing how much mass it is. Further, for a user who needs to strictly manage calories, such as people suffering from diabetes, it is difficult to strictly manage calories by the methods of Patent Document 1 and Patent Document 2.

An object of the present invention is to provide a management system capable of calculating a nutrient component with high accuracy by measuring the mass of a meal and acquiring the image in view of the above-mentioned problems.

In order to solve the above problems, the management system of the present invention is a management system for managing the nutritional components of the user's diet via a network, and is mounted on the tray for measuring the mass of the meal including dishes and the tray An imaging device for capturing a meal including the tableware and obtaining an image, and a management server for managing the nutrient component, the management server storing means for storing a recipe of the meal, and Based on the mass and the analysis means for analyzing the image, and the analysis result of the analysis means, the recipe of the meal is specified from the recipe stored in the storage means, and the nutritional component of the food corresponding to the specified recipe is And calculating means for calculating.

According to the present invention, it is possible to provide a management system capable of calculating nutrient components with high accuracy by measuring the mass of a meal and acquiring the image. This makes it possible to more accurately manage the calories of the meal in a simpler way.

It is a figure showing the whole calorie management system. It is a figure which shows the structure of a tray. It is a block diagram which shows the structure of a terminal. It is a block diagram which shows the structure of a management server. It is a flowchart which shows the process which registers tableware in a management server. It is a flow chart which shows processing of the whole calorie management stem. It is a flowchart which shows the calorie calculation process in a management server. It is a flow chart which shows processing of image analysis. It is a flowchart which shows the process of mass analysis.

First, with reference to FIG. 1, the structure of the management system which manages the nutritional component of the meal which concerns on this embodiment is demonstrated. The management system shown in FIG. 1 communicates with each other via a network, and has a tray 1 for measuring the mass of the meal, and a terminal 2 for acquiring the image of the meal and displaying the acquired image and nutritional components such as calories. And the management server 3 that manages the nutritional components of the food from the mass measured by the tray 1 and the image acquired by the terminal 2. In this embodiment, the management server 3 performs mass analysis and image analysis based on the mass of the meal measured in the tray 1 and the image acquired on the terminal 2, performs calorie analysis, and transmits the result to the terminal 2. , To display to the user. Therefore, it is possible to more accurately grasp the mass and calories of each menu of the meal consumed by the user. In addition, although a calorie is demonstrated as a nutrition component in this embodiment, you may manage nutrition components, such as salt content, a lipid, a protein, a carbohydrate, respectively, for example, without being limited to this.

Next, the configuration of the tray 1 according to the present embodiment will be described with reference to FIG. As shown in FIG. 2 (A), the tray 1 according to the present embodiment is divided into four locations (measuring units 1 (11) to 4 (14)) where the mass is to be measured, and By measuring, it is possible to measure the mass of the meal more accurately. For example, in the case of a meal of a plurality of items such as a staple food, a main dish, a side dish, and a soup, these can be placed on the measuring units 1 (11) to 4 (14) for more accurate mass measurement. It becomes. Further, as shown in FIG. 2B, the tray 1 is measured via the communication unit 15 capable of communicating with the terminal 2 and the management server 3 in addition to the measurement units 1 (11) to 4 (14). The mass measured by the unit 1 (11) to the measuring unit 4 (14) is transmitted to the terminal 2. In the present embodiment, the mass is transmitted from the tray 1 to the management server 3 via the terminal 2. However, the present invention is not limited to this. For example, the tray 1 directly transmits the mass to the management server 3 It may be Further, in the present embodiment, four places are used to measure the mass. However, the present invention is not limited to this, and may be changed as needed, such as two places or six places.

Next, the configuration of the terminal 2 will be described with reference to FIG. The terminal 2 includes a control unit 21 that controls the entire terminal 2 including each component, a camera (imaging device) 22 that acquires an image, an image acquired by the camera 22, information transmitted from the management server 3, etc. And a communication unit 24 for communicating with the tray 1, the management server 3 and the like. The terminal 2 according to the present embodiment may be, for example, a portable terminal such as a small PC, a mobile phone, or a smart phone, as long as it is an information processing apparatus including each component shown in FIG.

Next, the configuration of the management server 3 will be described with reference to FIG. The management server 3 includes a control unit 31, an analysis unit 32, a registration unit 33, a communication unit 34 that communicates with the terminal 2, and a DB (database) 35. The control unit 31 functions as a calculation unit that controls the entire management server 3 including each component and calculates the calories of the meal. The analysis unit 32 includes an image analysis unit 321 that analyzes an image transmitted from the terminal 2 and a mass analysis unit 322 that analyzes a mass. The registration unit 33 registers, in the DB 35, identification information of an individual, tableware information, and the like transmitted from the terminal 2.

The DB 35 includes a recipe storage unit 351 registered in advance, a nutrient component storage unit 352 which stores nutritional components of the meal in the recipe stored in the recipe storage unit 351, and a tableware and registration unit 33 registered in advance. And a tableware storage unit 353 for storing the weight and type of the registered tableware. Note that the recipe in the present embodiment includes information such as a finished image, food, its cooking method, and nutritional components. Further, the DB 35 includes information of the user, and for example, when registering the information of the dishes in the dish storage unit 353, the DB 35 is registered in association with the information of the user included in the DB 35 by the registration unit 33. Furthermore, management can be performed for each user by correlating and storing user information, the analysis result of the meal, the calorie intake, the nutritional components, and the like. In the present embodiment, the configuration shown in FIG. 4 is used, but the present invention is not limited to this. For example, the recipe storage unit 351 and the nutritional component storage unit 352 may be integrated, You may

Next, the tableware registration process will be described with reference to FIG. In the present embodiment, in order to measure the mass of the meal more accurately, the type and weight of the tableware are registered in the tableware storage unit 353 in advance. First, in step S 501, empty tableware is placed on the tray 1 to measure the mass of the tableware, and the camera 22 of the terminal 2 acquires an image of the tableware. Next, in step S502, the acquired mass and image are transmitted to the management server 3, and the image analysis unit 321 of the management server 3 analyzes the received image and specifies the type of tableware. At this time, mass analysis of dishes may be performed by the mass analysis unit 322 asynchronously.

Next, in step S503, the registration unit 33 determines, as a result of the image analysis by the image analysis unit 321, whether or not the dish has already been registered in the tableware storage unit 353. If the tableware is not registered in the tableware storage unit 353 (No), in step S504, the registration unit 33 determines the type and image of the tableware and the result of mass analysis of the tableware by the mass analysis unit 322 as the user information. It ties and registers in DB35 newly. On the other hand, when the tableware has already been registered (Yes), in step S505, the registration unit 33 associates the registration information of the tableware with the information of the user stored in the DB 35 and registers the table information in the DB 35. As the already registered dishes, for example, it is conceivable to manufacture original dishes. In this case, if the type and mass of tableware are measured in advance and registered in the tableware storage unit 353, a tag etc. is attached to the original tableware, and the image analysis unit 321 analyzes the tag etc. All you have to do is analyze your personal information without analyzing its mass.

Next, with reference to FIG. 6, the calorie calculation process according to the present embodiment will be described. First, in step S601, the camera 22 of the terminal 2 acquires an image of a meal. At this time, for example, in the case of multiple meals such as a staple food, a main dish, a side dish, and a soup, an image of the entire meal including all of them is acquired. Further, the mass of the meal measured in the tray 1 is acquired via the communication unit 24. Next, in step S602, the acquired image of the meal and the measured mass are transmitted to the management server 3 via the communication unit 24 of the terminal 2. Next, in step S603, the management server 3 receives the image and mass of the meal transmitted from the terminal 2 via the communication unit 34. Next, in step S604, the analysis unit 32 analyzes the received image and mass of the meal.

Next, in step S605, the management server 3 specifies a recipe based on the information stored in the DB 35 from the analysis result of step S604, performs a calorie analysis, and specifies the calories of each meal. Next, in step S606, the management server 3 transmits the result of the analysis in step S605 to the terminal 2 via the communication unit 34. Then, in step S 607, the terminal 2 receives the analysis result transmitted from the management server 3 via the communication unit 24. Next, in step S608, the terminal 2 displays the received analysis result on a display unit (not shown). As described above, the mass and the calorie of each meal taken by the user are accurately displayed.

Next, with reference to FIG. 7, the process in which the management server 3 analyzes the image and the mass to calculate the calorie will be described. This corresponds to the processing of steps S603 to S605 in FIG. First, in step S701, the image of the meal transmitted from the terminal 2 and the mass of the meal measured in the tray 1 are received. Next, in step S702, the image analysis unit 321 analyzes the received image of the meal. Next, in step S703, the mass analysis unit 322 analyzes the mass of the received meal. The processes in steps S702 and S703 may be performed asynchronously, and the order may be reversed. Next, in step S704, the recipe stored in the recipe storage unit 351 of the DB 35 is specified from the result of the image analysis in step S702, and the nutritional component stored in the nutrient component storage unit 352 based on the specified recipe. Identify Next, the calories of the meal are calculated from the mass analysis result in step S703 and the nutritional components specified in step S704.

Next, the process of image analysis in step S702 will be described with reference to FIG. First, in step S801, the image analysis unit 321 acquires an image of the entire meal including a plurality of meals transmitted from the terminal 2. Next, in step S802, the acquired image is analyzed to determine (specify) each meal. That is, when the staple food, the main dish, the side dish and the soup are included, the main food, the main dish, the side dish and the soup are divided from the acquired image. At this time, the tableware is specified from among the dishes stored in the tableware storage unit 353 from the image, also for the type of tableware in which the staple food, the main dish, the side dish, and the soup is placed. Next, in step S 803, a recipe that matches the recipe stored in the recipe storage unit 351 is specified from the image. That is, a recipe having an image that matches the divided staple food, main dish, side dish, and soup image is specified from the recipe storage unit 351.

Next, the process of mass analysis in step S703 will be described with reference to FIG. First, in step S 901, the mass analysis unit 322 acquires the mass measured by the tray 1 transmitted from the terminal 2. At this time, if it is a meal of multiple items such as a staple food, a main dish, a side dish, a soup, etc., the mass of the entire meal including all of the mass measured by the measurement units 1 (11) to 4 (14) To get Next, in step S902, the mass of each area of measurement unit 1 (11) to measurement unit 4 (14) is acquired. Next, in step S 903, the image analysis unit 321 obtains the mass of the dish specified by the image analysis from the dish storage unit 352, and subtracts the mass of the corresponding dish from the mass of each area to obtain the mass of the meal. .

For example, when the staple food is placed on the measuring unit 1 (11), the mass of the measuring unit 1 (11) is specified in step S902, and the image analysis unit 321 specifies the tableware from the image acquired by the terminal 2 By subtracting the mass of the tableware from the mass of the measurement unit 1 (11), the mass of the staple food itself that does not include the mass of the tableware is identified. Next, in step S904, as a result of subtraction in step S903, the mass of each meal (for example, main meal, main dish, side dish, soup) is calculated.

As described above, according to the present embodiment, it is possible to provide a management system that measures and manages calories with high accuracy by measuring the mass of a meal and acquiring the image. Although the camera and the display unit are provided in the terminal in the present embodiment, the present invention is not limited thereto. For example, the camera may be provided separately from the terminal, and the display unit may be provided in the tray. In this case, the user can grasp the calories on the display unit provided in the tray. That is, when the camera and the display unit are provided on the tray, an image is taken each time a meal is placed in the tray at the dining room etc., the mass is measured by the tray, calories are calculated in real time, and the calories are displayed. Thus, the user's calorie can be confirmed in real time.

Further, in the present embodiment, the method of calculating the calories of a meal from image analysis and mass analysis of the meal has been described, but the intake amount is not limited to the calories, and for example, each nutrient component such as salt, lipid and carbohydrate You may calculate In this case, by linking with the user's information, it is possible to manage the calories and nutritional components in the diet which the self has ingested regularly (for example, one week, one month, one year, etc.). Also, by analyzing and learning personal preferences based on such information, it is possible to perform nutritional management tailored to the individual, such as provision of appropriate recipes.

Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the present invention.

1 tray 3 management server 22 camera 31 control unit 32 analysis unit 35 DB

Claims

A management system for managing nutritional components of a user's diet through a network,
With tray which measures mass of meal including tableware,
An imaging device for capturing a meal including the tableware placed on the tray and acquiring an image;
A management server that manages the nutritional components;
Equipped with
The management server is
Storage means for storing the recipe of the meal;
Analysis means for analyzing the mass of the meal and the image;
Calculating means for specifying the recipe of the meal from the recipe stored in the storage means based on the analysis result of the analysis means, and calculating the nutritional component of the food corresponding to the specified recipe;
A management system comprising:
The analysis means
An image analysis unit that analyzes an image of a meal acquired by the imaging device;
Mass analysis means for analyzing the mass measured by the tray;
Including
The calculation means specifies a recipe storing the recipe of the meal by the storage means based on the analysis result of the image by the image analysis means, and specifies the recipe based on the analysis result of the mass by the mass analysis means The management system according to claim 1, wherein nutritional components of the food corresponding to a recipe are calculated.
The management server is
It further comprises registration means for registering the mass of the tableware for serving the meal,
The said mass analysis means calculates the mass of the meal which the said user ingests based on the mass of the meal measured by the said tray, and the mass of the tableware registered by the said registration means. Management system.
The management system according to claim 1, wherein the storage unit stores the nutritional component calculated by the calculation unit in association with information of a user who ingests the meal.
The management system according to claim 1, wherein the nutritional component contains at least a calorie, a salt, a lipid, a protein, and a carbohydrate.
The nutritional component of the user's diet performed in a management system including a tray for measuring the mass of the meal, an imaging device for capturing an image by photographing the meal placed on the tray, and a management server for managing calories Management method for managing
Analyzing the mass of the meal and the image;
A calculation step of specifying a recipe stored by the storage means of the management server based on an analysis result in the analysis step, and calculating a nutritional component of the food;
Management method characterized by having.