JP6368497B2 - Eating habit management program, eating habit management method, and eating habit management device - Google Patents

Description

  The present invention relates to a dietary life management program, a dietary life management method, and a dietary life management device.

  The need for dietary education is widely taken up as an effort to acquire various knowledge about food and various knowledge about food and judgment to choose food. In recent years, cases of lifestyle-related diseases such as obesity, diabetes, and hypertension are increasing due to disorder and bias in eating habits, and it is important to improve eating habits in order to extend life expectancy and reduce medical expenses. It has become.

  Conventionally, most of the guidance regarding eating habits is oral guidance from a doctor or the like. In addition, a device for measuring the number of chewing times during a meal is known as a method that can be measured by the user (diet) regarding his / her eating habits (see, for example, Patent Document 1).

Utility Model Registration No. 3106647

  However, even if verbal guidance is received from doctors, etc., it is difficult for the user to confirm their dietary habits and understand how their dietary life has improved, so the implementation of the guidance content continues for a long time. In many cases, it is difficult to get the guidance effect. In addition, it is not always easy for the chewing frequency measuring device to ensure continuous use and lead to an improvement in eating habits.

  The present invention has been made in view of the circumstances described above, and allows a user to easily check his / her eating habits and lead to improvement of eating habits, eating habits management method, and eating habits. It is an object to provide a management device.

In order to solve the above-mentioned problem, the eating habits management program according to the present invention uses a procedure A for causing the camera unit to acquire image data, and an image of the eating and drinking utensil from the image data acquired in the procedure A by image recognition processing. The procedure B for recognizing, the procedure C for detecting eating habits information, which is information related to the user's eating habits, from the images of the eating and drinking utensils recognized in the procedure B, and the eating habits information detected in the procedure C A dietary life management program for causing a computer including the camera unit to execute a dietary life management process including the procedure D to be collected and processed, and in the procedure B, the food and beverage transporting the food to the mouth An image of the food transport member is recognized, and in the procedure C, the food transport member is moved forward depending on whether the food transport member is placed on the table. Time that is placed on the table, and at least one information based on the placed on non time is characterized in that it is detected.

According to this invention, the eating and drinking utensils necessary for eating are recognized by the image recognition process, the user's eating habits information is detected, and the user's eating habits information is collected and processed. Therefore, the user can easily acquire information collected and processed regarding his / her eating habits, and can increase motivation for improving eating habits.
That is, it is possible to provide a dietary management device that allows the user to easily check his / her diet and lead to improvement of the diet.
Moreover, this invention can be implemented simply and cheaply only by installing the eating habits management program (application) in a smart phone or tablet type computer provided with a camera part.
In addition, the user can easily acquire the time during which the food transport member such as chopsticks is placed on the table (chopstick rest time) and the time when the member is not placed (chopstick holding time). . Therefore, the chopstick holding time corresponds to the time when the food and drink are often carried into the mouth and the food and drink are not chewed much, while the chopstick rest time stops carrying the food and drink into the mouth and bites the food and drink. it can be determined to correspond to many times are, the user, in the diet, that Do is possible to easily confirm their diet.
Also, dietary management program according to the present invention, a procedure A for obtaining the image data to the camera unit, from the image data acquired in the procedure A, Procedure B recognizes the image of the food equipment by the image recognition processing And, from the image of the eating tool recognized in the procedure B, the procedure C for detecting the eating habit information that is information related to the eating habits of the user, and the eating habit information detected in the procedure C is collected and processed. A dietary life management program for causing a computer having the camera unit to execute a dietary life management process having the procedure D. In the procedure C, the voice of the user during a meal is acquired through the microphone unit Voice information indicating the presence or absence of a predetermined keyword in the voice of the user during the meal is detected.
According to such a configuration, presence / absence of a predetermined keyword is detected in the voice during meal. Therefore, for example, by confirming the presence / absence of keywords such as “I will” or “Feast”, it is possible to improve, for example, the child's manners and encourage family members to eat.
Moreover, the eating habits management program according to the present invention includes a procedure A for causing the camera unit to acquire image data, and a procedure B for recognizing an image of the eating and drinking utensil from the image data acquired in the procedure A by an image recognition process. The procedure C for detecting eating habits information, which is information related to the user's eating habits, and the eating habits information detected in the procedure C are collected and processed from the images of the eating utensils recognized in the procedure B. A dietary life management program for causing a computer including the camera unit to execute a dietary life management process having a procedure D, wherein the image of the user eating from the image data is further recognized in the procedure B In step C, seating information indicating whether or not the user is seated during a meal is detected.
According to such a configuration, it is detected whether or not the user is seated during a meal. Therefore, for example, it can be confirmed whether or not the child sits firmly and eats, and it is possible to check that the child does not move around during the meal.

  Further, the present invention is characterized in that, in the procedure D, information based on the eating habits information is output through an output unit in a manner recognizable by the user.

  According to such a configuration, information based on dietary information can be displayed and output, for example, through voice through the output unit. Therefore, the user can confirm his / her diet quickly and easily.

  Further, the present invention is characterized in that in the procedure D, information based on the eating habits information processed in the past predetermined period is stored as history information in a storage means.

  According to such a configuration, the user can come into contact with history information about information based on dietary information stored in the storage unit. Therefore, the user can confirm his / her eating habits over a predetermined period in the past, and can further improve the eating habits.

  The present invention is characterized in that navigation information including advice on eating habits is provided to the user in accordance with information based on the eating habits information.

  According to such a configuration, by obtaining navigation information, the user can quickly correct the eating habits, for example, during a meal, and can further improve the eating habits.

  Further, the present invention is characterized in that, in the procedure C, mastication information received from a mastication number measuring device provided outside the computer for measuring the number of mastication times during a meal is detected.

  According to such a configuration, mastication information corresponding to the number of times of mastication of the user is further detected, and the number of times of mastication of the user is collected and processed. Therefore, the user can easily obtain information processed by collecting the number of chewing times during his / her meal.

  Further, the present invention is characterized in that the eating habit management process includes a procedure E for accepting input of information relating to a user including the eating habit information through an input means.

  According to such a configuration, the user, through the input means, dietary information such as food and beverage menu (raw materials) information, energy (calorie, calorie) information, ingredient information, user sex, age, disease history, etc. User registration information can be entered. Therefore, the user's eating habits can be confirmed in more detail, and the user's eating habits can be further improved.

  In addition, the present invention is characterized in that the eating habit management process includes a procedure F for communicating with at least one external device installed outside the computer.

  According to such a configuration, it is possible to communicate with an external device installed outside the computer and exchange various information.

  Further, according to the present invention, the external device includes a health information measuring device that measures health information that is information related to the health condition of the user, and the dietary management process is received from the health information measuring device. It has a procedure G for detecting health information.

  According to such a configuration, it is possible to collect and process health information received from various health information measuring devices such as a weight scale, a body composition meter, and a pedometer. Therefore, for example, it is possible to compare food consumption, energy consumption such as step count measurement values, body weight, BMI, body fat percentage, and the like, which can further contribute to improving the user's diet.

  In the procedure D, the information based on the dietary information and the information based on the health information are simultaneously displayed on the display output unit in the procedure D.

  According to such a configuration, the user can easily check information based on dietary information and information based on health information at the same time, and can further contribute to improvement of the user's dietary life.

  Further, according to the present invention, the external device includes a server computer having a database for storing information collected and processed in the procedure D, and information stored in the database is only for members registered in advance. It is accessible.

  According to such a configuration, since various information such as information based on dietary information and information based on health information can be stored in a server computer accessible to the member, the user becomes a server computer by becoming a member. It is possible to access history information about information based on past dietary information, for example. Therefore, the user can easily confirm his / her dietary life anytime and anywhere as long as he / she can access the server computer, and can further improve his / her dietary life.

  Further, the present invention is characterized in that the previously registered member includes a medical institution or a public institution that is permitted in advance.

  According to such a configuration, the user can receive appropriate guidance from an expert such as a doctor or a dietitian by visiting a medical institution or public institution that has been permitted in advance, thereby improving the eating habits more reliably. It becomes possible to do.

  According to the present invention, it is possible to provide a dietary management program, a dietary management method, and a dietary management device that allow a user to easily check their dietary habits and lead to an improvement in dietary habits.

1 is a perspective view showing an overall configuration of a dietary life management system according to a first embodiment of the present invention. It is a block diagram which shows the structure of the information communication terminal shown by FIG. It is a block diagram which shows the function of the eating habits management part in the control means shown by FIG. It is a block diagram which shows the structure of the mastication frequency measuring apparatus shown by FIG. It is an enlarged view of the operation panel of the information communication terminal for demonstrating the setting method of the target value regarding eating habits. It is a flowchart which shows the procedure of the operation | movement of the eating habits management part in an information communication terminal. It is a figure which shows an example of the display content of the operation panel in the middle of a meal. It is a figure which shows an example of the display content of the operation panel at the time of the end of a meal. It is a figure which shows the other example of the display content of the operation panel at the time of the end of a meal. It is a figure which shows the further another example of the display content of the operation panel at the time of the end of a meal. It is a figure which shows schematic structure of the eating habits management system which concerns on the 2nd Embodiment of this invention. It is a figure which shows schematic structure of the eating habits management system which concerns on the modification of the 2nd Embodiment of this invention. It is a figure which shows the whole structure of the eating habits management system which concerns on the 3rd Embodiment of this invention. It is a block diagram which shows the structure of the health information measuring device shown by FIG. It is a flowchart which shows the procedure of the operation | movement of the eating habits management part in the information communication terminal which concerns on 3rd Embodiment.

Embodiments of the present invention will be described in detail with reference to the drawings as appropriate.
In addition, in drawing shown below, the same referential mark shall be attached | subjected between the same members or corresponding members. In addition, the size and shape of the member may be schematically represented by being modified or exaggerated for convenience of explanation.

[First Embodiment]
FIG. 1 is a perspective view showing the overall configuration of a dietary management system 100 according to the first embodiment of the present invention. FIG. 2 is a block diagram showing the configuration of the information communication terminal 1 shown in FIG. FIG. 3 is a block diagram showing the function of the dietary life management unit 20 in the control means 2 shown in FIG. FIG. 4 is a block diagram showing a configuration of the mastication count measuring device 103 shown in FIG. FIG. 5 is an enlarged view of the operation panel 4 of the information communication terminal 1 for explaining a method for setting a target value related to eating habits.

  As shown in FIG. 1, a dietary life management system 100 according to the first embodiment of the present invention includes an information communication terminal 1 that functions as a dietary life management device. Moreover, the eating habits management system 100 is provided with the mastication frequency measuring device 103 for measuring the number of times (mastication frequency) that the user (diet) bites the food during the meal.

  The information communication terminal 1 is a computer including a camera unit 7 (see FIG. 2) such as a smartphone (multifunctional mobile phone) or a tablet computer. The information communication terminal 1 is placed on the dining table 108 in a state of being mounted on, for example, a cradle 107, and can be charged via the cradle 107. However, the cradle 107 is not necessarily required, and the information communication terminal 1 can be supported on an arbitrary instruction member and placed on the dining table 108.

  On the dining table 108, a place mat (place mat) 109 is laid, and on the place mat 109, a chopstick (a food / drink utensil, a food / drink transport member) 101 is placed. Here, the chopsticks 101 are placed on the chopstick rest 102. On the place mat 109, for example, a main food container 104a for receiving a main food such as rice, a main dish container (dish) 104b for receiving a main dish such as meat and fish, for example, a side dish for receiving a side dish such as vegetables. A food container (dish) 104c, for example, a beverage container 105 that contains a beverage such as alcohol or water, is further placed. Here, the beverage container 105 is placed on a coaster 106. The information communication terminal 1 is placed on the dining table 108 at a position where an image can be captured by the camera unit 7 described later. As the camera unit 7, a self-portrait camera that captures the side facing the operation panel 4 is used.

  As shown in FIG. 2, the information communication terminal 1 includes a control unit 2, a storage unit 3, an operation panel (output unit) 4, a microphone unit 5, a speaker unit (output unit) 6, a camera unit 7, a mobile communication interface 8, And a short-range communication interface 9.

  The control means 2 includes a CPU (Central Processing Unit) and a memory, and executes a predetermined program expanded in the memory. That is, the control means 2 exhibits the function of the eating habits management unit 20 (see FIG. 3) by expanding and executing the eating habits management program (application) installed in the storage means 3 in the memory and executing information. Overall control of the communication terminal 1 is performed.

  The memory | storage means 3 memorize | stores the information based on the eating habits information processed within the past predetermined period (for example, 2 weeks) as historical information. The predetermined period that is stored and held may be configured to be changeable. Here, information based on eating habits information whose storage period exceeds a predetermined period is automatically deleted by the control means 2. Moreover, the memory | storage means 3 has preserve | saved the dietary life management program as mentioned above. The eating habit management program may be installed in the storage unit 3 by the user via the Internet or a storage medium, for example, or may be installed in the storage unit 3 in advance before the information communication terminal 1 is shipped.

  The operation panel 4 is a touch panel for displaying various information or performing various inputs, and has a function as an output unit that performs display output of an image based on the various information. In addition, the operation panel 4 can be used as an input unit that receives input of information related to a user including dietary information. The user operates the operation panel 4 of the information communication terminal 1, through the information communication terminal 1, dietary information such as menu (raw materials) information of food and drink, energy (calorie, calorie) information, component information, etc. User registration information such as gender, age, and illness history can be entered.

  The microphone unit 5 is used for inputting voice. The speaker unit 6 outputs sound and has a function as an output unit that outputs sound based on various types of information. The camera unit 7 acquires image data by reading an image with an imaging element such as a CCD image sensor.

  The mobile communication interface 8 is an interface for performing mobile communication by connecting to a mobile communication network using radio waves in a predetermined frequency band. The near field communication interface 9 is an interface for performing near field communication. Here, infrared communication is used as near field communication. However, near field communication may be either wired communication using cables or wireless communication using radio waves or infrared rays.

  As shown in FIG. 3, the control means 2 has the function of the eating habit management unit 20 by developing the eating habit management program stored in the storage means 3 in the memory. The dietary life management unit 20 includes an image processing unit 21, a dietary life information detection unit 22, a dietary life information processing unit 23, a display output control unit 24, and an audio output control unit 25.

  The image processing unit 21 recognizes an image such as a food and drink utensil from the image data acquired by the camera unit 7 by image recognition processing. The image recognition process is performed, for example, by performing pattern matching that measures the degree of matching with a specific pattern (shape) given in advance. Note that recognition of an image of a food / drink utensil or the like may be performed by previously determining a place where the food / drink utensil or the like is placed on the table 108 and using the information on the place. For example, the chopsticks 101 are a pair of rod-like members placed in front of the user (dinner), and image recognition is easy. It is preferable that the main food container 104a, the main dish container 104b, the side dish container 104c, and the beverage container 105 are arranged in advance on the table 108 and further image-recognized by pattern matching or the like. In addition, in order to reliably perform image recognition of the eating and drinking utensils, a dedicated eating and drinking utensil having a predetermined shape may be prepared, which is preferable when the eating habit management program is executed in a facility such as a hospital.

  The eating habits information detection unit 22 detects eating habits information, which is information related to the eating habits of the user, from the recognized images of eating and drinking utensils. Based on whether or not the chopsticks 101 are placed on the table 108, it is based on at least one of the time during which the chopsticks 101 are placed on the table 108 (chopstick placement time) and the time when the chopsticks 101 are not placed (chopstick holding time). Information is detected. This detection information corresponds to one of eating habits information that is information relating to the eating habits of the user.

  In addition, the present invention relates to food and drink supported by food and drink support tools such as a main food container 104a, a main dish container (dish) 104b, a side dish container (dish) 104c, and a beverage container 105 placed on the table 108. The food / beverage information detection information, which is information, corresponds to one of the dietary information that is information related to the user's dietary life. And food and beverage information, such as the consumption of the food and drink currently supported by the food and drink support tool, can be detected from the change of the image of the recognized food and drink support tool, for example.

  Further, the number of times the user lifts the beverage container 105 such as a glass from the coaster 106 or places it on the coaster 106 can be detected based on the detection information of the food / drink information. If the number of times is greater than the predetermined number in step S8 to be described later, a message to that effect may be output through the speaker unit 6 to prevent excessive drinking of alcohol. In this case, the user can set the target value of the number of times the glass is lifted and the time interval of the lifting operation in advance in the information communication terminal 1 so that the drinking pitch does not become fast, and navigation that allows drinking according to that is possible. It becomes. In addition, when a drink container 105 such as a hot water bowl is placed on the coaster 106 and eats, the number of times the hot water bowl is lifted and the time interval of the lifting operation, for example, so that tea is divided into 10 meals, for example. The target value can be set, and it becomes possible to make a habit of slowly chewing and eating while drinking tea.

  The eating habit information processing unit 23 collects and processes the detected eating habits information. The display output control unit 24 performs control to cause the operation panel 4 to display and output an image. The audio output control unit 25 performs control for causing the speaker unit 6 to output audio.

  In the present embodiment, the image processing unit 21 further recognizes an image of the face of the user (person) who eats from the image data acquired by the camera unit 7, and the dietary information detection unit 22 detects the user during the meal. Seating information indicating whether or not is seated. Here, the seating information during the meal corresponds to one of the eating habits information that is information related to the eating habits of the user.

  In addition, the eating habits information detection unit 22 acquires the voice during the meal through the microphone unit 5 and checks whether or not there is a predetermined keyword in the voice during the meal, for example, “you receive” or “feast”. The voice information shown is detected. Here, the audio information during the meal corresponds to one of the eating habits information that is information related to the eating habits of the user.

  As shown in FIG. 4, the mastication frequency measuring device 103 has a mastication information acquisition unit 103a and a short-range communication interface 103b. The mastication information acquisition unit 103a detects and acquires mastication information corresponding to the number of mastications of the user. Here, the mastication information corresponds to one of eating habits information that is information related to the eating habits of the user.

  The mastication information acquisition unit 103a detects the movement of the lower jaw associated with the mastication movement to acquire mastication information, detects the muscle activity for jaw movement and acquires the mastication information, and deforms the ear canal during mastication To acquire mastication information by detecting mastication sound, and to acquire mastication information by detecting a mastication signal by extracting a specific frequency component from the output signal of a piezoelectric element attached to the temporal muscle with a hair band, etc. Various ones can be used.

  The near field communication interface 103b is the same as the near field communication interface 9. The mastication number measuring device 103 and the information communication terminal 1 are configured to be capable of transmitting information via the short-range communication interface 103b and the short-range communication interface 9.

  As shown in FIG. 5, the user can set target values related to eating habits using the operation panel 4 in the information communication terminal 1. By operating the operation panel 4, the user shifts the operation mode to the setting mode and inputs a target value. Examples of the target value include a target number of chewing times (for example, per meal), a target chopstick rest time (for example, per meal), a maximum allowable continuous chopstick holding time, and the like. In addition, the user operates the operation panel 4 to set the operation mode, the execution mode for collecting and processing dietary information, the setting mode for setting various information such as target values, the information based on the dietary information, and the like It is possible to sequentially shift to a display mode for displaying various types of information.

  The information communication terminal 1 in which the eating habit management program according to the present embodiment is installed includes an eating information processing function for collecting and processing eating information such as detection information such as chopstick rest time and chopstick holding time, and chewing information, A navigation function that provides users with navigation information including advice on eating habits according to information based on living information, and a data storage function that stores information based on eating habits information processed within a predetermined past period as history information Have. Note that the user can set the operation panel 4 not to execute a specific function such as a navigation function by operating the operation panel 4.

  The operation of the dietary life management unit 20 in the information communication terminal 1 configured as described above will be described with reference to FIGS. FIG. 6 is a flowchart showing an operation procedure of the eating habits management unit 20 in the information communication terminal 1. FIG. 7 is a diagram illustrating an example of display contents of the operation panel 4 during a meal. FIG. 8 is a diagram illustrating an example of display contents on the operation panel 4 at the end of the meal. FIG. 9 is a diagram showing another example of the display contents on the operation panel 4 at the end of the meal. FIG. 10 is a diagram showing still another example of the display content of the operation panel 4 at the end of the meal.

  As shown in FIG. 6, the control means 2 of the information communication terminal 1 first determines whether or not the user's meal has started (step S1). The start of a meal is determined by, for example, whether or not the user has performed an operation for starting the collection and processing of eating habits information through the operation panel 4. When it is determined that the meal has not yet started (step S1: No), the control means 2 stands by as it is.

  For example, before the start of a meal, input of information about a user including dietary information is accepted through the operation panel 4 (procedure E).

  When it is determined that the meal has started (step S1: Yes), the control unit 2 causes the camera unit 7 to acquire image data (step S2; procedure A). Moreover, the control means 2 measures meal time by measuring the elapsed time from the meal start using a built-in timer (not shown).

  In step S3 (procedure B), the control means 2 recognizes the image of the chopsticks 101 from the image data acquired by the camera unit 7 by image recognition processing.

  In step S4 (procedure C), the control means 2 measures at least one of the chopstick placement time and the chopstick holding time depending on whether or not the chopstick 101 is placed on the dining table 108 from the recognized image of the chopstick 101. Detect as dietary information.

  In step S4, the chopstick holding time is acquired. That is, the control means 2 calculates and obtains the chopstick holding time by subtracting the chopstick rest time measured in step S3 from the meal time measured in step S2.

  In step S5 (procedure C), detection of mastication information is performed. That is, the control means 2 receives and detects mastication information corresponding to the number of mastications of the user from the mastication frequency measuring device 103 as the user's dietary information.

  In step S6, detection of other dietary information is performed. That is, the control means 2 recognizes images of food and drink support tools such as the main food container 104a, the main dish container 104b, the side dish container 104c, and the beverage container 105 from the image data acquired by the camera unit 7. It recognizes by processing, and detects food and drink information which is information on food and drink received and supported by the food and drink support tool (procedure C). Moreover, the control means 2 detects the seating information in a meal and the audio | voice information in a meal in addition to food / beverage information as other dietary information (procedure C).

  And the control means 2 displays the information based on the eating habits information in a meal on the operation panel 4 (step S7; procedure D). In this embodiment, the eating habit information includes detection information such as chopstick rest time and chopstick holding time, mastication information, and food and drink information. Here, the information based on dietary information refers to dietary information or information derived from dietary information.

  As shown in FIG. 7, in the present embodiment, the operation panel 4 displays the number of chewing times, the chopstick holding time, and the chopstick rest time, and changes every moment. Here, by showing the user how to use the eating habits management program in advance, the chopstick holding time corresponds to the time when the food is often carried into the mouth and the food is not chewed much, while the chopstick rest It can be determined that the time corresponds to a time when the person often stops eating the food and drinks and bites the food and drink. Further, for example, the consumption of consumed food and drinks consumed, the amount of energy consumed, and the like can be displayed on the operation panel 4.

  In step S8 (procedure D), navigation information is output. That is, the control means 2 provides the user with navigation information including advice on eating habits according to the information based on the obtained eating habits information. Specifically, the control unit 2 causes navigation information to be output to at least one of the operation panel 4 and the speaker unit 6. If it does in this way, a user can correct eating habits quickly, for example during a meal by obtaining navigation information.

  The navigation information includes, for example, a message “Please put chopsticks” when the continuous chopstick holding time exceeds the preset allowable continuous chopstick holding time. This means that the chopsticks 101 are placed on the table 108 and chew food and drink well. For example, a message “put chopsticks and chew well” may be output. Also, other messages may be output according to the chopstick rest time, chopstick holding time, meal time, number of chewing times, and food / beverage information. In addition, navigation information for navigating the timing of mastication may be output in order to increase the number of mastications. The output of the navigation information in this case includes output of various information such as rhythm, music, video, etc. and display.

  In order to show the order of eating to the user, the food and drink support tool that receives the food and drink instructed to eat may be configured to be shown to the user through the operation panel 4 by an image, characters, or the like. For example, the side dish container 104c into which the vegetable is received may be instructed according to a diet program that eats mainly from the vegetable. Or even if these are repeatedly instructed in order so that the user eats the food and drink received in the main dish container 104a, the main dish container 104b, the side dish container 104c, and the beverage container 105 little by little in order. Good.

  Further, when it is determined that the food and drink received and supported by the main dish container 104a, the main dish container 104b, and the side dish container 104c are fast, a message such as "I eat too much early" is output. May be. In addition, when it is determined that the beverage container 105 is drinking many alcoholic beverages based on the decrease rate of the beverage received in the beverage container 105, a message such as “too much drinking” is output. May be. For example, the consumption of food and drink can be detected from the change in the recognition image of the food and drink support tool. Further, the content of the message can be changed based on the age of the user. For example, for children, a message to speed up the meal is output so that the meal while playing can be constrained and concentrated, and for adults, a message to slow the meal from a diet perspective May be output.

  Furthermore, in addition to messages according to chopstick rest time, chopstick holding time, meal time, number of chewing times, and messages according to food and drink information, messages corresponding to seating information during meals and audio information during meals can be output. For example, when it is determined from the seating information during the meal that the user has not been seated away from the table 108 for a predetermined time or longer, a message such as “Let's sit down” can be output.

  Note that the processing order of steps S2 to S4, step S5 and step S6, and steps S7 and S8 may be changed, or may be executed simultaneously.

  In step S9, the control means 2 determines whether or not the user's meal has ended. The end of the meal is determined based on, for example, whether or not the user has performed an operation for ending the collection and processing of eating habits information through the operation panel 4. When it is determined that the meal has not ended (step S9: No), the control unit 2 returns the process to step S2, and steps S2 to S9 are repeated.

  When it is determined that the meal has ended (step S9: Yes), information based on the eating habit information is stored (step S10; procedure D). That is, the control means 2 stores information based on dietary information in the storage means 3. In the present embodiment, information based on the total number of chewing times during a meal, the total meal time for a meal, the total chopstick rest time during a meal, the total chopstick holding time during a meal, and food and drink information is stored in the storage means 3. User registration information is also stored in the storage means 3. Note that other information such as meal time may be stored. Information based on dietary information in the storage means 3 is stored as history information for a predetermined period (for example, two weeks). Further, as history information, for example, information such as irregular dinner times or not eating much vegetables for dinner may be guided and stored.

  In this way, the user can contact history information about information based on dietary information stored in the storage unit 3.

  In step S11 (procedure D), the control means 2 causes the operation panel 4 to display information based on the eating habits information after the meal ends. The information based on the displayed dietary information includes the total number of chewing times during a meal, the total meal time for one meal, the total chopstick rest time during a meal, the total chopstick holding time during a meal, information based on food and beverage information, and the like. For example, as shown in FIG. 8, the total meal time for one meal and the total number of chewing times during the meal are displayed on the operation panel 4. Therefore, the user can quickly and easily confirm his / her eating habits after the meal is finished.

  In step S12, the control means 2 determines whether or not the processing shown in FIG. The end of the process is determined based on, for example, whether or not the user has performed a predetermined end operation through the operation panel 4. When it is determined that the process has not ended (step S12: No), the control unit 2 returns the process to step S11, shifts to the display mode, and repeats steps S11 and S12.

  At this time, the user can change the display content displayed on the operation panel 4 by operating the operation panel 4. For example, as shown in FIG. 9, the target mastication frequency achievement degree (%) and the target chopstick rest time achievement degree (%) may be displayed on the operation panel 4. For example, as shown in FIG. Information based, for example, the total number of chewing times during a meal may be displayed in a graph. In FIG. 10, the total number of chewing times for breakfast, lunch, and dinner is displayed in a time series over recent days. Thus, the display content displayed on the operation panel 4 can be selected from a plurality of types, and the user can more easily confirm his / her diet.

  On the other hand, when it is determined in step S12 that the process has ended (step S12: Yes), the control unit 2 ends the process shown in FIG.

  As described above, the eating habit management program according to the present embodiment recognizes the image of the eating and drinking utensil by the image recognition process from the procedure A (step S2) in which the camera unit 7 acquires the image data and the acquired image data. Procedure B (Step S3) to be performed, Procedure C (Step S4) for detecting eating habits information that is information related to the user's eating habits, and the detected eating habits information are collected from the recognized eating and drinking utensil images. The information communication terminal 1, which is a computer including the camera unit 7, performs a dietary life management process having the procedure D (steps S 7, S 8, S 10, S 11) to be processed.

Therefore, according to the present embodiment, the chopstick rest 102 and the like that are necessary for eating are recognized by the image recognition process, the user's eating habits information is detected, and the user's eating habits information is collected. Processed. Therefore, the user can easily acquire information collected and processed regarding his / her eating habits, and can increase motivation for improving eating habits. That is, the user can easily confirm his / her eating habits, which can lead to an improvement in eating habits.
Moreover, this embodiment can be implemented simply and inexpensively by simply installing a dietary management program (application) on a smartphone or tablet computer provided with the camera unit 7.

  Moreover, in this embodiment, the information based on eating habits information is output through at least one of the operation panel 4 and the speaker part 6 in the aspect which a user can recognize. Thereby, information based on eating habits information can be displayed and output, for example, by voice. Therefore, the user can confirm his / her diet quickly and easily.

  Moreover, in this embodiment, the information based on the dietary information processed in the past predetermined period is memorize | stored in the memory | storage means 3 as historical information. Thereby, the user can contact history information about information based on the eating habit information stored in the storage unit 3. Therefore, the user can confirm his / her eating habits over a predetermined period in the past, and can further improve the eating habits.

  In the present embodiment, navigation information including advice on eating habits is provided to the user in accordance with information based on eating habits information. If it does in this way, it will become possible for a user to correct eating habits quickly, for example during a meal by obtaining navigation information, and can improve eating habits more.

  Further, in the present embodiment, an image of the chopsticks 101 carrying food and drink to the mouth is recognized, and the time for which the chopsticks 101 are placed on the table 108 depending on whether the chopsticks 101 are placed on the table 108, And information based on at least one of the times when the information is not placed is detected. In this way, the user can easily obtain the time when the chopsticks 101 are placed on the table (chopstick placement time) and the time when the chopsticks 101 are not placed (chopstick holding time). Therefore, the chopstick holding time corresponds to the time when the food and drink are often carried into the mouth and the food and drink are not chewed much, while the chopstick rest time stops carrying the food and drink into the mouth and bites the food and drink. It is possible to determine that this time corresponds to a time that is often present, and the user can easily confirm his / her eating habits during a meal.

  Moreover, in this embodiment, the mastication information received from the mastication number measuring device 103 provided outside the information communication terminal 1 for measuring the number of mastication times during meals is detected. If it does in this way, while the mastication information according to the number of times of a user's mastication is detected, the number of times of mastication of a user is collected and processed. Therefore, the user can easily obtain information processed by collecting the number of chewing times during his / her meal.

  In addition to the mastication count measuring device 103, it is also possible to attach a detection means such as a microphone or a strain sensor that detects the user's swallowing action in the vicinity of the throat. In this case, it is possible to detect information about how many times the food has been swallowed, and the number of chewing times until the food is swallowed instead of the operation of counting the number of chewing times while the chopsticks 101 are placed on the table 108. Can be counted. Therefore, the number of times can be displayed on the operation panel 4, and when the number of times is less than the predetermined number, a message to that effect can be output through the speaker unit 6. In addition, the user can set a target value for the number of times of chewing until the user swallows food in the information communication terminal 1 in advance, and the habit of eating food well can be made.

  Moreover, in this embodiment, food / drink support tools such as the main food container 104a, the main dish container 104b, the side dish container 104c, and the beverage container 105 that support food and drink from the image data acquired by the camera unit 7 are used. An image is recognized, and food and drink information that is information related to food and drink received and supported by the food and drink support tool is detected. If it does in this way, it will become possible for a user to acquire easily information which collected foods information, such as consumption of food and drinks, and processed it as information about food and drinks eaten and eaten in the case of a meal. . Therefore, the user's eating and drinking information can be confirmed, and the user's eating habits can be further improved.

  Moreover, in this embodiment, the input of the information regarding the user containing eating habits information is received through the operation panel 4 as an input means. In this way, the user, through the operation panel 4, dietary information such as food and beverage menu (raw materials) information, energy (calorie, calorie) information, ingredient information, and the user's sex, age, disease history, etc. User registration information can be entered. Therefore, the user's eating habits can be confirmed in more detail, and the user's eating habits can be further improved.

  Moreover, in this embodiment, the audio | voice during a meal is acquired through the microphone part 5, and the audio | voice information which shows the presence or absence of the predetermined keyword in the audio | voice during a meal is detected. Therefore, for example, by confirming the presence / absence of keywords such as “I will” or “Feast”, it is possible to improve, for example, the child's manners and encourage family members to eat. It should be noted that the determination of the start of the meal in step S1 is determined by the utterance of a keyword indicating the start of the meal such as “I will receive”, for example, and the determination of the end of the meal in step S12 is the keyword indicating the end of the meal such as “the feast” It may be configured to be determined by utterance.

  Moreover, in this embodiment, the image of the user who eats is further recognized from the image data acquired by the camera part 7, and the seating information which shows whether the user is seated during a meal is detected. Therefore, for example, it can be confirmed whether or not the child sits firmly and eats, and it is possible to check that the child does not move around during the meal.

  The information communication terminal 1 may be a computer having a camera unit, and may be a normal mobile phone, a computer such as a tablet computer or a notebook PC (personal computer), a communication terminal, a display terminal, or the like. . For example, an order tablet such as a family restaurant has a camera unit, and it is also possible to display and output recorded data (food life information) during a meal on the operation panel of the order tablet. It is also possible to communicate from the order tablet to the cash register terminal and print out the recorded data (meal life information) during the meal on the receipt.

[Second Embodiment]
FIG. 11 is a diagram showing a schematic configuration of a dietary life management system 100a according to the second embodiment of the present invention. FIG. 12 is a diagram showing a schematic configuration of a dietary life management system 100b according to a modification of the second embodiment of the present invention.
Next, regarding the eating habit management system 100a according to the second embodiment, points that differ from the eating habit management system 100 according to the first embodiment described above will be described, and description of common points will be omitted as appropriate.

  As shown in FIG. 11, the dietary life management system 100a according to the second embodiment of the present invention is configured such that the information communication terminal 1 is placed on the dining table 108 with the camera unit 7 facing upward, and as a support member. Is different from the first embodiment in that the stand 11 is placed on the dining table 108 and the convex mirror 12 is supported by the stand 11 so as to be positioned above the camera unit 7. The camera unit 7 is a self-portrait camera that captures the side to which the operation panel 4 faces, and the information communication terminal 1 is placed on the dining table 108 with the operation panel 4 and the camera unit 7 facing up. In addition, in FIG. 11, illustration is abbreviate | omitted about the dining table 108 shown in FIG. 1, the food-drinks etc. which are mounted on the dining table 108, and the chewing frequency measuring device 103.

  In the second embodiment, the camera unit 7 can read an omnidirectional image around the information communication terminal 1 reflected on the convex mirror 12. Therefore, according to the third embodiment, in addition to the effects similar to those of the first embodiment described above, in addition to a plurality of users U1 and U2 (in FIG. 11, there are two users but three users). It may be possible to detect movements and eating habits information and collect and process them. Thereby, the information based on the eating habits information of a plurality of users U1 and U2 can be displayed and output on the operation panel 4, for example.

  Moreover, as shown in the eating habits management system 100b according to the modified example of the second embodiment of FIG. 12, as the support member, a bowl 13 placed on the dining table 108 and having a plurality of legs is used. You may comprise so that the convex mirror 12 may be supported by the upper part of the collar 13 so that it may be located above the camera part 7. FIG.

[Third Embodiment]
FIG. 13 is a diagram showing an overall configuration of a dietary life management system 100c according to the third embodiment of the present invention. FIG. 14 is a block diagram showing a configuration of the health information measuring apparatus 111 shown in FIG.
Next, the eating habits management system 100c according to the third embodiment will be described with respect to differences from the eating habits management system 100 according to the first embodiment described above, and description of common points will be omitted as appropriate.

  As shown in FIG. 13, the dietary management system 100c according to the third embodiment of the present invention is further provided with a health information measuring device 111, a PC 112, a server computer 113, and a medical institution 114. This is different from the first embodiment. In FIG. 13, the table 108 shown in FIG. 1 and the eating and drinking tools placed on the table 108 are not shown.

  As shown in FIG. 14, the health information measuring device 111 is a device that measures health information that is information related to a user's health status. Examples of the health information measuring device 111 include a weight scale, body composition meter (measurement of body weight, BMI, body fat percentage, muscle mass, internal fat, basal metabolism, estimated bone mass, etc.), pedometer, blood pressure monitor, thermometer, A urine sugar meter, an alcohol sensor, a breath checker, a hypnosis meter, a biological sensor and the like can be mentioned.

  The health information measuring device 111 includes a health information acquisition unit 111a and a short-range communication interface 111b. The health information acquisition unit 111a detects health status of the user and provides health information. The near field communication interface 111b is the same as the near field communication interface 9.

  As shown in FIG. 13, the PC 112 has storage means (not shown) that stores information from the dietary life management unit 20 in the control means 2 of the information communication terminal 1. Information such as dietary information, health information, and user registration information stored in the storage means 3 of the information communication terminal 1 by connecting the information communication terminal 1 and the PC 112 with, for example, the cable 118 or the short-range communication interface 9. Can be stored in the storage means of the PC 112. Information such as dietary information, health information, and user registration information can be uploaded from the PC 112 to the server computer 113 via the network 115 such as the Internet.

  Information such as dietary information, health information, and user registration information may be configured to be uploaded from the information communication terminal 1 to the server computer 113 via the network 116 such as a mobile communication network.

  The server computer 113 has a database 113a for storing information such as dietary information, health information, and user registration information from the information communication terminal 1. Information stored in the database 113a can be accessed only by members registered in advance. In this case, for example, an ID and a password are assigned to each member. The members registered in advance include a medical institution 114 that is permitted in advance, and the medical institution 114 browses information stored in the database 113a of the server computer 113 via the network 117 such as the Internet. can do. In addition to or in addition to the medical institution 114, public institutions such as health centers may be included in the members registered in advance.

FIG. 15 is a flowchart showing the procedure of the operation of the dietary life management unit 20 in the information communication terminal 1 according to the third embodiment.
Steps S1 to S6, S9, and S12 in FIG. 15 are the same as steps S1 to S6, S9, and S12 in FIG. 6 (first embodiment), respectively, and thus description thereof is omitted.

  In step S6a (procedure G), health information is detected. That is, the control unit 2 detects the user's health information received from the health information measuring device 111.

  In step S7a (procedure D), information based on dietary information during meals and information based on health information are displayed on the operation panel 4. Note that at least one of information based on dietary information during meals and information based on health information may be displayed.

  In step S8a (procedure D), navigation information is output. In this embodiment, the chopstick rest time, chopstick holding time, meal time, message corresponding to the number of chewing times, message corresponding to food / drink information, In addition to messages corresponding to seating information and audio information during meals, messages corresponding to health information can be output. For example, a message such as “Let's take care of body fat” may be output.

  In step S10a (procedure D), in addition to information based on dietary information including food and drink information and user registration information, the control means 2 further includes information based on seating information during meals as other dietary information and Information based on voice information during meals (information on presence / absence of keywords and occurrence frequency) and information based on health information are stored in the storage means 3.

  In step S11a (procedure D), the control means 2 causes the operation panel 4 to display information based on dietary information after the end of meal and information based on health information. Note that one of information based on dietary information after the end of meal and information based on health information may be displayed.

  Thus, according to 3rd Embodiment, in addition to having the same effect as 1st Embodiment mentioned above, there exist the following effects.

  That is, in the third embodiment, the information communication terminal 1 that functions as a dietary life management device includes a PC 112 or a server computer 113 as an external device installed outside the information communication terminal 1, a cable 118, and a short-range communication interface. 9. Communicate via communication means such as the mobile communication interface 8 (procedure F). In this way, the information communication terminal 1 can communicate with the PC 112 and the server computer 113 to exchange various information.

  In the third embodiment, the information communication terminal 1 detects the health information received from the health information measuring device 111 that measures health information that is information related to the user's health state. In this way, for example, health information received from various health information measuring devices 111 such as a weight scale, a body composition meter, and a pedometer can be collected and processed. Therefore, for example, it is possible to compare food consumption, energy consumption such as step count measurement values, body weight, BMI, body fat percentage, and the like, which can further contribute to improving the user's diet.

  In the third embodiment, information based on dietary information and information based on health information are simultaneously displayed and output on the operation panel 4. Therefore, the user can easily check information based on dietary information and information based on health information at the same time, and can further contribute to improvement of the user's dietary life.

  Further, since the information from the information communication terminal 1 can be stored in the PC 112, the user can use the PC 112 to contact history information about information based on past dietary information, for example. Therefore, the user can easily confirm his / her dietary habits in the past, and can further improve the dietary habits.

  Further, since the information from the information communication terminal 1 can be stored in the server computer 113 accessible to the member, the user accesses the server computer 113 by becoming a member, and is based on, for example, past dietary information. It is possible to contact history information about information and the like. Therefore, the user can easily check his / her eating habits anytime and anywhere as long as the server computer 113 can be accessed, and the eating habits can be further improved.

  In addition, the members registered in advance include medical institutions 114 and public institutions that are permitted in advance. Therefore, the user can receive appropriate guidance from specialists such as doctors and dietitians by visiting a medical institution 114 or a public institution that has been permitted in advance, and can improve her diet more reliably. Become.

  Also in the third embodiment, the dietary information and health information of a plurality of users may be detected and collected and processed in the same manner as in the second embodiment. Of course it is good.

  As mentioned above, although this invention was demonstrated based on embodiment, this invention is not limited to above-described embodiment, Various modifications are included. For example, the above-described embodiment has been described in detail for easy understanding of the present invention, and is not necessarily limited to one having all the configurations described. Further, a part of the configuration of an embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of an embodiment. In addition, it is possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.

  For example, in place of the chopsticks 101, a food transport member such as cutlery (knives, forks, spoons) may be used, and a cutlery rest (cutlery holder) may be used instead of the chopstick rest 102.

  Moreover, although the information communication terminal 1 which functions as a eating habits management apparatus is assumed to be installed in each home, the present invention is not limited to implementation in such a form. For example, a food education restaurant suitable for installing and using the information communication terminal 1 functioning as a dietary life management device is established, and the user prints out the record data (dietary information) of the meal at the cash register terminal (print output) It is also possible to carry out the information in such a manner that the data is acquired by, for example. In addition, on a paper sheet such as a receipt printed out at a cash register terminal of a food education restaurant, advice related to the future food life should be written in accordance with the record data (food life information) of the meal at the food education restaurant. May be. Furthermore, in a food education restaurant, processing is performed so that points (the points given when paying for goods and services, etc.) are earned according to the number of chewing times during the meal and the chopstick rest time (equivalent to the time for chewing food). May be. Therefore, for example, the user can receive a discount using the accumulated points when paying for the price of other products, etc., and can lead to the habit of chewing well during meals.

  Moreover, although the said embodiment demonstrated the case where various food-drinks etc. were mounted on the dining table 108, this invention is not limited to this. For example, a lunch purchased at a store such as a convenience store may be placed on the dining table 108, and the information communication terminal 1 may be placed on the dining table 108 at a position where the lunch can be captured by the camera unit 7. . In this case, the arrangement of staple foods, main dishes, side dishes, etc. in the lunch box may be determined in advance, and may be provided as, for example, a diet lunch box suitable for performing image recognition processing.

  In addition, the operation panel 4 displays buttons for linking to websites (homepages) of specialists such as doctors, nutritionists, professors, teachers, etc. You may be comprised so that instruction information may be obtained. The guidance information includes diet information, educational information such as how to hold chopsticks, manner information on meals, and the like. The guidance information may be displayed and output on the operation panel 4 or may be output as voice through the speaker unit 6. In addition, for example, when a user obtains guidance information from an expert and the dietary life management program is executed, various information such as information based on dietary information and information based on health information is displayed on the website of the expert. It may be automatically uploaded, collected and processed, and constructed as statistical data. Such statistical data can be published on the Web with the permission of the user. In addition, based on various information such as information based on uploaded dietary information and information based on health information, scoring and advice information is returned to the user's information communication terminal 1 and provided to the user. Also good.

1 Information communication terminal (computer)
2 Control means 3 Storage means 4 Operation panel (output unit, input means)
5 Microphone part 6 Speaker part (output part)
DESCRIPTION OF SYMBOLS 7 Camera part 8 Mobile communication interface 9 Near field communication interface 20 Dietary life management part 21 Image processing part 22 Dietary life information detection part 23 Dietary life information processing part 24 Display output control part 25 Audio | voice output control part 101 Chopsticks (Eating and drinking utensils, eating and drinking Material transporting materials)
103 Chewing Count Measuring Device 104a Main Food Container (Eating and Drinking Tools, Food and Drink Supporting Tools)
104b Main vegetable container (food and drink, food and beverage support)
104c Side dish container (food and drink, food and beverage support)
105 Beverage Containers (Eating and Drinking Tools, Food and Drink Supporting Tools 108 Dining Table 111 Health Information Measuring Device (External Device)
112 PC (external device)
113 Server computer (external device)
114 medical institutions

Claims (19)

Procedure A for causing the camera unit to acquire image data;
From the image data acquired in the procedure A, a procedure B for recognizing an image of a food and beverage utensil by an image recognition process;
Procedure C for detecting eating habits information, which is information related to a user's eating habits, from the image of the eating and drinking utensil recognized in the procedure B;
Procedure D for collecting and processing the dietary information detected in Procedure C;
A dietary life management program for causing a computer comprising the camera unit to execute a dietary life management process having:
In the procedure B, an image of a food transport member that transports food and drink to the mouth is recognized,
In the procedure C, depending on whether or not the food transport member is placed on the table, at least the time when the food transport member is placed on the table and the time when it is not placed Eating habits management program characterized in that information based on one side is detected. Procedure A for causing the camera unit to acquire image data;
From the image data acquired in the procedure A, a procedure B for recognizing an image of a food and beverage utensil by an image recognition process;
Procedure C for detecting eating habits information, which is information related to a user's eating habits, from the image of the eating and drinking utensil recognized in the procedure B;
Procedure D for collecting and processing the dietary information detected in Procedure C;
A dietary life management program for causing a computer comprising the camera unit to execute a dietary life management process having:
In the procedure C, the voice of the user during a meal is acquired through a microphone unit, and voice information indicating presence / absence of a predetermined keyword in the voice of the user during the meal is detected. Eating habits management program. Procedure A for causing the camera unit to acquire image data;
From the image data acquired in the procedure A, a procedure B for recognizing an image of a food and beverage utensil by an image recognition process;
Procedure C for detecting eating habits information, which is information related to a user's eating habits, from the image of the eating and drinking utensil recognized in the procedure B;
Procedure D for collecting and processing the dietary information detected in Procedure C;
A dietary life management program for causing a computer comprising the camera unit to execute a dietary life management process having:
In the procedure B, the image of the user eating from the image data is further recognized,
In the procedure C, seating information indicating whether or not the user is seated during a meal is detected. The dietary life according to any one of claims 1 to 3 , wherein in the procedure D, information based on the dietary life information is output through an output unit in a manner recognizable by the user. Management program. In the procedure D, the information based on the diet information processed in the past within a predetermined period, according to any one of claims 1 to 4, characterized in that it is stored in the storage unit as history information Eating habits management program. In the procedure D, depending on the information based on the diet information, navigation information including advice on diet, in any one of claims 1 to 5, characterized in that it is provided to the user The dietary management program described. In the procedure C, any of claims 1 to 6 chewing information received from chewing frequency measurement device for measuring the chewing times during meals provided outside the computer, characterized in that it is detected The dietary management program according to any one of the above. The dietary management process is:
The eating habit management program according to any one of claims 1 to 7 , further comprising: a procedure E for accepting input of information related to the user including the eating habit information through an input unit. The dietary management process is:
The dietary life management program according to any one of claims 1 to 8 , further comprising a procedure F for communicating with at least one external device installed outside the computer. The external device includes a health information measuring device that measures health information that is information about the health status of the user,
The eating habit management program according to claim 9 , wherein the eating habit management process includes a procedure G for detecting the health information received from the health information measuring device. 11. The eating habit management program according to claim 10 , wherein in the procedure D, information based on the eating habit information and information based on the health information are simultaneously displayed and output on an output unit. The external device includes a server computer having a database for storing the information collected and processed in the procedure D, and the information stored in the database is accessible only to members registered in advance. The eating habit management program according to any one of claims 9 to 11 , wherein the eating habit management program is characterized. The dietary life management program according to claim 12 , wherein the pre-registered member includes a medical institution or a public institution permitted in advance. Step A for causing the camera unit to acquire image data;
Step B for recognizing an image of a food and beverage utensil by image recognition processing from the image data acquired in Step A;
Step C for detecting eating habits information, which is information related to a user's eating habits, from the image of the eating and drinking utensils recognized in Step B;
Collecting and processing the dietary information detected in step C; and
A dietary management method comprising:
In step B, an image of a food transport member that transports food to the mouth is recognized,
In step C, depending on whether or not the food transport member is placed on the table, at least the time when the food transport member is placed on the table and the time when it is not placed A dietary management method characterized in that information based on one side is detected. Step A for causing the camera unit to acquire image data;
Step B for recognizing an image of a food and beverage utensil by image recognition processing from the image data acquired in Step A;
Step C for detecting eating habits information, which is information related to a user's eating habits, from the image of the eating and drinking utensils recognized in Step B;
Collecting and processing the dietary information detected in step C; and
A dietary management method comprising:
In step C, voice of the user during a meal is acquired through a microphone unit, and voice information indicating the presence or absence of a predetermined keyword in the voice of the user during the meal is detected. How to manage your eating habits. Step A for causing the camera unit to acquire image data;
Step B for recognizing an image of a food and beverage utensil by image recognition processing from the image data acquired in Step A;
Step C for detecting eating habits information, which is information related to a user's eating habits, from the image of the eating and drinking utensils recognized in Step B;
Collecting and processing the dietary information detected in step C; and
A dietary management method comprising:
In step B, the image of the user eating from the image data is further recognized,
In step C, seating information indicating whether or not the user is seated during a meal is detected. A camera unit for acquiring image data;
From the image data acquired by the camera unit, the image of the eating and drinking utensil is recognized by image recognition processing, and the eating habits information that is information related to the eating habits of the user is detected and detected from the recognized image of the eating and drinking utensil. Control means for performing control to collect and process the dietary information,
A dietary life management device comprising:
The control means recognizes an image of a food transport member that transports food to the mouth, and the food transport member is on the table depending on whether the food transport member is placed on the table. A dietary life management device characterized by detecting information based on at least one of a time when the device is placed on the device and a time when the device is not placed. A camera unit for acquiring image data;
From the image data acquired by the camera unit, the image of the eating and drinking utensil is recognized by image recognition processing, and the eating habits information that is information related to the eating habits of the user is detected and detected from the recognized image of the eating and drinking utensil. Control means for performing control to collect and process the dietary information,
A dietary life management device comprising:
The control means acquires the voice of the user during a meal through a microphone unit, and detects voice information indicating the presence or absence of a predetermined keyword in the voice of the user during the meal. Eating habits management device. A camera unit for acquiring image data;
From the image data acquired by the camera unit, the image of the eating and drinking utensil is recognized by image recognition processing, and the eating habits information that is information related to the eating habits of the user is detected and detected from the recognized image of the eating and drinking utensil. Control means for performing control to collect and process the dietary information,
A dietary life management device comprising:
The control means further recognizes an image of the user eating from the image data, and detects seating information indicating whether or not the user is seated during the meal.

Images