KR20150029257A - Method and system for providing food information using augmented reality - Google Patents

Method and system for providing food information using augmented reality Download PDF

Info

Publication number
KR20150029257A
KR20150029257A KR20130108163A KR20130108163A KR20150029257A KR 20150029257 A KR20150029257 A KR 20150029257A KR 20130108163 A KR20130108163 A KR 20130108163A KR 20130108163 A KR20130108163 A KR 20130108163A KR 20150029257 A KR20150029257 A KR 20150029257A
Authority
KR
South Korea
Prior art keywords
food
information
image
user
calorie
Prior art date
Application number
KR20130108163A
Other languages
Korean (ko)
Inventor
박지애
이종하
Original Assignee
계명대학교 산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 계명대학교 산학협력단 filed Critical 계명대학교 산학협력단
Priority to KR20130108163A priority Critical patent/KR20150029257A/en
Publication of KR20150029257A publication Critical patent/KR20150029257A/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/12Hotels or restaurants

Landscapes

  • Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention relates to a method to provide food information using augmented reality, wherein information of food is synthesized with a food image, by expressing the food information in augmented reality and to a system which realizes the method. More specifically, the method includes: a first step of photographing an identification image code displayed on food or the packing of the food; a second step of checking the type and calories of the food by decoding the photographed identification image code; a third step of photographing the food on which the identification image code is displayed; a fourth step of confirming the type and composition of the photographed food through a pattern recognition of the corresponding food; a fifth step of generating a calories display image of the corresponding food by matching the type and calories of the food from the second step with the type and composition of the food from the fourth step; and a sixth step of synthesizing the calories display image of the fifth step with the photographed food image from the third step, generating an augmented reality image, and outputting and displaying the generated augmented reality image. The method and the system to provide food information using augmented reality, provided by the present invention, enable a user to intuitively understand information of food which the user wants to eat by providing food information in which information of food is synthesized with a food image by expressing the food information in augmented reality. Accordingly, the user is able to easily decide whether to eat the corresponding food or not.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a method and system for providing food information using an augmented reality,

The present invention relates to a method and system for providing food information using an augmented reality, and more particularly, to a method and system for providing food information using an augmented reality in which food information is synthesized and displayed as an augmented reality .

Recently, as the economy develops, many people are being threatened by obesity as a result of diverse food cultures, increased calorie intake, lack of exercise, and various changes in the body caused by increased stress.

These obesity is caused by energy imbalance when overdose of nutrients over a long period of time compared to energy consumption, and it gives bad image to those who are uncomfortable and not beautiful appearance, and it gives inconvenience to activities. In particular, obesity increases the risk of diabetes and hyperlipemia, increases the risk of sexual dysfunction, arthritis, cardiovascular disease, gallstone disease, and in some cases, cancer.

Such obesity requires behavioral therapy in addition to improving lifestyle, reducing food intake and increasing exercise. Diet is the most important to reduce calorie intake, the recommended daily intake of less than 500 ~ 1000 보다 of calories from the usual intake, and the weight of the weight loss effect is known to vary depending on the nutrient composition in the diet recently. Exercise therapy is very important because it does not increase again after the body weight is reduced, and it is reported that at least 30 minutes of exercise every day is necessary to show the therapeutic effect of obesity.

Obesity is closely related to the caloric value of food, so people usually pay more attention to the calories (calories) of the food when they eat it, and they tend to memorize the calories of their food, It is inconvenient to check the calorific value of the food through a smart phone or the like and check the calorie of the food on a daily basis.

As a related art related to the related art, Korean Patent Laid-Open Publication No. 10-2012-0126157 (published on November 21, 2012) discloses a method for providing a food preparation method and food information by using an augmented reality program of a smart device, A food information providing method and a food information providing system using an augmented reality in which a food and a foodstuff to be cooked are superimposed on a real screen photographed through an augmented reality.

Korean Patent Laid-Open Publication No. 10-2012-0126157 discloses a method of using an augmented reality program of a smart device so that an image of a food material to be used when making a food can be viewed on a real image of a kitchen, So that it can be seen in a superimposed state. As a result, the process of cooking the food becomes pleasant, the interest in the cooking of the food can be enhanced, and the information on the new food can be easily obtained.

However, the conventional invention does not provide food information and intuitive information on the food including the calorie of the food to be consumed.

Therefore, it is desired to develop a new technology that intuitively grasps the food information including the calorie of the food to be ingested.

[Patent Document 1] Korean Published Patent Application No. 10-2012-0126157 (published on November 21, 2012)

The present invention has been proposed in order to solve the conventional inconveniences and to meet the conventional demands, and it is an object of the present invention to provide an image enhancement apparatus And to provide a method and system for providing food information using an augmented reality that allows intuitive knowledge of the augmented reality.

According to another aspect of the present invention, there is provided a method of providing food information using an augmented reality,

A first step of photographing the food or the identification image code displayed on the package;

A second step of decoding the photographed identification image code to identify the type and amount of food;

A third step of photographing the food marked with the identification image code;

A fourth step of confirming the type and configuration of the food by the pattern recognition of the photographed food image;

A fifth step of generating a calorie display image for the food by matching the food type and the calorie from the second step with the type and configuration of the food from the fourth step; And

And a sixth step of synthesizing the calorie display image of the fifth step with the food-taken image from the third step to generate and output an increase / decrease reality image.

Preferably, the identification image code is a QR code (Quick Response Code), the type of the food is a name of the food, and the configuration of the food is an arrangement form of the food.

More preferably, the photographing in the first and third steps is performed by a photographing module of the photographing apparatus, and the second, fourth, fifth, So that the increase / decrease reality image is displayed on the display of the photographed image.

More preferably, the photographing apparatus is any one selected from a smart phone having a camera function, a tablet computer having a camera function, a digital camera capable of wireless communication, and a wearable computer capable of wireless communication.

According to another aspect of the present invention, there is provided a system for providing food information using an augmented reality,

Food marked with an identification image code;

A photographing terminal including an identification image code and a photographing function for photographing the food, the photographing terminal including an application for providing food information using the augmented reality; And

And a server for downloading and providing an application installed in the photographing terminal.

Preferably, the identification image code has name information of at least one food and calorie information of each food, and the identification image code is a QR code.

More preferably, the food is one type or a plurality of types of food or a plurality of types of foods are packaged together.

More preferably, the photographing terminal is any one selected from a smart phone having a camera function, a tablet computer having a camera function, a digital camera capable of wireless communication, and a wearable computer capable of wireless communication.

Preferably, the application installed in the photographing terminal includes a database of food information including image pattern information of the food, name information of the food, and calorie information of the food.

More preferably, the application installed in the photographing terminal decodes the photographed identification image code to check the name and calorie of the food, and identifies the name and layout of the food through the pattern recognition of the photographed food image And generating a calorie display image for the food by matching the food name and calorie from the identification image code with the name and arrangement form of the food from the sensed food image, And synthesized with the food image to be displayed on the display.

According to another aspect of the present invention, there is provided a method of providing food information using an augmented reality,

A first step of photographing food by the photographing terminal;

A second step of confirming the name of the food by the pattern recognition of the taken food image at the photographing terminal;

A third step of requesting, by the photographing terminal, the calorie information and customizing information corresponding to the food name identified in the second step to the server;

The server retrieves and obtains the calorie information corresponding to the food name from the food information of the database in response to the request of the third step and acquires the user's life habit information of the user knowledge model corresponding to the user and the user health information A fourth step of generating user customized information and providing the calorie content information and the customized information to the photographing terminal;

A fifth step of generating an image of the calorie information and the customized information received from the server at the photographing terminal; And

And a sixth step of synthesizing the image generated in the fifth step at the photographing terminal with the food photographing image photographed at the first step to generate and output an increase / decrease reality image.

Preferably, the photographing terminal is any one selected from a smart phone having a camera function, a tablet computer having a camera function, a digital camera capable of wireless communication, and a wearable computer capable of wireless communication.

More preferably, the user lifestyle information includes preference food information of the user, daily intake food information of the user, daily exercise amount information of the user, and daily sleep information of the user.

More preferably, the user health information includes a user's height, weight, age, sex, blood pressure, blood glucose level, cholesterol level, current disease name and past medical history.

Preferably, the user-customized information includes fitness information of the intake for the food name.

More preferably, the user-customized information further includes information on the user's daily intake of food and calorie information, food information to be eaten by the user, or dietary information.

More preferably, the fitness information is expressed as a recommendation or a non-recommendation.

According to another aspect of the present invention, there is provided a system for providing food information using an augmented reality,

A name of the food is identified from a photographed image of the food, a name of the food is identified, and a request is made to the server for information on the calories of the food and customizing information corresponding to the name of the food. In accordance with the request, A shooting terminal for generating customized information as an image, synthesizing the generated image with the captured image of the food, and generating and outputting an increase / decrease reality image; And

Retrieves and fetches the calorie information corresponding to the food name from the food information of the database in response to a request from the photographing terminal and retrieves user's lifestyle information and user's health information of the user knowledge model corresponding to the user in the database A server for generating user customized information and providing the calorie content information and the customized information to the shooting terminal

As a constituent feature thereof.

Preferably, the photographing terminal is any one selected from a smart phone having a camera function, a tablet computer having a camera function, a digital camera capable of wireless communication, and a wearable computer capable of wireless communication.

More preferably, the user lifestyle information includes preference food information of the user, daily intake food information of the user, daily exercise amount information of the user, and daily sleep information of the user.

More preferably, the user health information includes a user's height, weight, age, sex, blood pressure, blood glucose level, cholesterol level, current disease name and past medical history.

Preferably, the user-customized information includes fitness information of the intake for the food name.

More preferably, the user-customized information further includes information on the user's daily intake of food and calorie information, food information to be eaten by the user, or dietary information.

More preferably, the fitness information is expressed as a recommendation or a non-recommendation.

According to the method and system for providing food information using the augmented reality proposed in the present invention, by combining the calorie information of the food as the food information on the image of the food and expressing it as an augmented reality, Information becomes intuitive. Accordingly, the user can easily judge whether or not the food is consumed.

According to the method and system for providing food information using the augmented reality proposed in the present invention, it is possible to recognize the type of food through the image of the food and request information corresponding to the type of food to the server, The information on the calorie of the food is provided together with the customized information of the user through the user knowledge model including the information and the health information and the information provided on the image taken on the food is expressed as the augmented reality, , It is possible to intuitively know the information including the amount of food consumed today, the amount of food to be consumed today, the recommended recommendation or refusal to eat the food, and the optimal food or diet suitable for the user's health condition . Accordingly, the user can easily judge whether or not the food is consumed, and can select the food suitable for him / herself, thereby helping the user's health.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a schematic view of a system for providing food information using an augmented reality according to an embodiment of the present invention; FIG.
BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a method and a device for providing a food information using an augmented reality according to an embodiment of the present invention.
Fig. 3 is a block diagram showing a configuration of a photography terminal used in the system of Fig. 1; Fig.
FIG. 4 is a functional block diagram illustrating a method of providing a food information using an augmented reality according to an embodiment of the present invention in a photographing terminal of the system shown in FIG. 1;
5 is a flowchart illustrating a method of providing food information using an augmented reality according to an embodiment of the present invention.
6 is a view schematically showing a system for providing food information using an augmented reality according to another embodiment of the present invention.
7 is a flowchart illustrating a method of providing food information using an augmented reality according to another embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, in order that those skilled in the art can easily carry out the present invention. In the following detailed description of the preferred embodiments of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. In the drawings, like reference numerals are used throughout the drawings.

In addition, in the entire specification, when a part is referred to as being 'connected' to another part, it may be referred to as 'indirectly connected' not only with 'directly connected' . Also, to "include" an element means that it may include other elements, rather than excluding other elements, unless specifically stated otherwise.

&Quot; Augmented Reality (AR) " used in the present invention means creating an augmented reality by showing additional information to the user in the real world. All information is distinguished from Virtual Reality (VR) in that information is scattered on the real world. Augmented reality, a concept that complements the real world with a virtual world, uses a virtual environment created by computer graphics, but the protagonist is a real environment. The computer graphics serve to provide additional information necessary for the real environment, and it means that the distinction between the real environment and the virtual screen is blurred by overlapping the virtual image with the real image that the user is viewing. Virtual reality technology allows a user to be immersed in a virtual environment, and the real environment can not be seen. However, augmented reality technology, which is a mixture of real environment and virtual objects, allows the user to see the real environment and provides better realism and additional information.

FIG. 1 is a schematic diagram of a system for providing food information using an augmented reality according to an embodiment of the present invention. Referring to FIG. As shown in the figure, the food information providing system using the augmented reality according to the present embodiment includes the food 10, the photographing terminal 20 and the server 30, which are displayed with the identification image code IDC.

The identification image code (IDC) has at least one kind of food type information (name information) and a calorie information of each food, for example, a QR code (Quick Response Code). This identification image code (IDC) may be printed on a package of food or attached in the form of a sticker, for example.

The food 10 may be one type or a plurality of types of food, or may be packaged with at least one type of food.

The photographing terminal 20 includes a photographing function for photographing the identification image code IDC and the food 10 and is a terminal capable of communicating with the server 30 through the mobile communication network. This is the configuration in which the application is installed and running. Examples of the shooting terminal 20 include a smart phone having a camera function, a tablet computer having a camera function, a digital camera capable of wireless communication, and a wearable computer capable of wireless communication. Here, as a wearable computer, an HMD (Head Mounted Display) can be exemplified.

The application installed and executed in the photographing terminal 20 may be configured to include a database of food information including image pattern information, type information (name information), and calorie information of all the foods 10 applicable to the present invention, The database for the food information may be provided only by the server 30 and the necessary food information may be provided to the photographing terminal 20 by the server 30 at the request of the photographing terminal 20.

In the present embodiment, description will be given only in the case where the database of the food information is held in the application of the photographing terminal 20. However, the server 30 has a database of the food information, The present invention is not limited to the above-described embodiments, and various modifications may be made without departing from the scope of the present invention.

The server 20 manages and manages food information including image pattern information, type information (name information) and calorie information of all the foods 10 applicable to the present invention as a database, And is responsible for updating the application by adding new food information and providing it to the shooting terminal 20.

FIG. 2 is a diagram schematically illustrating a procedure for implementing a method of providing a food information using an augmented reality according to an embodiment of the present invention, using a smartphone as a photographing terminal in the system of FIG.

As shown in the figure, the user uses the smartphone (photographing terminal) 20 in which the application according to the present invention is installed to identify the identification image code (IDC) displayed on the food 10 in the identification image code photographing mode of the application The image IDC_PI of the photographed identification image code is displayed on the display and the image IDC_PI of the photographed identification image code is decoded into the type information (name information) of the food and the calorie information of each food.

Then, when the user takes an image of the food 10 in the food photographing mode of the application, the image F_PI of the taken food is displayed on the display, and the image F_PI of the taken food is detected (Placement configuration) and the type of food (name) are identified.

In this example, since the food 10 is a lunch box packed with four types of food, the type information (name information) of the food decoded in the identification image code (IDC) and the calorie information of each food are four , The configuration (arrangement form) of four food items and the type (name) of four food items are recognized and extracted through pattern recognition of food image (F_PI).

Thus, the type information (name information) of the food and the calorie information of the food decoded from the identification image code are obtained from the configuration (arrangement shape) of the food extracted through the pattern recognition of the image F_PI of the picked food and the type (Calorie) display image of the food is generated, and the image of the calorie information (calorie) of the food is synthesized on the image F_PI of the food displayed on the display, And outputs it as a real image (AR_IMAGE).

FIG. 3 is a block diagram of a photography terminal used in the system of FIG. 1. FIG. As shown in the figure, the photographing terminal 20 applied to the present invention includes a photographing module 22, a key input module 23, a mobile communication module 25, a display module 24, a memory 24, And a control module 21.

The photographing module 22 is a configuration for photographing the food 10 and the identification image code IDC under the control of the control module 21 by the application according to the user's selection.

The key input module 23 includes a touch key and an external button key on the screen under the control of the control module 21. The key input module 23 is configured for user input. The mobile communication module 25, under the control of the control module 21, As shown in FIG.

The display module 24 is a configuration for displaying a photographed image and an augmented reality image on the screen under the control of the control module 21 by an application according to the present invention.

The memory 26 is a configuration for storing an application according to the present invention and temporarily or permanently or update-storing the data generated according to the execution of the application of the present invention.

The control module 21 controls the entire imaging module 22, the key input module 23, the mobile communication module 25, the display module 24 and the memory 26, Installation and execution of the augmented reality according to the present invention, and performs control of providing food information using the augmented reality according to the present invention as a whole in accordance with the execution of the application.

FIG. 4 is a functional block diagram illustrating a method of providing a food information using an augmented reality according to an embodiment of the present invention in a photographing terminal of the system shown in FIG. 1. Referring to FIG. Hereinafter, the method of providing food information in FIG. 4 will be described with reference to FIG.

First, the identification image code image IDC (IDC_PI) 41 is photographed by the control module 21 as the identification image code IDC displayed on the food 10 is photographed through the photographing module 22 Is transmitted to the identification image code decoding unit 42 and decoded into the type information (name information) of the food and the calorie information of each food.

The type information (name information) of the food and the calorie information of each food decoded in the identification image code decoding unit 42 are transmitted to the food type and calorie check unit 43 to identify the name of each food and the calories Calories) are managed and matched.

As the food 10 is photographed through the photographing module 22, the food photographing image F_PI 44 is transmitted to the pattern recognition unit 45 of the application executed by the control module 21, (Name) and the composition (arrangement form) of the food contained in the F_PI 44 are recognized and extracted by pattern recognition.

The name of the food and the configuration of the food (arrangement configuration) are transmitted to the food type and configuration confirmation unit 46 in the pattern recognition unit 45 and the name of each food and the configuration (arrangement form) Is managed.

The calorie display image generation unit 47 generates information on the calorie display image generated by the calorie display image generation unit 47 based on the name of each food item managed by the food type and calorie determination unit 43, (Calorie) of each food, the name of each food, the composition (arrangement form) of each food, the name of each food, the name of each food, (Calorie) display image of the food. That is, an image of calorie information (calorie) of the food is generated so that the calories (calories) of the foods are placed in the configuration (arrangement form) of the food corresponding to the same food name.

The calorie display image of the calorie information outputted from the calorie display image generator 47 is temporarily stored in the memory 26 (see FIG. 3), and the calorie display image 44 is displayed on the display (Calorie) display image of the food is superimposed on the food image 44 to be displayed on the display as an augmented reality image AR_IMAGE.

FIG. 5 is a flowchart illustrating a method of providing food information using an augmented reality according to an embodiment of the present invention. Referring to FIG. The present embodiment describes a smart phone as a photographing terminal and a QR code (Quick Response Code) as an identification image code. However, the present invention is not limited thereto. The description of other examples will be omitted.

As shown in the figure, first, the user executes, for example, an application installed in the smart phone as the shooting terminal 20 (step S51) and displays the QR code shooting mode as the identification image code on the display screen of the executed application (Step S52). The photographing module 22 is operated under the control of the control module 21 by the application.

Thereafter, when the user shoots the QR code displayed on the food or food wrapping paper or the like (step S53), the captured QR code image is delivered to the decoding section of the application. The QR code image is decoded in the decoding section, ) Information and calorie information are acquired (steps S54 to S55).

Then, the user selects the food shooting mode on the display screen of the application (step S56). The photographing module 22 is operated under the control of the control module 21 by the application.

Thereafter, when the user shoots the food (step S57), the image of the taken food is transmitted to the pattern recognition unit of the application, and the pattern recognition unit recognizes the food type (name) and the food composition (Layout shape) is recognized and extracted (step S58), and the food type (name) and the food composition (layout shape) are confirmed (step S59).

Subsequently, the calorie display image generating unit of the application matches the food type (name) information and the calorie information acquired in step S55 with the food type (name) and the food composition (arrangement form) identified in step S59 (step S60) (Calorie) display image for allowing the amount of calories (calories) of each food to be placed in the configuration (arrangement shape) of the food corresponding to the type (name) of the same food (step S61).

Then, the calorie display image (calorie) display image of the food produced in the calorie display image generator of the application is transmitted to the increase / decrease reality image generator of the application, and the increase / decrease reality image generator generates the calorie information Calories) display image is superimposed on the food-taken image in step S57 to generate an increase / decrease reality image and displayed on the display (steps S62 to S63).

As described above, according to this embodiment, the food information is synthesized with the image of the food, and is expressed as an augmented reality, so that the information about the food to be consumed by the user can be intuitively understood. Accordingly, the user can easily judge whether or not the food is consumed.

6 is a view schematically showing a system for providing food information using an augmented reality according to another embodiment of the present invention. The food information providing system using the augmented reality according to the present embodiment includes a photographing terminal 20 and a server 30.

Since the photographing terminal 20 is substantially the same as the photographing terminal in the embodiment of FIG. 1, a detailed description thereof will be omitted.

The application installed and executed in the photographing terminal 20 does not include a database of the food information including the calorie information. Such a database exists only in the server 30, and necessary food information or the like is requested at the request of the photographing terminal 20 And the server 30 provides the corresponding food information to the photographing terminal 20. Accordingly, the application according to the present embodiment has only a database of image pattern information and type information (name information) of the food 10, and it has functions of photographing function, pattern recognition function, food type (name) It has a function to generate the increasing and decreasing reality image.

The server 30 is configured differently from the embodiment of FIG. 1, and includes a database of food information and a user knowledge model. The food information includes food calorie information, and the user knowledge model includes user lifestyle information and user health information.

The user lifestyle information is provided by a user and includes preference food information, daily intake food information, daily exercise information, daily sleep information, and the like. The user health information is provided by the user and includes height, weight, age, sex, blood pressure, blood sugar level, cholesterol level, current disease name, past medical history, and the like.

7 is a flowchart illustrating a method of providing food information using an augmented reality according to another embodiment of the present invention.

As shown in the figure, the user first executes, for example, an application installed in the smart phone as the shooting terminal 20 (step S71), and selects the food shooting mode on the display screen of the executed application (step S72 ). The photographing module 22 is operated under the control of the control module 21 by the application.

Thereafter, when the user takes food (step S73), the image of the taken food is transmitted to the pattern recognition unit of the application. The pattern recognition unit recognizes the food type (name) by pattern recognition (Step S74), and the food type (name) is confirmed (step S75).

Then, the application is connected to the server 30 through the mobile communication module 25 under the control of the control module 21, and requests customization information on the type of food (name) (step S76).

In response to the request, the server 30 retrieves and obtains the calorie information corresponding to the food type (name) from the database, searches the user lifestyle information and user health information of the user knowledge model to generate customized information, And provides the calorie information of the food and the user-customized information to the photographing terminal 20. Accordingly, the photographing terminal 20 receives the user-fitted information together with the calorie content information corresponding to the food type (name) (step S77).

Here, the user-customized information includes fitness information (recommendation and non-recommendation) of the food type (name), information on the food and calorie consumed per day, information on food to be eaten today, or information on the food.

Thereafter, the imaging terminal 20 generates an image of the received calorie information and customized information as an image under the control of the control module 21 by the application (step S78)

Then, in the photographing terminal 20, under the control of the control module 21 by the application, the increase / decrease reality image is generated by the synthesis processing of superimposing the image generated in the step S78 on the food image taken at the step S73 So that a screen is displayed on the display (steps S79 to S80).

As described above, according to the present embodiment, the food type is recognized through the image of the food and the information corresponding to the type of food is requested from the server, and the user's lifestyle information and the user knowledge The information of the calorie of the food is received together with the customized information of the user through the model and the received information is expressed as the augmented reality on the image taken on the food so as to provide the calorie information of the food, The amount of food to be consumed today, the fitness information (recommendation or non-recommendation) of the food to be consumed, and the optimum food or diet suitable for the user's health condition. Accordingly, the user can easily judge whether or not the food is consumed, and can select the food suitable for him / herself, thereby helping the user's health.

The present invention may be embodied in many other specific forms without departing from the spirit or essential characteristics of the invention.

10: foodstuff 20: photographing terminal
21: control module 22: photographing module
23: key input module 24: display module
25: mobile communication module 26: memory
30: server 42: identification image code decoding unit
43: food type and calorie checking unit 45: pattern recognition unit
46: Food type and configuration confirmation unit 47: Calorie display image generation unit
48: Increment /

Claims (27)

A first step of photographing the food or the identification image code displayed on the package;
A second step of decoding the photographed identification image code to identify the type and amount of food;
A third step of photographing the food marked with the identification image code;
A fourth step of confirming the type and configuration of the food by the pattern recognition of the photographed food image;
A fifth step of generating a calorie display image for the food by matching the food type and the calorie from the second step with the type and configuration of the food from the fourth step; And
And a sixth step of synthesizing the calorie display image of the fifth step with the food image taken from the third step to generate and output an increase / decrease reality image, and outputting and displaying the resultant food image information using the augmented reality.
The image processing method according to claim 1,
And a QR code (Quick Response Code).
The method of claim 1,
And the name of the food is the name of the food.
The food according to claim 1,
Wherein the food information is an arrangement form of the food.
The method according to claim 1, wherein the photographing in the first step and the third step is performed by a photographing module of the photographing apparatus,
Wherein the second step, the fourth step, the fifth step, and the sixth step are performed by an application installed in the photographing apparatus, so that the increase / decrease reality image is displayed on the display of the photographed image. Information delivery method.
6. The apparatus according to claim 5,
A method for providing food information using an augmented reality, the method comprising: a smartphone having a camera function; a tablet computer having a camera function; a digital camera capable of wireless communication; and a wearable computer capable of wireless communication.
Food marked with an identification image code;
A photographing terminal including an identification image code and a photographing function for photographing the food, the photographing terminal including an application for providing food information using the augmented reality; And
And a server that downloads and provides an application installed in the imaging terminal.
8. The method according to claim 7,
Wherein the food information providing system comprises at least one food name information and calorie information of each food.
9. The method of claim 8,
And a QR code (Quick Response Code).
8. The food according to claim 7,
The system for providing food information using an augmented reality according to claim 1, wherein one type or a plurality of types of foods are packaged or packaged, or a plurality of types of foods are packaged and packaged.
8. The method according to claim 7,
The system for providing food information using an augmented reality, wherein the system is any one selected from a smart phone having a camera function, a tablet computer having a camera function, a digital camera capable of wireless communication, and a wearable computer capable of wireless communication.
8. The image processing apparatus according to claim 7,
And a database for food information including image pattern information of the food, name information of the food, and calorie information of the food.
13. The image taking apparatus according to claim 12,
Decodes the photographed identification image code to check the name and calorie of the food,
Recognizing the name of the food and the layout of the food through the pattern recognition of the taken food image,
Generating a calorie display image for the food by matching the food name and calorie from the identification image code with the name and arrangement form of the food from the picked food image,
And the generated calorie display image is synthesized with the photographed food image to generate an increase / decrease reality image and displayed on the display.
A first step of photographing food by the photographing terminal;
A second step of confirming the name of the food by the pattern recognition of the taken food image at the photographing terminal;
A third step of requesting, by the photographing terminal, the calorie information and customizing information corresponding to the food name identified in the second step to the server;
The server retrieves and obtains the calorie information corresponding to the food name from the food information of the database in response to the request of the third step and acquires the user's life habit information of the user knowledge model corresponding to the user and the user health information A fourth step of generating user customized information and providing the calorie content information and the customized information to the photographing terminal;
A fifth step of generating an image of the calorie information and the customized information received from the server at the photographing terminal; And
And a sixth step of synthesizing the image generated in the fifth step at the photographing terminal with the food image photographed at the first step to generate and output an increase / decrease reality image, How to provide food information.
15. The system according to claim 14,
A method for providing food information using an augmented reality, the method comprising: a smartphone having a camera function; a tablet computer having a camera function; a digital camera capable of wireless communication; and a wearable computer capable of wireless communication.
15. The method of claim 14, wherein the user lifestyle information comprises:
A user's preference food information, a user's daily intake food information, a user's daily exercise amount information, and a user's daily sleep information.
15. The method of claim 14,
The method for providing food information using an augmented reality, comprising the user's height, weight, age, sex, blood pressure, blood glucose level, cholesterol level, current disease name and past medical history.
15. The method of claim 14,
Wherein the fitness information includes information on fitness of intake for the food name.
19. The method of claim 18,
Wherein the supplemental information further includes information on the food consumed by the user today, calorie information of the user, food information to be eaten today by the user, or food information.
20. The method of claim 19,
Wherein the augmented reality information is expressed as a recommendation or a non-recommendation.
A name of the food is identified from a photographed image of the food, a name of the food is identified, and a request is made to the server for information on the calories of the food and customizing information corresponding to the name of the food. In accordance with the request, A shooting terminal for generating customized information as an image, synthesizing the generated image with the captured image of the food, and generating and outputting an increase / decrease reality image; And
Retrieves and fetches the calorie information corresponding to the food name from the food information of the database in response to a request from the photographing terminal and retrieves user's lifestyle information and user's health information of the user knowledge model corresponding to the user in the database And a server for generating the user customized information and providing the calorie information and the user customized information to the imaging terminal.
22. The terminal device according to claim 21,
The system for providing food information using an augmented reality, wherein the system is any one selected from a smart phone having a camera function, a tablet computer having a camera function, a digital camera capable of wireless communication, and a wearable computer capable of wireless communication.
22. The method of claim 21, wherein the user lifestyle information comprises:
A user's favorite food information, a user's daily intake food information, a user's daily exercise amount information, and a user's daily sleep information.
22. The method of claim 21,
Wherein the information includes a user's height, weight, age, sex, blood pressure, blood sugar level, cholesterol level, current disease name, and past medical history.
22. The method of claim 21,
And information on fitness of intake for the food name. The food information providing system using the augmented reality.
26. The method of claim 25,
A food information providing system for augmented reality, which includes information on a food consumed by a user today, calorie information of the user, food information to be eaten today by the user, or food information.
27. The method of claim 26,
Wherein the augmented reality information is expressed as a recommendation or a non-recommendation.
KR20130108163A 2013-09-09 2013-09-09 Method and system for providing food information using augmented reality KR20150029257A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR20130108163A KR20150029257A (en) 2013-09-09 2013-09-09 Method and system for providing food information using augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR20130108163A KR20150029257A (en) 2013-09-09 2013-09-09 Method and system for providing food information using augmented reality

Publications (1)

Publication Number Publication Date
KR20150029257A true KR20150029257A (en) 2015-03-18

Family

ID=53023783

Family Applications (1)

Application Number Title Priority Date Filing Date
KR20130108163A KR20150029257A (en) 2013-09-09 2013-09-09 Method and system for providing food information using augmented reality

Country Status (1)

Country Link
KR (1) KR20150029257A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017043686A1 (en) * 2015-09-11 2017-03-16 엘지전자 주식회사 Mobile terminal and operation method thereof
CN106599602A (en) * 2016-12-29 2017-04-26 太仓红码软件技术有限公司 Augmented reality apparatus and method for exhibiting formulated combined marker virtual information
WO2017091024A1 (en) * 2015-11-25 2017-06-01 Samsung Electronics Co., Ltd. User terminal apparatus and control method thereof
KR20190059728A (en) * 2017-11-23 2019-05-31 김선희 Apparatus and Method for Processing Food Information using Augmented Reality
KR20200023071A (en) * 2018-08-24 2020-03-04 주식회사 코엘 Infant eating habit education system and its method
KR20200092147A (en) * 2019-01-24 2020-08-03 윤수현 System for providing product score
KR102190977B1 (en) * 2019-12-10 2020-12-14 주식회사 서커스컴퍼니 Food information provider platform using an AR Menu board
CN112104890A (en) * 2020-11-17 2020-12-18 浙江口碑网络技术有限公司 Interaction method and device based on commodity materials
KR20210072491A (en) * 2019-12-09 2021-06-17 충남대학교병원 Dietary simulation system using VR/AR
EP3933772A1 (en) * 2020-07-03 2022-01-05 Tetra Laval Holdings & Finance S.A. A method and a server for faciliating provision of food product information

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017043686A1 (en) * 2015-09-11 2017-03-16 엘지전자 주식회사 Mobile terminal and operation method thereof
US10861153B2 (en) 2015-11-25 2020-12-08 Samsung Electronics Co., Ltd. User terminal apparatus and control method thereof
WO2017091024A1 (en) * 2015-11-25 2017-06-01 Samsung Electronics Co., Ltd. User terminal apparatus and control method thereof
KR20170060972A (en) * 2015-11-25 2017-06-02 삼성전자주식회사 User terminal appratus and control method thereof
CN108292420A (en) * 2015-11-25 2018-07-17 三星电子株式会社 Subscriber terminal equipment and its control method
US10521903B2 (en) 2015-11-25 2019-12-31 Samsung Electronics Co., Ltd. User terminal apparatus and control method thereof
US11568981B2 (en) 2015-11-25 2023-01-31 Samsung Electronics Co., Ltd. User terminal apparatus and control method thereof
CN106599602A (en) * 2016-12-29 2017-04-26 太仓红码软件技术有限公司 Augmented reality apparatus and method for exhibiting formulated combined marker virtual information
CN106599602B (en) * 2016-12-29 2019-08-27 上海德鋆信息科技有限公司 Show the augmented reality devices and methods therefor for formulating combination marker virtual information
KR20190059728A (en) * 2017-11-23 2019-05-31 김선희 Apparatus and Method for Processing Food Information using Augmented Reality
KR20200023071A (en) * 2018-08-24 2020-03-04 주식회사 코엘 Infant eating habit education system and its method
KR20200092147A (en) * 2019-01-24 2020-08-03 윤수현 System for providing product score
KR20210072491A (en) * 2019-12-09 2021-06-17 충남대학교병원 Dietary simulation system using VR/AR
KR102190977B1 (en) * 2019-12-10 2020-12-14 주식회사 서커스컴퍼니 Food information provider platform using an AR Menu board
EP3933772A1 (en) * 2020-07-03 2022-01-05 Tetra Laval Holdings & Finance S.A. A method and a server for faciliating provision of food product information
WO2022003023A1 (en) * 2020-07-03 2022-01-06 Tetra Laval Holdings & Finance S.A. A method and a server for faciliating provision of food product information
CN112104890A (en) * 2020-11-17 2020-12-18 浙江口碑网络技术有限公司 Interaction method and device based on commodity materials

Similar Documents

Publication Publication Date Title
KR20150029257A (en) Method and system for providing food information using augmented reality
US7925976B2 (en) Refrigerator having user avatar display function
US9881517B2 (en) Information processing device and storage medium
JP4690082B2 (en) Health maintenance support system, information processing system and user system used therefor, operation method, and operation program
US20200074524A1 (en) Network computing system for providing interactive menus and group recommendations
CN111480202B (en) Apparatus and method for personalized meal plan generation
CN110021404A (en) For handling the electronic equipment and method of information relevant to food
CN105243270B (en) Diet monitoring method, device, system and food and drink furniture
CN111222569A (en) Method, device, electronic equipment and medium for identifying food
CN106256129B (en) Method for operating image display device
CN109300526A (en) A kind of recommended method and mobile terminal
JPWO2017199389A1 (en) Information providing system, information providing method, and information providing program
JP3681710B2 (en) Cooking data provision device
JP2011203799A (en) Meal management system
JP2014241044A (en) Food information support device, food information support program, storage medium and food information support method
JP2020107096A (en) System, device, method, and program for suggesting menu
JP6211342B2 (en) Menu proposal method
KR20130089947A (en) Health menu management system and method using the same
KR101895509B1 (en) System of generating recipe contents and method thereof
KR20190048922A (en) Smart table and controlling method thereof
JP2006085459A (en) Cooking information provision system
JP3171542U (en) Health food provision system
KR20010074277A (en) Portable Diet Controller and Diet Control Method Using the Diet Controller
JP5101323B2 (en) Cooking support device
JP2022071655A (en) Program and information processor

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
AMND Amendment
E601 Decision to refuse application
AMND Amendment