KR102436656B1 - Method for providing educational game to improve eating habits - Google Patents

Abstract

A method of providing an educational eating habit improvement game according to some embodiments of the present disclosure is disclosed. The method of providing a game for improving eating habits for education includes: acquiring an image including at least one of tableware and food; calculating a score based on at least one of a change in the position of the dishes or a change in the amount of the food; and outputting a preset message based on the score.

Description

METHOD FOR PROVIDING EDUCATIONAL GAME TO IMPROVE EATING HABITS

The present disclosure relates to an educational game, and more particularly, to a method of providing a game for improving a child's eating habits.

Eating can be a very important activity for humans to provide nutrients necessary for the body by consuming food. Although such a diet is an essential activity for humans, if a proper eating habit is not established at a young age, many diseases can occur even in adulthood.

For example, diabetes, high blood pressure, obesity, anorexia, etc., which occupy a lot in modern society, may be caused by poor eating habits at a young age.

Although many parents are aware that these eating habits are important, it is not easy to teach children the right eating habits. This is because a child's concentration or attention is less formed than that of an adult, so it is difficult just to feed one meal's worth of food.

As a result, parents often make promises to their children that they will give them a present if they eat well. However, these conciliatory measures may not be enough to get your child to eat right and focus on eating.

Therefore, there is a demand for educational games that can help children have the right eating habits.

Republic of Korea Patent Registration 10-2101633

The present disclosure has been devised in response to the background art described above, and is intended to provide a game for improving eating habits for education.

The technical problems of the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the following description.

According to an embodiment of the present disclosure for solving the above-described problem, a method for providing an educational eating habit improvement game includes: acquiring an image including at least one of tableware and food; calculating a score based on at least one of a change in the position of the dishes or a change in the amount of the food; and outputting a preset message based on the score. may include.

In addition, the image further includes a plate and a person to be photographed, and the step of calculating a score based on at least one of a change in the position of the tableware or a change in the amount of food may include: recognizing a first point and a second point related to a position of the subject's mouth; and adding a preset first score to a current score when the position of the tableware is changed from the first point to the second point. may include.

Also, when the position of the tableware is changed from the first point to the second point, calculating the score by adding a preset first score to the current score may include indicating that food is present on the tableware. if recognized, adding the first score to the current score; may include.

The calculating of the score based on at least one of a change in the position of the tableware and a change in the amount of food may include: recognizing a first region in which the food is present in a first image captured at a first time point; recognizing a second region in which the food is present in a second image captured at a second time point after the first time point; and calculating the score by comparing the size of the first region with the size of the second region. may include.

Also, the second time point may be a time point at which the movement of the tableware is not recognized for a preset time.

The calculating of the score by comparing the size of the first region with the size of the second region may include calculating a difference between the size of the first region and the size of the second region; and adding a second score calculated based on the difference to the current score. may include.

In addition, the first area is an area in which at least one object having a color other than the first color related to the plate in the first image exists, and the second area is, in the second image, other than the first color It may be an area in which at least one object having a color of .

In addition, the first area is an area in which at least one object having a color other than a first color related to a plate and a second color related to the tableware in the first image exists, and the second area is, The second image may be an area in which at least one object having a color other than the first color and the second color exists.

In addition, before acquiring the image, obtaining a first image of the empty plate and the second image of the plate containing the food is taken; The method further comprising: calculating a score based on at least one of a change in the position of the tableware or a change in the amount of food, wherein calculating the score by comparing the first image and the second image with the image step; may include.

The calculating of the score by comparing the first image and the second image with the image may include at least one of a degree to which the image is similar to the first image and a degree to which the image is dissimilar to the second image. calculating the score based on may include.

Also, the score may have a different value depending on the type of the food.

Also, the type of the food may be recognized based on at least one of a color or a shape of the food included in the image.

In addition, recognizing the number of times the subject included in the image to be photographed; calculating a third score based on the number of times of writing; and adding the third score to the current score. may further include.

In addition, when it is recognized whether the score has reached a preset target score, transmitting a preset message to the parent terminal; may further include.

In addition, when it is recognized that the score has reached the target score, executing an automatic payment algorithm for a preset product; may further include.

The calculating of the score based on at least one of a change in the position of the tableware or the change in the amount of food may include: receiving data related to the weight of the plate and the food from the plate; calculating a fourth score based on the data; and adding the fourth score to a current score; may include.

The technical solutions obtainable in the present disclosure are not limited to the above-mentioned solutions, and other solutions that are not mentioned are clearly to those of ordinary skill in the art to which the present disclosure belongs from the description below. can be understood

According to some embodiments of the present disclosure, it is possible to provide a game that allows a child to have a correct eating habit.

The effects obtainable in the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those of ordinary skill in the art to which the present disclosure belongs from the description below. .

Various aspects are now described with reference to the drawings, wherein like reference numbers are used to refer to like elements collectively. In the following examples, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more aspects. It will be evident, however, that such aspect(s) may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate describing one or more aspects.
1 is a block diagram illustrating an example of a computing device according to some embodiments of the present disclosure.
2 is a flowchart illustrating an example of a method for a computing device to output a preset message according to some embodiments of the present disclosure.
3 is a flowchart illustrating an example of a method in which a computing device calculates a score based on a change in a position of a tableware according to some embodiments of the present disclosure;
4 is a diagram for describing an example of a method for a computing device to calculate a score based on a change in a position of a tableware according to some embodiments of the present disclosure;
5 is a flowchart illustrating an example of a method of calculating, by a computing device, a score based on a change in an amount of food according to some embodiments of the present disclosure.
6 is a diagram for describing an example of a method of calculating a score based on a change in an amount of food by a computing device according to some embodiments of the present disclosure;
7 is a flowchart illustrating an example of a method of calculating, by a computing device, a score based on a change in an amount of food according to some embodiments of the present disclosure.
FIG. 8 is a flowchart illustrating an example of a method in which a computing device calculates a score based on the number of times a photographed person writes, according to some embodiments of the present disclosure.
9 shows a general schematic diagram of an example computing environment in which embodiments of the present disclosure may be implemented.

Various embodiments and/or aspects are now disclosed with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth to provide a thorough understanding of one or more aspects. However, it will also be appreciated by one of ordinary skill in the art that such aspect(s) may be practiced without these specific details. The following description and accompanying drawings set forth in detail certain illustrative aspects of one or more aspects. These aspects are illustrative, however, and some of the various methods in principles of various aspects may be employed, and the descriptions set forth are intended to include all such aspects and their equivalents. Specifically, as used herein, “embodiment”, “example”, “aspect”, “exemplary”, etc. is not to be construed as an advantage or advantage of any aspect or design described over other aspects or designs. It may not be.

Hereinafter, the same or similar components are assigned the same reference numerals regardless of reference numerals, and redundant description thereof will be omitted. In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical ideas disclosed in the present specification are not limited by the accompanying drawings.

Although the first, second, etc. are used to describe various elements or elements, these elements or elements are not limited by these terms, of course. These terms are only used to distinguish one element or component from another. Therefore, it goes without saying that the first element or component mentioned below may be the second element or component within the spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used with the meaning commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless clearly defined in particular.

In addition, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless otherwise specified or clear from context, "X employs A or B" is intended to mean one of the natural implicit substitutions. That is, X employs A; X employs B; or when X employs both A and B, "X employs A or B" may apply to either of these cases. It should also be understood that the term “and/or” as used herein refers to and includes all possible combinations of one or more of the listed related items.

Also, the terms "comprises" and/or "comprising" mean that the feature and/or element is present, but excludes the presence or addition of one or more other features, elements and/or groups thereof. should be understood as not Also, unless otherwise specified or unless it is clear from context to refer to a singular form, the singular in the specification and claims should generally be construed to mean “one or more”.

In addition, as used herein, the terms “information” and “data” may often be used interchangeably.

When a component is referred to as being “connected” or “connected” to another component, it may be directly connected or connected to the other component, but it is understood that other components may exist in between. it should be On the other hand, when it is mentioned that a certain element is "directly connected" or "directly connected" to another element, it should be understood that no other element is present in the middle.

The suffixes "module" and "part" for the components used in the following description are given or used in consideration of ease of writing the specification, and do not have a meaning or role distinct from each other by themselves.

Objects and effects of the present disclosure, and technical configurations for achieving them will become clear with reference to the embodiments described below in detail in conjunction with the accompanying drawings. In describing the present disclosure, if it is determined that a detailed description of a well-known function or configuration may unnecessarily obscure the subject matter of the present disclosure, the detailed description thereof will be omitted. And the terms to be described later are terms defined in consideration of functions in the present disclosure, which may vary according to the intention or custom of the user or operator.

However, the present disclosure is not limited to the embodiments disclosed below and may be implemented in various different forms. Only the present embodiments are provided so that the present disclosure is complete, and to fully inform those of ordinary skill in the art to which the present disclosure belongs, the scope of the disclosure, and the present disclosure is only defined by the scope of the claims . Therefore, the definition should be made based on the content throughout this specification.

In the present disclosure, an educational eating habit improvement game can enable a child to form a correct eating habit.

Specifically, the computing device may photograph a subject (a child), dishes, food, and plates through the camera. In addition, the computing device may recognize whether the person to be photographed is eating through the image acquired through the camera. For example, when the computing device recognizes that the food on the plate has entered the mouth of the person to be photographed through the image, the computing device may recognize that the person to be photographed has eaten. In this case, the computing device may output a message of praise and the like that can be recognized by the photographed person. However, the present invention is not limited thereto.

Hereinafter, a method of providing an educational eating habit improvement game according to the present disclosure will be described with reference to FIGS. 1 to 9 .

1 is a block diagram illustrating an example of a computing device according to some embodiments of the present disclosure.

Referring to FIG. 1 , a computing device 100 may include a processor 110 , a storage unit 120 , and a communication unit 130 . However, since the above-described components are not essential in implementing the computing device 100 , the computing device 100 may have more or fewer components than those listed above.

The computing device 100 is a personal computer (PC), a notebook (note book), a mobile terminal, a smart phone (smart phone), a tablet PC (tablet pc), a web cap (web-cam) owned by the user and the like, and may include all types of terminals capable of accessing a wired/wireless network. However, the present invention is not limited thereto.

In the present disclosure, the computing device 100 may take a picture of a person to be photographed eating through a camera unit (not shown). And, the computing device 100 may recognize whether the person to be photographed is eating through the image acquired through the camera unit. However, the present invention is not limited thereto. Hereinafter, a method in which the computing device 100 recognizes whether the person to be photographed is eating through an image photographed will be described later with reference to FIGS. 2 to 8 .

Meanwhile, in the present disclosure, the computing device 100 may be any type of server, such as a microprocessor, a mainframe computer, a digital processor, a portable device, or a device controller. In this case, the computing device 100 may receive an image of a photographed person eating a meal from an external terminal having a camera unit. However, the present invention is not limited thereto.

Meanwhile, the processor 110 may typically process the overall operation of the computing device 100 . The processor 210 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the storage unit 120 . .

The storage unit 120 may include a memory and/or a permanent storage medium. The memory includes a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg SD or XD memory, etc.), and a random access memory (RAM). Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk, optical disk It may include at least one type of storage medium.

In the present disclosure, the storage unit 120 may store any type of information generated or determined by the processor 110 and any type of information received by the communication unit 130 .

On the other hand, the communication unit 130 is one that enables communication between the computing device 100 and the communication system, between the computing device 100 and the parent terminal (not shown), or between the computing device 100 and the network (not shown). It may include more than one module.

The communication unit 130 may include at least one of a mobile communication module, a wired Internet module, and a wireless Internet module. However, the present invention is not limited thereto.

2 is a flowchart illustrating an example of a method for a computing device to output a preset message according to some embodiments of the present disclosure.

Referring to FIG. 2 , the processor 110 of the computing device 100 may acquire an image including at least one of tableware and food ( S110 ).

Specifically, the processor 110 may acquire an image including at least one of tableware and food through the camera unit. Here, the tableware may be a spoon, chopsticks, a fork, or a user's hand. However, the present invention is not limited thereto.

Meanwhile, in the present disclosure, the computing device 100 may be a server. In this case, the processor 110 of the computing device 100 may receive an image including at least one of tableware and food from an external terminal through the communication unit 130 . However, the present invention is not limited thereto.

Meanwhile, the processor 110 of the computing device 100 may calculate a score based on at least one of a change in the position of dishes or a change in the amount of food ( S120 ). Here, the score may be a numerical value recorded in order to provide a preset message or a reward to the person (child) to be photographed.

For example, the score may be preset in response to a change in the position of the dishes or a change in the amount of food. Also, when a recorded current score exists, the processor 110 may add a newly calculated score to the current score. However, the present invention is not limited thereto. Hereinafter, the processor 110 adds the newly calculated score to the current score will be described later with reference to FIG. 3 .

Meanwhile, the processor 110 of the computing device 100 may recognize a first point related to the position of the plate and a second point related to the position of the subject's mouth in the image including at least one of tableware and food. Then, when the processor 110 recognizes that the position of the tableware has changed from the first point to the second point, the processor 110 may calculate a score. However, the present invention is not limited thereto. Hereinafter, an example of a method in which the processor 110 calculates a score based on a change in the position of the tableware will be described with reference to FIG. 3 .

As another example, the processor 110 may recognize whether the amount of food has changed through the first image captured at the first time point and the second image captured at a second time point after the first time point. In addition, when recognizing that the amount of food has changed, the processor 110 may calculate a score. However, the present invention is not limited thereto. Hereinafter, an example of a method in which the processor 110 calculates a score based on a change in the amount of food will be described with reference to FIG. 5 .

Meanwhile, the processor 110 of the computing device 100 may output a preset message based on the calculated score ( S130 ). Here, the preset message may be a message for praise or a message for reward payment. In addition, the preset message may be pre-stored in the storage unit 120 .

Specifically, the processor 110 may output a preset message when a score is calculated according to a change in the position of the dishes or a change in the amount of food. However, the present invention is not limited thereto.

For example, when a score is calculated as the processor 110 recognizes that the position of the tableware has changed, "The current score is 10 points!" Alternatively, a message such as "I am eating well" can be output. However, the present invention is not limited thereto.

Meanwhile, in the present disclosure, the preset message may include a video or sound effect. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, the processor 110 of the computing device 100 may output various messages based on whether the calculated score reaches a specific score.

For example, the processor 110 may output a first message when the score is calculated for the first time. For example, the first message is "The current score is 10 points!" Or it could be a message such as "I'm eating well". Then, when the calculated score reaches a specific score, the processor 110 may output a second message. For example, the second message may be a message such as “break through 70” or “be strong a little more”. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, when the processor 110 of the computing device 100 recognizes whether the score reaches a preset target score, it may transmit a preset message to the parent terminal. Here, the preset target score may be input in advance from the user of the parent terminal. In this case, the user of the parent terminal may recognize whether the person to be photographed has eaten well by checking the message. However, the present invention is not limited thereto.

Meanwhile, in the present disclosure, the message transmitted by the processor 110 of the computing device 100 to the parent terminal may be a message requesting compensation. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, when the processor 110 of the computing device 100 recognizes that the score has reached the target score, it may execute an automatic payment algorithm for a preset product.

Specifically, the processor 110 may provide an educational eating habit improvement game by driving the application program stored in the storage unit 120 . In this case, the application program may be linked with products that can be paid in-app. In this case, the processor 110 may purchase at least one product by executing an automatic payment algorithm for a preset product as the score reaches the target score. However, the present invention is not limited thereto.

According to the above-described configuration, the computing device 100 may output a preset message based on an image of a photographed person eating a meal. Accordingly, the computing device 100 may induce the person to be photographed to receive a reward by completing a meal well.

Meanwhile, according to some embodiments of the present disclosure, the processor 110 of the computing device 100 may recognize whether the person to be photographed has eaten based on a change in the position of the dishes. And, when it is recognized that the processor 110 has eaten, the processor 110 may calculate a score. Hereinafter, an example of a method in which the processor 110 according to the present disclosure calculates a score based on a change in the position of dishes will be described.

3 is a flowchart illustrating an example of a method in which a computing device calculates a score based on a change in a position of a tableware according to some embodiments of the present disclosure;

In the present disclosure, the processor 110 of the computing device 100 may acquire an image including at least one of tableware and food through the camera unit. In this case, the processor 110 may acquire an image further including a plate and a person to be photographed.

In this case, referring to FIG. 3 , the processor 110 of the computing device 100 may recognize a first point related to the position of the plate and a second point related to the position of the subject's mouth in the acquired image ( S121).

As an example, the processor 110 may recognize a plate, the position of the face and mouth of the photographed person, etc. using a learning model derived through a plurality of learning data. In addition, the processor 110 may recognize the position associated with the recognized plate and the position of the subject's mouth as the first point and the second point, respectively. However, the present invention is not limited thereto, and the first point and the second point may be recognized based on an input from a parent.

Meanwhile, when the position of the tableware is changed from the first point to the second point (S122, Yes), the processor 110 of the computing device 100 may add a preset first score to the current score (S123). .

Specifically, when recognizing that the recognized tableware has changed from the first point to the second point, the processor 110 may calculate a preset first score. Then, when the first score is calculated, the processor 110 may add a preset first score to the current score. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, when the first score is calculated, the processor 110 of the computing device 100 determines that the score is calculated based on at least one of a change in the position of dishes or a change in the amount of food. It is possible to output a message different from the message output accordingly. Then, the processor 110 may add the first score to the current score. However, the present invention is not limited thereto.

Meanwhile, in the present disclosure, the processor 110 may recognize dishes using a learning model derived through a plurality of learning data. However, the present invention is not limited thereto, and the tableware may be recognized based on an input from a parent.

Meanwhile, according to some embodiments of the present disclosure, a sensor for detecting movement of the dish may be attached to the dish. In this case, the communication unit 130 of the computing device 100 may receive data for recognizing whether the dish has moved from a sensor attached to the dish. Then, when the processor 110 recognizes that the dish has moved from the first point to the second point based on the received data, the processor 110 may add a preset first score to the current score. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, the processor 110 of the computing device 100 may add the first score to the current score only when recognizing that there is food on the tableware.

Specifically, when the position of the tableware changes from the first point to the second point, the processor 110 may recognize whether food is present on the tableware. Then, when recognizing that food is present on the tableware, the processor 110 may add the first score to the current score. Also, when recognizing that there is no food on the tableware, the processor 110 may not add the first score to the current score. However, the present invention is not limited thereto.

Meanwhile, in the present disclosure, the processor 110 of the computing device 100 may recognize dishes based on a learning model or an input from a parent. In this case, when the processor 110 recognizes that an object other than the tableware is seated or exists on the recognized tableware, the processor 110 may recognize the recognized object as food. However, the present invention is not limited thereto, and the processor 110 may recognize food based on a learning model or an input from a parent.

On the other hand, when the processor 110 of the computing device 100 recognizes that the position of the dishes has not changed from the first point to the second point (S122, No), it can wait until it is recognized that the position of the dishes has changed. have. However, the present invention is not limited thereto.

Meanwhile, in the present disclosure, the processor 110 of the computing device 100 may recognize whether the position change of the dishes has not been made for a preset period of time. In this case, the processor 110 may output a message, a video, an alarm, or the like that allows the person to be photographed to eat. However, the present invention is not limited thereto.

According to the above-described configuration, the processor 110 of the computing device 100 recognizes whether the person to be photographed has eaten food, based on whether the position of the dishes, food, plate, and the photographed person has changed in the photographed image. can do. Then, when the processor 110 recognizes that the person to be photographed has eaten food, the processor 110 may record the current score by adding the first score. However, the present invention is not limited thereto.

4 is a diagram for describing an example of a method for a computing device to calculate a score based on a change in a position of a tableware according to some embodiments of the present disclosure;

Referring to FIG. 4 , the processor (not shown) of the computing device 100 captures at least one of the tableware 200 , the food 300 , the plate 400 , and the subject 500 through the camera unit (not shown). can be filmed However, the present invention is not limited thereto.

Meanwhile, the processor 110 of the computing device 100 may recognize at least one of the tableware 200 , the food 300 , the plate 400 , and the subject 500 from the captured image. At this time, the processor 110 may recognize the second point related to the position of the mouth of the subject 500 from the first point related to the position of the plate 400 from the captured image. Then, when the processor 110 recognizes that the position of the tableware 200 has changed from the first point to the second point, the processor 110 may recognize that the subject 500 has eaten. In this case, the processor 110 may calculate the first score and add the first score to the current score. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, the processor 110 of the computing device 100 may calculate a score based on a change in the amount of food. Hereinafter, an example of a method in which the processor 110 according to the present disclosure calculates a score based on a change in the amount of food will be described with reference to FIG. 5 .

5 is a flowchart illustrating an example of a method of calculating, by a computing device, a score based on a change in an amount of food according to some embodiments of the present disclosure.

Referring to FIG. 5 , the processor 110 of the computing device 100 may recognize a first area in which food is present in a first image captured at a first point in time ( S210 ).

For example, the processor 110 may recognize food using a learning model derived through a plurality of learning data. In addition, the processor 110 may recognize an area in which the recognized food exists as the first area. However, the present invention is not limited thereto, and the first region or food may be recognized based on an input from a parent.

Meanwhile, in the present disclosure, the first time point may be a time point at which the person to be photographed starts to consume food. For example, the first time point may be a time point at which image capturing starts. As another example, the first time point may be a time point set based on an input from a parent. However, the present invention is not limited thereto.

Meanwhile, the processor 110 of the computing device 100 may recognize the second region in which food is present in the second image captured at the second time point after the first time point ( S220 ). Here, the second time point may be a time point after a preset time from the first time point. However, the present invention is not limited thereto.

For example, the processor 110 of the computing device 100 may recognize a point in time when a change in the position of the dishes is recognized as the second time point. In this case, the processor 110 may recognize the second region only at the second time point when the position change of the dishes is recognized, without the need to continuously recognize the second region. However, the present invention is not limited thereto.

As another example, the second time point may be a time point at which it is recognized that the person to be photographed has finished eating.

Specifically, the processor 110 of the computing device 100 may recognize whether the movement of the dishes is not recognized for a preset time. In addition, the processor 110 may recognize a point in time when the movement of the dishes is not recognized for a preset time as the second time point. However, the present invention is not limited thereto.

As another example, the second time point may be a time point at which it is recognized that the person to be photographed has finished eating based on an input from the parent. However, the present invention is not limited thereto.

Meanwhile, the processor 110 of the computing device 100 may calculate a score by comparing the size of the first region with the size of the second region ( S230 ).

Specifically, when the processor 110 recognizes that the size of the second region is smaller than the size of the first region, the processor 110 may recognize that the subject to be photographed has eaten food. Then, the processor 110 may calculate a score according to the intake of food by the photographed person. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, the processor 110 of the computing device 100 may recognize that the size of the second region has not decreased than the size of the first region even after a preset time has elapsed. In this case, the processor 110 may output a message, a video, an alarm, or the like that allows the person to be photographed to eat. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, the processor 110 of the computing device 100 may add a score to the current score based on a difference between the size of the first region and the size of the second region.

Specifically, the processor 110 may calculate a difference between the recognized size of the first area and the size of the second area. In addition, the processor 110 may add the second score calculated based on the calculated difference to the current score.

For example, when the difference between the calculated size of the first region and the size of the second region is equal to or greater than a preset value, the processor 110 may add a second score. Alternatively, the processor 110 may not add the second score when the calculated difference between the size of the first region and the size of the second region is less than or equal to a preset value. However, the present invention is not limited thereto. Hereinafter, an example in which the processor 110 according to the present disclosure adds the second score to the current score based on the difference between the size of the first region and the size of the second region will be described later with reference to FIG. 6 .

Meanwhile, according to some embodiments of the present disclosure, when the second score is calculated, the processor 110 of the computing device 100 determines that the score is calculated based on at least one of a change in the position of the dishes or a change in the amount of food. It is possible to output a message different from the message output accordingly. Then, the processor 110 may add the second score to the current score.

For example, as the second score is calculated, the output message is "Shall we eat all the food in this area?" Or it may be a message such as "I only eat this area". However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, the processor 110 of the computing device 100 may recognize food based on a color.

Specifically, the processor 110 may recognize an area in which at least one object having a color other than the first color associated with the plate in the first image captured at the first point of view is present as the first area. In this case, the first color related to the plate may be pre-inputted by the parent, or an empty plate containing no food may be photographed in advance and recognized. However, the present invention is not limited thereto. Also, the processor 110 may recognize an area in which at least one object having a color other than the first color exists in the second image captured at a second time point after the first time point as the second area. In addition, the processor 110 may calculate a score by comparing the sizes of the first region and the second region. However, the present invention is not limited thereto.

Meanwhile, in the present disclosure, the tableware may also be photographed in the first image photographed at the first time point and the second image photographed at the second time point. In this case, the processor 110 of the computing device 100 may recognize at least one object having a color other than the second color related to the tableware and the first color related to the plate as food.

Specifically, the processor 110 recognizes, as a second area, an area in which at least one object having a color other than the first color related to the plate and the second color related to the tableware exists in the first image captured at the first time point. can do. In this case, the second color related to the tableware may be pre-inputted by the parent or may be recognized by being photographed in advance. Also, the processor 110 may recognize an area in which at least one object having a first color and a color other than the first color exists in the second image captured at the second time point as the second area. In addition, the processor 110 may calculate a score by comparing the sizes of the first region and the second region. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, a sensor for detecting the weight of food may be provided on the plate. In this case, the communication unit 130 of the computing device 100 may receive data related to the weight of the plate and food from a sensor provided on the plate. Also, when the processor 110 recognizes that the weight of the food is reduced based on the received data, the processor 110 may calculate the fourth score by recognizing that the person to be photographed has consumed the food. In this case, the processor 110 may add the calculated fourth score to the current score. However, the present invention is not limited thereto.

According to the above configuration, the processor 110 of the computing device 100 may recognize food in the first image and the second image. In addition, the processor 110 may recognize that the subject to be photographed has consumed the food and calculate a score based on whether the recognized food is reduced.

6 is a diagram for describing an example of a method of calculating a score based on a change in an amount of food by a computing device according to some embodiments of the present disclosure;

Referring to FIG. 6A , the processor 110 of the computing device 100 may recognize the first region 310 in which food is present in the first image captured at the first time point.

For example, the processor 110 may recognize food based on a color, and recognize an area in which the recognized food exists as the first region 310 . However, the present invention is not limited thereto.

Meanwhile, referring to FIG. 6B , the processor 110 of the computing device 100 may recognize the second region 320 in which food is present in the second image captured at the second time point. And, when the first region 310 and the second region 320 are recognized, the processor 110 may calculate a score by comparing the size of the first region and the size of the second region. However, the present invention is not limited thereto.

Meanwhile, referring to FIG. 6C , the processor 110 of the computing device 100 may recognize the third region 330 in the first image captured at the first time point.

For example, the third region 330 may be a partial region among regions in which food is present. Here, some areas may have been previously input by the parent.

That is, the parent may designate a portion of the food as the third area directly or through the parent terminal. However, the present invention is not limited thereto.

Meanwhile, referring to FIG. 6D , the processor 110 of the computing device 100 may recognize whether food is present in the third area 330 in the second image captured at the second time point. have. In addition, when recognizing that there is no food in the third area, the processor 110 may calculate a score by recognizing that the photographed person has consumed all the food of the amount input by the parent. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, a score calculated based on a change in the position of dishes or a change in the amount of food may have a different value depending on the type of food.

Specifically, the food may have a preset value according to the type. For example, each of the plurality of foods may have a preset value based on an input from a parent.

For example, a score such as "10 points" for cherry tomatoes and "20 points" for broccoli may be preset. In this case, the processor 110 of the computing device 100 may recognize each type of a plurality of foods included in the first image captured at the first time point and the second image captured at the second time point. In this case, the processor 110 may calculate a preset score according to a plurality of types of food. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, the processor 110 of the computing device 100 may have a preset message according to the type of food.

For example, when broccoli is recognized, the processor 110 may output a message such as "I get stronger if I eat broccoli" before recognizing whether or not the subject has eaten food. However, the present invention is not limited thereto.

Meanwhile, in the present disclosure, the processor 110 of the computing device 100 may recognize the type of food based on at least one of a color or a shape of the food included in the image. However, the present invention is not limited thereto, and the processor 110 may recognize each food using a learning model derived through a plurality of learning data or may recognize each food based on data pre-inputted from a parent. In this case, the processor 110 may calculate a preset score according to a plurality of types of food. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, when the processor 110 of the computing device 100 recognizes at least one region 310 , 320 , 330 in which food is present, at least one region or a related region It is also possible to output a message inducing the subject to eat food.

For example, the processor 110 may output to the third region 330 or a region related to the third region 330, “Shall we eat this portion this time?” Alternatively, a message such as a character may be output. However, the present invention is not limited thereto.

According to the above-described configuration, the processor 110 of the computing device 100 may recognize an area in which food is present on the plate. In addition, when recognizing that the amount of food existing in the recognized area has changed, the processor 110 may calculate a score.

On the other hand, according to some embodiments of the present disclosure, the processor 110 of the computing device 100 based on whether the first image photographed at the first time point and the second image photographed at the second time point are similar to each other, can also be calculated. Hereinafter, an example of a method in which the processor 110 according to the present disclosure calculates a score based on the first image and the second image will be described with reference to FIG. 7 .

7 is a flowchart illustrating an example of a method of calculating, by a computing device, a score based on a change in an amount of food according to some embodiments of the present disclosure.

Referring to FIG. 7 , before acquiring an image, the processor 110 of the computing device 100 may acquire a first image in which an empty plate is photographed and a second image in which a plate containing food is photographed ( S310 ). .

On the other hand, in the present disclosure, the first image in which the empty plate is photographed may be pre-stored in the storage unit 120 . However, the present invention is not limited thereto.

Meanwhile, the processor 110 of the computing device 100 may calculate a score by comparing the first image and the second image with the image ( S320 ).

Specifically, the processor 110 may calculate a score based on at least one of a degree to which the image of the plate and the food photographed is similar to the first image or the degree to which the image is dissimilar to the second image.

For example, when the processor 110 recognizes that the image is similar to the first image, the processor 110 may calculate a score by recognizing that the person to be photographed has eaten food. Alternatively, when the processor 110 recognizes that the image is similar to the second image, the processor 110 may not calculate a score by recognizing that the person to be photographed did not consume food. Alternatively, when the processor 110 recognizes that the image is dissimilar to the second image, the processor 110 may calculate a score by recognizing that the person to be photographed has consumed food. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, the processor 110 of the computing device 100 may calculate a score based on the number of times of masturbation (the number of chewing) of the subject. Hereinafter, an example of a method in which the processor 110 according to the present disclosure calculates a score based on the number of times of authorship of a photographed person will be described with reference to FIG. 8 .

FIG. 8 is a flowchart illustrating an example of a method in which a computing device calculates a score based on the number of times a photographed person writes, according to some embodiments of the present disclosure.

Referring to FIG. 8 , the processor 110 of the computing device 100 may recognize the number of times a person to be photographed included in an image (S410).

Specifically, the processor 110 may recognize the face of the photographed person and the mouth of the photographed person from the photographed image. In addition, the processor 110 may recognize the number of times of masturbation based on the number of times the subject's mouth moves. However, the present invention is not limited thereto.

On the other hand, according to some embodiments of the present disclosure, when the processor 110 of the computing device 100 recognizes that the tableware has moved from the first point where the plate is located to the second point where the mouth of the person to be photographed is located, the It is also possible to recognize the number of times of writing. Accordingly, the processor 110 may not recognize the number of times of masturbation when there is no food in the mouth of the subject. However, the present invention is not limited thereto.

Meanwhile, the processor 110 of the computing device 100 may calculate a third score based on the number of times of writing ( S420 ).

For example, the storage unit 120 of the computing device 100 may store the third score according to the number of times of authoring. In this case, the processor 110 may calculate the third score pre-stored in the storage unit 120 based on the number of times of writing. However, the present invention is not limited thereto.

Meanwhile, the processor 110 of the computing device 100 may add the calculated third score to the current score ( S430 ). In addition, the processor 110 may output a preset message as the third score is added to the current score. However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, when the processor 110 of the computing device 100 recognizes that the number of authoring strokes of the person to be photographed is not sufficient, the processor 110 outputs a message inducing that the number of times of authoring by the person to be photographed can be increased. You may.

For example, the processor 110 may output a message such as "chew it tightly" when it is recognized that the person to be photographed has swallowed food with a number of mastications less than or equal to a preset number of mastications. However, the present invention is not limited thereto.

Referring to FIGS. 1 to 8 , the processor 110 of the computing device 100 may recognize whether the person to be photographed consumes food from an image in which the photographed person consumes food. In addition, the processor 110 may output a preset message based on a score calculated as the person to be photographed consumes food. Accordingly, the computing device 100 may induce the subject (child) to be continuously interested in meals.

9 shows a general schematic diagram of an example computing environment in which embodiments of the present disclosure may be implemented.

While the present disclosure has been described above generally in the context of computer-executable instructions that may be executed on one or more computers, those skilled in the art will appreciate that the present disclosure may be implemented as a combination of hardware and software and/or in combination with other program modules. you will know

Generally, modules herein include routines, procedures, programs, components, data structures, etc. that perform particular tasks or implement particular abstract data types. In addition, those skilled in the art will appreciate that the methods of the present disclosure are suitable for single-processor or multiprocessor computer systems, minicomputers, mainframe computers as well as personal computers, handheld computing devices, microprocessor-based or programmable consumer electronics, etc. (each of which is It will be appreciated that other computer system configurations may be implemented, including those that may operate in connection with one or more associated devices.

The described embodiments of the present disclosure may also be practiced in distributed computing environments where certain tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

Computers typically include a variety of computer-readable media. Media accessible by a computer includes volatile and nonvolatile media, transitory and non-transitory media, removable and non-removable media. By way of example, and not limitation, computer-readable media may include computer-readable storage media and computer-readable transmission media.

Computer-readable storage media includes volatile and non-volatile media, temporary and non-transitory media, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. includes media. A computer-readable storage medium may be RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital video disk (DVD) or other optical disk storage device, magnetic cassette, magnetic tape, magnetic disk storage device, or other magnetic storage device. device, or any other medium that can be accessed by a computer and used to store the desired information.

Computer readable transmission media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism, and Includes any information delivery medium. The term modulated data signal means a signal in which one or more of the characteristics of the signal is set or changed so as to encode information in the signal. By way of example, and not limitation, computer-readable transmission media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media. Combinations of any of the above are also intended to be included within the scope of computer-readable transmission media.

An exemplary environment 1100 implementing various aspects of the disclosure is shown including a computer 1102 , the computer 1102 including a processing unit 1104 , a system memory 1106 , and a system bus 1108 . do. A system bus 1108 couples system components, including but not limited to system memory 1106 , to the processing device 1104 . The processing device 1104 may be any of a variety of commercially available processors. Dual processor and other multiprocessor architectures may also be used as processing unit 1104 .

The system bus 1108 may be any of several types of bus structures that may be further interconnected to a memory bus, a peripheral bus, and a local bus using any of a variety of commercial bus architectures. System memory 1106 includes read only memory (ROM) 1110 and random access memory (RAM) 1112 . A basic input/output system (BIOS) is stored in non-volatile memory 1110, such as ROM, EPROM, EEPROM, etc., which BIOS is the basic input/output system (BIOS) that helps transfer information between components within computer 1102, such as during startup. contains routines. RAM 1112 may also include high-speed RAM, such as static RAM, for caching data.

Computer 1102 may also include an internal hard disk drive (HDD) 1114 (eg, EIDE, SATA) - this internal hard disk drive 1114 may also be configured for external use within a suitable chassis (not shown). Yes—a magnetic floppy disk drive (FDD) 1116 (eg, for reading from or writing to removable diskette 1118), and an optical disk drive 1120 (eg, a CD-ROM) for reading from, or writing to, disk 1122, or other high capacity optical media such as DVD. The hard disk drive 1114 , the magnetic disk drive 1116 , and the optical disk drive 1120 are connected to the system bus 1108 by the hard disk drive interface 1124 , the magnetic disk drive interface 1126 , and the optical drive interface 1128 , respectively. ) can be connected to The interface 1124 for external drive implementation includes, for example, at least one or both of Universal Serial Bus (USB) and IEEE 1394 interface technologies.

These drives and their associated computer readable media provide non-volatile storage of data, data structures, computer executable instructions, and the like. For computer 1102, drives and media correspond to storing any data in a suitable digital format. Although the description of computer-readable storage media above refers to HDDs, removable magnetic disks, and removable optical media such as CDs or DVDs, those skilled in the art will use zip drives, magnetic cassettes, flash memory cards, cartridges, It will be appreciated that other tangible computer-readable storage media and the like may also be used in the exemplary operating environment and any such media may include computer-executable instructions for performing the methods of the present disclosure. .

A number of program modules may be stored in the drive and RAM 1112 , including an operating system 1130 , one or more application programs 1132 , other program modules 1134 , and program data 1136 . All or portions of the operating system, applications, modules, and/or data may also be cached in RAM 1112 . It will be appreciated that the present disclosure may be implemented in various commercially available operating systems or combinations of operating systems.

A user may enter commands and information into the computer 1102 via one or more wired/wireless input devices, for example, a pointing device such as a keyboard 1138 and a mouse 1140 . Other input devices (not shown) may include a microphone, IR remote control, joystick, game pad, stylus pen, touch screen, and the like. Although these and other input devices are often connected to the processing unit 1104 through an input device interface 1142 that is connected to the system bus 1108, parallel ports, IEEE 1394 serial ports, game ports, USB ports, IR interfaces, It may be connected by other interfaces, etc.

A monitor 1144 or other type of display device is also coupled to the system bus 1108 via an interface, such as a video adapter 1146 . In addition to the monitor 1144, the computer typically includes other peripheral output devices (not shown), such as speakers, printers, and the like.

Computer 1102 may operate in a networked environment using logical connections to one or more remote computers, such as remote computer(s) 1148 via wired and/or wireless communications. Remote computer(s) 1148 may be workstations, server computers, routers, personal computers, portable computers, microprocessor-based entertainment devices, peer devices, or other common network nodes, and are generally Although including many or all of the components described, only memory storage device 1150 is shown for simplicity. The logical connections shown include wired/wireless connections to a local area network (LAN) 1152 and/or a larger network, eg, a wide area network (WAN) 1154 . Such LAN and WAN networking environments are common in offices and companies, and facilitate enterprise-wide computer networks, such as intranets, all of which can be connected to a worldwide computer network, for example, the Internet.

When used in a LAN networking environment, the computer 1102 is connected to the local network 1152 through a wired and/or wireless communication network interface or adapter 1156 . Adapter 1156 may facilitate wired or wireless communication to LAN 1152 , which also includes a wireless access point installed therein for communicating with wireless adapter 1156 . When used in a WAN networking environment, the computer 1102 may include a modem 1158 , connected to a communication server on the WAN 1154 , or otherwise establishing communications over the WAN 1154 , such as over the Internet. have the means A modem 1158 , which may be internal or external and a wired or wireless device, is coupled to the system bus 1108 via a serial port interface 1142 . In a networked environment, program modules described for computer 1102 or portions thereof may be stored in remote memory/storage device 1150 . It will be appreciated that the network connections shown are exemplary and other means of establishing a communication link between the computers may be used.

Computer 1102 may be associated with any wireless device or object that is deployed and operates in wireless communication, for example, printers, scanners, desktop and/or portable computers, portable data assistants (PDAs), communication satellites, wireless detectable tags. It operates to communicate with any device or place, and phone. This includes at least Wi-Fi and Bluetooth wireless technologies. Accordingly, the communication may be a predefined structure as in a conventional network or may simply be an ad hoc communication between at least two devices.

Wi-Fi (Wireless Fidelity) makes it possible to connect to the Internet, etc. without a wire. Wi-Fi is a wireless technology such as cell phones that allows these devices, eg, computers, to transmit and receive data indoors and outdoors, ie anywhere within range of a base station. Wi-Fi networks use a radio technology called IEEE 802.11 (a, b, g, etc.) to provide secure, reliable, and high-speed wireless connections. Wi-Fi can be used to connect computers to each other, to the Internet, and to wired networks (using IEEE 802.3 or Ethernet). Wi-Fi networks may operate in unlicensed 2.4 and 5 GHz radio bands, for example, at 11 Mbps (802.11a) or 54 Mbps (802.11b) data rates, or in products that include both bands (dual band). have.

A person of ordinary skill in the art of the present disclosure will recognize that the various illustrative logical blocks, modules, processors, means, circuits and algorithm steps described in connection with the embodiments disclosed herein include electronic hardware, (convenience For this purpose, it will be understood that it may be implemented by various forms of program or design code (referred to herein as "software") or a combination of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. A person skilled in the art of the present disclosure may implement the described functionality in various ways for each specific application, but such implementation decisions should not be interpreted as a departure from the scope of the present disclosure.

The various embodiments presented herein may be implemented as methods, apparatus, or articles of manufacture using standard programming and/or engineering techniques. The term “article of manufacture” includes a computer program or media accessible from any computer-readable device. For example, computer-readable storage media include magnetic storage devices (eg, hard disks, floppy disks, magnetic strips, etc.), optical disks (eg, CDs, DVDs, etc.), smart cards, and flash drives. memory devices (eg, EEPROMs, cards, sticks, key drives, etc.). The term “machine-readable medium” includes, but is not limited to, wireless channels and various other media capable of storing, retaining, and/or carrying instruction(s) and/or data.

The description of the presented embodiments is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the scope of the present disclosure. Thus, the present disclosure is not intended to be limited to the embodiments presented herein, but is to be construed in the widest scope consistent with the principles and novel features presented herein.

Claims (16)

acquiring an image including at least one of tableware and food;
calculating a score based on at least one of a change in the position of the dishes or a change in the amount of the food; and
outputting a preset message based on the score, and executing an automatic payment algorithm for a preset product when recognizing that the score has reached a preset target score;
containing,
How to provide educational eating habits improvement games.
The method of claim 1,
The video is
Further including a plate and a person to be photographed,
Calculating a score based on at least one of a change in the position of the tableware or a change in the amount of food includes:
Recognizing a first point related to the position of the plate in the image and a second point related to the position of the subject's mouth; and
adding a preset first score to a current score when the position of the tableware changes from the first point to the second point;
containing,
How to provide educational eating habits improvement games.
3. The method of claim 2,
calculating the score by adding a preset first score to the current score when the position of the tableware changes from the first point to the second point;
adding the first score to the current score when it is recognized that there is food on the tableware;
containing,
How to provide educational eating habits improvement games.
The method of claim 1,
Calculating a score based on at least one of a change in the position of the tableware or a change in the amount of food includes:
recognizing a first area in which the food is present in a first image captured at a first point in time;
recognizing a second region in which the food is present in a second image captured at a second time point after the first time point; and
calculating the score by comparing the size of the first region with the size of the second region;
containing,
How to provide educational eating habits improvement games.
5. The method of claim 4,
The second time point is
A point in time when the movement of the tableware is not recognized for a preset time,
How to provide educational eating habits improvement games.
5. The method of claim 4,
Comparing the size of the first region and the size of the second region to calculate the score,
calculating a difference between the size of the first region and the size of the second region; and
adding a second score calculated based on the difference to the current score;
containing,
How to provide educational eating habits improvement games.
5. The method of claim 4,
The first area is
It is an area in which at least one object having a color other than the first color related to the plate in the first image exists,
The second area is
an area in which at least one object having a color other than the first color exists in the second image,
How to provide educational eating habits improvement games.
5. The method of claim 4,
The first area is
An area in which at least one object having a color other than the first color related to the plate and the second color related to the tableware in the first image exists;
The second area is
an area in which at least one object having a color other than the first color and the second color exists in the second image;
How to provide educational eating habits improvement games.
The method of claim 1,
Before acquiring the image, obtaining a first image of an empty plate and a second image of a plate containing the food;
further comprising,
Calculating a score based on at least one of a change in the position of the tableware or a change in the amount of food includes:
calculating the score by comparing the first image and the second image with the image;
containing,
How to provide educational eating habits improvement games.
10. The method of claim 9,
Comparing the first image and the second image with the image to calculate the score,
calculating the score based on at least one of a degree to which the image is similar to the first image or a degree to which the image is dissimilar to the second image;
containing,
How to provide educational eating habits improvement games.
The method of claim 1,
The score is
having a different value depending on the type of food,
How to provide educational eating habits improvement games.
12. The method of claim 11,
The kind of food is,
Recognized based on at least one of a color or shape of food included in the image,
How to provide educational eating habits improvement games.
3. The method of claim 2,
recognizing the number of times the photographed person authored included in the image;
calculating a third score based on the number of times of writing; and
adding the third score to the current score;
further comprising,
How to provide educational eating habits improvement games.
The method of claim 1,
transmitting a preset message to a parent terminal when recognizing whether the score has reached a preset target score;
further comprising,
How to provide educational eating habits improvement games.
delete The method of claim 1,
Calculating a score based on at least one of a change in the position of the tableware or a change in the amount of food includes:
Receiving data related to the weight of the plate and food from the plate;
calculating a fourth score based on the data; and
adding the fourth score to a current score;
containing,
How to provide educational eating habits improvement games.

Images