KR102264334B1 - Inducing method of mastication movement and a recording medium recording a program for executing thereof - Google Patents

Abstract

The present invention relates to a method for inducing a mastication movement and a recording medium in which a program for executing the same is recorded.
Authoring motion induction method according to an example of the present invention is a face recognition step of recognizing the user's face for driving the content (contents); a content operation step in which the content is driven for a first period after the face recognition step; a sensing step of detecting whether a user who uses the content during the first period performs an authoring movement; and a time extension step of extending a driving time of the content when the authoring movement of the user is detected during the first period.
The present invention may be provided as a recording medium in which a program for executing the above-described masticatory movement induction method is recorded.

Description

A method of inducing a mastication movement and a recording medium in which a program for executing the method is recorded {Inducing method of mastication movement and a recording medium recording a program for executing thereof}

The present invention relates to a method for inducing masticatory movement and a recording medium in which a program for executing the method is recorded, and more specifically, a method for inducing a masticatory movement of infants at a time when eating habits are formed, and a program for executing the same It relates to a recording medium.

Mastication refers to the act of chewing food. This chewing simply means making food in a form that can be digested and swallowed.

This masticatory movement is a very important act of supplying nutrients necessary for the body by ingesting food, and it can be said that it is an act directly related to health. In particular, the behavior of distracting attention during meals and improper eating habits, such as consuming food in a hurry, impair health and become a major cause of diseases of the digestive system, diabetes, high blood pressure, and obesity.

Therefore, it is very important to educate young children, such as infants, to have good eating habits from an early age.

However, although all parents are aware of the importance of these meals and eating habits, it is not easy to teach children to focus on meals and have good eating habits as intended. it is a reality to

Moreover, when eating with parents or teachers, most children imitate the bad eating habits of their parents or teachers, so it is difficult to make them have good eating habits against their will.

Recently, some parents often use methods to induce meals using their children's favorite images or characters. Ingestion is causing secondary problems.

An object of the present invention is to provide a method for inducing a mastication movement and a recording medium on which a program for executing the same is recorded.

Authoring motion induction method according to an example of the present invention is a face recognition step of recognizing the user's face for driving the content (contents); a content operation step in which the content is driven for a first period after the face recognition step; a sensing step of detecting whether a user who uses the content during the first period performs an authoring movement; and a time extension step of extending a driving time of the content when the authoring movement of the user is detected during the first period.

and a stopping step of stopping driving of the content when the user's authoring motion is not detected during the first period.

According to the extension of the driving time of the content, the content may be continuously driven for a second period after the first period.

In the face recognition step, the user may perform a mastication motion by opening their mouth.

In the face recognition step, a facial guide line for positioning the user's face on the output unit, and a chewing guide line for opening the user's mouth more than required may be displayed.

In the content operation step, a video may be played during the first period.

The length of at least one of the first period and the second period may be set by the user or a guardian of the user.

The method may further include a content selection step in which content to be operated on an output unit of the electronic device is selected before the face recognition step.

In the content selection step, the content may be a moving picture provided and selected in the electronic device or may be selected by input of a file identifier address (Uniform Resource Locator, URL).

The detecting step may include: a face area detecting step of detecting the user's face area during the first period; a feature point extraction step of extracting a feature point for at least one of an eye, a nose, an upper lip, and a lower lip from the user's face; It may include; a mastication movement recognition step of recognizing the mastication movement of the user from the change in the position of the lower lip.

In the mastication movement recognition step, when the position of the lower lip goes down and rises at least once, it may be determined that the user is performing the mastication movement.

In addition, the present invention may be provided as a recording medium in which a program for executing the above-described masticatory movement inducing method is recorded.

A method for inducing authoring movement according to an example of the present invention and a recording medium in which a program for executing the method is recorded, detects whether the user performs the authoring movement in order to drive the content, and when the user's authoring movement is detected, the By extending the running time of the content, it is possible to induce the user's authoring movement.

1 is a diagram for explaining the concept of a mastication motion induction method according to an example of the present invention.
Figure 2 is a diagram for explaining an example of the terminal 100 for executing the mastication motion induction method according to an example of the present invention.
3 is a diagram for explaining an example of the structure of the app (APP) for executing the mastication exercise induction module 115 shown in FIG.
FIG. 4 is an example of a flowchart for explaining an example of a method in which the mastication motion induction module 115 shown in FIG. 2 operates.
5A to 5E are diagrams for explaining in more detail each step of the method in which the mastication motion inducing module 115 shown in FIG. 4 operates.
6 is a diagram for explaining content operation time setting and mode setting.
FIG. 7 is a flowchart for explaining the sensing step S4 shown in FIG. 3 .
8A to 8C are diagrams for explaining each step of FIG. 7 in more detail.
9 is a diagram for briefly explaining an example of decorating the robot and caring for the robot in FIG. 4 .

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In describing the present invention, if it is determined that adding a detailed description of a technique or configuration already known in the relevant field may make the gist of the present invention unclear, some of these will be omitted from the detailed description. In addition, the terms used in this specification are terms used to properly express the embodiments of the present invention, which may vary according to a person or custom in the relevant field. Accordingly, definitions of these terms should be made based on the content throughout this specification.

Hereinafter, a method for inducing a mastication movement according to the present invention and a recording medium in which a program for executing the method is recorded will be described with reference to the accompanying drawings.

Figure 1 is a diagram for explaining the concept of a method for inducing a mastication movement according to an example of the present invention, Figure 2 is a diagram for explaining an example of a terminal 100 for executing a method for inducing a mastication movement according to an example of the present invention .

Mastication refers to the act of chewing food. This masticatory movement is a very important act of supplying nutrients necessary for the body by ingesting food, and it can be said that it is an act directly related to health.

Therefore, it is very important to educate young children, such as infants, to have good eating habits from an early age.

Recently, as shown in FIG. 1 , in order to make it easier for the user 10 such as infants to consume food, the terminal 100 is used to induce food intake while allowing children to watch their favorite videos or characters. often do

However, when ingesting food while watching a video or character in this way, the user 10 has food in his mouth, but is immersed in watching a video, etc. have. As a result, proper eating habits are often not formed.

In order to solve this problem, the present invention provides a method of inducing an authoring movement, so that when the user 10 watches a video using the terminal 100, the content such as a video is played only when the authoring movement is performed. By allowing it to be driven, it is possible to improve the correct writing habit of the user 10 .

To this end, the authoring motion inducing method according to an example of the present invention may be installed and operated in the form of an application in the terminal 100 in which the content is driven.

The terminal 100 may be provided in the form of a mobile phone or a smart phone and a wireless communication terminal 100 that the user 10 can carry.

However, the present invention is not necessarily limited thereto, and the terminal 100 may include both wired and wireless communication devices as long as it is a communication device. For example, a tablet computer interworking with a camera, a laptop computer interworking with a camera, and portable media It may include a player, a personal digital assistant 100 (PDA), and the like.

As shown in FIG. 2 , the terminal 100 for performing the method for inducing the masticatory movement as described above may include a control unit 110 , a database unit 120 , an input unit 130 , and an output unit 140 .

The control unit 110 may include a communication module 111 , a camera module 113 , and a mastication motion induction module 115 .

When the user 10 inputs a file identifier address (Uniform Resource Locator, URL) using the input unit 130 to select content located outside through an Internet network, etc., the communication module 111 is the file identifier address. Wired or wireless communication can be performed with the outside so that the located content is displayed in the terminal 100 .

The camera module 113 may photograph the user 10 while the user 10 uses the content. As such, the photographing information of the user 10 may be used as data for determining whether the user 10 is performing a masturbation exercise through image analysis processing.

The authoring exercise inducing module 115 may be provided in the form of an application (APP) in which a program for inducing the authoring movement of the user 10 is stored.

When the user 10 executes such an authoring movement induction module 115, and selects and executes content in the authoring movement induction module 115, the authoring movement induction module 115 activates the camera module ( 113), it is possible to determine whether or not to extend the driving time of the contents by receiving the shooting information and determining whether the user 10 is doing the authoring exercise, and through this, the authoring movement of the user 10 can be induced.

The database unit 120 stores the photographing information photographed by the camera module 113 while the mastication movement induction module 115 is running, and records photographing information at the request of the mastication movement induction module 115 in the mastication movement induction module (115) may be provided.

The input unit 130 may be an input means such as a touch panel or a microphone provided in the terminal 100 , and may be used when the content is selected by the authoring motion induction module 115 .

The output unit 140 may be a display panel and a speaker provided in the terminal 100 to display an image or image, and when the authoring motion induction module 115 is executed and content is selected, an image for the corresponding content Alternatively, video and sound may be output through the output unit 140 .

Hereinafter, a method in which the above-described masticatory motion induction module 115 operates will be described.

3 is a diagram for explaining an example of the structure of the app (APP) for executing the masticatory motion induction module 115 shown in FIG. 2, and FIG. 4 is the mastication motion induction module 115 shown in FIG. 2 is operated It is an example of a flowchart for explaining an example of a method, and FIGS. 5A to 5E are diagrams for explaining each step of the method in which the masticatory motion induction module 115 shown in FIG. 4 operates in more detail, FIG. 6 is a diagram for explaining content operation time setting and mode setting.

When the app (APP) that executes the mastication exercise induction module 115 is executed, as shown in FIG. 3 , as an example, a login image, a user 10 selection image, a user 10 registration image, a basic screen image, It may be configured to include a guardian menu image, video viewing content, robot decorating content, and robot caring content.

In the login image, an image including an input field in which the user 10 ID and password can be input and a member registration field in which membership registration is possible may be displayed.

If you are a member, you can enter the user (10) ID and password to go to the basic screen image. If you are not a member, click the member registration box to select the user (10) to join the user (10) You can choose an image.

When clicking on the member registration box, the user 10 goes to the selected image, and in the user 10 selection, the case where the user 10 is an infant and the case where the user 10 is the guardian are selected, and the user 10 registration image is displayed. In the registration mode of the user 10 , the name, date of birth, and basic information of the guardian may be input.

When the user 10 ID and password are input on the login screen, the default screen image as shown in FIG. 5 may be transferred.

In the basic screen image, the parent menu (menu for guardians in Fig. 5) as the setting menu, the image view as the content to be driven, the robot decoration (the decoration menu in Fig. 5a), and the robot caring (mini game menu in Fig. 5a) images can be displayed have.

When the video view content is selected, the user 10 can watch the video content, and when the robot decorating menu is selected, the content that can decorate various pre-stored characters with various accessories can be driven, and when the robot caring menu is selected, , hand washing, eating, brushing, etc. various mini-game contents may be driven.

Here, when the user 10 executes viewing an image, decorating a robot (decoration menu in FIG. 5A ), and caring for a robot (mini game menu in FIG. 5A ), each content may be performed while inducing the user's authoring movement.

Hereinafter, when the user 10, who is an infant, selects an image view menu from the basic screen image shown in FIG. 5A , an example in which the method for inducing a mastication exercise is operated will be described.

When the user 10 selects the image view menu, the method of inducing a mastication movement may be operated.

As shown in Fig. 4, the authoring induction operation method according to an example of the present invention includes a content selection step (S1), a face recognition step (S2), a content operation step (S3), a detection step (S4), a stopping step (S5) ), a time extension step (S6) and an end step (S7).

When the image view menu is selected in FIG. 5A , as shown in FIGS. 4 and 5B , the content selection step S1 may be performed.

In the content selection step S1 , various video contents to be operated on the output unit 140 of the electronic device are displayed in FIG. 5B , and any one of the displayed contents may be selected.

Here, the content shown in FIG. 5B may be a selectable video provided in the electronic device or a video selected by input of a file identifier address (Uniform Resource Locator, URL).

In the content selection step (S1), when any one video content is selected, the face recognition step (S2) of FIG. 4 may be performed.

In the face recognition step S2, the face of the user 10 may be recognized for driving the content. To this end, as shown in (a) of FIG. 5C, a guide message for face recognition is displayed, and when OK is clicked, the user 10 is displayed on the screen of the output unit 140 as shown in (b). ), a facial guideline (G1) for guiding the position of the face, and a chewing guideline (G2) so that the mouth of the user 10 is opened more than required may be displayed.

In this face recognition step (S2), the user 10, as shown in (c) of Figure 5c, the terminal 100 so that the face of the user 10 is recognized in accordance with the facial guideline (G1) and the authoring guideline (G2) ) position and direction can be adjusted.

In the face recognition step (S2), when the user 10 repeatedly performs a mastication movement to spread and narrow the work in accordance with the authoring guideline G2, the face of the user 10 may be recognized. In this way, the mastication motion image recognized in the face recognition step (S2) may be used as sample data for detecting the mastication motion in the later detection step (S4).

When the face of the user 10 is recognized according to the facial guideline G1 and the authoring guideline G2, the selected video content is loaded and the content operation step S3 of FIG. 4 is performed, as shown in FIG. 5d, Video content may be played.

In the content operation step S3 , as shown in FIG. 5D , the selected video content may be driven and played for the first period. Here, the time length of the first period may be preset in the mastication exercise induction module 115 or selected and set by the user 10 or the user's 10 guardian as shown in FIG. 6 through the user menu. have.

In this way, the content operation step (S3) is executed, and while the selected video content is played as shown in FIG. 5D , a character G3 inducing the authoring movement is displayed at the edge of the video image, and the user 10's authoring movement can induce

In addition, in the detection step S4 , it is possible to detect whether the user 10 using the content during the first period performs the authoring movement through the camera module 113 of the terminal 100 .

That is, while the user 10 is watching the selected video content in the detection step S4, the camera module 113 continuously captures the user 10, analyzes the image of the captured shooting information, and through this, the user ( It can be determined whether 10) is masticating.

A method of determining whether or not a mastication motion is performed in the sensing step S4 will be described in more detail below with reference to FIG. 7 .

If it is determined in the detection step S4 that the user 10 does not perform the authoring exercise during the first period, as shown in FIG. 5E , the moving video content is stopped after the first period has elapsed, and FIG. 5E . A character inducing a masturbation movement, such as , may be displayed.

And, the detection step (S4) is repeatedly performed, so that the detection step (S4) may be continuously performed to detect whether the user 10 is masturbating.

When the user 10 performs the authoring exercise, the play time of the video content is extended in the time extension step S6 so that the video content can be played again.

If, during the first period during which the video content is played, the authoring movement of the user 10 is detected, the driving time of the content may be extended by the time extension step S6 without going through the stopping step S5, The authoring exercise inducing module 115 may allow the content to be continuously driven for the second period after the first period according to the extension of the driving time of the content.

Here, the length of time of the second period may be set by the user 10 or a guardian of the user 10 . Here, the length of the second period may be the same as or different from the length of the first period. In the present invention, the lengths of the first and second periods are the same, and the lengths of the first and second periods may be set in the guardian menu page as shown in FIG. 6 .

Then, in the end step (S7), before the play of the selected video content ends, the content operation step (S3), the detection step (S4), the stop step (S5), and the time extension step (S6) are repeatedly performed, When the selected video content is finished playing, the page may be moved back to the content selection step (S1).

Hereinafter, the sensing step (S4) of the present invention will be described in detail.

7 is a flowchart for explaining the sensing step S4 shown in FIG. 3 , and FIGS. 8A to 8C are diagrams for explaining each step of FIG. 7 in more detail.

As shown in FIG. 7 , an example of the detection step S4 according to the present invention may include a facial region detection step S41 , a feature point extraction step S42 , and a mastication motion recognition step S43 .

In the facial region detection step S41 , as shown in FIGS. 7 and 8A , the facial region SS of the user 10 during the first period during which the video content is executed or during the period during which the stop step S5 is executed. can detect

In the feature point extraction step S42 , as shown in FIGS. 7 and 8B , a feature point may be extracted from the facial region of the user 10 . Here, the region from which the feature point is extracted may be a region in which at least one of the eyes, nose, and upper lip and the lower lip are located in the face of the user 10 .

Through such feature point extraction, at least any one of the eyes, nose, and upper lip of the user 10 and the position of the lower lip may be recognized.

However, the present invention is not necessarily limited thereto, and if necessary, it is also possible to extract feature points for other parts such as the user's 10's chin or facial contour. As an example, it is also possible to extract a feature point for an area where the eyes, nose, upper lip, lower lip, and the chin line are located.

Hereinafter, for convenience of description, a case in which feature points for at least one of the eyes, nose, and upper lip and the region where the lower lip is located will be described as an example.

In this way, after the feature point of the user 10 is extracted, a change in the position of the feature point is sensed, and it is determined whether the user 10 performs the masticatory movement during the first period in the mastication motion recognition step S43 of FIG. 7 . .

Here, as shown in FIG. 8c , the masticatory movement is to determine whether or not to perform the masticatory movement of the user 10 from a change in the position of the lower lip among the eyes, nose, upper lip, and lower lip extracted as feature points of the user 10 . can

For example, in the mastication movement recognition step S43 , as shown in FIG. 8C , when the position of the lower lip goes down and rises at least once, it may be determined that the user 10 is performing the mastication movement.

More specifically, in order to detect a change in the position of the lower lip, after detecting the first gap D1 between the tip of the nose and the lower lip line sensed at the time of the masticatory movement in (a) of FIG. 8C , (b) ), when the masticatory movement is executed, the interval between the nose tip line and the lower lip line increases from the first interval D1 to the second interval D2, and again as in (c), the nose tip line and the lower lip line The line spacing may decrease from the second interval D2 to the third interval D3.

Accordingly, one execution cycle of the masticatory movement may be completed, and while the masticating movement is repeated, it is possible to determine whether the user 10 executes the masticating movement and how many times the masticating movement is performed.

Accordingly, the authoring movement induction module 115 according to an example of the present invention can determine whether the user 10 is performing the authoring movement while watching the video content, and if the authoring exercise is performed, the video content can be continuously viewed. control, and if the authoring movement is not performed, by stopping the operation of the video content, it is possible to induce the user 10 to continuously perform the authoring movement.

However, the mastication motion recognition step (S43) of the present invention is not necessarily limited to a change in the position of the lower lip, and any other method in which the mastication motion can be recognized is possible.

As another example, for more accurate recognition of masticatory motion, in the mastication motion recognition step (S43), the relative of the lower lip at the tip of the nose and the tip of the chin in order to exclude changes that occur while bowing or raising the head rather than the change of the lower lip itself. It is also possible to determine whether or not masticatory movement is performed by changing the position.

In addition, in FIGS. 3 to 8C , the method of inducing the authoring movement of the user 10 has been described as an example of a method operated in image viewing contents among video viewing contents, robot decorating contents, and robot caring contents, but the present invention is not limited thereto. However, it can be applied to other contents such as robot decorating content and robot caring content.

9 is a diagram for briefly explaining an example of decorating the robot and caring for the robot in FIG. 4 .

As an example, FIG. 9 shows an example of a brushing game among various mini-games exemplified in caring for a robot.

As shown in FIG. 9 , the method for inducing the masticating movement of the user 10 according to an example of the present invention is an image image of squeezing a toothbrush even in a brushing game (FIG. 9 (b)), an image of performing brushing (FIG. (c)), each step of the image of rinsing the mouth with a water cup (FIG. 9(d)) can also be controlled to move to another image when the mastication movement is performed.

Alternatively, differently from the above, in the method for inducing the authoring movement of the user 10 according to an example of the present invention, when the user 10 faithfully performs the authoring movement, the guardian of the user 10 gives a reward sticker, and the user It is also possible to enable content driving by the user 10 clicking the reward sticker by using the reward sticker provided by (10).

As such, the method for inducing authoring movement according to an example of the present invention and the recording medium on which a program for executing the same is recorded, detects whether the user 10 performs the authoring movement for driving the content, and the user 10 By extending the driving time of the content when the authoring movement of the user 10 is detected, the authoring movement of the user 10 may be induced.

The present invention is not limited to the above-described embodiments and the accompanying drawings, and various modifications and variations will be possible from the point of view of those of ordinary skill in the art to which the present invention pertains. Accordingly, the scope of the present invention should be defined not only by the claims of the present specification, but also by those claims and their equivalents.

100: terminal 110: control unit
120: database unit 130: input unit
140: output unit

Claims (12)

a face recognition step of recognizing a user's face in order to drive contents to be output to an output unit of the terminal;
a content operation step in which the content is driven for a first period after the face recognition step;
a sensing step of detecting whether a user who uses the content during the first period performs an authoring movement; and
a time extension step of extending the driving time of the content when the authoring movement of the user is detected during the first period;
In the face recognition step,
A facial guide line guiding the user's face to be positioned on the output unit, and a chewing guide line guiding the user's mouth to open more than required are displayed,
When the user opens his/her mouth to perform the authoring exercise in accordance with the authoring guideline in a state where the user's face is positioned in accordance with the facial guideline, the content operation step is performed thereafter,
The image for the masticatory movement performed by the user in the face recognition step is a method of inducing a mastication movement that is used as sample data for detecting the mastication movement of the user in the detection step. According to claim 1,
When the user's authoring movement is not detected during the first period, a stopping step of stopping the driving of the content; and a method for inducing authoring movement. 3. The method of claim 2,
According to the extension of the driving time of the content, the authoring movement inducing method in which the content is continuously driven for a second period after the first period. delete delete According to claim 1,
In the content operation step, a method for inducing authoring movement in which a video is played during the first period. 4. The method of claim 3,
The length of at least one of the first period and the second period is set by the user or a guardian of the user. According to claim 1,
The method further comprising: prior to the face recognition step, a content selection step in which content to be operated on an output unit of the electronic device is selected. 9. The method of claim 8,
In the content selection step,
The content is a moving picture provided and selected in the electronic device or a moving picture selected by input of a file identifier address (Uniform Resource Locator, URL). According to claim 1,
The detection step
a facial region detection step of detecting a facial region of the user during the first period;
a feature point extraction step of extracting a feature point for at least one of an eye, a nose, an upper lip, and a lower lip from the user's face;
A mastication movement induction method comprising a; a mastication movement recognition step of recognizing the mastication movement of the user from the change in the position of the lower lip. 11. The method of claim 10,
In the mastication movement recognition step,
When the position of the lower lip goes down and rises at least once, the masticatory movement inducing method for determining that the user is performing the masticatory movement. A recording medium in which a program for executing the method of inducing a mastication movement according to any one of claims 1 to 3 or 6 to 11 is recorded.

Images