TW201832717A - Unilateral chewing monitoring apparatus and method thereof - Google Patents

Abstract

The present invention provides a unilateral chewing monitoring apparatus and a method thereof, wherein the unilateral chewing monitoring apparatus comprises: a first module for acquiring continuous left image frames generated by a left masticatory muscle for a period of time; a second module for acquiring continuous right image frames generated by the right masticatory muscle in the time period; a processing module for receiving the left image frame of the first module and the right image frame of the second module. The processing module obtains a left side change value of the left image frame according to the continuous left image frames, and obtains a right side change value of the right image frame according to the continuous right image frames, and the processing module at least determines whether it is an unilateral chewing in the time period according to the result of comparison between the change value of the left image frame and the change value of the right image frame. The present invention can determine whether to chew on one side. Thus, it is possible to automatically monitor whether unilateral chewing is performed.

Description

Unilateral chewing monitoring equipment and method

The invention relates to the field of medical monitoring equipment, in particular to a unilateral chewing monitoring equipment and a method thereof.

When eating food, the chewing muscles on the left and right sides should be chewed evenly, so that the gums on both sides can be evenly stimulated by the function, which is beneficial to the normal development of the teeth, jaws and corresponding muscles. If you chew unilaterally for a long time, you will develop muscles on one side and muscle atrophy on the other side.

On the side that has not been chewed for a long time, due to the lack of functional stimulation, a large amount of food debris and tartar are deposited around the teeth, causing changes in the periodontal support bones, and symptoms such as bleeding gums and bad breath.

Long-term stress on one side, imbalance of left and right forces, and temporomandibular joint disease are also easily induced. The most common manifestations are popping sounds in the joints, joint pain, or restricted mouth opening. Therefore, those who have unilateral chewing habits should be corrected in time.

In view of the defects in the prior art, the purpose of the present invention is to provide a unilateral chewing monitoring device and method, which overcomes the difficulties in the prior art and can determine whether it is unilateral chewing. Thereby, it is possible to automatically monitor whether unilateral chewing is performed.

According to an aspect of the present invention, a unilateral chewing monitoring device is provided, including: a first module, which acquires a continuous left image frame generated by a left chewing muscle in a time period; a second module Group, the second module obtains the continuous right image frame generated by the right chewing muscle in the time period; a processor, the processor receives the left image frame and the The right image frame of the second module is described; the processor obtains the left variation value of a left image frame according to the continuous left image frame, and obtains the right side of a right image frame according to the continuous right image frame. A change value; the processor determines, at least according to a comparison result of a change value of the left image frame and a change value of the right image frame, whether the chewing is unilateral during the time period.

Preferably, the processor obtains a difference between a change value of the left image frame and a change value of the right image frame, and according to the difference between the change value and a change difference threshold , Determine whether it is unilateral chewing during the time period.

Preferably, the processor obtains the chewing duration of unilateral chewing in multiple time periods, the cumulative duration of left chewing and the cumulative duration of right chewing, and the cumulative duration of left chewing and the cumulative time of right chewing. Determining the absolute value of the long difference value, and at least according to the absolute value of the difference value and the difference threshold value, determining whether the plurality of time periods are unilateral chewing.

Preferably, the first module, the second module, and the processor are disposed in a wearable device.

Preferably, the processor obtains a change value of the left or right image frame according to the following formula: among them,( , , )with( , , ) Is the RGB value of the primitive points of the same position in two consecutive image frames, and n is the number of primitive points of the image frames.

Preferably, the first module, the second module, and the processor are disposed in a smart glasses, the first module is a first camera disposed under the left lens of the smart glasses, and the first A camera focuses on the left chewing muscle; the second module is a second camera disposed under the right lens of the smart glasses, and the second camera focuses on the right chewing muscle.

Preferably, it further comprises: a prompter, configured to perform a unilateral chewing prompt according to a result determined by the processor as unilateral chewing.

Preferably, the prompter is set on a wearable device or a mobile terminal.

According to another aspect of the present invention, a unilateral chewing monitoring method is further provided, including the following steps: acquiring a continuous left image frame generated by the left chewing muscle in a period of time, and obtaining a left image according to the continuous left image frame And a continuous right image frame generated by the right chewing muscle in the time period, and a right image frame change value is obtained according to the continuous right image frame; at least one left image frame A comparison result between the change value of the value and a change value of the right image frame determines whether the chewing is unilateral during the time period.

Preferably, the change value of the left or right image frame is obtained according to the following formula: among them,( , , )with( , , ) Is the RGB value of the primitive points of the same position in two consecutive image frames, and n is the number of primitive points of the image frames.

Preferably, the step of determining whether the chewing is unilateral during the time period according to the comparison result includes: obtaining a change value of both the change value of the left image frame and the change value of the right image frame The difference between the change value and the change difference threshold value to determine whether it is unilateral chewing during the time period.

Preferably, the method further includes the following steps: obtaining the chewing duration of one side chewing in multiple time periods, obtaining the cumulative duration of the left chewing and the cumulative duration of the right chewing; obtaining the cumulative duration of the left chewing and the accumulation of the right chewing The absolute value of the difference in duration, and at least according to the absolute value of the difference and the difference threshold, determine whether the plurality of time periods are unilateral chewing.

In view of this, the unilateral chewing monitoring device and method of the present invention can determine whether it is unilateral chewing, and thus can automatically monitor whether unilateral chewing is performed.

In order to have a better understanding of the above and other aspects of the present invention, the following specific examples are described in detail below in conjunction with the accompanying drawings:

Example embodiments will now be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that the present invention will be comprehensive and complete, and the concept of the example embodiments will be fully conveyed to Those of ordinary skill in the art. The same reference numerals in the drawings denote the same or similar structures, and their repeated description will be omitted.

The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of the embodiments of the present invention. However, those with ordinary knowledge in the art should realize that the technical solution of the present invention can be practiced without one or more of the specific details, or by using other methods, components, materials, and the like. In some cases, well-known structures, materials, or operations have not been shown or described in detail to avoid obscuring the invention.

The specific implementation of the present application will be further described in detail below with reference to the accompanying drawings and embodiments. The following examples are used to illustrate the present application, but are not used to limit the protection scope of the present application.

Those with ordinary knowledge in the art can understand that the terms "first" and "second" in this application are only used to distinguish different devices, modules, or parameters, etc., and they do not represent any specific technical meaning, nor do they mean them. Inevitable logical sequence.

FIG. 1 is a schematic structural diagram of a monitoring device 100 according to an embodiment of the present application, including: a first collector 110, a second collector 120, and a processor 130, where:

A first collector, configured to collect a continuous left image frame generated by the left chewing muscle in a period of time, and send a continuous left image frame to the processor;

Wherein, in the embodiment of the present application, the first collector may be a camera, such as a camera, which captures a continuous left image frame generated by the user's chewing muscle at a certain time interval t. Of course, those with ordinary knowledge in the art should understand that this is only an example and should not be understood as a limitation on the embodiments of the present application.

A second collector for collecting continuous right image frames generated by the right chewing muscle during the time period, and sending continuous right image frames to the processor;

Wherein, in the embodiment of the present application, the second collector may be a camera device, such as a camera, which captures a continuous right image frame generated by the user's chewing muscle at a certain time interval t. Of course, those with ordinary knowledge in the art should understand that this is only an example and should not be understood as a limitation on the embodiments of the present application.

A processor, configured to obtain a continuous left image frame generated by the left chewing muscle and a continuous right image frame generated by the right chewing muscle during a time period, and obtain a change value of the left image frame according to the continuous left image frame, A change value of a right image frame is obtained according to consecutive right image frames, and at least according to a change value of a left image frame and a change value of a right image frame, it is determined whether it is unilateral chewing in a time period.

The inventor of the present application found that when a user chews with the left chewing muscle, the left chewing muscle's action amplitude is greater than the right chewing muscle's action amplitude, which causes the continuous image frame of the left chewing muscle to change more than the right chewing muscle. The resulting continuous image frame changes. Similarly, when a user chews with the right chewing muscle, the movement range of the right chewing muscle is greater than that of the left chewing muscle, which causes the continuous image frame of the chewing muscle of the right chewing muscle to change more than that of the left chewing muscle. The change value of the image frame. Similarly, when a user chews with the left and right chewing muscles, the left chewing muscle's movement amplitude is equal to or almost equal to the right chewing muscle's movement amplitude, which results in the continuous image frame of the right chewing muscle's chewing muscles having a change value equal to or almost equal to The value of the continuous image frame produced by mastication of the left chewing muscle. Therefore, according to the value of the continuous image frame produced by the left chewing muscle and the value of the continuous image frame produced by the right chewing muscle, it can be determined to be left chewing or right chewing, and similarly determined to be non-unilateral chewing. Or chew on both sides.

The processor determines that the value of the continuous image frame produced by the left chewing muscle is greater than the value of the continuous image frame produced by the right chewing muscle, and determines that it is left chewing; or, based on the image of the left chewing muscle, The change value of the picture frame is smaller than the change value of the continuous image frame produced by the chewing of the right chewing muscle, and it is determined as the right chewing. Alternatively, it is determined to be bilateral chewing or non-unilateral chewing according to a change value of a continuous image frame produced by the right chewing muscle chewing equal to or almost equal to a change value of a continuous image frame produced by the chewing muscle of the left chewing muscle.

Wherein, the processor obtains the change value V of the continuous image frame produced by mastication of the left or right chewing muscle according to the following formula: among them,( , , )with( , , ) Is the R (red) G (green) B (blue) value of the primitive points at the same position of two consecutive image frames, and n is the number of primitive points of the image frame. In the above manner, the present invention counts one side The values of R (red), G (green), and B (blue) of all the primitive points in the continuous image frame produced by mastication of masticatory muscles are obtained, so as to obtain the change value V of the response image frame. The change value V of the image frame reflects the movement of the masticatory muscles. When the change value V is larger, it can be judged that the amount of movement of the masticatory muscle on that side is large; when the change value V is smaller, the side's Masticatory muscle movement is small. Therefore, by comparing the change value V of the masticatory muscle image frames on the left and right sides, we can obtain the comparison parameters of the movement of the left and right chewing muscles. By comparing the two contrast parameters, we can know that the movement of the left chewing muscle is more (Unilateral chewing, emphasis on left chewing) or more exercise of the right chewing muscle (unilateral chewing, emphasis on right chewing).

Those with ordinary knowledge in the art should understand that the above-mentioned embodiments of obtaining the change values of the continuous image frames generated by the left chewing muscles and the change values of the continuous image frames generated by the right chewing muscles are for illustration only. It should not be understood as a limitation to the embodiments of the present application. Corresponding variants and modifications made by those with ordinary knowledge in the field should be covered by the protection scope of the patent scope of this application.

Wherein, in the embodiment of the present application, the processor may be disposed on a wearable device. The wearable devices mentioned here, such as smart glasses, headphones, etc. The processor can communicate with the first and second collectors through Bluetooth, infrared, and other methods. Of course, those with ordinary knowledge in the art should understand that this is only for example and should not be construed as a limitation on this application. Other ways of communicating with each other are also included in the protection scope of this application.

In this embodiment of the present application, the change values of the continuous image frame generated by the left chewing muscle and the change values of the continuous image frame generated by the right chewing muscle respectively reflect the left chewing situation and the right chewing situation, such as whether chewing , Chewing action range, etc. Therefore, it can be determined whether it is unilateral chewing based on the continuous image frame change value produced by the left chewing muscle and the continuous image frame change value produced by the right chewing muscle. Thereby, it is possible to automatically monitor whether unilateral chewing is performed.

In a possible implementation manner, the processor obtains a difference between a change value of the left image frame and a change value of the right image frame, and determines a time period according to the difference between the change value and the change difference threshold. Whether the inside is unilateral chewing.

In a possible implementation manner, the processor obtains the chewing duration of unilateral chewing in multiple time periods, obtains the cumulative duration of left chewing and the cumulative duration of right chewing, and obtains the cumulative duration of left chewing and the right chewing duration. The absolute value of the difference of the accumulated duration is accumulated, and at least according to the absolute value of the difference and the difference threshold, it is determined whether the chewing is unilateral in a plurality of time periods. The difference threshold can be set according to the situation.

For n time periods (n is a natural number), for example, the first, second, third, and nth time periods, the chewing durations in each period are obtained respectively, and the n chewing durations are accumulated to obtain Cumulative duration. The method of recording the duration is, for example, calculating the chewing duration based on the start chewing time and the end chewing time. Of course, those with ordinary knowledge in the art can also use other methods to calculate the chewing duration, which is only used for illustration and should not be construed as limiting the scope of protection of the present application.

In this embodiment of the present application, if the absolute value of the difference between the cumulative duration of the left chewing and the cumulative duration of the right chewing is greater than the difference threshold, it means that the user chews on one side for a long time. Thereby, it is possible to automatically monitor whether unilateral chewing is performed.

FIG. 2 is a schematic structural diagram of a monitoring device 200 according to another embodiment of the present application. The monitoring device may further include a prompter 240 for performing a unilateral chewing prompt according to a result determined by the processor as a unilateral chewing.

The processor determines that it is unilateral chewing, and sends a trigger signal for unilateral chewing to the prompter, and the prompter performs unilateral chewing prompt according to the trigger signal.

For example, the absolute value of the difference between the cumulative length of the left chewing and the cumulative length of the right chewing is greater than the difference threshold, and the cumulative length of the left chewing is greater than the cumulative time of the right chewing. Prompt chewing with the left side for a long time, or prompt the user to chew with the right side. Or prompt the user to chew on the left side and the right side for the user's reference to adjust the chewing side. Similarly, a unilateral chewing prompt can be provided for the case where the user uses the right chewing.

In a possible embodiment, the prompter is one, that is, the processor sends a trigger signal for one-sided chewing to the prompter, and the prompter performs prompting according to the trigger signal. Users can know that they have used unilateral chewing for a long time, and can adjust the chewing side accordingly.

In another possible embodiment, the prompter includes a left prompter and a right prompter. For a case where the left prompter is determined to be chewed, the processor may send a trigger signal for one-sided chewing to the left prompter, and the left prompter is based on the trigger signal. For prompting, the user can know that he used to chew on the left side for a long time, and can adjust to use the right side for chewing accordingly. Similarly, for the case where the right side is determined to be chewed, the processor can send a trigger signal to the right side prompter The right-side prompter prompts according to the trigger signal. The user can know that he used the right side for chewing for a long time, and can adjust it to use the left side for chewing. Of course, those with ordinary knowledge in the art can understand that this is only for illustration and should not be understood as a limitation on the embodiments of the present application. For example, when the user uses the left chew for a long time, the processor may also send a trigger signal to the right prompter, and prompt the user to use the right chew according to the trigger information.

The prompter is set on a wearable device or a mobile terminal. The wearable devices mentioned here, such as smart glasses, headphones, etc. The reminder can be an indicator light, an alarm, or a spectacle lens of smart glasses, and the like.

A possible embodiment is that an indicator light or an alarm is provided on the left or right side of the smart glasses, respectively, for users to chew on the left side for a long time, the left indicator light flashes to remind, or the alarm prompts through the alarm. The prompter can be set on the left or right spectacle frame of the smart glasses; it can also be set on the left or right spectacles.

A possible embodiment is that, by displaying the subtitle content on the smart glasses, that is, using the display screen of the smart glasses as a reminder, the processor sends prompt information of the unilateral chewing result to the glasses, for example, the left side has been used for a long time. Chew and display the reminder information on the smart glasses. The user can see the prompt information and adjust the chewing side accordingly.

A possible embodiment is that an indicator light or an alarm is provided on the left or right side of the headset, respectively, for users to chew on the left side for a long time, the left indicator light flashes to remind, or the alarm prompts through the alarm. The left side mentioned here is, for example, the left earpiece of the headset, and the right side is, for example, the right earpiece of the headset.

A possible embodiment is that the prompter is disposed on the mobile terminal. The processor determines that it is unilateral chewing, and sends a trigger signal for unilateral chewing to the mobile terminal. According to the trigger signal, the mobile terminal performs unilateral chewing prompt by at least one of sound prompting, indicator flashing, alarm sound, and subtitle content display.

In this embodiment of the present application, a unilateral chewing prompt is performed according to a result determined to be unilateral chewing, and the user may be recommended to chew with one side for a short time, thereby reminding the user to chew evenly.

Fig. 3 is a schematic diagram showing that the first and second collectors of the monitoring device are cameras and are installed in the smart glasses. In the following, the processor and the prompter are both set in the smart glasses as an example. Those with ordinary knowledge in the art should understand that this is only used as an example and should not be construed as limiting the scope of the patent for this application. In this embodiment, the first module, the second module, and the processor are disposed in a smart glasses 8. The smart glasses 8 include a left lens 81 and a right lens 82. The first module and the second module continuously take pictures of the masticatory muscles on both sides of the mouth, respectively. The first module is a first camera 110 disposed under the left lens 81 of the smart glasses 8. The first camera 110 focuses the left chewing muscle 83, that is, the first camera 110 continuously takes pictures of the area where the left chewing muscle 83 is located. The second module is a second camera 120 disposed under the right lens 82 of the smart glasses 8. The second camera 120 focuses on the right chewing muscle 84, that is, the second camera 120 continuously takes pictures of the area where the right chewing muscle 84 is located. The processor is set in the smart glasses, and obtains the change values of the continuous image frame generated by the left chewing muscle and the change values of the continuous image frame generated by the right chewing muscle within a period of time. The change value of the image frame is greater than the change value of the continuous image frame produced by the right chewing muscle. It is determined to be unilateral chewing and left chewing. Record the left chewing duration and obtain the left chewing duration in n time periods. .

Similarly, the right chewing duration is obtained for n time periods.

The cumulative duration of chewing on the left is 3 hours, and the cumulative duration of chewing on the right is 1 hour. The absolute value of the difference between the cumulative length of the left chewing and the cumulative length of the right chewing is 2 hours, which is greater than the difference threshold of 30 minutes, which indicates that the left chewing is longer.

The processor sends prompt information to the left prompter provided on the left frame (or the temple) of the smart glasses, and triggers the left prompter to perform a reminder of "use the left side for a long time". The left prompter is, for example, a sound prompt , Or lights, alarms. Alternatively, the processor sends prompt information to the right prompter set on the right frame (or the temple) of the smart glasses, and triggers the right prompter to “Please use the right chew” reminder. The right prompter is, for example, a sound prompt. Or lights, sirens. Alternatively, by displaying the subtitle content on the smart glasses, that is, using the display screen of the smart glasses as the prompter, the processor sends prompt information to the prompter and displays the prompt information on the smart glasses, for example, "Long term use Chew on the left side, or use the right side for chewing, or show the chewing duration on the left and the chewing duration on the right on the smart glasses. "

The embodiments of the present application can enable the user to chew in a balanced manner, thereby avoiding gum bleeding, halitosis, and temporomandibular joint disease of the user due to asymmetric facial muscles and unbalanced chewing.

FIG. 4 is a schematic structural diagram of a monitoring device 400 according to another embodiment of the present application, including: a first module 410, a second module 420, and a processor 430, where:

The first module is used to obtain a continuous left image frame generated by the left chewing muscle in a period of time, and send a continuous left image frame to the processor;

The second module is used to obtain continuous right image frames generated by the right chewing muscles during the time period, and send continuous right image frames to the processor;

A processor, configured to obtain a change value of a left image frame according to a continuous left image frame, obtain a change value of a right image frame according to a continuous right image frame, and at least according to a change value of a left image frame and A change value of the right image frame to determine whether it is unilateral chewing during the time period.

The inventor of the present application found that when a user chews with the left chewing muscle, the left chewing muscle's action amplitude is greater than the right chewing muscle's action amplitude, which causes the continuous image frame of the left chewing muscle to change more than the right chewing muscle. The resulting continuous image frame changes. Similarly, when a user chews with the right chewing muscle, the movement range of the right chewing muscle is greater than that of the left chewing muscle, which causes the continuous image frame of the chewing muscle of the right chewing muscle to change more than that of the left chewing muscle. The change value of the image frame. Similarly, when a user chews with the left and right chewing muscles, the left chewing muscle's movement amplitude is equal to or almost equal to the right chewing muscle's movement amplitude, which results in the continuous image frame of the right chewing muscle's chewing muscles having a change value equal to or almost equal to The value of the continuous image frame produced by mastication of the left chewing muscle. Therefore, according to the value of the continuous image frame produced by the left chewing muscle and the value of the continuous image frame produced by the right chewing muscle, it can be determined to be left chewing or right chewing, and similarly determined to be non-unilateral chewing. Or chew on both sides.

The processor determines that the value of the continuous image frame produced by the left chewing muscle is greater than the value of the continuous image frame produced by the right chewing muscle, and determines that it is left chewing; or, based on the image of the left chewing muscle, The change value of the picture frame is smaller than the change value of the continuous image frame produced by the chewing of the right chewing muscle, and it is determined as the right chewing. Alternatively, it is determined to be bilateral chewing or non-unilateral chewing according to a change value of a continuous image frame produced by the right chewing muscle chewing equal to or almost equal to a change value of a continuous image frame produced by the chewing muscle of the left chewing muscle.

In the embodiment of the present application, the first module, the second module, and the processor may be disposed on a wearable device. The wearable devices mentioned here, such as smart glasses, headphones, etc.

Here, the first module and the second module can be implemented by, for example, a transceiver, and the processor can be implemented by, for example, a calculator and a comparator. The calculator calculates the change value of the left image frame and the change value of the right image frame. The change value of the left image frame and the change value of the right image frame are respectively output to two input ends of the comparator, and the comparator performs comparison based on the two values, and outputs a signal indicating the comparison result. For example, if the change value of the left image frame is greater than the change value of the right image frame, a high-potential signal is output; otherwise, a low-potential signal is output. In another embodiment, if a prompting module is also connected, the high-potential or low-potential signal is sent to the prompting module, and the prompting module performs prompting according to the high-potential signal or low-potential signal. Of course, the first module, the second module, and the processor may also be implemented by software programs and stored in a device or a storage medium, which will be described in the following embodiments.

Wherein, the processor obtains the change value V of the continuous image frame produced by mastication of the left or right chewing muscle according to the following formula: among them,( , , )with( , , ) Is the R (red) G (green) B (blue) value of the primitive points at the same position of two consecutive image frames, and n is the number of primitive points of the image frames.

Those with ordinary knowledge in the art should understand that the above-mentioned embodiments of obtaining the change values of the continuous image frames generated by the left chewing muscles and the change values of the continuous image frames generated by the right chewing muscles are for illustration only. It should not be understood as a limitation to the embodiments of the present application. Corresponding variants and modifications made by those with ordinary knowledge in the field should be covered by the protection scope of the patent scope of this application.

In this embodiment of the present application, the change values of the continuous image frame produced by the left chewing muscles and the change values of the continuous image frame produced by the right chewing muscles reflect the left chewing situation and the right chewing situation, for example Whether or not to chew, the magnitude of the chewing action, etc. Therefore, based on the changes in the continuous image frame produced by the left chewing muscle and the changes in the continuous image frame produced by the right chewing muscle, it can be determined whether it is unilateral chewing . Thereby, it is possible to automatically monitor whether unilateral chewing is performed.

In a possible implementation manner, the processor obtains a difference between a change value of the left image frame and a change value of the right image frame, and determines a time period according to the difference between the change value and the change difference threshold. Whether the inside is unilateral chewing.

In a possible implementation manner, the processor obtains the chewing duration of unilateral chewing in multiple time periods, obtains the cumulative duration of left chewing and the cumulative duration of right chewing, and obtains the cumulative duration of left chewing and the right chewing duration. The absolute value of the difference of the accumulated duration is accumulated, and at least according to the absolute value of the difference and the difference threshold, it is determined whether the chewing is unilateral in a plurality of time periods.

Wherein, the absolute value of the difference between the cumulative duration of the left chewing and the cumulative duration of the right chewing is greater than or equal to the difference threshold, and is determined to be unilateral chewing. For the determination of unilateral chewing, and the cumulative length of left chewing is greater than the accumulation of right chewing, determine the left chewing; For the determination of unilateral chewing, and the accumulation time of left chewing is less than the accumulation of right chewing, , Identified as chewing on the right. The absolute value of the difference between the cumulative duration of the left chewing and the cumulative duration of the right chewing was less than the difference threshold, and it was determined to be bilateral chewing.

For n time periods (n is a natural number), for example, the first, second, third, and nth time periods, the chewing durations in each period are obtained respectively, and the n chewing durations are accumulated to obtain Cumulative duration. The method of recording the duration is, for example, calculating the chewing duration based on the start chewing time and the end chewing time. Of course, those with ordinary knowledge in the art can also use other methods to calculate the chewing duration, which is only used for illustration and should not be construed as limiting the scope of protection of the present application.

In this embodiment of the present application, if the absolute value of the difference between the cumulative duration of the left chewing and the cumulative duration of the right chewing is greater than the difference threshold, it means that the user chews on one side for a long time. Thereby, it is possible to automatically monitor whether unilateral chewing is performed.

FIG. 5 is a schematic structural diagram of a monitoring device 500 according to another embodiment of the present application. Based on the embodiment shown in FIG. 4, the monitoring device may further include: a prompt module 540, which is used to determine For unilateral chewing results, perform unilateral chewing tips.

The processor determines that it is unilateral chewing, and sends a trigger signal for unilateral chewing to the prompt module, and the prompt module performs unilateral chewing prompt according to the trigger signal.

For example, the absolute value of the difference between the cumulative length of the left chewing and the cumulative length of the right chewing is greater than the difference threshold, and the cumulative length of the left chewing is greater than the cumulative time of the right chewing. Prompt chewing with the left side for a long time, or prompt the user to chew with the right side. Or prompt the user to chew on the left side and the right side for the user's reference to adjust the chewing side. Similarly, a unilateral chewing prompt can be provided for the case where the user uses the right chewing.

In a possible embodiment, the prompting module is one, that is, the processor sends a triggering signal for one-sided chewing to the prompter, and the prompting module performs prompting according to the triggering signal. Users can know that they have used unilateral chewing for a long time, and can adjust the chewing side accordingly.

In another possible embodiment, the prompting module includes a left prompting module and a right prompting module. For a situation where it is determined to be chewing on the left, the processor may send a trigger signal for one-sided chewing to the left prompting module, and the left prompting module The group gives a prompt according to the trigger signal, and the user can know that he used to chew on the left side for a long time, and can adjust it to use the right side for chewing. The trigger signal for one-sided chewing. The right-side reminder module gives a prompt based on the trigger signal. The user can know that he has used the right side for chewing for a long time and can adjust it to use the left side for chewing. Of course, those with ordinary knowledge in the art can understand that this is only for illustration and should not be understood as a limitation on the embodiments of the present application. For example, when the user uses the left chew for a long time, the processor may also send a trigger signal to the right prompter, and prompt the user to use the right chew according to the trigger information.

The prompt module is set on a wearable device or a mobile terminal. The wearable devices mentioned here, such as smart glasses, headphones, etc. The prompt module may be an indicator light, an alarm, or a spectacle lens of a smart glasses.

A possible embodiment is that an indicator light or an alarm is provided on the left or right side of the smart glasses, respectively, for users to chew on the left side for a long time, the left indicator light flashes to remind, or the alarm prompts through the alarm. The prompter can be set on the left or right spectacle frame of the smart glasses; it can also be set on the left or right spectacles.

A possible embodiment is that, by displaying the subtitle content on the smart glasses, that is, using the display screen of the smart glasses as a reminder, the processor sends prompt information of the unilateral chewing result to the glasses, for example, the left side has been used for a long time. Chew and display the reminder information on the smart glasses. The user can see the prompt information and adjust the chewing side accordingly.

A possible embodiment is that an indicator light or an alarm is provided on the left or right side of the headset, respectively, for users to chew on the left side for a long time, the left indicator light flashes to remind, or the alarm prompts through the alarm. The left side mentioned here is, for example, the left earpiece of the headset, and the right side is, for example, the right earpiece of the headset.

A possible embodiment is that the prompt module is disposed on the mobile terminal. The processor determines that it is unilateral chewing, and sends a trigger signal of unilateral chewing to the mobile terminal. According to the trigger signal, the mobile terminal provides unilateral chewing prompt by at least one of a sound prompt, an indicator flashing, an alarm sound, and a subtitle content display.

In this embodiment of the present application, a unilateral chewing prompt is performed according to a result determined to be unilateral chewing, and the user may be recommended to chew with one side for a short time, thereby reminding the user to chew evenly.

FIG. 6 is a schematic flowchart of a monitoring method according to an embodiment of the present application. The method includes the following steps:

S610: Obtain a continuous left image frame generated by the left chewing muscle in a period of time, and obtain a change value of the left image frame according to the continuous left image frame;

S620: Obtain a continuous right image frame generated by the right chewing muscle during the time period, and obtain a change value of the right image frame according to the continuous right image frame;

S630. At least according to a change value of a left image frame and a change value of a right image frame, determine whether it is unilateral chewing within a time period.

The inventor of the present application found that when a user chews with the left chewing muscle, the left chewing muscle's action amplitude is greater than the right chewing muscle's action amplitude, which causes the continuous image frame of the left chewing muscle to change more than the right chewing muscle. The resulting continuous image frame changes. Similarly, when a user chews with the right chewing muscle, the movement range of the right chewing muscle is greater than that of the left chewing muscle, which causes the continuous image frame of the chewing muscle of the right chewing muscle to change more than that of the left chewing muscle. The change value of the image frame. Similarly, when a user chews with the left and right chewing muscles, the left chewing muscle's movement amplitude is equal to or almost equal to the right chewing muscle's movement amplitude, which results in the continuous image frame of the right chewing muscle's chewing muscles having a value equal to or almost equal to The value of the continuous image frame produced by mastication of the left chewing muscle. Therefore, according to the value of the continuous image frame produced by the left chewing muscle and the value of the continuous image frame produced by the right chewing muscle, it can be determined to be left chewing or right chewing, and similarly determined to be non-unilateral chewing. Or chew on both sides.

It is determined that the value of the continuous image frame produced by the left chewing muscle is greater than the value of the continuous image frame produced by the right chewing muscle, and is determined to be left chewing; The value of the change is smaller than the value of the continuous image frame produced by the chewing of the right chewing muscle, and it is determined as the right chewing. Alternatively, it is determined to be bilateral chewing or non-unilateral chewing according to a change value of a continuous image frame produced by the right chewing muscle chewing equal to or almost equal to a change value of a continuous image frame produced by the chewing muscle of the left chewing muscle.

Wherein, the processor obtains the change value V of the continuous image frame produced by mastication of the left or right chewing muscle according to the following formula: among them,( , , )with( , , ) Is the R (red) G (green) B (blue) value of the primitive points at the same position of two consecutive image frames, and n is the number of primitive points of the image frames.

Those with ordinary knowledge in the art should understand that the above-mentioned embodiments of obtaining the change values of the continuous image frames generated by the left chewing muscles and the change values of the continuous image frames generated by the right chewing muscles are for illustration only. It should not be understood as a limitation to the embodiments of the present application. Corresponding variants and modifications made by those with ordinary knowledge in the field should be covered by the protection scope of the patent scope of this application.

In this embodiment of the present application, the change values of the continuous image frame produced by the left chewing muscles and the change values of the continuous image frame produced by the right chewing muscles reflect the left chewing situation and the right chewing situation, for example Whether or not to chew, the magnitude of the chewing action, etc. Therefore, based on the changes in the continuous image frame produced by the left chewing muscle and the changes in the continuous image frame produced by the right chewing muscle, it can be determined whether it is unilateral chewing . Thereby, it is possible to automatically monitor whether unilateral chewing is performed.

FIG. 7 is a schematic flowchart of a monitoring method according to another embodiment of the present application. In another possible implementation manner, as shown in FIG. 7, the following steps are included:

S810: Obtain a continuous left image frame generated by the left chewing muscle in a period of time, and obtain a change value of the left image frame according to the continuous left image frame.

S820. Obtain a continuous right image frame generated by the right chewing muscle in the time period, and obtain a change value of the right image frame according to the continuous right image frame.

S830. At least according to a change value of a left image frame and a change value of a right image frame, determine whether the chewing is unilateral in a time period.

S840. Obtain the chewing duration of unilateral chewing in multiple time periods, and obtain the cumulative duration of the left chewing and the cumulative duration of the right chewing;

Obtain the absolute value of the difference between the cumulative duration of the left chewing and the cumulative duration of the right chewing, and determine whether it is unilateral chewing in multiple time periods based on at least the absolute value of the difference and the difference threshold. The difference threshold can be set according to the situation.

In step S840, the absolute value of the difference between the cumulative duration of the left chewing and the cumulative duration of the right chewing is greater than or equal to the difference threshold, and it is determined to be unilateral chewing. For the determination of unilateral chewing, and the cumulative length of left chewing is greater than the accumulation of right chewing, determine the left chewing; For the determination of unilateral chewing, and the accumulation time of left chewing is less than the accumulation of right chewing, , Identified as chewing on the right. The absolute value of the difference between the cumulative duration of the left chewing and the cumulative duration of the right chewing was less than the difference threshold, and it was determined to be bilateral chewing.

For n time periods (n is a natural number), for example, the first, second, third, and nth time periods, the chewing durations in each period are obtained respectively, and the n chewing durations are accumulated to obtain Cumulative duration. The method of recording the duration is, for example, calculating the chewing duration based on the start chewing time and the end chewing time. Of course, those with ordinary knowledge in the art can also use other methods to calculate the chewing duration, which is only used for illustration and should not be construed as limiting the scope of protection of the present application.

In this embodiment of the present application, if the absolute value of the difference between the cumulative duration of the left chewing and the cumulative duration of the right chewing is greater than the difference threshold, it means that the user chews on one side for a long time. Thereby, it is possible to automatically monitor whether unilateral chewing is performed.

In the embodiment of the present application, the method may further include: performing a unilateral chewing prompt according to a result determined to be unilateral chewing.

For example, the absolute value of the difference between the cumulative length of the left chewing and the cumulative length of the right chewing is greater than the difference threshold, and the cumulative length of the left chewing is greater than the cumulative time of the right chewing. Prompt chewing with the left side for a long time, or prompt the user to chew with the right side. Or prompt the user to chew on the left side and the right side for the user's reference to adjust the chewing side. Similarly, a unilateral chewing prompt can be provided for the case where the user uses the right chewing.

In this embodiment of the present application, the user is prompted to chew unilaterally based on the result that the absolute value of the difference is greater than the threshold of the difference. The user may be recommended to chew with one side for a short period of time, thereby reminding the user to chew uniformly.

Those skilled in the art can understand that, in the above method of the embodiment of the present application, the sequence number of each step does not mean the order of execution. The execution order of each step should be determined by its function and internal logic, and should not respond. The implementation process of the embodiment of the present application constitutes any limitation.

FIG. 8 is a schematic structural diagram of another monitoring device 700 according to an embodiment of the present application. This embodiment does not limit the specific implementation of the monitoring device 700. As shown in FIG. 8, the monitoring device 700 may include:

A processor (processor) 710, a communication interface (Communications Interface) 720, a memory (memory) 730, and a communication bus 740. among them:

The processor 710, the communication interface 720, and the memory 730 complete communication with each other through a communication bus 740.

The communication interface 720 is configured to communicate with a network element such as a user terminal.

The processor 710 is configured to execute a program 732.

The program 732 may include code, and the code includes a computer operation instruction.

The processor 710 may be a central processing unit CPU, or an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

The memory 730 is configured to store the program 732. The memory 730 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one magnetic disk memory. The program 732 may specifically include:

The first module is used to obtain a continuous left image frame generated by the left chewing muscle in a period of time, and send a continuous left image frame to the processor;

The second module is used to obtain continuous right image frames generated by the right chewing muscles during the time period, and send continuous right image frames to the processor;

A processor, configured to obtain a change value of a left image frame according to a continuous left image frame, obtain a change value of a right image frame according to a continuous right image frame, and at least according to a change value of a left image frame and A change value of the right image frame to determine whether it is unilateral chewing during the time period.

In this embodiment of the present application, it is possible to determine whether it is unilateral chewing based on the change value of the continuous image frame produced by the left chewing muscle and the right image frame produced by the right chewing muscle chewing. Thereby, it is possible to automatically monitor whether unilateral chewing is performed.

For the specific implementation of each module in the program 732, reference may be made to the corresponding description in the corresponding module in the foregoing embodiment, and details are not described herein. Those with ordinary knowledge in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the devices and modules described above can be referred to the corresponding process descriptions in the foregoing method embodiments, and are not repeated here.

Those with ordinary knowledge in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the devices and modules described above can refer to the corresponding descriptions in the foregoing device embodiments, and are not repeated here.

Those having ordinary knowledge in the art can realize that the modules and method steps of each example described in combination with the embodiments disclosed in this application can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

If functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially a part that contributes to the original technology or a part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods in the embodiments of the present application. The aforementioned computer-readable storage medium includes physical volatile and non-volatile, removable and non-volatile, removable and non-volatile information stored in any manner or technology such as computer-readable instructions, data structures, program modules or other data. Non-removable media. Computer-readable storage media specifically include, but are not limited to, flash drives, removable hard drives, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), erasable and removable Programmable read-only memory (EPROM), electrically erasable and programmable read-only memory (EEPROM), flash memory or other solid-state memory technology, CD-ROM, digital versatile disc (DVD), HD-DVD , Blue-Ray or other optical storage devices, magnetic tape, magnetic disk storage, or other magnetic storage devices, or any other medium that can be used to store the required information and can be accessed by a computer.

In summary, the unilateral chewing monitoring device and method of the present invention can determine whether it is unilateral chewing, and thus can automatically monitor whether unilateral chewing is performed.

In summary, although the present invention has been disclosed as above with the embodiments, it is not intended to limit the present invention. Those with ordinary knowledge in the technical field to which the present invention pertains can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention shall be determined by the scope of the attached patent application.

8‧‧‧ smart glasses

81‧‧‧Left lens

82‧‧‧Right lens

83‧‧‧Left chewing muscle

84‧‧‧ Right chewing muscle

110‧‧‧The first collector (first camera)

120‧‧‧Second collector (second camera)

130‧‧‧ processor

200‧‧‧ monitoring equipment

240‧‧‧Reminder

400‧‧‧ monitoring equipment

410‧‧‧The first module

420‧‧‧Second Module

430‧‧‧ processor

500‧‧‧ monitoring equipment

540‧‧‧Tip Module

700‧‧‧ monitoring equipment

710‧‧‧ processor

720‧‧‧ communication interface

730‧‧‧Memory

732‧‧‧program

740‧‧‧Communication Bus

FIG. 1 is a schematic structural diagram of a monitoring device according to an embodiment of the present application. FIG. 2 is a schematic structural diagram of a monitoring device according to another embodiment of the present application. Fig. 3 is a schematic diagram showing that the first and second collectors of the monitoring device are cameras and are installed in the smart glasses. FIG. 4 is a schematic structural diagram of a monitoring device according to another embodiment of the present application. FIG. 5 is a schematic structural diagram of a monitoring device according to another embodiment of the present application. FIG. 6 is a schematic flowchart of a monitoring method according to an embodiment of the present application. FIG. 7 is a schematic flowchart of a monitoring method according to another embodiment of the present application. FIG. 8 is a schematic structural diagram of still another monitoring device according to an embodiment of the present application.

Claims (12)

A unilateral chewing monitoring device includes: a first module, the first module acquiring a continuous left image frame generated by a left chewing muscle in a period of time; a second module, the second module Acquiring a continuous right image frame generated by the right chewing muscle in the time period; a processor, the processor receiving the left image frame of the first module and the second module of the second module The right image frame; the processor obtains the left variation value of a left image frame according to the continuous left image frame, and obtains the right variation value of a right image frame according to the continuous right image frame; the processor at least According to a comparison result between a change value of the left image frame and a change value of the right image frame, it is determined whether the chewing is unilateral in the time period. The monitoring device according to item 1 of the scope of patent application, wherein the processor obtains a difference between a change value of the left image frame and a change value of the right image frame, and according to the The difference between the change value and the change difference threshold determines whether it is unilateral chewing during the time period. The monitoring device according to item 1 of the scope of patent application, wherein the processor obtains the chewing duration of unilateral chewing in multiple time periods, obtains the cumulative duration of left chewing and the cumulative duration of right chewing, and acquires left chewing The absolute value of the difference between the cumulative duration of the right and the cumulative duration of the right chewing, and whether at least the unilateral chewing is determined in the multiple time periods based on at least the absolute value of the difference and the difference threshold. The monitoring device according to item 1 of the scope of patent application, wherein the first module, the second module, and the processor are disposed in a wearable device. For example, the monitoring device according to any one of claims 1 to 4 in the patent scope, wherein the processor obtains a change value of the left or right image frame according to the following formula: among them,( , , )with( , , ) Is the RGB value of the primitive points of the same position in two consecutive image frames, and n is the number of primitive points of the image frames. The monitoring device according to item 5 of the scope of patent application, wherein the first module, the second module, and the processor are disposed on a smart glasses, and the first module is a left lens disposed on the smart glasses A first camera on the lower side, the first camera focuses on the left chewing muscle; the second module is a second camera disposed on the lower side of the right lens of the smart glasses, and the second camera focuses on the right chewing muscle. The monitoring device according to item 5 of the scope of patent application, further comprising: a prompter for performing a unilateral chewing prompt according to a result determined by the processor as unilateral chewing. The monitoring device according to item 7 of the scope of patent application, wherein the reminder is set on a wearable device or a mobile terminal. A unilateral chewing monitoring method includes the following steps: acquiring a continuous left image frame generated by the left chewing muscle in a period of time, obtaining a change value of a left image frame according to the continuous left image frame; and acquiring the time The continuous right image frame generated by the right chewing muscle in the segment is obtained from the right image frame change value according to the continuous right image frame; at least according to the left image frame change value and the right image As a result of comparing the change values of the boxes, it is determined whether the chewing is unilateral during the time period. The unilateral chewing monitoring method according to item 9 of the scope of patent application, wherein the change value of the left or right image frame is obtained according to the following formula: among them,( , , )with( , , ) Is the RGB value of the primitive points of the same position in two consecutive image frames, and n is the number of primitive points of the image frames. The unilateral chewing monitoring method according to item 9 of the scope of patent application, wherein the step of determining whether the time period is unilateral chewing according to the result of the comparison includes: obtaining a change value and a value of the left image frame. The difference between the change values of the change value of the right image frame and the change value threshold is used to determine whether it is unilateral chewing during the time period according to the difference value of the change value and the change difference threshold. The unilateral chewing monitoring method according to item 9 of the scope of patent application, further comprising the following steps: obtaining the chewing duration of the unilateral chewing in multiple time periods, obtaining the cumulative duration of the left chewing and the cumulative duration of the right chewing; An absolute value of a difference between the cumulative duration of the left chewing and the cumulative duration of the right chewing is obtained, and whether at least the unilateral chewing is determined in the multiple time periods according to at least the absolute value of the difference and the difference threshold.