TWI698224B - Chewing side monitoring method, monitoring device and wearable device - Google Patents

Abstract

A chewing side monitoring method comprises the following steps of: step S10: collecting a left side of an acoustic signal and a right side of the acoustic signal by a bone conduction method; step S20: generating a left side power spectrum of the left acoustic signal and a right side power spectrum of the right acoustic signal during the monitoring period; step S30: integrating the left side power spectrum to obtain the left integration value, and the right side power spectrum to obtain the right integration value; and step S40: determining the actual chew side of the monitoring period based on the left integration value and the right integration value. The chewing side monitoring method of the present invention can monitor the actual chewing side used for a period of time to judge whether to chew unilaterally for reminding the user to chew with balance.

Description

Chewing side monitoring method, monitoring device and wearable equipment

The invention relates to the technical field of medical monitoring, in particular to a masticatory side monitoring method, monitoring device and wearable equipment.

When eating food, the chewing muscles on the left and right sides should chew in a balanced manner, so that the gums on both sides can be stimulated evenly, which is conducive to the normal development of teeth, jaws and corresponding muscles. If chewing on one side for a long time, it will cause muscle development on one side and muscle atrophy on the other side, and the asymmetry of the face will cause developmental deformities.

In addition, on the side that has not chewed for a long time, due to the lack of functional stimulation, a large amount of food debris and tartar are deposited around the teeth, causing changes in the periodontal supporting bone, and symptoms such as gum bleeding and bad breath.

In addition, long-term force on one side can lead to imbalance of left and right forces, and it is also easy to induce temporomandibular joint disease. The most common manifestations are snapping sounds in the joints, joint pain or restricted mouth opening. Therefore, people who have the habit of chewing on one side should correct it in time.

In view of the shortcomings in the prior art, the purpose of the present invention is to provide a chewing side monitoring method, a monitoring device and a wearable device to monitor the actual chewing side used within a period of time, determine whether to chew on one side, and promptly issue reminders to prompt the user to balance chew.

According to one aspect of the present invention, there is provided a method for monitoring the chewing side, including: step S10, obtaining left and right acoustic wave signals collected by bone conduction; step S20, generating the left power spectrum of the left acoustic signal in the monitoring period, And the right power spectrum of the right acoustic wave signal; step S30, integrate the left power spectrum to obtain the left integral value, and integrate the right power spectrum to obtain the right integral value; step S40, at least according to the left integral value and the right integral value, Determine the actual chewing side during the monitoring period.

Preferably, step S30 and step S40 further include: step S31, calculating the value difference between the left integral value and the right integral value; step S32, preset a first threshold, and determine whether the absolute value of the difference is greater than For the first threshold, if yes, execute step S40, if no, return to step S10.

Preferably, step S30 and step S40 further include: step S31, calculating the value difference between the left integral value and the right integral value; step S32, preset a first threshold, and determine whether the absolute value of the difference is greater than If the first threshold is yes, go to step S33, if no, go back to step S10; step S33, preset a second threshold to determine whether the absolute value of the difference is greater than the second threshold, if yes, go to step S40, if not , Return to step S10.

Preferably, the chewing side monitoring method of the present invention further includes: step S50, counting the cumulative number of times the actual chewing side is the left side and the cumulative number of times the actual chewing side is the right side in multiple monitoring periods; step S60, preset a third threshold, Determine whether the absolute value of the difference between the cumulative number of times the actual chewing side is the left side and the cumulative number of times the actual chewing side is the right side is greater than the third threshold, if yes, execute step S70, if not, return to step S10; step S70, output recommendation Chewing side.

Preferably, the chewing side monitoring method of the present invention further includes: step S80, judging whether the actual chewing side in the current monitoring period matches the recommended chewing side, if yes, return to step S10, if not, execute step S90; step S90, output The first prompt message.

Preferably, the chewing side monitoring method of the present invention further includes: step S100, preset a designated chewing side, determine whether the actual chewing side in the current monitoring period matches the designated chewing side, if yes, return to step S10, if not, execute Step S110; Step S110, output a second prompt message.

According to another aspect of the present invention, there is provided a masticatory side monitoring device, including: a first bone conduction module for collecting left side acoustic wave signals; a second bone conduction module for collecting right side acoustic wave signals; and an analysis module Group, connected with the first bone conduction module and the second bone conduction module, used to generate the left power spectrum of the left acoustic wave signal in the monitoring period, integrate the left power spectrum to obtain the left integral value, and generate the monitoring The right side power spectrum of the right sound wave signal in the period is integrated to obtain the right side integral value; a judgment module is connected to the analysis module, and the judgment module is based on at least the left side integral value and the right side integral value, Determine the actual chewing side during the monitoring period.

Preferably, the chewing side monitoring device of the present invention further includes: a conduction module with a first threshold pre-stored and connected between the analysis module and the judgment module, and the conduction module calculates the left integral value and the right The value difference of the integral value, when the absolute value of the value difference is greater than the first threshold, the judgment module is turned on.

Preferably, a second threshold is also prestored in the judgment module, and the judgment module judges the actual chewing side at least according to the absolute value of the difference between the left integral value and the right integral value and the second threshold.

Preferably, the mastication side monitoring device of the present invention further includes: a statistical module with a third threshold pre-stored and connected to the judgment module. The statistical module counts the cumulative number of times the actual mastication side is the left side in multiple monitoring periods, And the actual chewing side in the multiple monitoring periods are the accumulated times on the right side; an output module is connected to the statistics module, the output module when the actual chewing side is the accumulated times on the left side and the actual chewing side is the right side When the absolute value of the difference between the accumulated times is greater than the third threshold, the recommended chewing side is output.

Preferably, the chewing side monitoring device of the present invention further includes: a prompt module connected to the output module and the judging module, the prompt module judging whether the actual chewing side in the current monitoring period matches the recommended chewing side , Output the first prompt message when it does not match.

Preferably, a designated chewing side is pre-stored in the prompt module, and the prompt module determines whether the actual chewing side in the current monitoring period matches the designated chewing side, and outputs a second prompt message when it does not match.

According to another aspect of the present invention, there is provided a wearable device including the above-mentioned masticatory side monitoring device.

In view of this, the mastication side monitoring method, monitoring device and wearable device of the present invention can monitor the actual mastication side used within a period of time, determine whether to chew unilaterally, and promptly issue reminders to prompt the user to chew evenly.

10‧‧‧The first bone conduction module

20‧‧‧Second Bone Conduction Module

30‧‧‧Analysis Module

40‧‧‧Judgment Module

50‧‧‧Conduction Module

60‧‧‧Statistics Module

70‧‧‧Output Module

80‧‧‧Reminder Module

100‧‧‧Monitoring device

110‧‧‧Processing components

120‧‧‧Storage

130‧‧‧Battery Assembly

140‧‧‧Multimedia components

150‧‧‧Audio Components

160‧‧‧Input/Output Interface

170‧‧‧Sensor assembly

180‧‧‧Communication components

200‧‧‧Bone Conduction Headphone

201‧‧‧Bone Conduction Sensor

1100‧‧‧Processor

A‧‧‧Left power spectrum curve

B‧‧‧Power spectrum curve on the right

N‧‧‧Sound wave collection point

S10‧‧‧Step

S20‧‧‧Step

S30‧‧‧Step

S31‧‧‧Step

S32‧‧‧Step

S33‧‧‧Step

S40‧‧‧Step

S50‧‧‧Step

S60‧‧‧Step

S70‧‧‧Step

S80‧‧‧Step

S90‧‧‧Step

S100‧‧‧Step

S110‧‧‧Step

Fig. 1 is a schematic flowchart of a method for monitoring the chewing side of an embodiment of the present invention.

Fig. 2 is a schematic diagram of the position of the acoustic wave collection point in the embodiment shown in Fig. 1.

Fig. 3a is a graph of the left power spectrum and the right power spectrum in a mastication state in the embodiment shown in Fig. 1.

FIG. 3b is a graph of the left power spectrum and the right power spectrum in another chewing state in the embodiment shown in FIG. 1.

FIG. 4 is a schematic flowchart of a monitoring method according to another embodiment of the present invention.

FIG. 5 is a schematic flowchart of a monitoring method according to another embodiment of the present invention.

FIG. 6 is a schematic flowchart of a monitoring method according to another embodiment of the present invention.

FIG. 7 is a schematic flowchart of a monitoring method according to another embodiment of the present invention.

Fig. 8 is a schematic diagram of the connection structure of the masticatory side monitoring device according to an embodiment of the present invention.

Fig. 9 is a schematic diagram of a connection structure of a monitoring device according to another embodiment of the present invention.

Fig. 10 is a schematic diagram of a connection structure of a monitoring device according to another embodiment of the present invention.

FIG. 11 is a schematic diagram of using a wearable device according to an embodiment of the present invention.

Example embodiments will now be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms, and should not be construed as being limited to the embodiments set forth herein; on the contrary, these embodiments are provided so that the present invention will be comprehensive and complete, and fully convey the concept of the example embodiments to Those skilled in the art. The same reference numerals in the figures indicate the same or similar structures, and thus their repeated description will be omitted.

The described features, structures or characteristics can be combined in one or more embodiments in any suitable way. In the following description, many specific details are provided to give a sufficient understanding of the embodiments of the present invention. However, those skilled in the art should realize that without one or more of the specific details, or using other methods, components, materials, etc., the technical solutions of the present invention can also be practiced. In some cases, well-known structures, materials or operations are not shown or described in detail to avoid obscuring the present invention.

The specific embodiments of the present invention will be described in further detail below in conjunction with the drawings and embodiments. The following examples are used to illustrate the present invention, but not to limit the protection scope of the present invention.

Those skilled in the art can understand that the terms "first" and "second" in the present invention are only used to distinguish different parameters, modules, or equipment, etc., and do not represent any specific technical meaning, nor do they mean Inevitable logical order.

Fig. 1 is a schematic flow chart of a method for monitoring the chewing side of an embodiment of the present invention, which includes the following steps: S10, acquiring a left acoustic wave signal and a right acoustic wave signal collected by bone conduction. As an optional implementation, for example, a bone conduction sensor is used to collect data on both sides of the user's head. The bone conduction sensor can be set on a wearable device, such as a bone conduction headset, smart glasses or a smart hat. When the user wears the wearable After the device, the bone conduction sensor on the left side of the user's head collects the left sound wave signal, and the bone conduction sensor on the right side of the user's head collects the right sound wave signal. The frequency at which the bone conduction sensor collects sound waves can be freely set by the user. For example, it can be set to 1s/time, which means collecting once per second, or 2s/time, which means collecting once every two seconds, and so on.

Figure 2 is a schematic diagram of the sound wave collection point. As shown in Figure 2, when the bone conduction sensor is used for sound wave collection, the specific collection position is located in the cheek area on both sides of the user's head, such as near the ears or the temple area, as shown in Figure 2. The sound wave collection point N shown is an optional collection location.

Step S20: Generate the left power spectrum of the left acoustic wave signal and the right power spectrum of the right acoustic wave signal in the monitoring period. Among them, the duration of the monitoring period can be freely set by the user, such as 30 seconds, 1 minute or longer. Taking the monitoring period of 1 minute as an example, that is, for every 1 minute of left and right acoustic signals collected in step S10, step S20 calculates and generates the left power spectrum of the left acoustic signal collected within 1 minute and the 1 The right power spectrum of the right acoustic signal collected within minutes.

Step S30: Integrate the left power spectrum to obtain the left integral value, and integrate the right power spectrum to obtain the right integral value. Figure 3a is a graph of the left power spectrum and the right power spectrum in a chewing state, and Figure 3b is a graph of the left power spectrum and the right power spectrum in another chewing state, where the left power spectrum curve is marked as line A, and the right power spectrum The curve is marked as line B. As shown in Figure 3a, the abscissa is the frequency unit kHz, and the ordinate is the power unit dB. The left integral value obtained by integrating the left power spectrum is the area between the left power spectrum curve and the coordinate axis, when shown in Figure 3a When the user uses the left side to chew in a monitoring period under the chewing state, the integrated value of the left power spectrum is greater than the integrated value of the right power spectrum. As shown in Figure 3b, the abscissa is the frequency unit kHz, and the ordinate is the power unit dB. The right integral value obtained by integrating the right power spectrum is the area between the right power spectrum curve and the coordinate axis, when shown in Figure 3b When the user chews on the right side in a monitoring period under the chewing state, the integrated value of the right power spectrum is greater than the integrated value of the left power spectrum.

In step S40, the actual chewing side in the monitoring period is determined based on at least the left integral value and the right integral value. It can be seen from Figure 3a and Figure 3b that when there is unilateral mastication in a monitoring period, there is a difference between the integral value of the left power spectrum and the integral value of the right power spectrum, according to the magnitude of the left integral value and the right integral value , It can be judged that the side with the larger integral value is the actual chewing side used in a monitoring period.

In this embodiment, it is possible to monitor the actual chewing side used by the user in a monitoring period, and then determine whether to chew on one side.

Fig. 4 is a schematic flow chart of a monitoring method according to another embodiment of the present invention. As shown in Fig. 4, the monitoring method of this embodiment further includes between step S30 and step S40: step S31, calculating the left integral value and the right integral value Step S32, preset a first threshold, determine whether the absolute value of the difference is greater than the first threshold, if yes, perform step S40, if not, return to step S10.

Since the monitoring method of the present invention aims to monitor whether the user is chewing on one side while chewing, it is only necessary to determine the actual chewing side used in the monitoring period only when the user is recognized as being in a chewing state. This embodiment identifies whether the user is in a chewing state based on the relationship between the absolute value of the difference between the left integral value and the right integral value and the first threshold. When the absolute value of the difference reaches a predetermined level, that is, greater than the first threshold (the first threshold) A threshold can be set reasonably according to the actual situation), it is considered that there is a large difference between the collected left and right acoustic signals (for example, the left acoustic signal is significantly stronger than the right acoustic signal), it is recognized as being in a chewing state; The left integral value and the right integral value in the cycle are relatively close, that is, when the absolute value of the value difference is not greater than the preset first threshold, it is considered that the collected left acoustic wave signal and the right acoustic wave signal strength are close, indicating that the user may be in a state of speaking. The sound wave signal, or the sound wave signal caused by simultaneous chewing on both sides, does not require further monitoring in this case, so step S40 is not executed, but step S10 is returned to the next monitoring cycle.

In addition to the above-mentioned method of automatically recognizing the chewing state, manual control can also be performed. The user enters the chewing start instruction when starting to chew, and enters the chewing end instruction when the chewing ends. At this time, the time period between the chewing start instruction and the chewing end instruction That is, when the user is recognized as being in the chewing state, step S10-step S40 are executed to determine the actual chewing side used by the user during the monitoring period (ie, the time period between the chewing start instruction and the chewing end instruction).

Alternatively, several chewing periods can also be set in advance as the monitoring period. For example, three chewing periods of breakfast time 7:00-8:00, lunch time 12:00-13:00 and dinner time 18:00-19:00 can be set in advance. During the monitoring period, the user is automatically recognized as being in a chewing state during these three chewing periods, so that steps S10 to S40 are automatically executed to determine the actual chewing side.

In this embodiment, the actual chewing side used in the monitoring period can be determined only when the user is recognized as being in the chewing state, thereby saving resources and monitoring power consumption.

Fig. 5 is a schematic flow chart of a monitoring method according to another embodiment of the present invention. As shown in Fig. 5, the monitoring method of this embodiment further includes between step S30 and step S40: step S31, calculating the left integral value and the right integral value Step S32, preset a first threshold, determine whether the absolute value of the difference is greater than the first threshold, if yes, perform step S33, if not, return to step S10; step S33, preset a second threshold, determine Whether the absolute value of the value difference is greater than the second threshold, if yes, execute step S40, if not, return to step S10.

Compared with the embodiment shown in FIG. 4, this embodiment adds step S33, that is, when the embodiment shown in FIG. 4 determines the mastication state, continue to determine whether to chew on one side. When chewing on both sides, there is a slight difference between the left integral value and the right integral value. When judging the actual chewing side, if there is a slight difference between the left integral value and the right integral value, the judgment will be made (for example, the left integral value If the value is slightly larger than the integral value on the right, it is judged that the actual chewing side is the left side), which may cause certain errors. Therefore, this embodiment calculates the difference between the left integral value and the right integral value, and when the absolute value of the difference is greater than the preset second threshold (the second threshold can also be set reasonably according to the actual situation), it is determined that the user There is a unilateral chewing situation, and then it is judged that the actual chewing side used in the monitoring period is the side with the larger integral value; and if the absolute value of the difference between the left integral value and the right integral value is not greater than the second threshold , It means that the actual chewing side used in the monitoring period is both sides.

Taking the monitoring period of 1 minute as an example, if the left integral value is greater than the right integral value in the 1 minute, and the difference between the left integral value and the right integral value is significant, and it is greater than the second threshold, it means that the user is in the If you prefer to use the left chewing side for chewing within 1 minute, it can be judged that the actual chewing side in the current 1 minute is the left side; similarly, if the integral value on the right side is calculated to be greater than the integral value on the left side within 1 minute, and the integral value on the right side is calculated The difference between the value and the integral value on the left is significant. It is greater than the second threshold, indicating that the user prefers to use the right chewing side for chewing within the 1 minute. At this time, it can be judged that the actual chewing side in the current 1 minute is the right side ; And if the value difference between the left integral value and the right integral value in the current 1 minute is not greater than the second threshold, it means that the user uses the left chewing in the current 1 minute and uses the right chewing for the same time. At this time, the judgment The chewing side used in this 1 minute is both sides.

This embodiment determines whether the chewing side of the monitoring period is the left side or the right side or both sides according to the relationship between the value difference of the integral values on the left and right sides and the second threshold, so as to accurately determine whether to chew on one side.

Fig. 6 is a schematic flow chart of a monitoring method according to another embodiment of the present invention. It should be noted that the embodiment shown in Fig. 6 can be developed based on the embodiment shown in Fig. 1 or the implementation shown in Fig. 4 or Fig. 5 Examples are expanded, and the various embodiments can be combined with each other to form variants that meet different monitoring periods and different monitoring states. In order to avoid repeated explanations, FIG. 6 directly quotes the embodiment shown in FIG. 1, which should not be regarded as a limitation of the present invention.

As shown in FIG. 6, the monitoring method in this embodiment further includes: step S50, counting the cumulative number of times the actual chewing side is the left side and the cumulative number of the actual chewing side being the right side in multiple monitoring periods; step S60, preset a third Threshold, judging whether the absolute value of the difference between the cumulative number of times on the left side of the actual chewing and the cumulative number of times on the right side of the actual chewing side is greater than the third threshold, if yes, go to step S70, if not, return to step S10; step S70, output recommended chewing side.

Among them, the multiple monitoring periods in step S50 can be regarded as a monitoring period. The monitoring period can be freely set by the user, for example, the monitoring period can be set to one hour or one day or one week; or the monitoring period can also be limited by the start instruction and the end instruction . In a whole monitoring period, the user may use left chewing in several monitoring periods and right chewing in other monitoring periods. By counting the monitoring period using left chewing and the monitoring period using right chewing in one monitoring period Only when the number of times difference is significant, that is, exceeds the third threshold, can it be accurately determined that the user prefers to use one side for chewing for a long time during the monitoring period.

Specifically, for example, the monitoring period is set to 1 minute, the monitoring period is 1 day, and the third threshold is 30. Statistics found that in the monitoring period of 1 day, the user used the left side to chew for 10 minutes, that is to say, the number of monitoring cycles when the actual chewing side is on the left side is judged to be 10, and the time for using the right side to chew is 80 minutes. That is to say, it is judged that the number of monitoring cycles whose actual chewing side is on the right side is 80, and the statistics show that the difference between the number of monitoring cycles on the left side and the right side in a day is 70, which is greater than the third threshold of 30, so It is determined that the user has unilateral chewing, and the recommended chewing side is output. The recommended chewing side is the side with the smaller number of monitoring cycles accumulated by the user in the day, that is, the left side. Similarly, when the statistics show that the side with the smaller number of monitoring cycles used in a day is the right side, the right chewing side is output as the recommended chewing side; and if the chewing side is determined to be the left side monitoring within one day of the monitoring period When the difference between the number of cycles and the number of monitoring cycles determined to be the right side is not greater than the third threshold, it indicates that the time difference between the user's use of the left chewing and the right chewing within a day is not large, and it can be considered that the user is using double chewing. Chew on the side without a recommendation reminder.

Further, the way of outputting the recommended chewing side can be voice, for example, outputting the voice prompt of "please chew on the left side". The voice can be transmitted to the user through the bone conduction sensor. The bone conduction sensor converts the voice into mechanical vibrations of different frequencies. The human skull, bony labyrinth, inner ear lymph, spiral organs, auditory nerve, and auditory center transmit speech. This transmission method can ensure that users hear clear speech in a noisy environment, and will not spread in the air and affect others . Alternatively, the recommended chewing side can also be output through vibration. For example, when the recommended chewing side is the left side, the user's left masticatory muscle can be vibrated three times to indicate that the user is prompted to chew on the left side. Of course, the reminder can also be given in other reasonable ways, such as sending the recommended chewing side to the display screen of the mobile terminal, and the user can learn the recommended chewing side after seeing the reminder on the display screen.

Further, as a preferred embodiment, the monitoring method of this embodiment further includes: step S80, judging whether the actual chewing side in the current monitoring period matches the recommended chewing side, if yes, return to step S10, if not, execute step S90 ; Step S90, output the first prompt message. After the recommended chewing side is output in step S60, step S70 continues to monitor whether the user uses the recommended chewing side for chewing in real time. For example, after outputting the left side as the recommended chewing side in step S60, step S70 continues to monitor to determine the chewing used in the current monitoring period Whether the side is the recommended left side, if it is the left side, it indicates that the user has corrected unilateral chewing, then this monitoring is over, you can return to step S10 for the next monitoring cycle monitoring, if it is not the left side, it indicates that the user has not used the recommended chewing side to perform To chew, step S90 is executed to output a first prompt message to prompt the user to use the recommended chewing side to chew. The first prompt message can also be output by voice, vibration or other reasonable methods.

This embodiment is used to output recommended information in time when it is calculated that the user has used one side to chew during a long monitoring period for too long, to remind the user to use the other side to chew, and to supervise whether the user uses the recommended chewing side in real time. This encourages users to chew evenly.

FIG. 7 is a schematic flowchart of a monitoring method according to another embodiment of the present invention. It should also be noted that FIG. 7 directly refers to the embodiment shown in FIG. 1 in order to avoid repetitive explanations, which should not be regarded as a limitation of the present invention.

As shown in Figure 7, the monitoring method in this embodiment further includes: step S100, preset a designated chewing side, and determine whether the actual chewing side in the current monitoring period matches the designated chewing side, if yes, return to step S10, if not, Perform step S110; step S110, output a second prompt message.

Step S100 in this embodiment is used when the user knows that there is a unilateral chewing situation, so he can manually input a designated chewing side, and then monitor in real time whether the actual chewing side in the current monitoring period matches the input designated chewing side. When they match, the second prompt message is output. The second prompt message may be a voice message, such as "Please use the designated left side to chew", or vibration information, such as vibrating the left side of the user's face to prompt the user to use the left side to chew.

Of course, this embodiment can be combined with other embodiments, for example, combined with the embodiment shown in FIG. 6, after obtaining the recommended chewing side, it is determined whether the recommended chewing side and the designated chewing side match, and corresponding prompts are given when they do not match.

In this embodiment, the user can set the designated chewing side according to his own situation to supervise and prompt himself to use the designated chewing side to chew.

The present invention also provides a mastication side monitoring device. FIG. 8 is a schematic diagram of the connection structure of the mastication side monitoring device according to an embodiment of the present invention. As shown in FIG. 8, the monitoring device of this embodiment includes: a first bone conduction module 10 for Acquire the left side sound wave signal; the second bone conduction module 20, used to collect the right side sound wave signal; the analysis module 30, connected to the first bone conduction module 10 and the second bone conduction module 20, used to generate the left side in the monitoring cycle The left power spectrum of the acoustic signal, the left power spectrum is integrated to obtain the left integral value, and the right power spectrum of the right acoustic signal in the monitoring period is generated, and the right power spectrum is integrated to obtain the right integral value; judgment module 40 and analysis module 30 Connected, the judgment module 40 judges the actual chewing side in the monitoring period at least according to the left integral value and the right integral value.

Wherein, both the first bone conduction module 10 and the second bone conduction module 20 can be bone conduction sensors, such as bone conduction microphones, which use the slight vibration of the bones of the head and neck caused by the user to chew or speak to collect the user's chewing sound waves. Or speech sound waves. The first bone conduction module 10 and the second bone conduction module 20 are arranged on both sides of the user's head, for example, respectively, at the position of the acoustic wave collection point N shown in FIG. 2. Alternatively, the first bone conduction module 10 and the second bone conduction module 20 can only be used to receive acoustic signals, and the collection operation is performed by a bone conduction sensor independent of the monitoring device. That is to say, the bone conduction sensor used to obtain the sound wave signal can be arranged in the monitoring device of the present invention, that is, the first bone conduction module 10 and the second bone conduction module 20 are directly set as bone conduction sensors. The monitoring device directly collects sound wave signals through the first bone conduction module 10 and the second bone conduction module 20; or, the bone conduction sensor is independent of the monitoring device of the present invention, at this time, the first bone conduction module 10 and the second bone conduction module 10 The conduction module 20 receives the sound wave signal sent by the bone conduction sensor. The frequency when the bone conduction sensor collects sound waves can be freely set by the user, or it can be the factory default, and the present invention is not limited here.

Among them, the working modes of the analysis module 30 and the judgment module 40 have been described in the above method embodiments, so they will not be repeated.

In a preferred embodiment, when it is detected that the actual chewing side is the left or right side, that is, unilateral chewing exists, the monitoring device of this embodiment can also output the unilateral chewing detection result in real time. For example, if the judging module 40 determines that the actual chewing side is the left side, it can output the unilateral chewing detection result of "the actual chewing side is the left side", for example, to a mobile terminal, so that the user can know his chewing state in real time; Yes, the unilateral chewing detection result can also be used as a command to control the opening or closing of certain programs through the application of the mobile terminal, for example, to control the closing of a game program, thereby expanding the scope of use of the unilateral chewing detection result.

The monitoring device of this embodiment can monitor the actual chewing side used by the user in one monitoring period, and then determine whether there is unilateral chewing.

FIG. 9 is a schematic diagram of the connection structure of a monitoring device according to another embodiment of the present invention. As shown in FIG. 9, the monitoring device of this embodiment except for the first bone conduction module 10, the second bone conduction module 20, and the analysis module 30 In addition to the judgment module 40, it also includes: a conduction module 50, which has a first threshold prestored and is connected between the analysis module 30 and the judgment module 40. The conduction module 50 is used to calculate the left integral value and the right integral value. When the absolute value of the value difference is greater than the first threshold, the judgment module 40 is turned on. In other words, the conduction module 50 is mainly used to identify whether the user is in a chewing state, and when it is identified as being in a chewing state, the left integral value and the right integral value are transmitted to the analysis module 30 to determine the module 40, that is, the conduction analysis module The group 30 judges the module 40, thereby saving terminal resources and avoiding unnecessary chewing monitoring caused by actions such as speech. Of course, it is also possible to manually turn on and turn off the conduction module 50 to perform a period of monitoring, and this period of time is regarded as the monitoring period. The duration of the monitoring period can be freely set by the user, or it can be defaulted by the monitoring device when it leaves the factory, which is not limited by the present invention.

Further, a second threshold is pre-stored in the judgment module 40. When the conduction module 50 is turned on (that is, the user is in a chewing state), the judgment module 40 determines the absolute value of the difference between the left integral value and the right integral value. And the second threshold value to determine the actual chewing side. Specifically, the judgment module 40 calculates the value difference between the left integral value and the right integral value. When the absolute value of the value difference is greater than or equal to the second threshold, it is judged that there is unilateral chewing, and then it is judged that the left integral value and the right integral value are The larger side is the actual chewing side; and if the absolute value of the difference between the left integral value and the right integral value is less than the second threshold, it indicates that there is only a slight difference between the integral values on the left and right sides, and it can be judged as Non-unilateral chewing or bilateral chewing.

The statistics module 60 prestores a third threshold and is connected to the judgment module 40. The statistics module 60 counts the cumulative number of times the actual chewing side is the left side in multiple monitoring periods, and the cumulative number of the actual chewing side is the right side in multiple monitoring periods Times; The output module 70 is connected to the statistics module 60. The output module 70 outputs the recommended chewing when the absolute value of the difference between the accumulated times on the left side of the actual chewing side and the accumulated times on the right side of the actual chewing side is greater than the third threshold side.

Among them, multiple monitoring periods as a monitoring period can be freely set by the user, such as 1 day; or by pressing the start button on the monitoring device to start statistics, and after multiple monitoring periods have passed, pressing the end button on the monitoring device to end For statistics, the period from the start of the statistics to the end of the statistics is the monitoring period; or, the monitoring period may also be the default when the device leaves the factory, which is not limited by the present invention. Among them, the device including the statistical module 60 and the output module 70 may include the conduction module 50 at the same time, or only include the first bone conduction module 10, the second bone conduction module 20, the analysis module 30, and the judgment module 40. , Its different combinations form a monitoring device that can monitor different mastication states, and correspond to different monitoring methods, which have been described in the above method embodiments.

The prompt module 80 is connected with the output module 70 and the judgment module 40. The prompt module 80 judges whether the actual chewing side in the current monitoring period matches the recommended chewing side, and outputs a first prompt message when it does not match.

Further, a designated chewing side can also be pre-stored in the prompt module 80, and the prompt module 80 determines whether the actual chewing side in the current monitoring period matches the designated chewing side, and outputs a second prompt message when it does not match.

It should be noted that the functional modules added in the embodiment shown in FIG. 9 compared with the embodiment shown in FIG. 8 can be combined in different forms to form different implementations, and the working mode of each functional module has been implemented in the above-mentioned method. It is explained in the example and will not be repeated here.

To sum up, the chewing side monitoring device of this embodiment can monitor the actual chewing side used by the user within a period of time, and promptly issue corresponding reminders for real-time supervision, thereby prompting the user to perform balanced chewing.

FIG. 10 is a schematic diagram of the connection structure of another monitoring device 100 provided by an embodiment of the present invention. The device 100 is suitable for terminal equipment, and this embodiment does not limit its specific implementation. As shown in FIG. 10, the monitoring device 100 may include : Processing component 110, storage 120, power supply component 130, multimedia component 140, audio component 150, input/output interface 160, sensor component 170, and communication component 180.

The processing component 110 is used to control the overall operation of the device 100, and the processing component 110 may include one or more processors 1100 to execute instructions to complete all or part of the steps in the foregoing method embodiments. In addition, the processing component 110 may include one or more modules (not shown in the figure) to facilitate the interaction between the processing component 110 and other components. For example, the processing component 110 may include a multimedia module to facilitate interaction with the multimedia component 140.

The storage 120 is configured to store various types of data to support the operation of the device 100. These data include instructions for any application or method operating on the device 100, contact data, and the like. The storage 120 can be implemented by any type of volatile or nonvolatile storage medium or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), Erase Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), Magnetic Storage, Flash Storage, Magnetic Disk or Optical Disk.

The power supply component 130 provides power to various components of the device 100. The power supply component 130 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 100.

The multimedia component 140 provides an output interface screen between the device 100 and the user, and may include a liquid crystal display and a touch panel. If the screen is a touch panel, it can include one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor can not only sense the boundaries of touch or slide actions, but also detect touch or slide operations related Duration and pressure. In some embodiments, the multimedia component 140 further includes a front camera and/or a rear camera. When the device 100 is in an operating mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external For multimedia data, each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

The audio component 150 is configured to output and/or input audio signals. For example, the audio component 150 includes a microphone for receiving audio signals, and the received audio signals can be further stored in the storage 120 and executed via the processing component 110. In some embodiments, the audio component 150 further includes a speaker for outputting audio signals.

The input/output interface 160 provides an interface between the processing component 110 and a peripheral interface module. The above-mentioned peripheral interface module may be a keyboard, a click wheel, a button, etc. These buttons may include but are not limited to: lock button, volume button, start button And close button.

The sensor assembly 170 includes one or more sensors for providing the device 100 with various aspects of state evaluation. For example, the sensor component 170 can detect the on/off state of the device 100; the sensor component 170 can also detect the position change of the device 100 or a component of the device 100, whether there is contact between the user and the device 100, the orientation or acceleration of the device 100 / Deceleration and temperature changes of the device 100, etc. The sensor component 170 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 170 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

The communication component 180 is configured to facilitate wired or wireless communication between the device 100 and other devices. The device 100 can access a wireless network based on a communication standard, such as WiFi, 2G, 3G, or 4G, or a combination thereof. In one embodiment, the communication component 180 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In another embodiment, the communication component 180 further includes a near field communication module to facilitate short-range communication. The near field communication module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In some embodiments, the apparatus 100 can be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gates Array (FPGA), controller, microcontroller, microprocessor or other electronic components are implemented to implement the above methods.

The present invention also provides a wearable device. The above-mentioned functional modules and electronic components can be set on a wearable bone conduction earphone, smart glasses or smart hat, thereby forming the wearable device of the present invention.

FIG. 11 is a schematic diagram of the use of the wearable device of the present invention. As shown in FIG. 11, the wearable device is specifically a bone conduction headset 200. The bone conduction headset 200 is provided with a bone conduction sensor 201. In actual use, the user wears it In the bone conduction headset 200, the bone conduction sensor 201 is located at the position of the user's masticatory muscles (shown in the figure is the user's left face, and the bone conduction sensor 201 is located at the position of the user's left masticatory muscles), and the bone conduction sensor 201 is used to collect left sound waves signal. Among them, the processor including the analysis module, the judgment module, the statistics module and other functional modules and the memory for storing instructions are all arranged inside the bone conduction earphone 200, so they are not shown in detail in the figure. The processor controls the bone conduction sensor 201 to collect the left chewing side sound wave signal and the right chewing side sound wave signal on both sides of the user's head in a bone conduction manner, and then send them to the processor, and then the processor obtains the left power spectrum and the right power spectrum during the monitoring period ; Judging the actual chewing side used in the monitoring period according to the left power spectrum and the right power spectrum in the monitoring period. The storage is used to store various operating instructions to be executed by the processor or various operating data input by the user.

It can be seen that in this embodiment, by arranging each functional module in the chewing side monitoring device on the bone conduction earphone, the user can conveniently monitor the chewing side of the user through the bone conduction earphone.

Based on the above description, the chewing side monitoring method, monitoring device and wearable device of the present invention can monitor the user's chewing state in real time, determine whether to chew on one side, and issue corresponding prompts, thereby prompting the user to balance chewing.

The specific embodiments of the present invention have been described above. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art can make various deformations or modifications within the scope of the patent application, which does not affect the essence of the present invention.

S10‧‧‧Step

S20‧‧‧Step

S30‧‧‧Step

S40‧‧‧Step

Claims (11)

A method for monitoring the chewing side includes: step S10, acquiring left and right acoustic signals collected by bone conduction; step S20, generating the left power spectrum of the left acoustic signal and the right power of the right acoustic signal in the monitoring period Step S30, integrate the left power spectrum to obtain the left integral value, and integrate the right power spectrum to obtain the right integral value; Step S40, at least according to the left integral value and the right integral value, determine the actual chewing during the monitoring period Step S50, count the cumulative number of times the actual chewing side is the left side and the cumulative number of the actual chewing side as the right side in multiple monitoring periods; step S60, preset a third threshold, and determine that the actual chewing side is the cumulative number of times on the left Whether the actual mastication side is the absolute value of the difference between the accumulated times on the right side is greater than the third threshold, if yes, execute step S70, if not, return to step S10; and step S70, output the recommended mastication side. The mastication side monitoring method described in the first item of the scope of patent application, wherein between step S30 and step S40, it further includes: step S31, calculating the value difference between the left integral value and the right integral value; and step S32, preset A first threshold, it is judged whether the absolute value of the value difference is greater than the first threshold, if yes, execute step S40, if not, return to step S10. According to the mastication side monitoring method described in item 1 of the scope of patent application, between step S30 and step S40, it further includes: step S31, calculating the value difference between the left integral value and the right integral value; Step S32, preset a first threshold, determine whether the absolute value of the value difference is greater than the first threshold, if yes, perform step S33, if not, return to step S10; and step S33, preset a second threshold, and determine the Whether the absolute value of the value difference is greater than the second threshold, if yes, execute step S40, if not, return to step S10. For example, the mastication side monitoring method described in item 1 of the scope of the patent application further includes: step S80, judging whether the actual mastication side in the current monitoring period matches the recommended mastication side, if yes, return to step S10, if not, execute step S90; and step S90, output a first prompt message. For example, the mastication side monitoring method described in item 1, 2 or 3 of the scope of patent application further includes: step S100, preset a designated mastication side, and determine whether the actual mastication side in the current monitoring period matches the designated mastication side, If yes, return to step S10, if not, execute step S110; and step S110, output a second prompt message. A device for monitoring the chewing side includes: a first bone conduction module for collecting left side acoustic wave signals; a second bone conduction module for collecting right side acoustic wave signals; an analysis module, and the first bone conduction module The group is connected to the second bone conduction module to generate the left power spectrum of the left acoustic wave signal in the monitoring period, integrate the left power spectrum to obtain the left integral value, and generate the right power of the right acoustic wave signal in the monitoring period The right side power spectrum is integrated to obtain the right side integral value; a judgment module is connected to the analysis module, and the judgment module judges the actual chewing side in the monitoring period at least according to the left integral value and the right integral value ; A statistics module, prestored with a third threshold, connected to the judgment module, the statistics module counts the cumulative number of times the actual chewing side is the left side in multiple monitoring periods, and The actual chewing side in the multiple monitoring periods is the cumulative number of times on the right side; and an output module connected to the statistics module, the output module when the actual chewing side is the cumulative number of times on the left and the actual chewing side is the right side When the absolute value of the difference between the accumulated times is greater than the third threshold, the recommended chewing side is output. For example, the mastication side monitoring device described in item 6 of the scope of patent application further includes: a conduction module with a first threshold pre-stored, connected between the analysis module and the judgment module, and the conduction module calculates the The value difference between the left integral value and the right integral value. When the absolute value of the difference is greater than the first threshold, the judgment module is turned on. For example, in the mastication side monitoring device described in item 6 of the scope of patent application, a second threshold is also pre-stored in the judgment module, and the judgment module is based on at least the absolute value of the difference between the left integral value and the right integral value and The second threshold determines the actual chewing side. For example, the mastication side monitoring device described in item 6 of the scope of patent application further includes: a prompt module connected to the output module and the judgment module. The prompt module determines the actual mastication side and the judgment module in the current monitoring period. Whether the recommended chewing sides match, and output a first prompt message when they do not match. For example, in the mastication side monitoring device described in item 9 of the scope of patent application, a designated chewing side is pre-stored in the prompt module, and the prompt module determines whether the actual chewing side in the current monitoring period matches the designated chewing side. When they match, the second prompt message is output. A wearable device includes the chewing side monitoring device as described in any one of items 6 to 10 in the scope of patent application.

Images