KR102377676B1 - Apparatus for controlling external device - Google Patents

Abstract

According to some embodiments of the present disclosure, provided is an apparatus for controlling an external device, in an apparatus for controlling an external device, capable of being mountable on a mask, which comprises: a pressure sensing unit which recognizes a pressure inside the mask; a sound signal acquisition unit which acquires a sound signal generated from the inside of the mask; a control unit which generates a first control signal for controlling an external device based on a change in the pressure and an analysis result of the sound signal; and a communication unit which transmits the first control signal to the external device.

Description

External device control device {APPARATUS FOR CONTROLLING EXTERNAL DEVICE}

The present disclosure relates to an external device control device, and more particularly, to an external device control device mountable on a mask.

When operating a portable terminal such as a smart phone, a user typically directly views and controls the portable terminal using both hands, or attempts to control a wireless communication device connected to the portable terminal by using the user's voice.

In order to use the user's voice to control the portable terminal, the voice input to the wireless communication device connected to the portable terminal must be clear. However, when the user is wearing a mask, there is a problem in that it is difficult to control the portable terminal because the voice is not clear.

Accordingly, the user takes off the mask and attempts to control the portable terminal using voice. However, in a situation in which the user cannot take off the mask, there is a problem in that the portable terminal cannot be controlled using the user's voice.

Republic of Korea Patent No. 10-1139297 (Registered on April 17, 2012)

The present disclosure has been made in response to the above-described background art, and is intended to provide an external device control device that can be mounted on a mask that allows a mask wearer to control an external device without taking off the mask.

The technical problems of the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the following description.

In an external device control device mountable on a mask for solving the above-described problem, the external device control device includes: a pressure sensing unit for recognizing a pressure inside the mask; an acoustic signal acquisition unit configured to acquire an acoustic signal generated inside the mask; a control unit configured to generate a first control signal for controlling an external device based on a change in the pressure and an analysis result of the sound signal; and a communication unit configured to transmit the first control signal to the external device.

Alternatively, the control unit recognizes one or more types of breathing of the wearer of the mask based on the change in pressure and the analysis result of the acoustic signal, wherein the types are natural inhalation, natural exhalation, artificial inhalation and artificial exhalation. Including -, it is possible to generate the first control signal based on the recognized breathing pattern using the number of artificial inhalation and the number of artificial exhalation.

Alternatively, when the breathing pattern includes a preset start breathing pattern and a preset end breathing pattern, the control unit is based on a control breathing pattern existing between the preset start breathing pattern and the preset end breathing pattern to generate the first control signal.

Alternatively, the controller may recognize the control breathing pattern when recognizing that the preset start breathing pattern exists by analyzing the breathing pattern.

Alternatively, the controller may recognize the natural in-breath and the natural exhalation in the one or more breaths based on the change amount of the pressure, the change time of the pressure, and the change period of the pressure.

Alternatively, when recognizing the change in pressure, the control unit recognizes that the mask is in a worn state, and when the mask is recognized as being in a worn state, based on the change in pressure and an analysis result of the sound signal The first control signal may be generated.

Alternatively, the control unit, when the reduced state is maintained for a preset reference time after the pressure is less than a preset value, recognizes the breath of the wearer of the mask as an in-breath, and the pressure is higher than the preset value If the enlarged state is maintained for a preset reference time after increasing, the wearer's breathing may be recognized as an exhalation.

Alternatively, the preset value may be a pressure value inside the mask in an apnea state of the wearer.

Alternatively, the control unit analyzes the sound signal acquired through the sound signal acquisition unit to recognize a volume and a signal pattern, and recognizes an action of a wearer of the mask based on the volume and the signal pattern and generate a second control signal for controlling the external device based on the action, and control the communication unit to transmit the second control signal to the external device.

Alternatively, the acoustic signal acquisition unit may include: a first microphone disposed within a preset first distance from the wearer's mouth in a state in which the mask to which the external device control device is mounted is worn by the wearer; and a second microphone disposed at a position more than a preset distance from the wearer's mouth while the mask to which the external device control device is mounted is worn by the wearer.

Alternatively, the control unit generates an attenuated signal obtained by attenuating the amplitude of the acoustic signal obtained through the second microphone, and generates an inverse-phase-processed signal using the attenuated signal, the inverse signal and the second 1 A voice signal of the wearer may be acquired by synthesizing an acoustic signal obtained through a microphone.

Alternatively, when it is recognized that the wearer's command is included in the voice signal by analyzing the voice signal, the control unit preferentially generates a third control signal for controlling the external device based on the command, The third control signal may be preferentially transmitted to the external device through the communication unit.

Alternatively, the controller may generate the first control signal based on an analysis result of the voice signal and a change in the pressure.

Alternatively, the pressure sensing unit may include: a first pressure sensing unit disposed within a preset third distance from the wearer's nose in a state in which the mask to which the external device control device is mounted is worn by the wearer; and a second pressure sensing unit disposed within a preset fourth distance from the wearer's mouth while the mask to which the external device control device is mounted is worn by the wearer.

Alternatively, the control unit, using the change in the first pressure obtained from the first pressure sensing unit and the change in the second pressure obtained from the second pressure sensing unit to recognize the source of each of the one or more breaths and , It is possible to generate the first control signal based on the recognized breathing pattern using the number of artificial inhalation and the number of artificial exhalation of each of the sources.

The present disclosure can provide a convenient external device control device because a mask wearer can control an external device without taking off the mask.

Effects obtainable in the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those of ordinary skill in the art to which the present disclosure belongs from the description below. .

Various aspects are now described with reference to the drawings, wherein like reference numbers are used to refer to like elements throughout. In the following example, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more aspects. It will be evident, however, that such aspect(s) may be practiced without these specific details.
1 is a block diagram of an external device control apparatus according to some embodiments of the present disclosure.
2 is a view in which an external device control apparatus is mounted on a mask according to some embodiments of the present disclosure;
3 is a view for explaining a case in which a user wears a mask equipped with an external device control device according to some embodiments of the present disclosure;
4, 5, 6, 8, 9, and 11 are flowcharts for explaining an example of a process of controlling an external device performed by the external device controlling apparatus according to some embodiments of the present disclosure.
7 is for explaining an example of a method of recognizing inhalation and exhalation through a change in pressure over time inside the mask while the user wears a mask equipped with an external device control device according to some embodiments of the present disclosure; It is a drawing.
10 is a diagram for explaining a method for acquiring a wearer's voice signal performed by an external device control apparatus according to some embodiments of the present disclosure;

Various embodiments and/or aspects are now disclosed with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth to provide a thorough understanding of one or more aspects. However, it will also be appreciated by one of ordinary skill in the art that such aspect(s) may be practiced without these specific details. The following description and accompanying drawings set forth in detail certain illustrative aspects of one or more aspects. These aspects are illustrative, however, and some of various methods may be employed in the principles of the various aspects, and the descriptions set forth are intended to include all such aspects and their equivalents. Specifically, as used herein, “embodiment”, “example”, “aspect”, “exemplary”, etc. are not to be construed as advantageous or advantageous over any aspect or design described herein. It may not be.

Hereinafter, the same or similar components are assigned the same reference numerals regardless of reference numerals, and overlapping descriptions thereof will be omitted. In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical ideas disclosed in the present specification are not limited by the accompanying drawings.

Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used with the meaning commonly understood by those of ordinary skill in the art to which this disclosure belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless clearly defined in particular.

In addition, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless otherwise specified or clear from context, “X employs A or B” is intended to mean one of the natural implicit substitutions. That is, X employs A; X employs B; Or, when X employs both A and B, "X employs A or B" can be applied to either of these cases. Also, as used herein, the term “and/or” should be understood to refer to and include all possible combinations of one or more of the listed related items.

Also, the terms "comprises" and/or "comprising" mean that the feature and/or element is present, but excludes the presence or addition of one or more other features, elements, and/or groups thereof. should be understood as not Also, unless otherwise specified or unless it is clear from context to refer to a singular form, the singular in the specification and claims should generally be construed to mean “one or more”.

And, the term "at least one of A or B" should be interpreted as meaning "when including only A", "when including only B", and "when combined with the configuration of A and B".

When a component is referred to as being “connected” or “connected” to another component, it is understood that it may be directly connected or connected to the other component, but other components may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The suffixes "module" and "part" for the components used in the following description are given or used in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves.

Objects and effects of the present disclosure, and technical configurations for achieving them will become clear with reference to the embodiments described below in detail in conjunction with the accompanying drawings. In describing the present disclosure, if it is determined that a detailed description of a well-known function or configuration may unnecessarily obscure the subject matter of the present disclosure, the detailed description thereof will be omitted. In addition, the terms described below are terms defined in consideration of functions in the present disclosure, which may vary according to intentions or customs of users and operators.

However, the present disclosure is not limited to the embodiments disclosed below and may be implemented in various different forms. Only the present embodiments are provided so that the present disclosure is complete, and to fully inform those of ordinary skill in the art to which the present disclosure belongs, the scope of the disclosure, and the present disclosure is only defined by the scope of the claims . Therefore, the definition should be made based on the content throughout this specification.

The external device control device according to some embodiments of the present disclosure may refer to an external device control device that can be mounted on a mask so that a mask wearer can control an external device without taking off the mask.

1 is a block diagram of an external device control apparatus according to some embodiments of the present disclosure;

In the present disclosure, the external device control device 100 may refer to a device mounted on a mask to control the external device 200 based on an action such as breathing of a wearer of the mask. Specifically, the external device control device 100 may be mounted inside the mask. Here, the inner side of the mask may be a portion in contact with the face when the user wears the mask.

Referring to FIG. 1 , an external device control apparatus 100 according to some embodiments of the present disclosure may transmit a control signal to an external device 200 through a communication network 300 .

The external device control apparatus 100 may include a pressure sensing unit 110 , an acoustic signal acquisition unit 120 , a control unit 130 , a communication unit 140 , a storage unit 150 , and a power supply unit 160 . However, the above-described components are not essential in implementing the external device control device 100 , and the external device control device 100 may have more or fewer components than those listed above.

The pressure sensing unit 110 may recognize the pressure inside the mask, that is, atmospheric pressure. Specifically, when the user wears the mask on which the external device control device 100 is mounted, the pressure sensing unit 110 may recognize the pressure inside the mask, that is, the change in atmospheric pressure.

The pressure sensing unit 110 may include a first pressure sensing unit 111 and a second pressure sensing unit 112 . However, the above-described components are not essential in implementing the pressure sensing unit 110 , and the pressure sensing unit 110 may have more or fewer components than those listed above.

The first pressure sensing unit 111 is disposed within a third preset distance from the nose of the wearer while the mask equipped with the external device control device 100 is worn on the wearer so as to recognize the pressure inside the mask, that is, atmospheric pressure. can be

More specifically, the first pressure sensing unit 111 may be disposed more than 10 mm above the center of the wearer's upper lip, and a specific area corresponding to the lower part of the wearer's nostril entrance (eg, based on the center of the nose) As a result, it can be arranged in an area within 40 mm of left and right width). When the first pressure sensing unit 111 is disposed at the above-described position, it is possible to easily recognize a change in pressure (or air pressure) generated by breathing through the wearer's nose. However, the present invention is not limited thereto.

The second pressure sensing unit 112 is to be disposed within a predetermined fourth distance from the wearer's mouth in a state in which the mask equipped with the external device control device 100 is worn on the wearer so as to recognize the pressure inside the mask, that is, the atmospheric pressure. can

More specifically, the second pressure sensing unit 112 may be disposed in a specific area corresponding to the center of the wearer's lower lip (for example, an area within 20 mm of upper and lower width and 40 mm of left and right width based on the center of the lower lip). there is. When the second pressure sensing unit 112 is disposed in the above-described position, it is possible to easily recognize a change in pressure (or air pressure) generated by breathing through the wearer's mouth. However, the present invention is not limited thereto.

In the present disclosure, the first pressure sensing unit 111 and the second pressure sensing unit 112 may be disposed at different positions when the external device control apparatus 100 is mounted on a mask. Accordingly, the external device control apparatus 100 may more accurately recognize the source of the wearer's breathing.

Meanwhile, as described above, when the external device control apparatus 100 includes a plurality of pressure sensing units, a change in pressure (specifically, atmospheric pressure) generated inside the mask may be recognized in detail.

The acoustic signal acquisition unit 120 may acquire an acoustic signal generated inside the mask. Specifically, when the user wears the mask on which the external device control apparatus 100 is mounted, the acoustic signal acquisition unit 120 may acquire the acoustic signal generated inside the mask. Here, the acoustic signal acquired by the acoustic signal acquisition unit 120 may include not only a sound generated by the wearer of the mask but also an external sound. Accordingly, according to some embodiments of the present disclosure, the external sound may be removed by a preset method. A detailed description thereof will be described later in more detail with reference to FIGS. 9 and 10 .

The acoustic signal acquisition unit 120 may include a first microphone 121 and a second microphone 122 . However, the above-described components are not essential in implementing the acoustic signal acquisition unit 120 , and the acoustic signal acquisition unit 120 may have more or fewer components than those listed above.

The first microphone 121 may be disposed within a preset first distance from the wearer's mouth in a state in which the mask equipped with the external device control device 100 is mounted to the wearer so as to obtain an acoustic signal generated inside the mask. there is.

More specifically, the first microphone 121 may be located in a specific area corresponding to the center of the wearer's mouth (eg, within a radius of 20 mm from the center of the mouth). When the first microphone 121 is disposed at the above-described position, a sound generated by the wearer's mouth may be more clearly recognized. However, the present invention is not limited thereto.

The second microphone 122 is located at a position more than a preset second distance from the wearer's mouth in a state in which the mask equipped with the external device control device 100 is mounted to the wearer so as to obtain an acoustic signal generated inside the mask. can be placed.

More specifically, the second microphone 122 may be disposed at a position outside a radius of 60 mm with respect to the center of the wearer's mouth. When the second microphone 122 is disposed at the above-described position, a sound generated from the outside may be recognized as louder than a sound generated by the wearer. Accordingly, the second microphone 122 may be utilized to remove (remove noise) an externally generated sound from a sound generated by the wearer. However, the present invention is not limited thereto.

The first microphone 121 and the second microphone 122 may be disposed at different positions when the external device control apparatus 100 is mounted on a mask. Accordingly, externally generated sounds other than the voice of the wearer of the mask can be effectively removed. A detailed description thereof will be described later in more detail with reference to FIGS. 9 and 10 .

The control unit 130 receives a control signal (eg, a first control signal, a second control signal, a third control signal, etc.) for controlling the external device 200 based on a change in pressure and an analysis result of the acoustic signal. can create

The control unit 130 may recognize one or more types of breathing of the wearer of the mask based on the change in pressure and the analysis result of the acoustic signal. Here, the type of breathing may include natural breathing, natural exhalation, artificial inhalation, and artificial exhalation.

Here, the controller 130 may recognize the natural inhalation and natural exhalation in one or more breaths based on the amount of pressure change, the pressure change time, and the pressure change period. Specifically, the controller 130 determines that the first breath of the wearer wearing the mask is the basic breath, and based on the amount of change in the pressure recognized through the pressure sensing unit 110 in the first breath, the change time of the pressure, and the change period of the pressure Thus, natural in-breath and natural out-breath can be recognized. In addition, the controller 130 may determine that the in-breath that does not correspond to the natural in-breath as the artificial in-breath, and determine that the exhalation does not correspond to the natural out-breath as the artificial exhalation.

In addition, the controller 130 may recognize a short artificial in-breath, a long artificial in-breath, a short artificial exhalation, and a long artificial exhalation from the artificial in-breath and the artificial out-breath based on the pressure change time. For example, when the pressure change time is shorter than a preset time (eg, 2 seconds), the controller 130 may determine that the recognized artificial inhalation is a short artificial inhalation.

In addition, when the breathing pattern includes a preset start breathing pattern and a preset end breathing pattern, the controller 130 controls the first control based on the control breathing pattern existing between the preset start breathing pattern and the preset end breathing pattern. signal can be generated. Here, the first control signal may be generated through the number of artificial inhalation and artificial exhalation included in the control breathing pattern.

The breathing pattern may mean a pattern in which the user artificially breathes. Here, the breathing pattern may mean a ratio of a rising holding time and a falling holding time of the pressure inside the mask. However, the present invention is not limited thereto.

The preset starting breathing pattern may mean a pattern in which the user artificially breathes, indicating a starting point for recognizing the control breathing pattern in the controller 130 . Here, the preset start breathing pattern may include a predetermined pattern of artificial inhalation and artificial exhalation. For example, the preset start breathing pattern may be set to two artificial inhalations and one artificial exhalation. At least one of these preset start breathing patterns may be recorded in the storage unit 150 .

The preset end breathing pattern may mean a pattern in which the user artificially breathes, indicating an end point for recognizing the control breathing pattern in the control unit 130 . Here, the preset end respiration pattern may include a predetermined pattern of artificial inhalation and artificial exhalation. For example, the preset end breathing pattern may be set to one artificial inhalation and two artificial exhalations. At least one of these preset end breathing patterns may be recorded in the storage unit 150 .

The controlled breathing pattern may refer to a pattern in which the user artificially breathes in order to control the external device 200 . Here, the control breathing pattern may include a predetermined pattern of artificial inhalation and artificial exhalation. For example, when the preset control breathing pattern is one artificial in-breath and 0 artificial exhalation, it may be set as a pattern for turning on the screen of the external device 200 . At least one of these preset controlled breathing patterns may be recorded in the storage unit.

A specific method for the control unit 130 to generate the first control signal is as follows.

The controller 130 may analyze the breathing pattern of the wearer wearing the mask to which the external device control apparatus 100 is mounted in real time.

When the artificial in-breath and artificial exhalation are recognized in the wearer's breathing pattern, the controller 130 may continue to detect the wearer's breathing pattern.

The controller 130 may recognize whether a pattern generated through artificial in-breath and artificial exhalation is similar to a preset start breathing pattern. Here, when it is determined that a preset start breathing pattern and a pattern generated through artificial in-breath and artificial exhalation are similar to each other by more than a preset degree, the controller 130 may recognize that the two patterns are similar.

When it is determined that the pattern generated through the artificial in-breath and artificial exhalation is similar to the preset start breathing pattern, the control unit 130 may recognize that the artificial in-breath and artificial exhalation after the preset start breathing pattern are control breathing patterns.

The control unit 130 may compare the control breathing pattern recognized through the artificial inhalation and artificial exhalation of the mask wearer with a plurality of controlled breathing patterns stored in the storage unit 150 . In addition, the controller 130 may check the control breathing pattern similar to the control breathing pattern recognized through the artificial inhalation and artificial exhalation of the mask wearer in the storage unit 150 . Here, when each of the plurality of control breathing patterns is recognized, the storage unit 150 may store information on which control signal should be generated. Accordingly, the control unit 130 may generate a control signal corresponding to the control breathing pattern recognized through the artificial inhalation and artificial exhalation of the mask wearer based on the information stored in the storage unit 150 .

Meanwhile, the controller 130 may recognize a breathing pattern continuously after the control breathing pattern, and recognize whether a pattern generated through artificial in-breath and artificial exhalation is similar to a preset end breathing pattern. Here, the controller 130 may recognize that the two patterns are similar when it is determined that the preset end respiration pattern and the pattern generated through the artificial in-breath and artificial exhalation are similar by more than a preset degree.

If, the control unit 130 recognizes that the pattern generated through the artificial inhalation and artificial exhalation is similar to the preset end breathing pattern, the artificial inhalation and artificial exhalation after the preset end breathing pattern is recognized as not a control breathing pattern can do.

Meanwhile, when the control unit 130 first recognizes a change in pressure, that is, atmospheric pressure, based on the pressure recognized through the pressure sensing unit 110 , it may recognize that the mask is in a wearing state. When it is recognized that the mask is worn, the controller 130 may generate a first control signal based on a change in pressure and an analysis result of the acoustic signal.

Specifically, when the mask is not in a wearing state, the control unit 130 operates only the pressure sensing unit 110 to reduce power consumption in a standby state to recognize only a change in pressure, that is, a change in atmospheric pressure. And, when recognizing the change in pressure, the control unit 130 may operate the entire configuration in an operating state.

After the pressure (specifically, atmospheric pressure) becomes smaller than a preset value, when the reduced state is maintained for a preset reference time, the control unit 130 may recognize the breathing of the mask wearer as an inhalation. In addition, when the pressure (specifically, atmospheric pressure) becomes greater than a preset value and then the increased state is maintained for a preset reference time, the controller 130 may recognize the breath of the wearer of the mask as an exhalation.

Here, the preset value may be a pressure value inside the mask in the wearer's apnea state.

The controller 130 may analyze the sound signal acquired through the sound signal acquisition unit 120 to recognize the volume and signal pattern, and recognize the action of the wearer of the mask based on the volume and the signal pattern. In this disclosure, the action may include natural breathing, blowing in the wind, and speaking.

Specifically, when it is recognized that the volume is smaller than a preset level (eg, 10 dB) and the signal pattern is periodically repeated, the controller 130 may recognize the wearer's action as natural breathing. When recognizing that the volume is greater than a preset size and the signal pattern is maintained without being repeated, the controller 130 may recognize the wearer's action as blowing in the wind. In addition, when the control unit 130 recognizes that a signal pattern of a voice waveform is generated at a volume greater than that of breathing and a signal pattern that did not appear in natural breathing and blowing in the wind occurs, the wearer's action may be recognized as speaking.

Meanwhile, the control unit 130 generates a second control signal for controlling the external device 200 based on the recognized action, and controls the communication unit 140 to transmit the second control signal to the external device 200 . can

A specific method for the control unit 130 to generate the second control signal is as follows.

The control unit 130 may analyze in real time an acoustic signal obtained from the inside of the mask to which the external device control apparatus 100 is mounted. In addition, the controller 130 may recognize a volume and a signal pattern from the sound signal.

Meanwhile, the controller 130 may recognize whether the recognized volume and signal pattern are similar to the volume and signal pattern corresponding to a specific action (eg, speaking). Here, when it is determined that the recognized volume and signal pattern and the volume and signal pattern corresponding to a specific action are similar to each other by more than a preset degree, the controller 130 may recognize that the two volume and signal patterns are similar.

The controller 130 may compare the volume and signal pattern corresponding to a specific action with a plurality of volume and signal patterns stored in the storage 150 . In addition, the control unit 130 may check the volume and signal pattern similar to the volume and signal pattern corresponding to the specific action in the storage unit 150 . Here, the storage unit 150 may store information on which control signal should be generated when each of a plurality of volume levels and signal patterns is recognized. Accordingly, the control unit 130 may generate a control signal corresponding to the volume and signal pattern recognized through the acoustic signal obtained from the inside of the mask based on the information stored in the storage unit 150 .

Meanwhile, in the present disclosure, the controller 130 may remove noise from the sound acquired through the sound acquisition unit. Here, the noise may mean a sound other than a sound generated by the wearer of the mask (specifically, a sound generated inside the mask). However, the present invention is not limited thereto.

Specifically, the control unit 130 generates an attenuated signal obtained by attenuating the amplitude of the acoustic signal acquired through the second microphone 122 , and generates an inverse-phase-processed signal using the attenuated signal, and the first microphone 121 . ), it is possible to synthesize the acoustic signal obtained through the inverse phase signal. In this case, the voice signal of the wearer of the mask from which the noise has been removed may be obtained.

On the other hand, when it is recognized that the wearer's command is included in the voice signal by analyzing the voice signal, the control unit 130 preferentially generates a third signal for controlling the external device 200 based on the command, and the communication unit 140 . Through , the third control signal may be preferentially transmitted to the external device 200 .

According to some embodiments of the present disclosure, the controller 130 may generate the first control signal based on the result of analyzing the voice signal and the change in pressure.

Specifically, the control unit 130 transmits the sound signal obtained through the first microphone 121 and the second microphone 122 obtained inside the mask to which the external device control apparatus 100 is mounted in real time. can be analyzed as

The controller 130 may generate an attenuated signal obtained by attenuating the amplitude of the acoustic signal acquired through the second microphone 122 , and may generate a reverse-phase-processed signal using the attenuated signal. In addition, the controller 130 may obtain a voice signal of the wearer of the mask by synthesizing the acoustic signal acquired through the first microphone 121 with the inverse signal.

The control unit 130 recognizes artificial exhalation and artificial inhalation based on the acquired voice signal and the change in pressure (specifically, atmospheric pressure) in the mask, and based on the artificial exhalation and artificial inhalation, the wearer's artificial breathing pattern can be recognized. . In addition, the controller 130 may compare the wearer's artificial breathing pattern with a plurality of breathing patterns stored in the storage unit 150 . In addition, the controller 130 may check a breathing pattern similar to the acquired breathing pattern in the storage 150 . Here, the storage unit 150 may store information on which control signal should be generated by each of a plurality of breathing patterns. Accordingly, the controller 130 may generate a control signal based on a change in pressure and an acoustic signal acquired inside the mask based on information stored in the storage 150 .

On the other hand, the control unit 130 by using the change in the first pressure obtained from the first pressure sensing unit 111 and the change in the second pressure obtained from the second pressure sensing unit 112 at least one source of each breath Recognize and generate a control signal based on the recognized breathing pattern using the number of artificial inhalation and artificial exhalation of each source.

Here, the source means a source that generates inhalation or exhalation, and the source may include a wearer's mouth and nose. However, the present invention is not limited thereto.

After the pressure becomes smaller than the preset value, the controller 130 may recognize that the wearer's breathing of the mask is the inhalation if the state of being smaller than the preset value for a preset reference time is maintained. Here, the preset value may be a pressure value inside the mask in the wearer's apnea state.

On the other hand, the inspiratory source may include the mouth, the nose, or both the mouth and the nose.

When the artificial inhalation is an inhalation using only the mouth, the change in pressure is expressed by Equation 1 below.

[Equation 1]

P1 > k*P2+d

When the artificial inhalation is an inhalation using only the nose, the change in pressure is expressed by Equation 2 below.

[Equation 2]

P1 < k*P2-d

When the artificial inhalation is an inhalation using the mouth and nose at the same time, the change in pressure is expressed by Equation 3 below.

[Equation 3]

k*P2-d < P1 < k*P2+d

P1 is a pressure reduction difference value compared to a preset value of the second pressure sensing unit 112 (eg, the pressure value inside the mask in the wearer's apnea state), and P2 is a preset value of the first pressure sensing unit 111 It is the difference in pressure reduction compared to the value (for example, the pressure value inside the mask in the wearer's apnea state), k is the ratio to match the pressure between mouth-only breathing and nose-only breathing with natural breathing (Factor), d is It may be a pressure change value that occurs when breathing through the mouth and nose at the same time.

In the present disclosure, the control unit 130 analyzes the change in pressure measured by the first pressure sensing unit 111 and the second pressure sensing unit 112 using Equations 1, 2 and 3 above. Thus, the source of the inhalation can be recognized.

On the other hand, the controller 130 may recognize that the breath of the wearer of the mask is the exhalation when the pressure is greater than the preset value and remains greater than the preset value for the preset reference time. Here, the preset value may be a pressure value inside the mask in the wearer's apnea state.

The exhalation source may include the mouth, the nose, or both the mouth and the nose.

When the artificial exhalation is the inhalation using only the mouth, the change in pressure is expressed by Equation 4 below.

[Equation 4]

P1 > k*P2+d

When the artificial exhalation is the inhalation using only the nose, the change in pressure is expressed by Equation 5 below.

[Equation 5]

P1 < k*P2-d

When the artificial exhalation is the inhalation using the mouth and the nose at the same time, the change in pressure is as shown in Equation 6 below.

[Equation 6]

k*P2-d < P1 < k*P2+d

P1 is a pressure increase difference value compared to a preset value of the second pressure sensing unit 112 (eg, a pressure value inside the mask in the wearer's apnea state), and P2 is a preset value of the first pressure sensing unit 111 It is the difference in pressure increase compared to the value (for example, the pressure value inside the mask in the wearer's apnea state), k is the ratio to match the pressure between mouth-only breathing and nose-only breathing with natural breathing (Factor), d is It may be a pressure change value that occurs when breathing through the mouth and nose at the same time.

In the present disclosure, the control unit 130 analyzes the change in pressure measured by the first pressure sensing unit 111 and the second pressure sensing unit 112 using Equations 4, 5 and 6 described above. Thus, the source of the exhalation can be recognized.

As such, the control unit 130 uses the change in the first pressure obtained from the first pressure sensing unit 111 and the change in the second pressure obtained from the second pressure sensing unit 112 to control each source of one or more breaths. By recognizing it, it is possible to create more diverse patterns by distinguishing breathing from the mouth and breathing from the nose, and control signals for complex commands can also be generated through various patterns.

The controller 130 may recognize the artificial wind generated by the wearer in the mask. Here, the artificial wind may include an artificial wind generated by the wearer's mouth and an artificial wind generated by the wearer's nose.

Specifically, the control unit 130 may control the first pressure sensing unit 111 , the second pressure sensing unit 112 , and the first microphone 121 based on a value (or signal) measured in a preset number (eg, , 4) is satisfied, it can be recognized as an artificial wind generated by the mouth of the wearer of the mask. Here, the first condition is that the pressure recognized by the second pressure sensing unit 112 rises larger than the pressure recognized when the wearer breathes only through the mouth and exhales for a preset first time (eg, 30 sec) when the condition is satisfied, when the pressure recognized by the first pressure sensing unit 111 is less than the pressure when the wearer exhales through the mouth and nose, a preset second time period (eg, 20 seconds) ) or longer, the level of the signal measured by the first microphone 121 or the level of the synthesized signal obtained by synthesizing the signals measured by each of the first microphone 121 and the second microphone 122 is the reference value. If greater than the condition satisfied and the control unit 130 recognizes a specific voice signal (eg, a sound produced when breathing through the mouth such as “whoo”) from the voice signal acquired by the acoustic signal acquisition unit 120 , In some cases, conditions to be satisfied may be included. However, the present invention is not limited thereto.

On the other hand, the control unit 130 based on the value (or signal) measured by the first pressure sensing unit 111, the second pressure sensing unit 112, and the first microphone 121 a preset number (for example, When the second condition of 4) is satisfied, it may be recognized as an artificial wind generated by the nose of the wearer of the mask. Here, the second condition is that the pressure recognized by the first pressure sensing unit 111 rises larger than the pressure recognized when the wearer breathes only through the nose and exhales for a preset third time period (eg, 10 seconds). A condition that lasts longer than, a condition in which the pressure recognized by the second pressure sensing unit 111 is less than the pressure when the wearer exhales through the mouth and nose is maintained for more than a preset fourth time (eg, 20 seconds) , a condition that is satisfied when the level of the signal measured by the first microphone 121 or the level of the synthesized signal obtained by synthesizing the signals measured by each of the first microphone 121 and the second microphone 122 is greater than the reference value, and It may include a condition in which a specific voice signal (eg, a sound generated when breathing through the nose, such as "breath") is recognized from the voice signal acquired by the acoustic signal acquisition unit 120 . However, the present invention is not limited thereto.

The communication unit 140 may include any wired/wireless communication network capable of transmitting and receiving any type of data and signals. For example, the communication unit 140 may transmit a control signal generated by the control unit 130 to the external device 200 .

The storage unit 150 may store any type of information generated or determined by the controller 130 and any type of information received by the communication unit 140 . For example, the storage unit 150 may store the control signal generated by the control unit 130 and check when and which control signal is generated by the control unit 130 .

Also, the storage unit 150 may store a control signal mapped to each of a plurality of breathing patterns, volume, signal patterns, and voice signals. Specifically, a preset start breathing pattern and a preset end breathing pattern may be stored in the storage unit 150 . Accordingly, the control unit 130 may generate a corresponding control signal by comparing the analysis result of the change in pressure and the sound signal with a plurality of breathing patterns, volume, signal patterns, and reference voice signals stored in the storage unit 150 .

Here, the storage unit 150 includes a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (eg, SD or XD memory). etc.), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), It may include at least one type of storage medium among a magnetic memory, a magnetic disk, and an optical disk. However, the present invention is not limited thereto.

The power supply unit 160 includes a power supply body (eg, a battery, a dry cell), can supply power to the control unit 140 through the power supply unit, and selectively supply power by the control unit 140 to Power consumption can be reduced.

In the present disclosure, the external device 200 may refer to an electronic device that is controlled by receiving a control signal from the external device control apparatus 100 .

Specifically, the external device 200 has a mechanism for communicating with the external device control device 100 through the communication network 300 , and includes a PC, a laptop computer, a mobile phone, a smart phone, and a laptop computer. ), digital broadcasting terminals, PDA (personal digital assistants), PMP (portable multimedia player), navigation, slate PC, tablet PC, ultrabook, wearable device, for example For example, it may include a watch-type terminal (smartwatch), a glass-type terminal (smart glass), a head mounted display (HMD), and any electronic device.

The external device 200 may include a processor 201 , a storage 202 , and a communication unit 203 . However, since the above-described components are not essential in implementing the external device 200 , the external device 200 may have more or fewer components than those listed above. Here, each component may be configured as a separate chip, module, or device, or may be included in one device.

The processor 201 may typically process the overall operation of the external device 200 . For example, the processor 201 may control the external device 200 based on a control signal received through the communication unit 203 .

The storage unit 202 may store information about the control signal received through the communication unit 203 .

The communication unit 203 may include any wired/wireless communication network capable of transmitting and receiving any type of data and signals. For example, the communication unit 203 may receive a control signal transmitted from the external device control apparatus 100 .

The communication network 300 may include any wired/wireless communication network capable of transmitting and receiving any type of data and signals. Specifically, the communication network 300 may include a wireless communication network capable of transmitting and receiving a control signal between the external device control apparatus 100 and the external device 200 .

2 is a view in which an external device control apparatus is mounted on a mask according to some embodiments of the present disclosure;

Referring to FIG. 2 , the external device control apparatus 100 may be mounted inside the mask 1 .

The external device control apparatus 100 may have a size smaller than the size of the mask 1 . Accordingly, the external device control apparatus 100 can be mounted at the center of the mask 1 in a size that does not leave the mask 1 .

The external device control apparatus 100 is provided with a first pressure sensing unit 111, a first microphone 121, and a second pressure sensing unit 112 in order from top to bottom of the central portion, and is provided at left and right edges Each of the second microphones 122 may be provided. However, the present invention is not limited thereto, and each location may be different depending on circumstances.

On the other hand, the external device control device 100 is the opposite side where the first pressure sensing unit 111 , the second pressure sensing unit 112 , the first microphone 121 , and the second microphone 122 are not provided, that is, A hook in the form of Velcro may be formed on a surface in contact with the mask 1 . In addition, a Velcro-shaped locking ring may be formed on the surface of the mask 1 in contact with the external device control device 100 . Accordingly, the external device control apparatus 100 can be mounted on the mask 1 .

According to some embodiments of the present disclosure, the external device control apparatus 100 may have a ring (not shown) formed thereon to hang the ring (not shown) on the mask 1 . The shape of the ring (not shown) may be formed in the form of a hook. However, the present invention is not limited thereto and may be formed in a form that can be hung on the mask 1 .

According to some embodiments of the present disclosure, the external device control device 100 may be mounted on the mask 1 by being inserted into a pocket formed on the mask 1 . Here, the pocket is formed in a size that can accommodate the external device control device 100 , and a button may be provided to open and close the pocket. Specifically, it may include a shank button. However, the present invention is not limited thereto.

3 is a view for explaining a case in which a user wears a mask equipped with an external device control device according to some embodiments of the present disclosure.

Referring to FIG. 3 , when the user wears the mask 1 on which the external device control device 100 is mounted, the first pressure sensing unit 111 may be disposed between the wearer's nose and mouth. Specifically, the first pressure sensing unit 111 may be disposed to correspond to the wearer's pharynx to recognize the pressure inside the mask 1 that is changed according to wind generated from the wearer's nose.

The first microphone 121 may be disposed in the wearer's mouth. Specifically, the first microphone 121 may be disposed to correspond to the central portion between the lips of the wearer to acquire an acoustic signal according to a sound generated from the mouth of the wearer.

The second pressure sensing unit 112 may be disposed under the wearer's lips. Specifically, the second pressure sensing unit 112 may be disposed to correspond to the wearer's chin to recognize the pressure inside the mask 1 that is changed according to the wind generated from the wearer's mouth.

The second microphone 122 may be disposed on the cheek of the wearer. Specifically, the second microphone 122 may be positioned at the edge of the mask far from the wearer's nose and mouth to acquire an acoustic signal coming into the mask from the outside of the mask.

As described above, when the first pressure sensing unit 111 and the second pressure sensing unit 112 are disposed at the above-described positions, the source of the wearer's breathing can be more accurately recognized. In addition, when the first microphone 121 and the second microphone 122 are disposed at the above-described positions, external sounds other than the voice of the mask wearer can be effectively removed.

Meanwhile, the external device control device 100 is mounted on the mask 1 to generate a control signal based on a change in pressure inside the mask 1 and an analysis result of the acoustic signal and transmit the control signal to the external device 200 . can A detailed description thereof will be described later with reference to FIG. 4 .

4 is a flowchart illustrating an example of a process of controlling an external device performed by an external device control apparatus according to some embodiments of the present disclosure.

Referring to FIG. 4 , the external device control apparatus 100 may recognize the pressure inside the mask 1 through the pressure sensing unit 110 ( S110 ).

Specifically, the control unit 130 may recognize a change in pressure inside the mask 1 through the pressure sensing unit 110 . In this case, the controller 130 may recognize that the current state is a mask wearing state (ie, a state in which the user wears the mask 1 ).

According to some embodiments of the present disclosure, when recognizing that the current state is a mask wearing state, the controller 130 may change the acoustic signal acquisition unit 120 from an inactive state to an active state.

Specifically, the acoustic signal acquisition unit 120 of the external device control apparatus 100 may maintain an inactive state in order to reduce power consumption in the standby state. In addition, when it is recognized that the user wears the mask through the pressure sensing unit 110 , the control unit 130 may change the acoustic signal acquisition unit 120 from an inactive state to an active state.

Meanwhile, as described above in FIG. 1 , the pressure sensing unit 110 may include a first pressure sensing unit 111 and a second pressure sensing unit 112 . In this way, two pressure sensing units 110 are configured to detect pressure changes around the wearer's mouth and nose, respectively, and can recognize a more diverse pattern by distinguishing breathing from the mouth and breathing from the nose.

The external device control apparatus 100 may acquire an acoustic signal generated inside the mask 1 through the acoustic signal acquisition unit 120 (S120).

Specifically, the control unit 130 may acquire an acoustic signal generated inside the mask and an acoustic signal generated outside the mask through the acoustic signal acquisition unit 120 . In this case, the controller 130 may acquire only the acoustic signal generated inside the mask through noise canceling, which will be described later with reference to FIGS. 9 and 10 . However, the present invention is not limited thereto.

Meanwhile, according to some embodiments of the present disclosure, the acoustic signal acquisition unit 120 may include a first microphone 121 and a second microphone 122 to perform noise cancellation. However, the above-described components are not essential in implementing the acoustic signal acquisition unit 120 , and the acoustic signal acquisition unit 120 may have more or fewer components than those listed above.

The external device control apparatus 100 may generate a first control signal for controlling the external device 200 based on the result of analyzing the change in pressure and the sound signal through the controller 130 ( S130 ).

Specifically, the control unit 130 may recognize artificial in-breath, artificial exhalation, natural in-breath, and natural exhalation based on a result of analysis of a change in pressure and a sound signal. In addition, the controller 130 may generate a first control signal by using a respiration pattern recognized by using each number of artificial inhalation and artificial exhalation.

For example, when the controller 130 recognizes that the artificial respiration pattern recognized based on the pressure change and the analysis result of the acoustic signal is a pattern that turns off the screen of the external device 200 , the screen of the external device 200 . It is possible to generate a first control signal to turn off. However, the present invention is not limited thereto.

Meanwhile, when the first control signal is generated in step S130 , the control unit 130 of the external device control apparatus 100 may transmit the first control signal to the external device 200 through the communication unit 140 ( S140).

According to some embodiments of the present disclosure, the communication unit 140 of the external device control apparatus 100 may be in a deactivated state before the control signal is generated. However, when the control signal is generated in step S130 , the controller 130 activates the deactivated communication unit 140 and then controls the activated communication unit 140 to transmit the first control signal to the external device 200 . can

Meanwhile, the external device 200 may be any electronic device that has a history of transmitting and receiving information for wireless communication connection with the external device control device 100 in advance through a pairing process.

As in some embodiments described above in FIG. 4 , the user of the external device control apparatus 100 can easily control the external device 200 through breathing while wearing a mask, thereby providing convenience to the user.

On the other hand, according to some embodiments of the present disclosure, the control unit 130 of the external device control device 100 recognizes whether the mask wearer's breathing is artificial and whether it is an in-breath or an out-breath, and on the basis of the breathing pattern generated Based on the first control signal may be generated. A detailed description thereof will be described later with reference to FIG. 5 .

5 is a flowchart illustrating an example of a process of controlling an external device performed by an external device control apparatus according to some embodiments of the present disclosure.

Referring to FIG. 5 , the controller 130 may recognize one or more types of breathing of the wearer of the mask based on the result of analysis of the change in pressure and the sound signal ( S210 ).

Here, the type of breathing may include a natural in-breath, a natural out-breath, an artificial in-breath, and an artificial out-breath.

Specifically, the controller 130 may recognize a natural in-breath and a natural exhalation in the one or more breaths based on the amount of change in pressure, the time of change in pressure, and the period of change in pressure.

More specifically, the controller 130 determines that the first breath of the wearer wearing the mask is the basic breath, and the amount of change in pressure recognized through the pressure sensing unit 110 in the first breath, the change time of the pressure, and the change period of the pressure. It is possible to recognize natural in-breath and natural out-breath on the basis of In addition, the controller 130 may determine that the in-breath that does not correspond to the natural in-breath as the artificial in-breath, and determine that the exhalation does not correspond to the natural out-breath as the artificial exhalation.

On the other hand, when the control unit 130 recognizes the breathing type in step S210, the first control signal may be generated based on the recognized breathing pattern using the number of artificial in-breaths and the number of artificial exhalations (S220). ).

Specifically, when the breathing pattern includes a preset start breathing pattern and a preset end breathing pattern, the controller 130 may control the first breathing pattern based on the control breathing pattern existing between the preset start breathing pattern and the preset end breathing pattern. A control signal can be generated.

For example, when the breathing pattern includes one artificial in-breath and two artificial exhalations, the controller 130 may recognize it as a preset start breathing pattern. In addition, when one artificial in-breath and one artificial exhalation are included after the preset start breathing pattern, the controller 130 may recognize as a preset control breathing pattern as a pattern for increasing the volume of the external device 200 . And, when the breathing pattern includes three artificial inhalations and three artificial exhalations, the controller 130 may recognize it as a preset end breathing pattern. Accordingly, the controller 130 may recognize a pattern for increasing the volume of the external device 200 and generate a first control signal corresponding thereto.

As in some embodiments described above with reference to FIG. 5 , when the wearer's breathing type is recognized and a control signal is generated based on the breathing pattern, the wearer can control the external device 200 without using a hand.

Meanwhile, the controller 130 of the external device control apparatus 100 may control the external device by determining whether the user wears a mask. This will be described later in more detail with reference to FIG. 6 .

6 is a flowchart illustrating an example of a process of controlling an external device performed by an external device control apparatus according to some embodiments of the present disclosure.

Referring to FIG. 6 , when recognizing a change in pressure, the controller 130 may recognize that the mask is in a wearing state (S310).

Specifically, when the pressure change value recognized through the pressure sensing unit 110 is lower than a preset value, the controller 130 recognizes that the mask is not worn, and the pressure change recognized through the pressure sensing unit 110 When the value is greater than the preset value, it may be recognized that the user wears the mask.

In the present disclosure, when the user wears the mask, the air pressure inside the mask is inevitably changed because the user must breathe. Accordingly, the controller 130 can easily recognize whether the user wears the mask by recognizing the changed value of the pressure (specifically, atmospheric pressure) inside the mask.

On the other hand, the controller 130 recognizes that the pressure change value recognized through the pressure sensing unit 110 is smaller than a preset value after recognizing that the mask is worn, and when the time recognized as being small continues for a certain period of time or more It may be recognized that the user has removed the mask.

When it is recognized that the mask is in a wearing state in step S310 , the controller 130 may generate a first control signal based on a change in pressure and an analysis result of an acoustic signal ( S320 ).

Specifically, when the mask is not in the wearing state, the controller 130 may recognize only the pressure by operating only the pressure sensing unit 110 to reduce power consumption in the standby state. And, when recognizing the change in pressure, the control unit 130 may operate the entire configuration in an operating state.

As in some embodiments described above with reference to FIG. 6 , the control unit 130 determines whether the user wears a mask, and when the mask is not worn, only the pressure sensing unit 110 operates to reduce power consumption.

Meanwhile, the controller 130 of the external device control apparatus 100 may recognize the mask wearer's breathing as an in-breath or an out-breath. Specifically, the controller 130 may recognize the breath of the wearer of the mask as an in-breath when the reduced state is maintained for a preset reference time after the pressure is less than a preset value. Meanwhile, the controller 130 may recognize the breathing of the mask wearer as an exhalation when the increased state is maintained for a preset reference time after the pressure is greater than a preset value. A detailed description thereof will be described later in detail with reference to FIG. 7 .

7 is for explaining an example of a method of recognizing inhalation and exhalation through a change in pressure over time inside the mask while the user wears a mask equipped with an external device control device according to some embodiments of the present disclosure; It is a drawing.

FIG. 7A is a diagram illustrating a change in pressure according to time inside the mask in a state in which the user wears the mask on which the external device control device 100 is mounted.

FIG. 7B is a diagram illustrating the amount of change in pressure according to time inside the mask in a state in which the user wears the mask on which the external device control device 100 is mounted.

FIG. 7C is a diagram illustrating a change rate of pressure according to time inside the mask in a state in which the user wears the mask to which the external device control device 100 is mounted.

7 (a), (b) and (c), the control unit 130 analyzes the change in the pressure recognized by the pressure sensing unit 110 to recognize the mask wearer's breathing as exhalation or inhalation. can

Specifically, the control unit recognizes that the value of the pressure inside the mask recognized by the pressure sensing unit 110 is greater than the value of the pressure inside the mask (apnea pressure value) when the wearer is in an apnea state, and the pressure sensing unit 110 When it is recognized that the change amount of pressure inside the mask recognized in is greater than the change amount of pressure inside the mask when the wearer is in an apnea state, and assuming that the rate of change of pressure inside the mask is 0 when the wearer is in an apnea state, the pressure sensing unit 110 ), when it is recognized that the change rate of the pressure inside the mask recognized is greater than 0, the wearer's breathing may be recognized as an exhalation. Here, a section for recognizing the wearer's breathing as an exhalation may be a section A and a section C. However, the present invention is not limited thereto.

On the other hand, the control unit 130 recognizes that the value of the pressure inside the mask recognized by the pressure sensing unit 110 is smaller than the value of the pressure inside the mask (apnea pressure value) when the wearer is in an apnea state, and the pressure sensing unit 110 ), the pressure sensing unit ( When it is recognized that the change rate of the pressure inside the mask recognized in 110) is smaller than 0, the wearer's breathing may be recognized as an inhalation. Here, a section for recognizing the wearer's breathing as an inhalation may be a section B. However, the present invention is not limited thereto.

In this way, the control unit 130 may recognize the inhalation and exhalation by analyzing the change in pressure, the amount of change in the pressure, and the rate of change in the pressure according to time inside the mask.

Meanwhile, the controller 130 of the external device control apparatus 100 analyzes the sound signal acquired through the sound signal acquisition unit 120 to generate a second control signal, and transmits the second control signal to the external device 200 . can be transmitted A detailed description thereof will be described later with reference to FIG. 8 .

8 is a flowchart illustrating an example of a process of controlling an external device performed by an external device control apparatus according to some embodiments of the present disclosure.

Referring to FIG. 8 , the controller 130 may analyze the sound signal acquired through the sound signal acquisition unit 120 to recognize the volume and signal pattern ( S510 ).

Specifically, the controller 130 may recognize a volume based on the size of the acoustic signal, and recognize a signal pattern based on a waveform and a period generated from the acoustic signal. However, the present invention is not limited thereto, and the volume and signal pattern may be recognized by analyzing the sound signal in various ways.

The controller 130 may recognize the action of the wearer of the mask based on the volume and the signal pattern (S520). Here, the action may include natural breathing, blowing in the wind, and speaking.

Specifically, when it is recognized that the volume is smaller than a preset level (eg, 10 dB) and the signal pattern is periodically repeated, the controller 130 may recognize the wearer's action as natural breathing. When recognizing that the volume is greater than a preset size and the signal pattern is maintained without being repeated, the controller 130 may recognize the wearer's action as blowing in the wind. In addition, when the control unit 130 recognizes that a signal pattern of a voice waveform is generated at a volume greater than that of breathing and a signal pattern that did not appear in natural breathing and blowing in the wind occurs, the wearer's action may be recognized as speaking.

For example, when the preset level is 10 dB, the controller 130 analyzes the sound signal acquired through the sound signal acquisition unit 120 and the recognized volume is 20 dB, and when one signal pattern is maintained without a period The wearer's action may be recognized as blowing in the wind.

The controller 130 may generate a second control signal for controlling the external device 200 based on the action (S530).

Specifically, information on a control signal corresponding to an action of the wearer may be stored in the storage unit 150 . When the action of the wearer is recognized in step S520 , the controller 130 may recognize which control signal is a control signal corresponding to the recognized action of the wearer based on information stored in the storage 150 . there is.

However, when the wearer's action is speaking, the controller 130 may analyze the wearer's voice signal to recognize whether a command is included in the voice signal. Here, when analyzing the wearer's voice signal, it is possible to recognize whether a command is included in the voice signal by analyzing the meaning included in the voice signal through natural language processing technology. In this case, the control signal may be a control signal corresponding to a command included in the voice signal. A detailed description of this will be described later in more detail with reference to FIG. 9 .

The controller 130 may control the communication unit 140 to transmit the second control signal to the external device 200 (S540).

According to some embodiments of the present disclosure, the communication unit 140 may be in a deactivated state before the control signal is generated. However, when the control signal is generated in step S530 , the controller 130 activates the deactivated communication unit 140 and then controls the activated communication unit 140 to transmit the second control signal to the external device 200 . can

According to some embodiments described above with reference to FIG. 8 , the wearer of the mask may control the external device based on various actions.

Meanwhile, according to some embodiments of the present disclosure, the controller 130 of the external device control apparatus 100 may remove noise from the wearer's voice signal through noise cancellation. A detailed description thereof will be described later with reference to FIG. 9 .

9 is a flowchart illustrating an example of a process of controlling an external device performed by an external device control apparatus according to some embodiments of the present disclosure.

Referring to FIG. 9 , the controller 130 may generate an attenuated signal obtained by attenuating the amplitude of the acoustic signal acquired through the second microphone 122 ( S610 ). Here, the acoustic signal obtained through the second microphone 122 may include an acoustic signal coming in from the outside of the mask and an acoustic signal generated through at least one of a wearer's mouth and nose inside the mask.

The second microphone 122 may be located at a position more than a predetermined distance away from the wearer's mouth inside the mask, that is, at an edge inside the mask. Accordingly, the magnitude of the acoustic signal coming in from the outside of the mask included in the acoustic signal obtained through the second microphone 122 may be greater than the magnitude of the acoustic signal generated through at least one of the wearer's mouth and nose inside the mask. Therefore, when the control unit 130 attenuates the acoustic signal acquired from the second microphone, the acoustic signal generated inside the mask among the acoustic signals acquired through the second microphone 122 is virtually zero in magnitude. can That is, the size of the acoustic signal generated through at least one of the wearer's mouth and nose inside the mask may be reduced to a negligible level when the acoustic signal is synthesized.

The controller 130 may generate a reverse-phase-processed signal using the attenuated signal (S620).

Specifically, the controller 130 may generate an inverse signal, which is a signal obtained by inverting the phase of the attenuated signal.

The controller 130 may obtain the wearer's voice signal by synthesizing the inverse signal and the acoustic signal obtained through the first microphone 121 with the inverse signal (S630).

Specifically, the first microphone 121 may be disposed within a predetermined distance from the wearer's mouth inside the mask. Accordingly, in the acoustic signal obtained through the first microphone 121 , a sound coming in from the outside of the mask is recognized as being small, and a sound generated in the vicinity of the wearer's mouth inside the mask is recognized as being large. Accordingly, the controller 130 may acquire the wearer's voice signal in which only the sound generated around the wearer's mouth exists by synthesizing the acoustic signal acquired through the first microphone 121 with the inverse signal. In this case, although the acoustic signal generated through at least one of the wearer's mouth and nose inside the mask is included in the attenuated signal attenuated in step S610, the size is negligible, so in step S630 Even if the synthesis is performed, the acoustic signal generated through at least one of the wearer's mouth and nose inside the mask obtained through the first microphone 121 may not change significantly.

Meanwhile, the inverse signal may be a signal obtained by inverting only the phase of the signal input into the mask from the outside obtained through the first microphone 121 inverted. This is because the signals input to the inside of the mask from the outside obtained through the first microphone 121 and the second microphone 122 are the same signal only different in size,

Meanwhile, when it is recognized that the wearer's command is included in the voice signal by analyzing the voice signal, the controller 130 may preferentially generate a third control signal for controlling the external device 200 based on the command (S640). ). Here, when analyzing the wearer's voice signal, it is possible to recognize whether a command is included in the voice signal by analyzing the meaning included in the voice signal through natural language processing technology. In this case, the control signal may be a control signal corresponding to the user's voice command included in the voice signal.

That is, the controller 130 may preferentially generate the control signal through the wearer's words rather than generating the control signal through the wearer's inhalation or exhalation. This is because, when the wearer of the mask speaks a command for controlling an external device, it is more effective to analyze it and perform control than performing control through inhalation or exhalation. In addition, when the wearer speaks, artificial in-breath or artificial exhalation occurs, and if these are separately analyzed, an erroneous control signal may be generated. Accordingly, in the present disclosure, in order to prevent such a problem, when the wearer's command is included in the voice signal, the third signal may be preferentially generated based on the command.

Meanwhile, when the third control signal is generated in step S640 , the control unit 130 may preferentially transmit the third control signal to the external device through the communication unit 140 ( S650 ).

According to some embodiments of the present disclosure, when a command is included in the wearer's voice signal, information on which external device to control may also be included in the command. Accordingly, when analyzing the wearer's voice signal, the controller 130 may analyze the meaning included in the voice signal through natural language processing technology to recognize information on the object to be commanded. When recognizing the information on the object, the controller 130 may transmit a third control signal by performing pairing with an external device corresponding to the information on the object. However, the present invention is not limited thereto, and the external device may be an external device that has been previously communicated with the external device control apparatus 100 .

10 is a diagram for explaining a method for acquiring a wearer's voice signal performed by an external device control apparatus according to some embodiments of the present disclosure;

FIG. 10A is a diagram illustrating an acoustic signal acquired through the second microphone 122 . The acoustic signal obtained through the second microphone 122 may include a signal 10 generated around the wearer's mouth inside the mask and a signal 20 input from the outside into the mask.

The controller 130 may acquire an acoustic signal through the second microphone 122 positioned at the edge of the inside of the mask. Accordingly, the signal 20 input from the outside into the mask may be greater than the signal 10 generated around the wearer's mouth inside the mask.

Meanwhile, FIG. 10(b) is a diagram illustrating an attenuated signal obtained by completely attenuating the acoustic signal shown in FIG. 10(a). Referring to (b) of FIG. 10 , the signal 30 generated in the vicinity of the wearer's mouth inside the mask attenuated by the control unit 130 may be reduced in size and may be almost eliminated. However, even if the signal 20 input from the outside into the mask is attenuated, the magnitude may not be attenuated enough to disappear.

FIG. 10( c ) is a diagram illustrating an inverse signal obtained by performing an inverse process using the attenuated signal of FIG. 10 ( b ). The inverse signal may include both signals obtained by performing inverse phases of the two signals 30 and 40 shown in FIG. 10B. However, since the signal 10 generated in the vicinity of the wearer's mouth inside the mask is in a state that is almost disappeared through attenuation, the signal inverting it is not shown in FIG. 10( c ). On the other hand, according to (c) of FIG. 10, the control unit 130 performs phase reverse processing on the signal 40 obtained by attenuating the signal 20 input from the outside shown in FIG. 10(b) into the mask. Only inverted antiphase signals can be generated.

FIG. 10( d ) is a diagram illustrating an acoustic signal acquired through the first microphone 121 . In FIG. 10( d ), the signal 60 generated around the wearer's mouth inside the mask obtained through the first microphone 121 and the signal 60 obtained through the first microphone 121 are inputted into the mask from the outside. Signal 70 is shown.

The controller 130 may acquire an acoustic signal through the first microphone 121 positioned around the wearer's mouth inside the mask. Accordingly, the signal 60 generated around the wearer's mouth inside the mask may be greater than the signal 70 input into the mask from the outside.

FIG. 10(e) is a diagram illustrating a process of synthesizing the signal shown in FIG. 10(c) and the signal shown in FIG. 10(d). Referring to (e) of FIG. 10 , the controller 130 may synthesize the inverse signal 50 and the signal 70 inputted into the mask from the outside obtained through the first microphone 121 . The reversed-phase signal 50 may be a signal obtained by inverting only the phase of the signal 70 inputted from the outside to the inside of the mask, obtained through the first microphone 121 . Accordingly, the signal 70 inputted from the outside to the inside of the mask obtained through the first microphone 121 may be canceled from the sound signal obtained through the first microphone 121 through the synthesis process.

Specifically, when the control unit 130 attenuates the acoustic signal obtained through the second microphone 122 , the attenuated signal 40 is a signal inputted into the mask from the outside obtained through the first microphone 121 . (70) can be attenuated to have a size corresponding to each other. In addition, the control unit 130 may generate the inverse signal 50 by performing an inverse process on the attenuated signal 40 . Therefore, when the acoustic signal acquired through the first microphone 121 and the inverse signal are synthesized, as shown in FIG. The magnitude may be much smaller than the magnitude of the signal 60 generated in the periphery of the wearer's mouth inside the mask. As a result, the controller 130 may synthesize the acoustic signals obtained through the microphones 121 and 122 disposed at different positions through the above-described process to make it as if only the wearer's voice signal exists in the acoustic signal.

When the noise canceling method described above in FIGS. 9 and 10 is used, noise can be removed from the voice signal through a relatively simple method without a separate noise canceling process.

11 is a flowchart illustrating an example of a process of controlling an external device performed by an external device control apparatus according to some embodiments of the present disclosure.

Referring to FIG. 11 , the control unit 130 uses the change in the first pressure obtained by the first pressure sensing unit 111 and the change in the second pressure obtained in the second pressure sensing unit 112 to breathe more than once. Each source can be recognized (S710).

Specifically, the control unit 130 may recognize the source of each breath more than once by comparing the change of the first pressure and the change of the second pressure with a preset range. Here, the controller 130 may set a preset range based on the value of the pressure inside the mask when the wearer is in an apnea state.

For example, as a result of comparing the change in the first pressure and the change in the second pressure with the preset range, the controller 130 recognizes that the change in the first pressure is outside the preset range, and the change in the second pressure is It may be recognized as being within a preset range. In this case, the controller 130 may recognize that the wearer of the mask is breathing using the nose.

As another example, as a result of comparing the change in the first pressure and the change in the second pressure with the preset range, the controller 130 recognizes that the change in the first pressure is within the preset range, and the change in the second pressure can be recognized as out of the preset range. In this case, the controller 130 may recognize that the wearer of the mask is breathing through the mouth. However, the present invention is not limited thereto.

The control unit 130 may generate a first control signal based on the recognized breathing pattern using the number of artificial inhalation and artificial exhalation of each source (S720).

For example, the controller 130 may recognize a breathing pattern of one artificial inhalation generated from the nose and four artificial exhalations generated from the mouth.

In addition, the controller 130 may check a control breathing pattern similar to one artificial inhalation generated from the nose and four artificial exhalations generated from the mouth in the storage unit 150 .

In addition, the control unit 130 may generate a control signal corresponding to one artificial inhalation generated from the nose and four artificial exhalations generated from the mouth based on the information stored in the storage unit 150 . For example, the control signal may be a signal for causing the call list of the external device 200 to appear on the display of the external device 200 . However, the present invention is not limited thereto.

11 , the control unit 130 detects a change in the first pressure obtained by the first pressure sensing unit 111 and a change in the second pressure obtained by the second pressure sensing unit 112 , as in some embodiments described above in FIG. 11 . By recognizing the source of each breath more than once by using it, it is possible to create more diverse patterns by distinguishing breathing from the mouth and breathing from the nose, and control signals for complex commands can also be generated through various patterns.

It will also be apparent to those skilled in the art that the steps shown in FIGS. 4 to 11 are exemplary steps, and some of the steps of FIGS. 4 to 11 may be omitted or additional steps may be present without departing from the scope of the present disclosure. will be. In addition, specific details regarding the components 100 to 300 described in FIGS. 4 to 11 may be replaced with those described above with reference to FIGS. 1 to 3 .

The description of the presented embodiments is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the scope of the present disclosure. Thus, the present disclosure is not intended to be limited to the embodiments presented herein, but is to be construed in the widest scope consistent with the principles and novel features presented herein.

Claims (15)

An external device control device mountable on a mask, the external device control device comprising:
a pressure sensing unit for recognizing the pressure inside the mask;
an acoustic signal acquisition unit configured to acquire an acoustic signal generated inside the mask;
A first control signal for controlling an external device is generated based on the change in pressure and an analysis result of the sound signal, and a volume and a signal pattern are recognized by analyzing the sound signal obtained through the sound signal acquisition unit, a controller for recognizing an action of a wearer of the mask based on the volume and the signal pattern and generating a second control signal for controlling the external device based on the action; and
a communication unit for transmitting the first control signal and the second control signal to the external device;
containing,
External device control unit.
The method of claim 1,
The control unit is
recognizing one or more types of breathing of the wearer of the mask based on the change in pressure and the analysis result of the acoustic signal, wherein the types include natural inhalation, natural exhalation, artificial inhalation and artificial exhalation;
generating the first control signal based on the recognized breathing pattern using the number of artificial in-breaths and the number of artificial exhalations;
External device control unit.
3. The method of claim 2,
The control unit is
When the breathing pattern includes a preset start breathing pattern and a preset end breathing pattern, the first control signal is generated based on a control breathing pattern existing between the preset start breathing pattern and the preset end breathing pattern doing,
External device control unit.
4. The method of claim 3,
The control unit is
When it is recognized that the preset start breathing pattern exists by analyzing the breathing pattern, the control breathing pattern is recognized,
External device control unit.
3. The method of claim 2,
The control unit is
Recognizing the natural in-breath and the natural exhalation in the one or more breaths based on the change amount of the pressure, the change time of the pressure, and the change period of the pressure,
External device control unit.
The method of claim 1,
The control unit is
When the change in pressure is recognized, it is recognized that the mask is worn,
When it is recognized that the mask is worn, generating the first control signal based on a change in the pressure and an analysis result of the acoustic signal,
External device control unit.
The method of claim 1,
The control unit is
After the pressure becomes smaller than a preset value, if the reduced pressure is maintained for a preset reference time, the mask wearer's breathing is recognized as an inhalation,
Recognizing that the wearer's breathing is exhaled when the pressure is maintained for a preset reference time after the pressure is greater than the preset value,
External device control unit.
8. The method of claim 7,
The preset value is
The pressure value inside the mask in the wearer's apnea state,
External device control unit.
delete delete The method of claim 1,
The sound signal acquisition unit:
a first microphone disposed within a preset first distance from the wearer's mouth in a state in which the mask to which the external device control device is mounted is worn by the wearer; and
a second microphone disposed at a position more than a predetermined distance from the wearer's mouth while the mask on which the external device control device is mounted is worn by the wearer;
including, and
The control unit is
generating an attenuated signal obtained by attenuating the amplitude of the acoustic signal acquired through the second microphone;
generating a reverse-phase-processed signal using the attenuation signal;
To obtain the wearer's voice signal by synthesizing the inverse signal and the acoustic signal obtained through the first microphone,
External device control unit.
12. The method of claim 11,
The control unit is
When it is recognized that the wearer's command is included in the voice signal by analyzing the voice signal, a third control signal for controlling the external device is preferentially generated based on the command;
Transmitting the third control signal preferentially to the external device through the communication unit,
External device control unit.
12. The method of claim 11,
The control unit is
generating the first control signal based on an analysis result of the voice signal and a change in the pressure;
External device control unit.
3. The method of claim 2,
The pressure sensing unit:
a first pressure sensing unit disposed within a third preset distance from the wearer's nose while the mask on which the external device control device is mounted is worn by the wearer; and
a second pressure sensing unit disposed within a preset fourth distance from the wearer's mouth in a state in which the mask to which the external device control device is mounted is worn by the wearer;
containing,
External device control unit.
15. The method of claim 14,
The control unit is
Recognizing the source of each of the one or more breaths using the change in the first pressure obtained from the first pressure sensing unit and the change in the second pressure obtained from the second pressure sensing unit,
generating the first control signal based on a respiration pattern recognized using the number of artificial inhalations and the number of artificial exhalations of each of the sources;
External device control unit.

Images