CN108551604B - Noise reduction method, noise reduction device and noise reduction earphone - Google Patents
Noise reduction method, noise reduction device and noise reduction earphone Download PDFInfo
- Publication number
- CN108551604B CN108551604B CN201810386706.4A CN201810386706A CN108551604B CN 108551604 B CN108551604 B CN 108551604B CN 201810386706 A CN201810386706 A CN 201810386706A CN 108551604 B CN108551604 B CN 108551604B
- Authority
- CN
- China
- Prior art keywords
- earphone
- user
- users
- noise reduction
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1041—Mechanical or electronic switches, or control elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
- H04R2460/01—Hearing devices using active noise cancellation
Abstract
The invention discloses a noise reduction method, a noise reduction device and a noise reduction earphone, wherein user voices are discriminated in environmental audios, and when the user voices exist in the environmental audios around the earphone and the volume of the user voices exceeds a preset volume threshold value, the voice signals output by the earphone are subjected to preset processing, so that a user can know that the volume of the voice per se exceeds the preset volume threshold value, and the problem that the existing noise reduction earphone only filters all external sounds and cannot process the condition that the user voices are too loud to influence other people is effectively solved.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a noise reduction method, a noise reduction device and a noise reduction earphone.
Background
The noise reduction earphone is an earphone which reduces noise by using a certain method. The existing noise reduction earphones comprise active noise reduction earphones and passive noise reduction earphones. The active noise reduction earphone generates reverse sound waves equal to external noise through a noise reduction system, and neutralizes the noise, so that the noise reduction effect is realized. The passive noise reduction earphone mainly forms a closed space by surrounding ears, or adopts sound insulation materials such as silica gel earplugs and the like to block external noise.
Because the existing noise reduction earphone isolates the noise and the sound emitted by the earphone wearer, under many conditions, the earphone wearer needs to hear the sound of the wearer, for example, when a user carries out voice communication, the user can increase the speaking volume because the user is difficult to hear the speaking sound of the user due to the use of the noise reduction earphone, and other users can be influenced if the situation occurs in a public place; in addition, many users listen to music and are reluctant to follow humming, and if the users humming in public places, other users are affected.
That is to say, the existing noise reduction earphone only filters all external sounds, and cannot deal with the situation that the sound of the user is too loud and affects others.
Disclosure of Invention
The invention provides a noise reduction method, a noise reduction device and a noise reduction earphone, and aims to solve the problem that in the prior art, the noise reduction earphone only filters all external sounds and cannot process the condition that a user has too much sound to affect others.
In one aspect, the present invention provides a method for noise reduction, the method comprising: judging whether the environmental audio around the earphone contains user voice; when the environment audio contains the user voice, whether the user voice exceeds a preset volume threshold value is further judged, if yes, the audio signal output by the earphone is subjected to preset processing, and therefore the user can know that the voice volume of the user exceeds the preset volume threshold value.
Further, before determining whether the ambient audio around the headset contains the user speech, the method further includes:
ambient audio around the headset is acquired.
Further, when the earphone is a passive noise reduction earphone, acquiring an ambient audio around the earphone, specifically including: acquiring ambient audio around the earphone through a microphone;
when the earphone is an active noise reduction earphone, the method for acquiring the ambient audio around the earphone specifically comprises the following steps: the ambient audio around the headset is acquired by the headset itself.
Further, determining whether the environmental audio around the earphone contains the user voice specifically includes:
acquiring a voiceprint characteristic of a user;
and judging whether the environmental audio contains the user voice or not according to the voiceprint characteristics of the user.
Further, the preset processing is performed on the audio signal output by the earphone, and specifically includes:
the audio signal output by the earphone is selectively denoised or added with a prompt tone.
Further, selectively denoising or adding a prompt tone to the audio signal output by the earphone specifically comprises:
when the earphone is an active noise reduction earphone, noise reduction processing is carried out on the environmental audio outside the voice of the user;
when the earphone is a passive noise reduction earphone, prompt tones are sent to the user.
Further, performing noise reduction processing on the environmental audio outside the user voice specifically includes:
and shielding the user voice frequency in the environment audio, and performing noise reduction processing on the environment audio with the user voice frequency shielded.
Further, after judging whether the voice of the user exceeds a preset volume threshold, the method further includes:
and when judging whether the user is in a preset limit area, if so, carrying out preset processing on the audio signal output by the earphone.
Further, the preset restricted area includes a public place area and a private place area where other users are in an undisturbed state.
Further, when judging whether the user is in a preset limited area, if so, performing preset processing on the audio signal output by the earphone, specifically comprising:
acquiring the geographical position information of the earphone;
judging whether the user is in a public place area currently or not according to the geographical position information;
if so, carrying out preset processing on the audio signal output by the earphone;
if the earphone or the terminal connected with the earphone is judged to be connected with the home gateway or the vehicle-mounted system, the audio signal output by the earphone is subjected to preset processing;
or after the user is judged to be in the preset private place area, whether other users are in the disturbance-free state in the private place area is further judged, and after the situation that other users are in the disturbance-free state in the private place area is determined, the audio signal output by the earphone is subjected to preset processing.
Further, whether other users in the private area are in the do-not-disturb state is judged, and the method specifically comprises the following steps: and judging whether other users exist in the private place area, if so, acquiring the current states of the other users, and judging whether the other users exist in the private place area and are in the disturbance-free state according to the current states of the other users.
Further, judging whether other users exist in the private area specifically includes:
judging whether other users exist in the private place area or not through the infrared sensor, and if so, determining that other users exist in the private place area;
alternatively, the first and second electrodes may be,
judging whether other users exist or not through the infrared sensor, if so, further detecting the distance between the other users through the ultrasonic sensor, judging that the distance is smaller than a preset distance threshold value, and determining that other users exist in the private place area;
the method includes the steps of obtaining current states of other users, and judging whether the other users are in an interference-free state in a private place area according to the current states of the other users, and specifically includes the steps of:
acquiring image information of other users through a camera, judging whether the other users are in a rest state, a book reading state or a writing state according to the image information, and if so, determining that the other users in the private area are in an interference-free state;
or acquiring the voice of other users through a microphone, judging whether the other users are in a conversation state according to the voice and combining with image information, and if so, determining that the other users in the private area are in a disturbance-free state.
In yet another aspect, the present invention provides a noise reduction apparatus comprising: the voice processing unit is used for judging whether the environmental audio around the earphone contains user voice, further judging whether the user voice exceeds a preset volume threshold value when the environmental audio contains the user voice, and triggering the noise reduction unit if the environmental audio contains the user voice; and the noise reduction unit is used for carrying out preset processing on the audio signal output by the earphone so as to enable a user to know that the volume of the voice per se exceeds a preset volume threshold.
Further, the voice processing unit is also used for acquiring the ambient audio around the earphone.
Further, the voice processing unit is further configured to, when the earphone is a passive noise reduction earphone, obtain the ambient audio around the earphone through the microphone, and when the earphone is an active noise reduction earphone, obtain the ambient audio around the earphone through the earphone itself.
Further, the voice processing unit is further configured to obtain a voiceprint feature of the user, and determine whether the environmental audio includes the user voice according to the voiceprint feature of the user.
Furthermore, the noise reduction unit is also used for carrying out noise reduction processing on the environmental audio outside the voice of the user when the earphone is an active noise reduction earphone, and sending prompt tone to the user when the earphone is a passive noise reduction earphone.
Further, the apparatus further comprises: and the intelligent sensing unit is used for triggering the noise reduction unit if the user is in the preset limited area.
The intelligent sensing unit is further used for acquiring the geographical position information of the earphone, judging whether the user is in a public place area currently according to the geographical position information, if so, triggering the noise reduction unit, otherwise, continuously judging whether the earphone or the terminal connected with the earphone is connected with the home gateway or the vehicle-mounted system, or judging whether the user is in a preset private place area according to the geographical position information, if so, triggering the noise reduction unit, or further judging whether other users are in an interference-free state in the private place area after judging that the earphone or the terminal connected with the earphone is connected with the home gateway or the vehicle-mounted system, and triggering the noise reduction unit after determining that other users are in the interference-free state in the private place area.
Further, the intelligent sensing unit is further configured to determine whether other users exist in the private area, and if so, obtain the current states of the other users, and determine whether other users exist in the private area and are in an interference-free state according to the current states of the other users.
The intelligent sensing unit is further used for judging whether other users exist in the private place area through the infrared sensor, if so, determining that other users exist in the private place area, or judging whether other users exist through the infrared sensor, if so, further detecting the distance between the intelligent sensing unit and other users through the ultrasonic sensor, and determining that other users exist in the private place area if the distance is smaller than a preset distance threshold; and acquiring image information of other users through the camera, judging whether the other users are in a rest state, a book reading state or a writing state according to the image information, if so, determining that the other users in the private area are in a disturbance-free state, or acquiring the sound of the other users through the microphone, judging whether the other users are in a conversation state according to the sound and combining with the image information, and if so, determining that the other users in the private area are in the disturbance-free state.
In another aspect, the present invention provides a noise reduction headphone, comprising any one of the noise reduction apparatus described above.
The invention has the following beneficial effects:
according to the invention, the user voice is discriminated in the environment audio, when the user voice exists in the environment audio around the earphone and the voice volume of the user exceeds the preset volume threshold, the voice signal output by the earphone is subjected to preset processing, so that the user can know that the voice volume of the user exceeds the preset volume threshold, and the problem that the existing noise reduction earphone only filters all external sounds and cannot process the condition that the voice of the user is too loud and affects others is effectively solved.
Drawings
Fig. 1 is a schematic flow chart of a noise reduction method according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of another noise reduction method provided by the embodiment of the present invention;
FIG. 3 is a schematic flow chart of still another noise reduction method provided by the embodiment of the present invention;
FIG. 4 is a flow chart illustrating a further noise reduction method according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a noise reduction apparatus according to an embodiment of the present invention.
Detailed Description
The invention provides a noise reduction method, a noise reduction device and a noise reduction earphone, aiming at solving the problem that the noise reduction earphone in the prior art only filters all external sounds but cannot process the condition that the user has too much sound and affects others. The present invention will be described in further detail below with reference to the drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and do not limit the invention.
An embodiment of the present invention provides a noise reduction method, and referring to fig. 1, the method includes:
s101, judging whether the environmental audio around the earphone contains user voice, and entering the next step when the environmental audio contains the user voice;
s102, judging whether the voice of the user exceeds a preset volume threshold value, and if so, entering the next step;
s103, carrying out preset processing on the audio signal output by the earphone so that a user can know that the volume of the voice per se exceeds a preset volume threshold value.
That is to say, in the embodiment of the present invention, the user voice is discriminated in the environmental audio, and when it is determined that the user voice exists in the environmental audio around the earphone and the user voice volume exceeds the preset volume threshold, the audio signal output by the earphone is subjected to the preset processing, so that the user knows that the voice volume of the user itself exceeds the preset volume threshold, thereby effectively avoiding the occurrence of a situation that the user affects other people due to the fact that the user cannot hear the voice of the user when wearing the earphone, and effectively solving the problem that the existing noise reduction earphone cannot distinguish the external voice and only filters all the external voice, thereby reducing the user experience.
The method of the embodiment of the invention has the main application scenes that: when a user wears the earphone with the noise reduction function, the earphone shields the sound of the user, so that the user can influence other users due to the fact that the sound of the user is large under the condition that the user does not know the user.
The noise reduction method can be independently completed by the noise reduction earphone, or can be completed by a terminal connected with the earphone or by the matching of the terminal connected with the earphone and the earphone.
It should be noted that the noise reduction earphone according to the embodiment of the present invention includes an active noise reduction earphone and a passive noise reduction earphone, and only when the volume of the user voice exceeds a preset volume threshold, the noise reduction processing is performed on the environmental audio other than the user voice, and when the volume of the user voice does not exceed the preset volume threshold, it is considered that the user voice does not affect others, so that the noise reduction processing is performed on all the environmental audio.
Specifically, the user voice is discriminated in the environment audio, after the user voice is judged to exist in the environment audio around the earphone, whether the user voice volume exceeds a preset volume threshold value or not is further judged, and when the user voice volume exceeds the preset volume threshold value, noise reduction processing is carried out on the environment audio outside the user voice, so that the noise reduction earphone can distinguish external sound, and the situation that other people are influenced due to overlarge sound of the noise reduction earphone is avoided.
That is to say, in the embodiment of the present invention, the environmental audio is monitored, and when the user voice is monitored and exceeds the preset volume threshold, the noise reduction processing is performed on the environmental audio other than the user voice, so as to distinguish the external sound of the noise reduction earphone, thereby improving the user experience.
In specific implementation, before step S101, the method further includes: ambient audio around the headset is acquired.
Further, the step of acquiring the ambient audio around the earphone according to the embodiment of the present invention specifically includes:
aiming at the passive noise reduction earphone, the embodiment of the invention acquires the ambient audio around the earphone through the microphone;
for the active noise reduction earphone, the embodiment of the present invention obtains the ambient audio around the earphone through the earphone itself, and specifically, the active noise reduction earphone in the embodiment of the present invention obtains the ambient audio around the earphone through its own voice processing unit.
It should be noted that, in the implementation, a person skilled in the art may also set other ways to acquire the environmental audio, for example, by setting an acquisition device to specifically acquire the environmental audio, and so on.
Further, the embodiment of the present invention determines whether the environmental audio around the earphone contains the user voice, specifically including: and acquiring the voiceprint characteristics of the user, and judging whether the environmental audio contains the user voice or not according to the voiceprint characteristics of the user.
That is, the embodiment of the present invention determines whether the environmental audio includes the user voice by determining whether the environmental audio includes the voiceprint feature of the user.
Specifically, the passive noise reduction earphone of the embodiment of the present invention obtains the ambient audio around the earphone through a microphone, where the microphone may be on the earphone or on a terminal connected to the earphone.
That is, the embodiment of the present invention may be configured to obtain the ambient audio around the earphone through a microphone on the earphone, or may also be configured to obtain the ambient audio around the earphone through a microphone on a terminal connected to the earphone, which is not particularly limited in this respect.
The embodiment of the invention aims at the active noise reduction earphone, and obtains the ambient audio around the earphone through the voice processing unit of the active noise reduction earphone.
The embodiment of the invention carries out preset processing on the audio signal output by the earphone, and specifically comprises the following steps: the audio signal output by the earphone is selectively denoised or added with a prompt tone.
Specifically, the embodiment of the present invention is directed to an active noise reduction earphone, which performs noise reduction processing on an ambient audio other than a user's voice, and is directed to a passive noise reduction earphone, which issues a prompt tone to the user.
In addition, the embodiment of the invention carries out noise reduction processing on the environmental audio except the user voice by shielding the user voice frequency in the environmental audio and carrying out noise reduction processing on the environmental audio shielding the user voice frequency.
In specific implementation, after judging whether the voice of the user exceeds the preset volume threshold value, the embodiment of the invention needs to further judge whether the user is in a preset limit area, and if so, the audio signal output by the earphone is subjected to preset processing.
That is to say, after it is determined that the voice of the user exceeds the preset volume threshold, the embodiment of the present invention needs to further determine the area where the user is located, and if the user is currently located in the preset limited area, the audio signal output by the earphone is subjected to the preset processing, so as to avoid disturbing the normal use of the earphone by the user and reduce the user experience.
The preset restricted area in the embodiment of the present invention includes a public area and a private area where other users are in an undisturbed state, and of course, those skilled in the art may set other restricted areas according to actual situations, for example, set a library as the restricted area, and so on.
In specific implementation, when determining whether a user is in a preset restricted area, if so, the embodiment of the present invention performs preset processing on an audio signal output by an earphone, and specifically includes:
acquiring the geographical position information of the earphone;
judging whether the user is in a public place area currently or not according to the geographical position information;
if so, carrying out preset processing on the audio signal output by the earphone;
if the earphone or the terminal connected with the earphone is judged to be connected with the home gateway or the vehicle-mounted system, the audio signal output by the earphone is subjected to preset processing;
or after the user is judged to be in the preset private place area, whether other users are in the disturbance-free state in the private place area is further judged, and after the situation that other users are in the disturbance-free state in the private place area is determined, the audio signal output by the earphone is subjected to preset processing.
That is to say, the embodiment of the present invention determines, according to the obtained geographical location information of the headset and the connection relationship between the headset and the terminal, that the headset is located in a public place area and a private place area where other users are in an undisturbed state.
Specifically, the method of the embodiment of the invention is used for determining whether the user is in a private place area or a public place area by collecting user behavior information and combining the user geographic position information.
The private area of the embodiment of the present invention may be set according to a user, for example, a fixed place where the time of the non-working time exceeds a certain threshold is set as a private area, for example, a home is set as a private area, of course, a person skilled in the art may set all residential areas as private areas, and of course, all business areas, restaurants, office buildings, and the like may also be set as public areas.
In addition to using the geographical location to determine the private and public areas, embodiments of the present invention may also determine the private and public areas based on the connection of the headset to the terminal, e.g., if the headset is connected to a home gateway or to a vehicle system, the user is determined to be in the private area, and when the user headset is connected to a shared WiFi or a corporate WiFi, the user is determined to be in the public area.
The user mobile equipment is connected with the home gateway, so that the user is a private place at home; if the shared WiFi or the corporate WiFi is connected, it is determined that the user is in a public area.
In specific implementation, the embodiment of the invention judges whether other users exist in the private place area and are in the disturbance-free state, and judges whether other users exist in the private place area or not, if so, the current states of the other users are obtained, and whether other users exist in the private place area and are in the disturbance-free state is judged according to the current states of the other users.
The embodiment of the invention judges whether other users exist in the private place area through the infrared sensor, and if so, determines that other users exist in the private place area; or judging whether other users exist or not through the infrared sensor, if so, further detecting the distance between the user and the other users through the ultrasonic sensor, judging that the distance is smaller than a preset distance threshold value, and determining that other users exist in the private place area;
that is to say, the embodiment of the present invention may determine whether there are other users in the private area only by the infrared sensor, or may determine whether there are other users in the private area by the infrared sensor and the ultrasonic sensor together.
In consideration of the characteristic that sound gradually becomes smaller as the distance becomes farther, the embodiment of the present invention further detects the distance by the ultrasonic sensor in a case where the infrared sensor judges that there is a person in the private area, and determines that there are other users in the private area if the distance is smaller than a preset distance threshold, and otherwise, determines that there are no other users in the private area.
In specific implementation, the embodiment of the present invention obtains the current states of other users, and determines whether there is any other user in the private area in the non-disturbing state according to the current states of other users, and specifically includes:
the method comprises the steps that photos of other users are obtained through a camera, whether the other users are in a rest state, a book reading state or a writing state is judged according to the photos, and if yes, the other users in the private place area are determined to be in an interference-free state;
or acquiring the voice of other users through a microphone, judging whether the other users are in a conversation state or not according to the voice and combining with the picture, and if so, determining that the other users in the private area are in a disturbance-free state.
That is, the embodiment of the present invention obtains the current state of the other user through the camera, the infrared sensor, the microphone, the ultrasonic sensor, and the like.
The disturbance-free state in the embodiment of the present invention is a state that is not desired to be disturbed, such as a state of rest, book reading, writing, talking, etc., and the present invention is not limited to this specifically.
In specific implementation, the embodiment of the present invention performs noise reduction processing on an environmental audio other than a user voice, and specifically includes: and shielding the user voice frequency in the environment audio, and performing noise reduction processing on the environment audio with the user voice frequency shielded.
Namely, the invention can shield the frequency of the user voice in the environment audio frequency so as to realize the distinguishing and filtering of the external sound.
It should be noted that, in the implementation, those skilled in the art may also mask other sounds in the ambient audio according to the method of the present invention, for example, in order to take care of the pet in time, a noise reduction earphone may be set to not perform noise reduction processing on the sound of the pet raised by the earphone user, and so on.
Generally speaking, the method of the embodiment of the invention can enable the user of the noise reduction earphone to hear the sound of the user in a proper occasion, thereby avoiding the influence on other users caused by the fact that the user of the noise reduction earphone cannot hear the sound of the user or hear the sound too small, and the user uses larger volume.
In order to better explain the noise reduction method of the present invention, the following will explain the noise reduction method of the present invention in detail by taking an active noise reduction earphone as an example with reference to fig. 2 and 3:
fig. 2 is a schematic flow chart of another noise reduction method provided in an embodiment of the present invention, and as shown in fig. 2, the method includes:
1. the voice processing unit collects user voice and extracts user voiceprint features;
2. when the earphone works, the noise reduction unit starts the noise reduction function;
3. the noise reduction unit sends the received environmental audio (namely noise) to the voice processing unit;
4. the noise reduction unit sends an instruction for judging whether the user wears the earphone to the intelligent sensing unit;
5. the intelligent sensing unit judges whether the user wears the earphone or not, and if the user wears the earphone, the step 6 is operated;
the earphone is provided with a pressure sensor to sense the pressure of the auricle (in-ear type) or the ear of the user, if the pressure mode is met, the user is judged to wear the earphone, or the earphone is provided with a temperature sensor to acquire temperature information in real time, if the temperature is close to the temperature of a human body, the user is judged to wear the earphone, or the earphone is provided with an infrared sensor to sense the blocking of light rays through the infrared sensor, if the light rays are blocked, the user is considered to wear the earphone, the above modes can be used in combination, and technicians in the field can set other modes to judge whether the user wears the earphone according to actual needs, which is not particularly limited in the invention.
6. The intelligent sensing unit judges whether the environment where the user is located is a public place or a private place of the user, if the environment is the public place, the step 7 is operated, and if the environment is the private place of the user, no treatment is performed;
specifically, the embodiment of the invention can determine whether the user is in a private place or a public place by collecting user behavior information and combining geographical location information. For example, a fixed place (such as a home) where the non-working time is long is a private place, and if the user mobile device is connected to the home gateway, the user is a private place at home; and if the shared WiFi or company WiFi is connected, the user is in a public place, and the user is in a public place such as a shopping mall, a restaurant, an office building and the like.
When the user is in the vehicle, the user is in a private place, and the situation can be specifically judged according to whether the terminal of the user is connected with the vehicle-mounted system or not, or according to the fact that the vehicle-mounted system monitors that the user is in the vehicle.
7. The intelligent sensing unit sends an instruction for judging whether the voice of the user is contained to the voice processing unit;
8. the voice processing unit judges whether the environment audio contains the user voice, if so, the step 9 is operated, otherwise, no processing is carried out;
9. the voice processing unit judges whether the volume of the voice of the user exceeds a preset volume threshold value, the step 10 is operated if the volume of the voice of the user exceeds the preset volume threshold value, and otherwise, no processing is carried out;
10. the voice processing unit sends an instruction for not reducing the noise of the user voice to the noise reduction unit;
11. the noise reduction unit does not reduce noise of the user voice.
That is to say, in the embodiment of the present invention, by obtaining the voiceprint feature of the user of the headset, when the user wears the headset, whether the environmental audio contains the user voice is monitored according to the voiceprint feature of the user, if the environmental audio contains the user voice and the user is in a public place, it is determined whether the user voice volume exceeds a preset volume threshold, and if the user voice volume exceeds the preset volume threshold, the noise reduction processing is not performed on the user voice.
Fig. 3 is a schematic flow chart of a further noise reduction method according to an embodiment of the present invention, as shown in fig. 3, the method includes:
1. the voice processing unit collects user voice and extracts user voiceprint features;
2. when the earphone works, the noise reduction unit starts the noise reduction function;
3. the noise reduction unit sends the received environmental audio (namely noise) to the voice processing unit;
4. the noise reduction unit sends an instruction for judging whether the user wears the earphone to the intelligent sensing unit;
5. the intelligent sensing unit judges whether the user wears the earphone or not, and if the user wears the earphone, the step 6 is operated;
6. the intelligent sensing unit judges whether the environment where the user is located is a public place or a private place of the user, if the environment is the public place, the step 8 is operated, and if the environment is the private place of the user, the step 7 is operated;
7. the intelligent sensing unit judges whether other users are in the disturbance-free state or not, and if so, the step 8 is operated;
the disturbance-free state is the state which is not desired to be disturbed, such as the states of rest, reading books, writing, talking and the like;
the state of a person is sensed through a sensor of the Internet of things household appliance in a private place, and the current state of the person is obtained through a camera, an infrared sensor, a microphone, an ultrasonic sensor and the like.
8. The intelligent sensing unit sends an instruction for judging whether the voice of the user is contained to the voice processing unit;
9. the voice processing unit judges whether the noise contains the user voice, if so, the step 10 is operated, otherwise, no processing is carried out;
10. the voice processing unit judges whether the volume of the voice of the user exceeds a preset volume threshold value, the step 11 is operated if the volume of the voice of the user exceeds the preset volume threshold value, and otherwise, no processing is carried out;
11. the voice processing unit sends an instruction for not reducing the noise of the voice of the user to the noise reduction unit;
12. the noise reduction unit does not reduce noise of the user voice.
That is to say, the invention monitors whether the environmental audio contains the user voice, when the environmental audio contains the user voice and the user is in a public place or a private place and other users are in an interference-free state, further judges whether the voice volume of the user exceeds a preset volume threshold, and if the voice volume of the user exceeds the preset volume threshold, the noise reduction processing is not carried out on the voice of the user.
Fig. 4 is a schematic flow chart of another noise reduction method according to an embodiment of the present invention, and as shown in fig. 4, the method is mainly applied to a passive noise reduction headphone, and the noise reduction method according to the embodiment of the present invention includes:
1. the voice processing unit collects user voice and extracts user voiceprint features;
2. the noise reduction unit confirms that the earphone works, namely, voice is played;
3. the first personal noise reduction unit sends an instruction for judging whether the user wears the earphone to the intelligent sensing unit;
4. the intelligent sensing unit judges whether the user wears the earphone or not, and if the user wears the earphone, the step 5 is operated;
5. the intelligent sensing unit judges whether the environment where the user is located is a public place or a private place of the user, if the environment is the public place, the step 6 is operated, and if the environment is the private place of the user, no treatment is performed;
6. the intelligent sensing unit sends an instruction for receiving the environmental audio to the microphone;
7. a microphone receives ambient audio;
8. the microphone sends the received environmental audio to the voice processing unit;
9. the voice processing unit judges whether the environmental audio contains the voice of the user, if so, the step 10 is operated, otherwise, no processing is carried out;
10. the voice processing unit judges whether the volume of the voice of the user exceeds a preset volume threshold value, the step 11 is operated if the volume of the voice of the user exceeds the preset volume threshold value, and otherwise, no processing is carried out;
11. the voice processing unit sends voice prompt information to the noise reduction unit;
12. the noise reduction unit plays voice prompt information.
That is to say, in the embodiment of the present invention, the ambient audio is received by the microphone, and whether the ambient audio contains the user voice is monitored, if the ambient audio contains the user voice, it is further determined whether the user voice volume exceeds a preset volume threshold, and if the user voice volume exceeds the preset volume threshold, the voice prompt information is played to prompt the user.
Correspondingly, an embodiment of the present invention further provides a noise reduction apparatus, and referring to fig. 5, the apparatus includes: the voice processing unit is used for judging whether the environmental audio around the earphone contains user voice, further judging whether the user voice exceeds a preset volume threshold value when the environmental audio contains the user voice, and triggering the noise reduction unit if the environmental audio contains the user voice; and the noise reduction unit is used for carrying out preset processing on the audio signal output by the earphone so as to enable a user to know that the volume of the voice per se exceeds a preset volume threshold.
That is to say, in the embodiment of the present invention, the voice processing unit discriminates the user voice in the environmental audio, and when it is determined that the user voice exists in the environmental audio around the headset and the user voice volume exceeds the preset volume threshold, the noise reduction unit performs preset processing on the audio signal output by the headset, so that the user knows that the user voice volume exceeds the preset volume threshold, thereby effectively avoiding the occurrence of a situation that the user cannot hear his own voice when wearing the headset, thereby affecting others, and effectively solving the problem that the existing noise reduction headset cannot distinguish the external voice, and only filters all external voices, thereby reducing user experience.
The method of the embodiment of the invention has the main application scenes that: when a user wears the earphone with the noise reduction function, the earphone shields the sound of the user, so that the user can influence other users due to the fact that the sound of the user is large under the condition that the user does not know the user.
It should be noted that the noise reduction device according to the embodiment of the present invention is disposed on a noise reduction earphone, and the noise reduction earphone according to the embodiment of the present invention includes an active noise reduction earphone and a passive noise reduction earphone, and only when the volume of the voice of the user exceeds a preset volume threshold, the noise reduction processing is performed on the environmental audio other than the voice of the user, and when the volume of the voice of the user does not exceed the preset volume threshold, it is determined that the voice of the user does not affect others, so that the noise reduction processing is performed on all the environmental audio.
Further, the voice processing unit of the embodiment of the present invention is further configured to acquire an ambient audio around the headset. In specific implementation, the voice processing unit in the embodiment of the present invention obtains the ambient audio around the earphone through the microphone when the earphone is a passive noise reduction earphone, and obtains the ambient audio around the earphone through the earphone itself when the earphone is an active noise reduction earphone.
In specific implementation, the voice processing unit of the embodiment of the invention judges whether the environmental audio contains the user voice or not according to the voiceprint characteristics of the user by acquiring the voiceprint characteristics of the user.
That is, the voice processing unit of the embodiment of the present invention determines whether the environmental audio includes the user voice by determining whether the environmental audio includes the voiceprint feature of the user.
In a specific implementation, the noise reduction unit according to the embodiment of the present invention is further configured to perform noise reduction processing on an ambient audio other than the user speech when the earphone is an active noise reduction earphone, and send a prompt tone to the user when the earphone is a passive noise reduction earphone.
Specifically, the embodiment of the present invention is directed to an active noise reduction earphone, which performs noise reduction processing on an ambient audio other than a user's voice, and is directed to a passive noise reduction earphone, which issues a prompt tone to the user.
In specific implementation, the noise reduction apparatus according to the embodiment of the present invention further includes: and the intelligent sensing unit is used for triggering the noise reduction unit if the intelligent sensing unit judges whether the user is in a preset limited area.
That is to say, in the embodiment of the present invention, after determining whether the voice of the user exceeds the preset volume threshold, when it is further determined whether the user is in the preset limited region, if so, the audio signal output by the earphone is subjected to the preset processing.
In specific implementation, the intelligent sensing unit in the embodiment of the present invention is further configured to obtain geographic position information of the earphone, determine whether the user is currently located in a public place area according to the geographic position information, if so, trigger the noise reduction unit, otherwise, continuously determine whether the earphone or the terminal connected to the earphone is connected to the home gateway or the vehicle-mounted system, or determine whether the user is located in a preset private place area according to the geographic position information, if it is determined that the earphone or the terminal connected to the earphone is connected to the home gateway or the vehicle-mounted system, trigger the noise reduction unit, or, after it is determined that the user is located in the preset private place area, further determine whether other users are located in a non-disturbing state in the private place area, and trigger the noise reduction unit after it is determined that other users are located in the non-disturbing state in the private place area.
That is to say, the embodiment of the present invention determines, according to the obtained geographical location information of the headset and the connection relationship between the headset and the terminal, that the headset is located in a public place area and a private place area where other users are in an undisturbed state.
Specifically, the embodiment of the invention is used for determining whether the user is in a private place area or a public place area by collecting user behavior information and combining the user geographical location information.
Further, the intelligent sensing unit is further configured to determine whether other users exist in the private area, and if so, obtain the current states of the other users, and determine whether other users exist in the private area and are in an interference-free state according to the current states of the other users.
In specific implementation, the intelligent sensing unit of the embodiment of the invention judges whether other users exist in the private place area through the infrared sensor, if so, determines that other users exist in the private place area, or judges whether other users exist through the infrared sensor, if so, further detects the distance from other users through the ultrasonic sensor, and determines that other users exist in the private place area if the distance is smaller than a preset distance threshold; and acquiring image information of other users through the camera, judging whether the other users are in a rest state, a book reading state or a writing state according to the image information, if so, determining that the other users in the private area are in a disturbance-free state, or acquiring the sound of the other users through the microphone, judging whether the other users are in a conversation state according to the sound and combining with the image information, and if so, determining that the other users in the private area are in the disturbance-free state.
That is, the embodiment of the present invention obtains the current state of the other user through the camera, the infrared sensor, the microphone, the ultrasonic sensor, and the like.
The disturbance-free state in the embodiment of the present invention is a state that is not desired to be disturbed, such as a state of rest, book reading, writing, talking, etc., and the present invention is not limited to this specifically.
Accordingly, embodiments of the present invention further provide a noise reduction earphone, where the active noise reduction earphone includes any one of the noise reduction devices described above, and achieves a corresponding technical effect, and the active noise reduction earphone can be understood with reference to the method embodiment section and the device embodiment section, and details are not described herein again.
It should be noted that, in the specific implementation, in order to reduce the production cost of the noise reduction earphone, those skilled in the art may also set the speech processing unit and the intelligent sensing unit of the embodiment of the present invention on a terminal connected to the noise reduction earphone.
The noise reduction earphone provided by the embodiment of the invention can enable a user to hear own voice in a proper occasion, thereby avoiding the influence on other people caused by the fact that the user cannot hear own voice or hear too small voice due to the fact that the user uses a larger volume when using the noise reduction earphone.
Although the preferred embodiments of the present invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, and the scope of the invention should not be limited to the embodiments described above.
Claims (13)
1. A method of noise reduction, comprising:
judging whether the environmental audio around the earphone contains user voice;
when the environment audio comprises the user voice, further judging whether the user voice exceeds a preset volume threshold value, if so, performing preset processing on an audio signal output by the earphone so as to enable a user to know that the voice volume of the user exceeds the preset volume threshold value;
the audio signal to earphone output carries out predetermined processing, specifically includes:
selectively denoising or adding a prompt tone into the audio signal output by the earphone;
the audio signal to earphone output carries out selective noise reduction or adds the prompt tone, specifically includes:
when the earphone is an active noise reduction earphone, noise reduction processing is carried out on the environmental audio outside the voice of the user;
after judging whether the voice of the user exceeds the preset volume threshold, the method further comprises the following steps:
when judging whether the user is in the preset restricted area, if yes, the audio signal output by the earphone is subjected to preset processing, and the method specifically comprises the following steps:
acquiring the geographical position information of the earphone;
judging whether the user is in a public place area currently or not according to the geographical position information;
if so, carrying out preset processing on the audio signal output by the earphone;
if the earphone or the terminal connected with the earphone is judged to be connected with the home gateway or the vehicle-mounted system, the audio signal output by the earphone is subjected to preset processing;
or after the fact that the user is in a preset private place area is judged, whether other users are in an interference-free state in the private place area is further judged, and after the fact that other users are in the interference-free state in the private place area is confirmed, audio signals output by the earphone are subjected to preset processing;
judging whether other users exist in the private place area and are in an interference-free state specifically comprises:
judging whether other users exist in the private place area, if so, acquiring the current states of the other users, and judging whether the other users exist in the private place area and are in an interference-free state according to the current states of the other users;
the determining whether there are other users in the private place area specifically includes:
judging whether other users exist in the private place area or not through an infrared sensor, and if so, determining that other users exist in the private place area;
alternatively, the first and second electrodes may be,
judging whether other users exist or not through an infrared sensor, if so, further detecting the distance between the private place and the other users through an ultrasonic sensor, judging that the distance is smaller than a preset distance threshold value, and determining that the other users exist in the private place area;
the obtaining of the current states of other users and the judging of whether other users are in the disturbance-free state in the private place area according to the current states of other users specifically include:
acquiring image information of other users through a camera, judging whether the other users are in a rest state, a book reading state or a writing state according to the image information, and if so, determining that the other users in the private place area are in an interference-free state;
or acquiring the voice of other users through a microphone, judging whether other users are in a conversation state according to the voice and the image information, and if so, determining that other users in the private place area are in an interference-free state.
2. The method of claim 1, wherein prior to determining whether the ambient audio surrounding the headset contains user speech, further comprising:
ambient audio around the headset is acquired.
3. The method of claim 2,
when the earphone is a passive noise reduction earphone, the acquiring of the ambient audio around the earphone specifically includes: acquiring ambient audio around the earphone through a microphone;
when the earphone is an active noise reduction earphone, the acquiring of the ambient audio around the earphone specifically includes: ambient audio around the headset is acquired by the headset itself.
4. The method of claim 1, wherein the determining whether the ambient audio surrounding the headset contains user speech comprises:
acquiring a voiceprint characteristic of a user;
and judging whether the environment audio contains the user voice or not according to the voiceprint characteristics of the user.
5. The method of claim 1, wherein selectively denoising or adding an alert tone to the audio signal output by the headphones further comprises:
and when the earphone is a passive noise reduction earphone, a prompt tone is sent to a user.
6. The method according to claim 5, wherein the denoising the ambient audio other than the user speech specifically comprises:
and shielding the user voice frequency in the environment audio, and performing noise reduction processing on the environment audio with the user voice frequency shielded.
7. The method of claim 1,
the preset limited area comprises a public place area and a private place area where other users are in an undisturbed state.
8. A noise reducing device, comprising:
the voice processing unit is used for judging whether the environmental audio around the earphone contains user voice, further judging whether the user voice exceeds a preset volume threshold value when the environmental audio contains the user voice, and triggering the noise reduction unit if the environmental audio contains the user voice;
the noise reduction unit is used for carrying out preset processing on the audio signal output by the earphone so that a user can know that the volume of the voice per se exceeds a preset volume threshold;
the audio signal to earphone output carries out predetermined processing, specifically includes:
selectively denoising or adding a prompt tone into the audio signal output by the earphone;
the noise reduction unit is also used for performing noise reduction processing on the environmental audio outside the user voice when the earphone is an active noise reduction earphone;
further comprising:
the intelligent sensing unit is used for triggering the noise reduction unit if the user is in a preset limited area;
the intelligent sensing unit is also used for acquiring the geographical position information of the earphone, judging whether the user is in the public place area or not according to the geographical position information, if so, triggering the noise reduction unit, otherwise, continuously judging whether the earphone or the terminal connected with the earphone is connected with the home gateway or the vehicle-mounted system, or, judging whether the user is in a preset private place area according to the geographical position information, if the earphone or the terminal connected with the earphone is judged to be connected with the home gateway or the vehicle-mounted system, triggering the noise reduction unit, or, after the user is judged to be in the preset private place area, further judging whether other users in the private place area are in the disturbance-free state or not, triggering the noise reduction unit after determining that other users in the private place area are in an interference-free state;
the intelligent sensing unit is further used for judging whether other users exist in the private place area, if so, acquiring the current states of the other users, and judging whether other users exist in the private place area and are in an interference-free state according to the current states of the other users;
the intelligent sensing unit is further used for judging whether other users exist in the private place area through an infrared sensor, if so, determining that other users exist in the private place area, or judging whether other users exist through the infrared sensor, if so, further detecting the distance between the intelligent sensing unit and other users through an ultrasonic sensor, and determining that other users exist in the private place area if the distance is smaller than a preset distance threshold; and acquiring image information of other users through a camera, judging whether the other users are in a rest state, a book reading state or a writing state according to the image information, if so, determining whether the other users in the private place area are in an interference-free state, or acquiring the sound of the other users through a microphone, judging whether the other users are in a call state according to the sound and combining with the image information, and if so, determining that the other users in the private place area are in the interference-free state.
9. The apparatus of claim 8,
the voice processing unit is further configured to obtain an ambient audio around the headset.
10. The apparatus of claim 9,
the voice processing unit is further used for acquiring the ambient audio around the earphone through a microphone when the earphone is a passive noise reduction earphone, and acquiring the ambient audio around the earphone through the earphone when the earphone is an active noise reduction earphone.
11. The apparatus of claim 8,
the voice processing unit is further configured to acquire a voiceprint feature of the user, and determine whether the environmental audio contains the user voice according to the voiceprint feature of the user.
12. The apparatus according to any one of claims 8 to 11,
the noise reduction unit is also used for sending prompt tone to the user when the earphone is a passive noise reduction earphone.
13. A noise reducing headphone, characterized by comprising the noise reducing apparatus of any one of claims 8 to 12.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810386706.4A CN108551604B (en) | 2018-04-26 | 2018-04-26 | Noise reduction method, noise reduction device and noise reduction earphone |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810386706.4A CN108551604B (en) | 2018-04-26 | 2018-04-26 | Noise reduction method, noise reduction device and noise reduction earphone |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108551604A CN108551604A (en) | 2018-09-18 |
| CN108551604B true CN108551604B (en) | 2021-05-07 |
Family
ID=63512556
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810386706.4A Active CN108551604B (en) | 2018-04-26 | 2018-04-26 | Noise reduction method, noise reduction device and noise reduction earphone |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108551604B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109065058B (en) * | 2018-09-30 | 2024-03-15 | 合肥鑫晟光电科技有限公司 | Voice communication method, device and system |
| CN110475178B (en) | 2019-09-11 | 2020-11-24 | 歌尔股份有限公司 | Wireless earphone noise reduction method and device, wireless earphone and storage medium |
| CN112383856A (en) * | 2020-11-06 | 2021-02-19 | 刘智矫 | Sound field detection and audio filtering method and system for intelligent earphone |
| CN112750464B (en) * | 2020-12-25 | 2023-05-23 | 深圳米唐科技有限公司 | Human sounding state detection method, system and storage medium based on multiple sensors |
| CN112911441A (en) * | 2021-01-18 | 2021-06-04 | 上海闻泰信息技术有限公司 | Noise reduction method, apparatus, audio device, and computer-readable storage medium |
| CN113068094B (en) * | 2021-04-17 | 2023-02-03 | 深圳市美恩微电子有限公司 | Bluetooth headset with environmental noise reduction function and noise reduction system thereof |
| CN113490089B (en) * | 2021-06-02 | 2022-07-29 | 安克创新科技股份有限公司 | Noise reduction control method, electronic device and computer readable storage device |
| CN113534672A (en) * | 2021-06-28 | 2021-10-22 | 青岛海尔空调器有限总公司 | Method and device for controlling intelligent equipment and intelligent equipment |
| CN113257272A (en) * | 2021-06-29 | 2021-08-13 | 深圳小米通讯技术有限公司 | Voice signal processing method and device, electronic equipment and storage medium |
| CN113671846B (en) * | 2021-08-06 | 2024-03-12 | 深圳市欧瑞博科技股份有限公司 | Intelligent device control method and device, wearable device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101197871A (en) * | 2006-12-07 | 2008-06-11 | 乐金电子(中国)研究开发中心有限公司 | Automatic voice measuring and reminding device |
| CN101840700A (en) * | 2010-04-28 | 2010-09-22 | 宇龙计算机通信科技(深圳)有限公司 | Voice recognition method based on mobile terminal and mobile terminal |
| CN103685757A (en) * | 2013-12-19 | 2014-03-26 | 闻泰通讯股份有限公司 | Mobile phone voice communication control system and method |
| CN105120063A (en) * | 2015-07-13 | 2015-12-02 | 联想(北京)有限公司 | Volume prompting method of input voice and electronic device |
| CN106534491A (en) * | 2016-10-18 | 2017-03-22 | 广东小天才科技有限公司 | Method and device for realizing alarm clock reminding and terminal equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102195897B1 (en) * | 2013-06-05 | 2020-12-28 | 삼성전자주식회사 | Apparatus for dectecting aucoustic event, operating method thereof, and computer-readable recording medium having embodied thereon a program which when executed by a computer perorms the method |
-
2018
- 2018-04-26 CN CN201810386706.4A patent/CN108551604B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101197871A (en) * | 2006-12-07 | 2008-06-11 | 乐金电子(中国)研究开发中心有限公司 | Automatic voice measuring and reminding device |
| CN101840700A (en) * | 2010-04-28 | 2010-09-22 | 宇龙计算机通信科技(深圳)有限公司 | Voice recognition method based on mobile terminal and mobile terminal |
| CN103685757A (en) * | 2013-12-19 | 2014-03-26 | 闻泰通讯股份有限公司 | Mobile phone voice communication control system and method |
| CN105120063A (en) * | 2015-07-13 | 2015-12-02 | 联想(北京)有限公司 | Volume prompting method of input voice and electronic device |
| CN106534491A (en) * | 2016-10-18 | 2017-03-22 | 广东小天才科技有限公司 | Method and device for realizing alarm clock reminding and terminal equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108551604A (en) | 2018-09-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108551604B (en) | Noise reduction method, noise reduction device and noise reduction earphone | |
| US11244666B2 (en) | Method and device for acute sound detection and reproduction | |
| CN112019962B (en) | Context-based ambient sound enhancement and acoustic noise cancellation | |
| US9491542B2 (en) | Automatic sound pass-through method and system for earphones | |
| US8675884B2 (en) | Method and a system for processing signals | |
| US8855343B2 (en) | Method and device to maintain audio content level reproduction | |
| US7986791B2 (en) | Method and system for automatically muting headphones | |
| US7317805B2 (en) | Telephone with integrated hearing aid | |
| CN114466277A (en) | Headset with listen mode and method of operating the same | |
| US20120101819A1 (en) | System and a method for providing sound signals | |
| US20110091047A1 (en) | Active Noise Control in Mobile Devices | |
| CN110915238B (en) | Speech intelligibility enhancement system | |
| KR101647974B1 (en) | Smart earphone, appliance and system having smart mixing module, and method for mixing external sound and internal audio | |
| CN110896509A (en) | Earphone wearing state determining method, electronic equipment control method and electronic equipment | |
| US11153677B2 (en) | Ambient sound enhancement based on hearing profile and acoustic noise cancellation | |
| US20220335924A1 (en) | Method for reducing occlusion effect of earphone, and related apparatus | |
| KR20170019929A (en) | Method and headset for improving sound quality | |
| CN107005757B (en) | For mitigating the device and method of the obstruction of itself speech in earphone | |
| KR101022312B1 (en) | Earmicrophone | |
| KR101482420B1 (en) | Sound Controller of a Cellular Phone for Deafness and its method | |
| KR20000024573A (en) | Dual directional communication headset with noise reduction | |
| CN111314513A (en) | Ear protection control method of electronic equipment and electronic equipment with same | |
| KR20020040711A (en) | A method of speaking without microphone in headset |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |