CN109361995B - Volume adjusting method and device for electrical equipment, electrical equipment and medium - Google Patents
Volume adjusting method and device for electrical equipment, electrical equipment and medium Download PDFInfo
- Publication number
- CN109361995B CN109361995B CN201811113445.5A CN201811113445A CN109361995B CN 109361995 B CN109361995 B CN 109361995B CN 201811113445 A CN201811113445 A CN 201811113445A CN 109361995 B CN109361995 B CN 109361995B
- Authority
- CN
- China
- Prior art keywords
- audio signal
- environment
- electrical equipment
- frequency
- volume
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000005236 sound signal Effects 0.000 claims abstract description 261
- 238000001914 filtration Methods 0.000 claims abstract description 11
- 238000001228 spectrum Methods 0.000 claims description 29
- 238000004458 analytical method Methods 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 6
- 210000001260 vocal cord Anatomy 0.000 claims description 6
- 210000005069 ears Anatomy 0.000 claims description 5
- 238000001514 detection method Methods 0.000 abstract description 5
- 230000008569 process Effects 0.000 abstract description 5
- 230000007613 environmental effect Effects 0.000 description 28
- 230000003287 optical effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 238000004422 calculation algorithm Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 206010011469 Crying Diseases 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 2
- 238000011038 discontinuous diafiltration by volume reduction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 206010011224 Cough Diseases 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000010183 spectrum analysis Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0316—Speech enhancement, e.g. noise reduction or echo cancellation by changing the amplitude
- G10L21/0324—Details of processing therefor
- G10L21/034—Automatic adjustment
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/78—Detection of presence or absence of voice signals
- G10L25/84—Detection of presence or absence of voice signals for discriminating voice from noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/60—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals
- H04N5/602—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals for digital sound signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Quality & Reliability (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The embodiment of the invention discloses a volume adjusting method and device for electrical equipment, the electrical equipment and a medium. The method comprises the following steps: in the playing process of the electrical equipment, filtering audio signals of a sound box in the audio signals received by the microphone to obtain environment audio signals; analyzing the frequency characteristics of the environment audio signals, and judging whether target audio signals of users exist in the environment audio signals or not; and if the target audio signal exists, adjusting the volume of the electrical equipment according to the loudness of the target audio signal. By adopting the technical scheme, the intelligent detection of the user sound in the environment is realized, and the volume of the electrical equipment is adjusted according to the sound.
Description
Technical Field
The embodiment of the invention relates to the technical field of control, in particular to a volume adjusting method and device for electrical equipment, the electrical equipment and a medium.
Background
Along with the development of science and technology, the intellectualization and humanization of electrical equipment are the problems which people generally pay attention to, and the intellectualization and humanization of the electrical equipment provide great convenience for the operation of people.
Wherein, the setting of the volume of the electrical equipment greatly influences the user experience. Taking a television as an example, when the volume of the television is set to be high, if a user needs to talk or make a call, the volume needs to be manually reduced so as not to disturb the conversation. Sometimes even when the ring tone of the phone is low or set to a vibration mode, it is easy to miss an incoming call. Therefore, the volume of the electrical equipment can be automatically reduced in an intelligent detection mode when the user needs the electrical equipment, and great convenience is brought to the life of the user.
At present, whether a user really talks can be judged by identifying the face of the person, positioning the eyes of the person or identifying the gesture or the change of the lips of the user through an image acquisition module, and an identification result is transmitted to a volume control module, so that the volume of electrical equipment is adjusted. However, the method requires complicated equipment and algorithms in the detection process, has high cost, high requirements on the ambient light and the use angle of the detection equipment, and has high limitation.
Disclosure of Invention
The embodiment of the invention provides a volume adjusting method and device of electrical equipment, the electrical equipment and a medium, so as to realize intelligent detection of user sound in the environment and adjust the volume of the electrical equipment according to the sound.
In a first aspect, an embodiment of the present invention provides a volume adjustment method for an electrical device, where the method includes:
when the electrical equipment plays audio, filtering audio signals of a sound box in the audio signals received by the microphone to obtain environment audio signals;
carrying out spectrum analysis on the environment audio signal, and judging whether a target audio signal of a user exists in the environment audio signal or not;
and if the target audio signal exists, adjusting the volume of the electrical equipment according to the loudness of the target audio signal.
In a second aspect, an embodiment of the present invention further provides a volume adjustment device for an electrical device, where the volume adjustment device includes:
the environment audio signal acquisition module is used for filtering a sound box audio signal in the audio signals received by the microphone to obtain an environment audio signal when the electrical equipment plays audio;
the target audio signal judgment module is used for analyzing the frequency characteristics of the environment audio signals and judging whether the target audio signals of the user exist in the environment audio signals or not;
and the volume adjusting module is used for adjusting the volume of the electrical equipment according to the loudness of the target audio signal if the target audio signal exists.
In a third aspect, an embodiment of the present invention further provides an electrical apparatus, where the electrical apparatus includes:
one or more processors;
a storage device for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the volume adjustment method of the electric device provided by any embodiment of the invention.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the volume adjustment method for an electrical device provided in any embodiment of the present invention.
According to the technical scheme of the embodiment of the invention, when the electrical equipment plays audio, the audio signals of the sound box in the audio signals received by the microphone are filtered to obtain the environmental audio signals, and the environmental audio signals can be obtained by filtering the audio signals of the sound box in the audio signals received by the microphone. Whether the target audio signal of the user exists in the environment audio signal can be judged by analyzing the frequency characteristic of the environment audio signal, if the target audio signal exists, the volume of the electrical equipment is adjusted according to the loudness of the target audio signal, so that the volume played by the electrical equipment does not influence the normal conversation of the user, the situation that the volume is manually adjusted by the user is avoided, and great convenience is provided for the user.
Drawings
Fig. 1 is a flowchart of a volume adjustment method for an electrical device according to an embodiment of the present invention;
fig. 2 is a flowchart of a volume adjustment method for an electrical device according to a second embodiment of the present invention;
fig. 3 is a block diagram of a volume adjustment device of an electrical apparatus according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electrical apparatus according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a flowchart of a method for adjusting a volume of an electrical apparatus according to an embodiment of the present invention, where the method may be performed by a volume adjusting device of the electrical apparatus, the device may be implemented by software and/or hardware, and the device may be integrated in an electrical apparatus, such as a television, a smart speaker, and the like. Referring to fig. 1, the method of the present embodiment specifically includes:
s110, when the electrical equipment plays audio, the audio signals of the sound box in the audio signals received by the microphone are filtered to obtain environment audio signals.
When the electrical equipment plays audio, the audio signal received by the microphone of the electrical equipment contains a sound box audio signal sent by a sound box of the electrical equipment, and may also contain an environment audio signal. The environmental audio signal may include a user speaking, a child crying, a telephone ring, a fan, and other machine noises. In order to determine the speaking voice of the user from the audio signals received by the microphone and correspondingly adjust the volume of the electrical equipment, the technical scheme of the embodiment may first acquire the environmental audio signal, and then identify the target audio signal of the user from the environmental audio signal.
In order to collect the environmental audio signal, the microphone in this embodiment is a stereo microphone built in the electrical equipment, and the microphone may be preferably placed at two ends of the top of the electrical equipment, so that the audio signal with better stereo effect can be collected. In addition, the microphone can be kept at a certain distance from the sound box of the electrical equipment, so that the situation that the sound box audio signal is mixed with the environment audio signal due to overlarge volume is avoided, and the environment audio signal is not easy to identify.
For example, filtering the audio signal of the loudspeaker to obtain the ambient audio signal may be performed by superimposing an inverse audio signal of the loudspeaker. Wherein the reverse audio signal may be generated by collecting an electrical signal output to the loudspeaker.
Optionally, the method may further include acquiring an electrical signal output to the sound box, converting the electrical signal into a first energy spectrum corresponding to the audio signal of the sound box, converting the audio signal received by the microphone into a second energy spectrum, and subtracting the first energy spectrum from the second energy spectrum to obtain an energy spectrum of the ambient audio signal, so as to filter the audio signal of the sound box from the audio signal received by the microphone. Wherein, the conversion of the audio signal received by the microphone into the second energy spectrum can be realized by means of fourier transform.
And S120, analyzing the frequency characteristic of the environment audio signal, and judging whether the environment audio signal has a target audio signal of the user.
For example, since the frequency range of the target audio signal of the vocal cord vibration when the user speaks is different from the frequency range of the audio signal that can be heard by the human ear, it is possible to determine whether the target audio signal of the user exists in the environmental audio signal by analyzing the frequency characteristics of the environmental audio signal using this feature.
Since the environmental audio signal collected by the microphone is an audio signal in a time domain, in order to analyze the frequency characteristic of the environmental audio signal, it is preferable to perform Fourier Transform on the environmental audio signal by using a short-time Fourier Transform (STFT) algorithm to obtain the environmental audio signal in the frequency domain, and certainly, the frequency domain distribution of the environmental audio signal may also be obtained by using a fast Fourier Transform, a wavelet Transform, a Discrete Cosine Transform (DCT) or other manners.
Illustratively, the frequency spectrum density (hereinafter, referred to as the spectrum) can be obtained by the above time-domain to frequency-domain transformation algorithm. The frequency spectrum refers to a representation mode of a signal in a time domain in a frequency domain, and can be obtained by performing fourier transform on the signal, and the obtained result is: and the frequency distribution spectrum respectively takes the amplitude and the phase as vertical axes and the frequency as horizontal axes. In this embodiment, the frequency spectrum of the environmental audio signal is represented by the frequency as the abscissa and the amplitude as the ordinate. Since the first frequency range of human vocal cord vibrations is 85-1100Hz (hertz) and the second frequency range that can be heard by the human ear is 20-20000Hz, the ratio of the energy distribution of 85-1100Hz to the energy distribution of 20-20000Hz can be determined by the frequency spectrum based on the ambient audio signal. If the ratio is above a set threshold, it may be determined that a person is speaking, i.e., that the user's target audio signal is present in the ambient audio signal.
The threshold value is an empirical value, and is preferably 50%. The energy distribution of the first frequency range is the sum of the squares of the amplitudes corresponding to each frequency point in the first frequency range, and the energy distribution of the second frequency range is the sum of the squares of the amplitudes corresponding to each frequency point in the second frequency range.
Further, in this embodiment, the frequency characteristics of the environmental audio signal may also be analyzed by using the energy spectrum. The horizontal axis of the energy spectrum is frequency, and the vertical axis is the square of the amplitude corresponding to the frequency, and represents the energy corresponding to the frequency. Based on the energy spectrum, the energy corresponding to a certain frequency can be directly determined. And based on the energy spectrum, it may be determined that the energy distribution of the first frequency range is a sum of values of the ordinate corresponding to each frequency point in the first frequency range, and the energy distribution of the second frequency range is a sum of values of the ordinate corresponding to each frequency point in the second frequency range.
And S130, if the target audio signal exists, adjusting the volume of the electrical equipment according to the loudness of the target audio signal.
For example, if the distance between the user and the electrical device reaches the set distance, the volume of the electrical device does not affect the conversation of the user, and the volume of the electrical device does not need to be adjusted. However, if the distance between the user and the electrical equipment is less than the set distance, the volume of the electrical equipment needs to be reduced in order to avoid the volume of the electrical equipment from influencing the conversation of the user.
In this embodiment, the distance between the user and the electrical equipment is preferably reflected by the loudness of the target audio signal, and the larger the loudness is, the closer the distance is described; the smaller the loudness, the farther away is illustrated. Therefore, when the loudness of the target audio signal reaches the preset loudness, it indicates that the distance between the user and the electrical equipment is less than the set distance, and at this time, the volume of the electrical equipment needs to be reduced. Wherein, the loudness is set to an empirical value, which can be generally set to 40 db.
Optionally, when the volume of the electrical equipment is turned down, the electrical equipment may be set to a mute state, so as to achieve the purpose of not interfering with the user conversation at all.
Preferably, when the volume of the electrical equipment is reduced, the volume of the electrical equipment can be reduced by more than 10 decibels, so that a user who does not participate in conversation can still continuously receive the audio signal of the sound box of the electrical equipment on the basis of avoiding influencing the conversation of the user, and the user experience is improved.
According to the technical scheme of the embodiment of the invention, when the electrical equipment plays audio, the audio signals of the sound box in the audio signals received by the microphone are filtered to obtain the environmental audio signals, and the environmental audio signals can be obtained by filtering the audio signals of the sound box in the audio signals received by the microphone. Whether the target audio signal of the user exists in the environment audio signal can be judged by analyzing the frequency characteristic of the environment audio signal, if the target audio signal exists, the volume of the electrical equipment is adjusted according to the loudness of the target audio signal, so that the volume played by the electrical equipment does not influence the normal conversation of the user, the situation that the volume is manually adjusted by the user is avoided, and great convenience is provided for the user.
Further, if it is determined that the time for the target audio signal to stop reaches the first set time threshold, that is, the time for the user to stop speaking reaches the set time threshold, the volume of the electrical equipment may be adjusted to the initial volume. The initial volume may be a power-on volume or a default volume of the electrical device, or a volume before the electrical device is automatically adjusted. The first set time threshold is preferably set to 2 minutes. The setting is that after the user conversation is finished, the volume of the electrical equipment needs to be recovered, so that the user experience is improved.
Further, if it is determined that the time for which the target audio signal stops reaches the second set time threshold, that is, the time for which the user continues speaking is less than the second set time threshold, the volume of the electrical equipment does not need to be adjusted. Wherein the second set time threshold is less than the first set time threshold, and is preferably set to 2 seconds in general, so as to allow for the user to suddenly make a cough or other special situations, in which the volume of the electrical device does not need to be adjusted.
Example two
Fig. 2 is a flowchart of a volume adjustment method for an electrical device according to a second embodiment of the present invention, which is optimized based on the second embodiment, and adds acquisition of an environmental audio signal and recognition of a telephone ring tone, and further confirms a target audio signal of a user in the environmental audio signal. Wherein explanations of the same or corresponding terms as those of the above-described embodiments are omitted. Referring to fig. 2, the method provided in this embodiment includes:
s210, when the electrical equipment plays audio, generating a reverse audio signal which is opposite to the phase of the audio signal of the sound box of the electrical equipment and has the same amplitude.
And S220, determining the delay time of the reverse audio signal according to the distance between the sound box and the microphone.
The delay time is set by considering the actual distance between the sound box and the microphone, and the synchronism of the received sound box audio signal and the superposed reverse audio signal can be ensured by setting the delay time.
Specifically, since the propagation speed of sound is 340M/s, if the actual distance between the speaker and the microphone is M, the delay time is M/340 (sec).
And S230, when the set delay time is reached, superposing the reverse audio signal and the audio signal received by the microphone to filter the audio signal of the sound box to obtain an environment audio signal.
S240, Fourier transform is carried out on the environment audio signal to obtain the frequency spectrum of the environment audio signal.
S250, determining the ratio of the energy distribution of the first frequency range of the human vocal cord vibration to the energy distribution of the second frequency range which can be heard by human ears based on the frequency spectrum, and judging whether the target audio signal of the user exists in the environment audio signal according to the ratio.
And S260, carrying out similarity analysis on the environment audio signals of two adjacent seconds based on the frequency spectrum.
For example, similarity analysis may be performed on the environmental audio signals of two adjacent seconds according to the following formula to obtain a similarity value:
wherein similarity is a similarity value, i is a frequency, AiRepresenting the amplitude corresponding to the previous second of the environment audio signal with the frequency i; b isiRepresenting the amplitude of the ambient audio signal with frequency i in the next second. It should be noted that i may also represent a frequency interval, and then AiOr BiThe represented amplitude is the sum of the amplitudes corresponding to the frequency points in the frequency interval, and the calculation amount can be reduced by the arrangement.
Step S260 and step S270 do not have the precedence of the execution sequence, and may be performed simultaneously or sequentially. In this embodiment, step S260 is preferably performed first, and on the basis of preliminarily determining whether the target audio signal of the user exists, further determination is performed through step S270, and finally the result of step S270 may be used as the standard.
And S270, if the obtained similarity value is smaller than a set threshold, determining that the target audio signal of the user exists in the environment audio signal.
Since the sound spectrum generally changes continuously when the user talks, the similarity between the amplitudes of two adjacent seconds is low. And the noise of some specific machines or the crying of children is monotonous and has larger similarity. Therefore, by calculating the similarity value of the ambient audio signals of two adjacent seconds, it can be determined whether the target audio signal of the user exists in the ambient audio signals.
Specifically, if the obtained similarity value is smaller than a set threshold, which is generally preferably 0.5, it is determined that the target audio signal of the user exists in the environmental audio signal. And if the obtained similarity value is larger than or equal to the set threshold value, determining that the target audio signal of the user does not exist in the environment audio signal.
And S280, adjusting the volume of the electrical equipment according to the loudness of the target audio signal.
In this embodiment, for example, a phone ring template may be preset, and if the phone ring collected by the microphone matches with the pre-existing phone ring template, the volume of the electrical device is automatically turned down.
In order to improve the matching efficiency, the user can input the telephone ring frequently used by the user or family as a template in advance. When the subsequent microphone collects the telephone ring, the identification degree of the telephone ring can be improved.
Furthermore, when the matching of the environmental audio signal and the pre-stored telephone ring template is successful, the indicator light of the electrical equipment can be controlled to flash to remind the user. Because the sensitivity of the microphone is higher and the audio signals of the sound box of the electric equipment are filtered out from the environment audio signals, the success rate of detecting the telephone ring or the telephone vibration sound is higher than that of human ears, so that the condition that the electric equipment misses the call due to overlarge sound of the electric equipment is avoided.
On the basis of the above embodiments, the present embodiment can improve the accuracy of determining the target audio signal in the environmental audio signal by comparing the similarity between the two adjacent second environmental audio signals. By identifying the telephone ring in the environment audio signal, the volume of the electrical equipment can be automatically reduced when the microphone receives the telephone ring, so that the condition that the telephone is missed due to overlarge sound of the electrical equipment is avoided.
EXAMPLE III
Fig. 3 is a block diagram of a volume adjustment device of an electrical apparatus according to a third embodiment of the present invention, where the volume adjustment device includes: an ambient audio signal acquisition module 310, a target audio signal determination module 320, and a volume adjustment module 330. Wherein the content of the first and second substances,
the environment audio signal acquisition module 310 is configured to filter, in a playing process of the electrical equipment, an audio signal of a sound box in the audio signals received by the microphone to obtain an environment audio signal;
a target audio signal determining module 320, configured to analyze a frequency characteristic of the environmental audio signal, and determine whether a target audio signal of a user exists in the environmental audio signal;
and the volume adjusting module 330 is configured to adjust the volume of the electrical device according to the loudness of the target audio signal if the target audio signal exists.
According to the technical scheme of the embodiment of the invention, when the electrical equipment plays audio, the audio signals of the sound box in the audio signals received by the microphone are filtered to obtain the environmental audio signals, and the environmental audio signals can be obtained by filtering the audio signals of the sound box in the audio signals received by the microphone. Whether the target audio signal of the user exists in the environment audio signal can be judged by analyzing the frequency characteristic of the environment audio signal, if the target audio signal exists, the volume of the electrical equipment is adjusted according to the loudness of the target audio signal, so that the volume played by the electrical equipment does not influence the normal conversation of the user, the situation that the volume is manually adjusted by the user is avoided, and great convenience is provided for the user.
On the basis of the foregoing embodiment, the ambient audio signal acquisition module is specifically configured to:
generating a reverse audio signal with the phase opposite to that of the audio signal of the sound box of the electrical equipment and the same amplitude;
determining the delay time of the reverse audio signal according to the distance between the sound box and the microphone;
and when the set delay time is reached, superposing the reverse audio signal and the audio signal received by the microphone so as to filter the audio signal of the sound box to obtain an environment audio signal.
On the basis of the foregoing embodiment, the target audio signal determination module is specifically configured to:
carrying out Fourier transform on the environment audio signal to obtain a frequency spectrum of the environment audio signal;
determining the energy distribution ratio of the energy distribution of a first frequency range of human vocal cord vibration to a second frequency range audible to human ears based on the frequency spectrum;
judging whether a target audio signal of a user exists in the environment audio signal according to the ratio;
the energy distribution of the first frequency range is the square sum of the amplitude corresponding to each frequency point in the first frequency range, and the energy distribution of the second frequency range is the square sum of the amplitude corresponding to each frequency point in the second frequency range.
On the basis of the above embodiment, the apparatus further includes:
the similarity analysis module is used for carrying out similarity analysis on the environment audio signals of two adjacent seconds based on the frequency spectrum;
and the target audio signal determining module is used for determining that the target audio signal of the user exists in the environment audio signal if the similarity value obtained by the similarity analyzing module is smaller than a set threshold.
On the basis of the above embodiment, the similarity analysis module is specifically configured to:
similarity analysis is carried out on the environment audio signals of two adjacent seconds according to the following formula to obtain a similarity value:
wherein similarity is a similarity value, i is a frequency or a frequency interval, AiRepresenting the amplitude corresponding to the previous second of the environment audio signal with the frequency i; b isiRepresenting the amplitude of the ambient audio signal with frequency i in the next second.
On the basis of the above embodiment, the apparatus further includes:
and the initial volume adjusting module is used for adjusting the volume of the electrical equipment to the initial volume if the time for stopping the target audio signal is determined to reach the set time threshold.
On the basis of the above embodiment, the apparatus further includes:
the telephone ring matching module is used for matching the environment audio signal with a pre-stored telephone ring template;
and the volume reduction module is used for controlling the volume reduction of the sound box of the electrical equipment if the environment audio signal is successfully matched with the pre-stored telephone ring template.
The volume adjusting device of the electrical equipment provided by the embodiment of the invention can execute the volume adjusting method of the electrical equipment provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the executing method. For details of the technology not described in detail in the above embodiments, reference may be made to a volume adjustment method of an electrical device provided in any embodiment of the present invention.
Example four
Fig. 4 is a schematic structural diagram of an electrical apparatus according to a fourth embodiment of the present invention. FIG. 4 illustrates a block diagram of an exemplary appliance device 12 suitable for use in implementing embodiments of the present invention. The electrical device 12 shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiment of the present invention.
As shown in FIG. 4, the appliance device 12 is in the form of a general purpose computing device. The components of the appliance device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.
The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)30 and/or cache memory 32. The appliance device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 4, and commonly referred to as a "hard drive"). Although not shown in FIG. 4, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.
The appliance device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with the appliance device 12, and/or with any devices (e.g., network card, modem, etc.) that enable the appliance device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, the appliance device 12 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 20. As shown, the network adapter 20 communicates with the other modules of the appliance device 12 over the bus 18. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction with appliance device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 16 executes various functional applications and data processing by executing programs stored in the system memory 28, for example, to implement a volume adjustment method for an electrical apparatus provided in any embodiment of the present invention, the method including:
in the playing process of the electrical equipment, filtering audio signals of a sound box in the audio signals received by the microphone to obtain environment audio signals;
analyzing the frequency characteristics of the environment audio signals, and judging whether target audio signals of users exist in the environment audio signals or not;
and if the target audio signal exists, adjusting the volume of the electrical equipment according to the loudness of the target audio signal.
EXAMPLE five
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a volume adjustment method for an electrical device provided in any embodiment of the present invention, where the method includes:
in the playing process of the electrical equipment, filtering audio signals of a sound box in the audio signals received by the microphone to obtain environment audio signals;
analyzing the frequency characteristics of the environment audio signals, and judging whether target audio signals of users exist in the environment audio signals or not;
and if the target audio signal exists, adjusting the volume of the electrical equipment according to the loudness of the target audio signal.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (7)
1. A volume adjusting method of an electrical device is characterized by comprising the following steps:
when the electrical equipment plays audio, filtering audio signals of a sound box in the audio signals received by the microphone to obtain environment audio signals;
the audio signal of the sound box in the audio signal received by the microphone is filtered to obtain an environment audio signal, and the method comprises the following steps:
generating a reverse audio signal with the phase opposite to that of the audio signal of the sound box of the electrical equipment and the same amplitude;
determining the delay time of the reverse audio signal according to the distance between the sound box and the microphone;
when the set delay time is reached, superposing the reverse audio signal and the audio signal received by a microphone to filter the audio signal of the sound box to obtain an environment audio signal;
analyzing the frequency characteristics of the environment audio signals, and judging whether target audio signals of users exist in the environment audio signals or not;
analyzing the frequency characteristics of the environment audio signal, and judging whether a target audio signal of a user exists in the environment audio signal, wherein the method comprises the following steps:
carrying out Fourier transform on the environment audio signal to obtain a frequency spectrum of the environment audio signal;
determining the ratio of the energy distribution of a first frequency range of human vocal cord vibration to the energy distribution of a second frequency range audible to human ears based on the frequency spectrum;
judging whether a target audio signal of a user exists in the environment audio signal according to the ratio;
the energy distribution of the first frequency range is the square sum of the amplitude corresponding to each frequency point in the first frequency range, and the energy distribution of the second frequency range is the square sum of the amplitude corresponding to each frequency point in the second frequency range;
based on the frequency spectrum, carrying out similarity analysis on the environment audio signals of two adjacent seconds;
if the obtained similarity value is smaller than a set threshold value, determining that the target audio signal of the user exists in the environment audio signal;
and if the target audio signal exists, adjusting the volume of the electrical equipment according to the loudness of the target audio signal.
2. The method of claim 1, wherein performing similarity analysis on two adjacent seconds of the ambient audio signal comprises:
similarity analysis is carried out on the environment audio signals of two adjacent seconds according to the following formula to obtain a similarity value:
wherein similarity is a similarity value, i is a frequency or a frequency interval, AiRepresenting the amplitude corresponding to the previous second of the environment audio signal with the frequency i; b isiRepresentation frequencyThe amplitude corresponding to the next second of the ambient audio signal with the rate i.
3. The method according to any one of claims 1-2, further comprising:
and if the time that the target audio signal stops is determined to reach the set time threshold, adjusting the volume of the electric equipment to the initial volume.
4. The method according to any one of claims 1-2, further comprising:
matching the environment audio signal with a pre-stored telephone ring template;
and if the matching is successful, controlling the volume of the sound box of the electrical equipment to be reduced.
5. A volume adjustment device of an electric appliance, comprising:
the environment audio signal acquisition module is used for filtering a sound box audio signal in the audio signals received by the microphone to obtain an environment audio signal when the electrical equipment plays audio;
the environment audio signal acquisition module is specifically configured to:
generating a reverse audio signal with the phase opposite to that of the audio signal of the sound box of the electrical equipment and the same amplitude;
determining the delay time of the reverse audio signal according to the distance between the sound box and the microphone;
when the set delay time is reached, superposing the reverse audio signal and the audio signal received by a microphone to filter the audio signal of the sound box to obtain an environment audio signal;
the target audio signal judgment module is used for analyzing the frequency characteristics of the environment audio signals and judging whether the target audio signals of the user exist in the environment audio signals or not;
the target audio signal judgment module is specifically configured to:
carrying out Fourier transform on the environment audio signal to obtain a frequency spectrum of the environment audio signal;
determining the energy distribution ratio of the energy distribution of a first frequency range of human vocal cord vibration to a second frequency range audible to human ears based on the frequency spectrum;
judging whether a target audio signal of a user exists in the environment audio signal according to the ratio;
the energy distribution of the first frequency range is the square sum of the amplitude corresponding to each frequency point in the first frequency range, and the energy distribution of the second frequency range is the square sum of the amplitude corresponding to each frequency point in the second frequency range;
the similarity analysis module is used for carrying out similarity analysis on the environment audio signals of two adjacent seconds based on the frequency spectrum;
the target audio signal determination module is used for determining that the target audio signal of the user exists in the environment audio signal if the similarity value obtained by the similarity analysis module is smaller than a set threshold value;
and the volume adjusting module is used for adjusting the volume of the electrical equipment according to the loudness of the target audio signal if the target audio signal exists.
6. An electrical device, characterized in that it comprises:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of volume adjustment for an appliance device of any of claims 1-4.
7. A computer-readable storage medium, on which a computer program is stored, wherein the program, when executed by a processor, implements a volume adjustment method of an electric device according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811113445.5A CN109361995B (en) | 2018-09-25 | 2018-09-25 | Volume adjusting method and device for electrical equipment, electrical equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811113445.5A CN109361995B (en) | 2018-09-25 | 2018-09-25 | Volume adjusting method and device for electrical equipment, electrical equipment and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109361995A CN109361995A (en) | 2019-02-19 |
| CN109361995B true CN109361995B (en) | 2021-07-30 |
Family
ID=65351344
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811113445.5A Active CN109361995B (en) | 2018-09-25 | 2018-09-25 | Volume adjusting method and device for electrical equipment, electrical equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109361995B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110347367B (en) * | 2019-07-15 | 2023-06-20 | 百度在线网络技术（北京）有限公司 | Volume adjusting method, terminal device, storage medium and electronic device |
| CN112181348A (en) * | 2020-08-28 | 2021-01-05 | 星络智能科技有限公司 | Sound style switching method, system, computer equipment and readable storage medium |
| CN112235688B (en) * | 2020-09-25 | 2022-03-22 | 深圳市火乐科技发展有限公司 | Method and device for adjusting sound field |
| CN113380244A (en) * | 2021-05-28 | 2021-09-10 | 幻境虚拟现实(广州)智能科技研究院有限公司 | Intelligent adjustment method and system for playing volume of equipment |
| CN113571035B (en) * | 2021-06-18 | 2022-06-21 | 荣耀终端有限公司 | Noise reduction method and noise reduction device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102761721A (en) * | 2011-04-27 | 2012-10-31 | 海尔集团公司 | Volume control method and system for TV |
| CN102833505A (en) * | 2012-09-14 | 2012-12-19 | 高亿实业有限公司 | Automatic regulation method and system for television volume, television and television remote control device |
| JP5105097B2 (en) * | 2009-01-23 | 2012-12-19 | 日本電気株式会社 | Speech classification apparatus, speech classification method and program |
| CN202759531U (en) * | 2012-06-13 | 2013-02-27 | 青岛海尔电子有限公司 | Television set volume control system |
| CN104916288A (en) * | 2014-03-14 | 2015-09-16 | 深圳Tcl新技术有限公司 | Human voice highlighting processing method and device in audio |
| CN105406828A (en) * | 2014-08-22 | 2016-03-16 | 小米科技有限责任公司 | Sound equipment adjustment method and device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106470284B (en) * | 2015-08-20 | 2020-02-11 | 钉钉控股（开曼）有限公司 | Method, device, system, server and communication device for eliminating acoustic echo |
| CN106531177B (en) * | 2016-12-07 | 2020-08-11 | 腾讯科技（深圳）有限公司 | Audio processing method, mobile terminal and system |
| CN108091343A (en) * | 2018-01-16 | 2018-05-29 | 北京三体云联科技有限公司 | A kind of echo cancel method and device |
-
2018
- 2018-09-25 CN CN201811113445.5A patent/CN109361995B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5105097B2 (en) * | 2009-01-23 | 2012-12-19 | 日本電気株式会社 | Speech classification apparatus, speech classification method and program |
| CN102761721A (en) * | 2011-04-27 | 2012-10-31 | 海尔集团公司 | Volume control method and system for TV |
| CN202759531U (en) * | 2012-06-13 | 2013-02-27 | 青岛海尔电子有限公司 | Television set volume control system |
| CN102833505A (en) * | 2012-09-14 | 2012-12-19 | 高亿实业有限公司 | Automatic regulation method and system for television volume, television and television remote control device |
| CN104916288A (en) * | 2014-03-14 | 2015-09-16 | 深圳Tcl新技术有限公司 | Human voice highlighting processing method and device in audio |
| CN105406828A (en) * | 2014-08-22 | 2016-03-16 | 小米科技有限责任公司 | Sound equipment adjustment method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109361995A (en) | 2019-02-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109361995B (en) | Volume adjusting method and device for electrical equipment, electrical equipment and medium | |
| US11483434B2 (en) | Method and apparatus for adjusting volume of user terminal, and terminal | |
| US11069366B2 (en) | Method and device for evaluating performance of speech enhancement algorithm, and computer-readable storage medium | |
| CN108681440A (en) | A kind of smart machine method for controlling volume and system | |
| CN110956976B (en) | Echo cancellation method, device and equipment and readable storage medium | |
| US20230317096A1 (en) | Audio signal processing method and apparatus, electronic device, and storage medium | |
| CN111343410A (en) | Mute prompt method and device, electronic equipment and storage medium | |
| CN112053702B (en) | Voice processing method and device and electronic equipment | |
| US20240096343A1 (en) | Voice quality enhancement method and related device | |
| US8423357B2 (en) | System and method for biometric acoustic noise reduction | |
| CN110475181A (en) | Equipment configuration method, device, equipment and storage medium | |
| CN105261363A (en) | Voice recognition method, device and terminal | |
| US20230290335A1 (en) | Detection of live speech | |
| CN110197663B (en) | Control method and device and electronic equipment | |
| CN111782859A (en) | Audio visualization method and device and storage medium | |
| CN110827845B (en) | Recording method, device, equipment and storage medium | |
| CN114678038A (en) | Audio noise detection method, computer device and computer program product | |
| CN114125128A (en) | Anti-eavesdropping recording method, device and terminal | |
| CN112118511A (en) | Earphone noise reduction method and device, earphone and computer readable storage medium | |
| WO2020102943A1 (en) | Method and apparatus for generating gesture recognition model, storage medium, and electronic device | |
| EP4394761A1 (en) | Audio signal processing method and apparatus, electronic device, and storage medium | |
| CN110289010B (en) | Sound collection method, device, equipment and computer storage medium | |
| US20230223033A1 (en) | Method of Noise Reduction for Intelligent Network Communication | |
| US20230267942A1 (en) | Audio-visual hearing aid | |
| CN116320872A (en) | Earphone mode switching method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |