CN108600885B - Sound signal processing method and related product - Google Patents
Sound signal processing method and related product Download PDFInfo
- Publication number
- CN108600885B CN108600885B CN201810276532.6A CN201810276532A CN108600885B CN 108600885 B CN108600885 B CN 108600885B CN 201810276532 A CN201810276532 A CN 201810276532A CN 108600885 B CN108600885 B CN 108600885B
- Authority
- CN
- China
- Prior art keywords
- sound source
- source signal
- reminding
- electroacoustic transducer
- earphone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000005236 sound signal Effects 0.000 title claims abstract description 74
- 238000003672 processing method Methods 0.000 title claims abstract description 29
- 238000012545 processing Methods 0.000 claims abstract description 32
- 238000000034 method Methods 0.000 claims abstract description 29
- 238000004590 computer program Methods 0.000 claims description 22
- 230000001934 delay Effects 0.000 claims description 12
- 238000001914 filtration Methods 0.000 claims description 7
- 238000009499 grossing Methods 0.000 claims description 6
- 238000001514 detection method Methods 0.000 claims description 5
- 238000013507 mapping Methods 0.000 claims description 4
- 230000006870 function Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 6
- DWDGSKGGUZPXMQ-UHFFFAOYSA-N OPPO Chemical compound OPPO DWDGSKGGUZPXMQ-UHFFFAOYSA-N 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000004044 response Effects 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 238000009432 framing Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000013500 data storage Methods 0.000 description 2
- 230000004807 localization Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000009429 distress Effects 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 230000005674 electromagnetic induction Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000000704 physical effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 210000000697 sensory organ Anatomy 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1041—Mechanical or electronic switches, or control elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
- H04R2430/03—Synergistic effects of band splitting and sub-band processing
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Telephone Function (AREA)
- Headphones And Earphones (AREA)
Abstract
The application relates to a sound signal processing method and device, a computer readable storage medium, an electronic device and a headset. The method comprises the following steps: when the earphone is in a playing state, acquiring sound source signals acquired by the microphone, the first electroacoustic transducer and the second electroacoustic transducer; acquiring position information of the sound source signal relative to the earphone according to the time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer for receiving the sound source signal; when the sound source signal accords with the preset reminding condition, the operation of reminding the user is executed according to the position information, the sound source signal can be positioned only by utilizing the inherent device of the earphone, the structure of the earphone is simplified, the cost is saved, meanwhile, when the sound source signal accords with the preset reminding condition, the user can be automatically reminded according to the position information of the sound source signal relative to the earphone, the user can timely make correct processing on the sound source signal, and the important or urgent situation is avoided being missed.
Description
Technical Field
The present application relates to the field of audio technologies, and in particular, to a method and an apparatus for processing a sound signal, a computer-readable storage medium, an electronic device, and an earphone.
Background
With the development of communication technology, electronic devices (mobile phones, tablet computers and the like) have been incorporated into the lives of people, and the lives of people are greatly improved.
When a user wears the earphones to listen to the sound played by the electronic equipment, the hearing of the auxiliary visual sense organ is greatly limited due to the sound played by the earphones, the user hardly notices an external sound source signal, cannot position the sound source signal by utilizing the earphones, and makes a correct and timely response.
Disclosure of Invention
The embodiment of the application provides a sound signal processing method and device, a computer readable storage medium and electronic equipment, which can acquire position information of a sound source signal based on an earphone and automatically remind a user, so that the user experience is improved.
A sound signal processing method, the method being based on an earphone comprising a microphone, a first electroacoustic transducer and a second electroacoustic transducer, wherein the first and second electroacoustic transducers are used for playing and recording audio signals, the method comprising:
when the earphone is in a playing state, acquiring sound source signals acquired by a microphone, a first electroacoustic transducer and a second electroacoustic transducer;
acquiring position information of the sound source signal relative to the earphone according to the time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer for receiving the sound source signal;
and when the sound source signal meets the preset reminding condition, executing the operation of reminding the user according to the position information.
A sound signal processing apparatus, the apparatus being based on an earphone comprising a microphone, a first electroacoustic transducer and a second electroacoustic transducer, the apparatus comprising:
the acquisition module is used for acquiring sound source signals acquired by a microphone, the first electroacoustic transducer and the second electroacoustic transducer when the earphone is in a playing state;
the acquisition module is used for acquiring the position information of the sound source signal relative to the earphone according to the time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer for receiving the sound source signal;
and the reminding module is used for executing the operation of reminding the user according to the position information when the sound source signal meets the preset reminding condition.
A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the sound signal processing method in the various embodiments of the present application.
An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the sound signal processing method in the various embodiments of the present application are implemented when the computer program is executed by the processor.
An earphone comprises a microphone, a first electroacoustic transducer, a second electroacoustic transducer, a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor is electrically connected with the microphone, the first electroacoustic transducer, the second electroacoustic transducer and the memory respectively, and the steps of the sound signal processing method in the embodiments of the present application are realized when the processor executes the computer program.
According to the sound signal processing method and device, the computer-readable storage medium, the electronic device and the earphone, when the earphone is in a playing state, sound source signals collected by the microphone, the first electroacoustic transducer and the second electroacoustic transducer can be acquired; acquiring position information of the sound source signal relative to the earphone according to the time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer for receiving the sound source signal; when the sound source signal accords with the preset reminding condition, the operation of reminding the user is executed according to the position information, the sound source signal can be positioned only by utilizing the inherent device of the earphone, the structure of the earphone is simplified, the cost is saved, meanwhile, when the sound source signal accords with the preset reminding condition, the user can be automatically reminded according to the position information of the sound source signal relative to the earphone, the user can timely make correct processing on the sound source signal, and the missing of important or urgent events is avoided.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a diagram illustrating an exemplary embodiment of an application environment of a sound signal processing method;
FIG. 2 is a schematic diagram showing an internal configuration of an electronic apparatus according to an embodiment;
FIG. 3 is a flow diagram of a method for sound signal processing in one embodiment;
FIG. 4 is a flow chart of acquiring position information of the sound source signal relative to the headset according to a time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer receiving the sound source signal in one embodiment;
FIG. 5 is a flowchart illustrating an operation performed to remind a user according to the location information when the sound source signal meets a preset reminding condition in one embodiment;
fig. 6 is a flowchart illustrating an operation of reminding a user according to the position information when the sound source signal meets a preset reminding condition in another embodiment;
FIG. 7 is a flowchart of a sound signal processing method in another embodiment;
FIG. 8 is a block diagram showing the structure of an audio signal processing apparatus according to an embodiment;
fig. 9 is a block diagram of a partial structure of a mobile phone related to an electronic device provided in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
It will be understood that, as used herein, the terms "first," "second," and the like may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, a first acquisition unit may be referred to as a second acquisition unit, and similarly, a second acquisition unit may be referred to as a first acquisition unit, without departing from the scope of the present invention. The first acquisition unit and the second acquisition unit are both acquisition units, but are not the same acquisition unit.
Fig. 1 is a schematic diagram of an application environment of a sound signal processing method according to an embodiment. As shown in fig. 1, the application environment includes an electronic device 110 and a headset 120 in communication with the electronic device 110.
Among other types of earphones 120 may be in-ear earphones, ear buds, headphones, ear hooks, and the like. The electronic device and the headset 120 may communicate in a wired or wireless manner to realize data transmission. The earphone 120 includes a microphone, a left speaker and a right speaker, wherein the left speaker and the right speaker can be replaced with an electroacoustic transducer, having a function of collecting and playing audio signals.
Fig. 2 is a schematic diagram of an internal structure of an electronic device in one embodiment. The electronic device 110 includes a processor, memory, and a display screen connected by a system bus. Wherein the processor is configured to provide computing and control capabilities to support the operation of the entire electronic device 110. The memory is used for storing data, programs, and/or instruction codes, etc., and at least one computer program is stored on the memory, and the computer program can be executed by the processor to realize the audio signal processing method suitable for the electronic device 110 provided in the embodiment of the present application. The Memory may include a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-only Memory (ROM), or a Random-Access-Memory (RAM). For example, in one embodiment, the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a database, and a computer program. The database stores data related to implementing an audio signal processing method provided in the above embodiments. The computer program can be executed by a processor for implementing an audio signal processing method provided by various embodiments of the present application. The internal memory provides a cached operating environment for the operating system, databases, and computer programs in the non-volatile storage medium. The display screen may be a touch screen, such as a capacitive screen or an electronic screen, for displaying interface information of the electronic device 110, and includes an on-screen state and an off-screen state. The electronic device 110 may be a mobile phone, a tablet computer, a personal digital assistant, a wearable device, or the like.
Those skilled in the art will appreciate that the configuration shown in fig. 2 is a block diagram of only a portion of the configuration associated with the present application, and does not constitute a limitation on the electronic device 110 to which the present application is applied, and that a particular electronic device 110 may include more or less components than those shown, or combine certain components, or have a different arrangement of components.
Fig. 3 is a flow chart of a sound signal processing method in one embodiment. The sound signal processing method in this embodiment is described by taking the electronic device or the headset in fig. 1 as an example. A sound signal processing method based on an earphone comprising a microphone, a first electroacoustic transducer and a second electroacoustic transducer, wherein the first and second electroacoustic transducers are used for playing and recording audio signals. As shown in fig. 3, the sound signal processing method includes steps 302 to 306.
Step 302: when the earphone is in a playing state, sound source signals collected by a microphone, a first electroacoustic transducer and a second electroacoustic transducer are obtained.
The earphone can communicate with the electronic equipment in a wired or wireless mode, and when the earphone is in a playing state, a user can use the earphone to communicate, listen to songs or listen to books and the like. Wherein, the playing state can be understood as that the earphone is in the working state and worn on the ear of the user.
The headset comprises a microphone, a first electroacoustic transducer and a second electroacoustic transducer, wherein the microphone is used for collecting voice signals of a user or external environment sounds. The first electroacoustic transducer and the second electroacoustic transducer can be respectively used as a left loudspeaker (loudspeaker) and a right loudspeaker (loudspeaker) of the original earphone, and convert an electric signal corresponding to an audio signal into a sound wave signal which can be heard by a user. Meanwhile, the electroacoustic transducer is very sensitive to sound waves, can cause the vibration of a cone of a loudspeaker, and drives a coil connected with the cone to make a motion of cutting magnetic lines in a magnetic field of a permanent magnet, so that current changing along with the change of the sound waves is generated (the phenomenon of generating the current is called electromagnetic induction phenomenon in physics), and meanwhile, electromotive force of audio frequency is output at two ends of the coil, so that the electroacoustic transducer can also collect and record external environment sounds. That is, the first electroacoustic transducer (left loudspeaker) and the second electroacoustic transducer (right loudspeaker) of the earphone can be used as microphones.
Electroacoustic transducers, although they differ in their type, function or operating state, comprise two basic components, namely an electrical system and a mechanical vibration system, which are interconnected by some physical effect inside the electroacoustic transducer to accomplish the conversion of energy.
Sound source signals acquired by the headset-based microphone, the first electro-acoustic transducer and the second electro-acoustic transducer are acquired. That is, the microphone, the first electroacoustic transducer (left horn) and the second electroacoustic transducer (right horn) of the earphone periodically collect the sound source signal.
It should be noted that the sound source signal may be generated by a speaker, a certain sound device or a generator, or may be a voice of a human, and in this application, no limitation is made to the sound source signal.
Step 304: and acquiring the position information of the sound source signal relative to the earphone according to the time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer for receiving the sound source signal.
Specifically, the sound source signals received by the microphone of the earphone, the first electroacoustic transducer and the second electroacoustic transducer can be used as reference microphones to acquire the time delay of receiving the sound source signals, and the sound source signals are estimated and positioned based on the time delay estimation technology of the time delay difference, so as to acquire the position information of the sound source signals relative to the earphone. The position information can be understood as distance information of the sound source signal from the earphone and orientation information relative to the earphone.
It should be noted that the position information of the sound source signal relative to the earphone can be understood as the position information of the sound source signal relative to the center position of the earphone (the center positions of the microphone, the first electroacoustic transducer and the second electroacoustic transducer), and can also be understood as the position information of the sound source signal relative to the microphone, the first electroacoustic transducer or the second electroacoustic transducer; but also the position information of the sound source signal with respect to any reference point on the headset.
Optionally, the sound source signal may be positioned based on a directional technique of high resolution spectrum estimation according to the sound source signal received by the microphone, the first electroacoustic transducer, and the second electroacoustic transducer, or may be positioned based on a controllable beam forming technique; the sound source signal can also be localized based on a localization technique of sound pressure amplitude ratio.
Step 306: and when the sound source signal meets the preset reminding condition, executing the operation of reminding the user according to the position information.
When the sound source signal meets the preset reminding condition, the user can be reminded according to the preset reminding content corresponding to the position information. The preset reminding condition can be that the decibel number of the sound source signal is greater than a preset value, and the sound source signal comprises certain preset characteristic audio frequencies, such as 'whistle, alarm, shout, specific name of person, place name and time'. According to the acquired position information of the sound source signal relative to the earphone, the distance from the sound source signal to the current earphone and the azimuth signal can be acquired. And setting reminding modes of different strategies according to the position information, and executing operation of reminding a user according to the reminding mode corresponding to the position information when the sound source signal meets the preset reminding condition.
According to the sound signal processing method, when the earphone is in a playing state, sound source signals collected by the microphone, the first electroacoustic transducer and the second electroacoustic transducer can be acquired; acquiring position information of the sound source signal relative to the earphone according to the time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer for receiving the sound source signal; when the sound source signal accords with the preset reminding condition, the operation of reminding the user is executed according to the position information, the sound source signal can be positioned only by utilizing the inherent device of the earphone, the structure of the earphone is simplified, the cost is saved, meanwhile, when the sound source signal accords with the preset reminding condition, the user can be automatically reminded according to the position information of the sound source signal relative to the earphone, the user can timely make correct processing on the sound source signal, and the missing of important or urgent events is avoided.
Fig. 4 is a flow chart of acquiring the position information of the sound source signal relative to the earphone according to the time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer receiving the sound source signal in one embodiment. In one embodiment, acquiring the position information of the sound source signal relative to the headset according to the time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer for receiving the sound source signal comprises:
step 402: three sets of time delays for receiving a current frame sound source signal with the microphone, the first electro-acoustic transducer and the second electro-acoustic transducer as reference microphones are respectively obtained.
The sound source signal can also be called as a sound wave signal, in the process of sound wave propagation, due to different distances from the microphone, the first electroacoustic transducer and the second electroacoustic transducer, the time of sound wave reaching the microphone, the first electroacoustic transducer and the second electroacoustic transducer is also different, and the time interval of sound wave reaching the microphone, the first electroacoustic transducer and the second electroacoustic transducer is called time delay.
Because the microphone, the first electroacoustic transducer (left horn) and the second electroacoustic transducer (right horn) are fixed on the earphone, a coordinate system can be constructed based on the earphone, the positions of the microphone, the first electroacoustic transducer and the second electroacoustic transducer in the coordinate system are known quantities, and meanwhile, the distance between each two of the microphone, the first electroacoustic transducer (left horn) and the second electroacoustic transducer (right horn) is also known quantity. And the time interval of the sound source signal reaching any two of the microphone, the first electroacoustic transducer and the second electroacoustic transducer can be calculated by combining the propagation speed of the sound wave in the air.
Specifically, for convenience of description, the microphone, the first electroacoustic transducer and the second electroacoustic transducer are all referred to as microphones and are respectively denoted by M1, M2 and M3. With the microphones M1, M2, and M3 as reference microphones, respectively, the time delay (time interval or) between every two microphones (microphone pair) is obtained, and then three different sets of time delays are obtained. The time delay can be estimated by obtaining the peak offset of the cross-correlation function of the amplitudes of the signals received by the microphones M1, M2, M3, and then according to the sampling frequency of the signals.
Step 404: and obtaining the average time delay according to the three groups of time delays.
And carrying out weighted average according to corresponding time delays in the three groups of acquired time delay data to obtain an average value as average time delay.
Step 406: and carrying out positioning estimation on the position information of the sound source signal according to the average time delay, and acquiring the position information of the sound source signal relative to the earphone.
Based on the average time delay and the known position information of the microphones M1, M2, and M3, the position information of the sound source signal can be further estimated for localization, and the position information of the sound source signal relative to the headphones, that is, the distance information and the orientation information between the sound source signal and the headphones, can be obtained.
In the method in this embodiment, the microphones M1, M2, and M3 are used as reference microphones to calculate the paired time delays with other microphones, and finally, the corresponding time delay pairs in the obtained three sets of data are weighted and averaged to obtain an average value, and the sound source signal is located according to the obtained average value, so that the accuracy of location can be improved.
In one embodiment, acquiring the position information of the sound source signal relative to the earphone according to the time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer for receiving the sound source signal further comprises:
step 4011: detecting whether a valid sound signal is present in the sound source signal.
Due to the existence of the environmental noise, the acquired sound source signal includes a noise component, and an effective sound signal needs to be distinguished from the sound source signal, so that the influence of the noise on the estimation of the time delay is avoided.
The short-time zero crossing rate refers to the frequency of appearance of abnormal values of waveform acquisition values in a certain frame of sound signals, and is lower in a sound signal section, and is higher in a noise or silent signal section. Whether effective sound signals exist in the sound source signals can be determined through a short-time zero-crossing rate detection method.
Optionally, a method of detecting short-time energy may also be used to determine whether the acquired sound source signal is valid.
Step 4013: and when the effective sound signal exists, smoothing and filtering the source sound signal.
When effective sound signals exist in the collected sound source signals, the sound source signals can be subjected to smoothing processing in a windowing and framing mode, wherein framing refers to dividing sound source signal frames into multi-frame signals according to the same time period, so that each frame becomes more stable, and windowing and framing refers to weighting each frame of voice signals by using a window function. In this embodiment, a hamming window function is used with smaller side lobes.
The frequency of the noise signal may be distributed in the whole frequency space, and the filtering refers to a process of performing filtering processing on a signal in a specific frequency band in the sound source signal, and keeping the signal in the specific frequency band to be pulled down so as to attenuate signals in other frequency bands. The sound source signal after the smoothing processing can be clearer through filtering.
Fig. 5 is a flowchart illustrating an operation of reminding a user according to the position information when the sound source signal meets a preset reminding condition in one embodiment. In one embodiment, when the sound source signal meets a preset reminding condition, the operation of reminding the user according to the position information is performed, and the operation includes:
step 502: judging whether the sound source signal comprises a characteristic audio frequency;
when a valid sound signal exists in the sound source signal, the valid sound signal is analyzed, and whether the characteristic audio is included in the sound source signal or not is judged. The characteristic audio includes, but is not limited to, character characteristic audio, time characteristic audio, position characteristic audio, and event characteristic audio.
Specifically, the character characteristic audio may be names, nicknames, etc. of people, companies, which are concerned by the user; the time characteristic audio can be an audio signal comprising numbers, years, months and days; the position characteristic audio can be the country, city, company, home address and the like of the user; the event characteristic audio may be a special warning audio such as a siren, distress, etc.
For example, if the user lie stores "lie four" and "duplet" as the characteristic audio. When a person calls the plum four or the plum, the similarity reaches a set degree, the sound source signal is considered to comprise the characteristic audio, and when the sound source signal comprises the characteristic audio, the sound source signal is considered to accord with a preset reminding condition.
Step 504: and when the sound source signal comprises the characteristic audio, executing operation of reminding a user according to preset reminding content.
And when the sound source signal comprises the characteristic audio, performing operation of reminding the user according to the position information of the sound source signal relative to the earphone and the acquired characteristic audio. Wherein the location information comprises distance information and orientation information.
Specifically, the operation of reminding the user is executed according to the preset reminding content, and the operation comprises the following steps:
calling a mapping relation between the characteristic audio and a preset reminding mode, and determining the preset reminding mode corresponding to the current preset reminding condition; and executing operation of reminding the user according to the determined preset reminding mode.
The feature audio includes, but is not limited to, a character feature audio, a time feature audio, a position feature audio, and an event feature audio, and a corresponding preset reminding mode may be set according to a preset priority of the feature audio. Wherein, the priority is from high to low: event feature audio-the name or nickname of the user himself in the character feature audio-the name of the people, companies, nicknames that the user is interested in the character feature audio-time feature audio-location feature audio.
Specifically, the preset reminding mode comprises a first reminding mode and a second reminding mode, wherein the first reminding mode is earphone reminding, namely, certain specific sound recording played by an earphone is transmitted to ears of a user to remind the user. The second reminding mode is electronic equipment reminding for communicating with the earphone, wherein the electronic equipment reminding mode can be interface display reminding, interface display and ring combination reminding or interface display and vibration combination reminding and the like. Various reminders as will occur to those skilled in the art are included in embodiments of the invention.
According to the priority of the characteristic audio, a preset reminding mode corresponding to the current level can be set, and furthermore, the first reminding mode with high priority can be corresponding to the first reminding mode, and the second reminding mode with low priority can be corresponding to the second reminding mode. For example, when someone calls "lie four" or "little lie", the user can be reminded by the earphone in combination with the characteristic audio and the position information, and the reminding content is "call for someone at the left rear 1 m", so that the user can be reminded to talk with someone in time; when a whistle is generated, the earphone reminding can be performed on the user by combining the characteristic audio and the position information, the reminding content is that a vehicle is in the rear 3 meters at the right side, the user can be timely reminded of paying attention to safety in a visual angle blind area, and the safety vigilance of the user is improved; when a user discusses the 'OPPO mobile phone', the user can be reminded of the interface display of the electronic equipment by combining the characteristic audio and the position information, wherein the reminding content is 'front 1 m, OPPO and OPPO', so that the user is reminded that the user discusses the 'OPPO' in front 1 m, and if the user is interested in the 'OPPO', the user can stay for half a moment to obtain related information and the like.
According to the sound processing method, when the sound source signal meets the preset reminding condition, the user can be automatically reminded according to the characteristic audio and the position information of the sound source signal and the preset reminding mode, so that the user can timely and correctly process the sound source signal, and important or urgent situations are avoided.
Fig. 6 is a flowchart illustrating an operation of reminding a user according to the position information when the sound source signal meets a preset reminding condition in another embodiment. In one embodiment, when the sound source signal meets a preset reminding condition, an operation of reminding a user is executed according to the position information, and the operation includes:
step 602: and judging whether the sound source signal comprises characteristic audio.
Step 604: and when the characteristic audio is included in the sound source signal, inquiring whether the user continuously records the sound source signal.
When the characteristic audio is included in the sound source signal, the user is asked whether to continuously record the sound source signal. The method for inquiring whether the user continuously records the sound source signal can be an inquiry in a mode of playing voice through an earphone; the user may also be asked whether to record the sound source signal continuously through a display interface of the electronic device in communication with the headset, and the display form of the display interface is not limited herein.
Receiving a response instruction of the user on whether to continuously record the sound source signal, and executing step 606 when the response instruction output by the user is yes: and selecting and controlling the microphone, the first electroacoustic transducer or the second electroacoustic transducer to continuously acquire the sound source signal and marking the sound source signal.
Specifically, when the current headset is in a scene of listening to music, the microphone may be controlled to continuously collect a sound source signal until the headset leaves the sound source signal, where leaving the sound source signal means that the distance information in the position information is greater than a preset value. When the front earphone is in a call scene, the first electroacoustic transducer or the second electroacoustic transducer can be controlled to continuously collect the sound source signal until the earphone leaves the sound source signal. Meanwhile, the continuously collected sound source signals are marked and stored, so that the sound source signals can be conveniently played repeatedly by a user, and information concerned or important by the user can be extracted.
Receiving a response instruction of the user on whether to continuously record the sound source signal, and executing step 606: and executing operation of reminding a user according to the position information, and deleting the sound source signal. And executing operation for reminding the user according to the acquired position information, and deleting the acquired sound source signal so as to release the storage space.
Fig. 7 is a flowchart of a sound signal processing method in another embodiment. In one embodiment, the method further comprises:
step 702: when the earphone is in a playing state, synchronously acquiring a sound source signal based on a microphone, a first electroacoustic transducer and a second electroacoustic transducer;
step 704: acquiring position information of the sound source signal relative to the earphone according to the time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer for receiving the sound source signal;
step 706: when the sound source signal meets a preset reminding condition, executing operation of reminding a user according to the position information;
the steps 702-706 correspond to the steps 302-306 in the previous embodiment one by one, and are not described again.
Step 708: determining geographical location information of the sound source signal based on the current geographical location information of the headset and the location information.
When the earphone is in a playing state, the current geographical position information of the electronic equipment communicating with the earphone can be acquired, and the current geographical position information of the electronic equipment can be used as the geographical position information of the earphone. The geographical position information of the earphone can be acquired through a GPS positioning module built in the electronic equipment. According to the geographical position information of the earphone and the position information of the sound source signal relative to the earphone, the geographical position information of the sound source signal can be obtained.
Step 710: and generating a target sound source file according to the sound source signal and the geographical position information of the sound source signal.
And binding the acquired sound source signal with the geographical position information of the sound source signal to generate a target sound source file. Furthermore, the target sound source file can also carry time information for collecting the sound source signals, so that the location and time information of the target sound source file can be obtained in time, and the sound source signals can be abundantly displayed.
Step 712: and receiving an operation instruction of a user, and playing the target sound source file.
And receiving an operation instruction of a user, wherein the operation instruction can be received by the earphone or an electronic device which communicates with the earphone. When the earphone receives the operation instruction, the operation instruction of the user can be received through a physical key of the earphone, and the operation instruction of the user can also be received through a touch panel preset on the earphone. Of course, the user may input an operation instruction on the electronic device communicating with the headset. Here, the object to receive the user operation command is not limited, and the input method of the operation command is not further limited.
When the operation instruction is received, a target sound source file can be played, wherein the target sound source file comprises the geographical position information for collecting the sound source signal and even comprises the time information for collecting the sound source signal. When the user plays the target sound source file again, the location of the sound source signal can be known, so that the user can remember the voice. Meanwhile, when the earphone is used, the user can acquire the external condition through the recorded target file, and the user can know the external conversation content without repeatedly wearing the earphone, so that the user can avoid missing important information.
It should be understood that although the various steps in the flow charts of fig. 1-7 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 1-7 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.
Fig. 8 is a block diagram of a sound signal processing apparatus according to an embodiment. An apparatus for processing a sound signal, the apparatus comprising:
a sound source obtaining module 810, configured to obtain a sound source signal collected based on a microphone, a first electroacoustic transducer, and a second electroacoustic transducer when the earphone is in a playing state;
a position obtaining module 820, configured to obtain position information of the sound source signal relative to the earphone according to a time delay of the microphone, the first electroacoustic transducer, and the second electroacoustic transducer receiving the sound source signal;
and the reminding module 830 is configured to execute an operation of reminding a user according to the position information when the sound source signal meets a preset reminding condition.
The sound signal processing device may be provided in an earphone or in an electronic apparatus.
When the earphone is in a playing state, the sound signal processing device can acquire sound source signals acquired by a microphone, the first electroacoustic transducer and the second electroacoustic transducer; acquiring position information of the sound source signal relative to the earphone according to the time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer for receiving the sound source signal; when the sound source signal accords with the preset reminding condition, the operation of reminding the user is executed according to the position information, the sound source signal can be positioned only by utilizing the inherent device of the earphone, the structure of the earphone is simplified, the cost is saved, meanwhile, when the sound source signal accords with the preset reminding condition, the user can be automatically reminded according to the position information of the sound source signal relative to the earphone, the user can timely make correct processing on the sound source signal, and the missing of important or urgent events is avoided.
In one embodiment, the location acquisition module includes:
a first acquisition unit for respectively acquiring three sets of time delays with a microphone, a first electroacoustic transducer and a second electroacoustic transducer as reference microphones;
a second obtaining unit, configured to obtain an average time delay according to the three groups of time delays;
and the third acquisition unit is used for carrying out positioning estimation on the position information of the sound source signal according to the average time delay and acquiring the position information of the sound source signal relative to the earphone.
The sound information processing apparatus in the present embodiment can improve the accuracy of positioning a sound source signal.
In one embodiment, the location acquisition module further comprises:
a detection unit for detecting whether a valid sound signal exists in the sound source signal;
and the processing unit is used for smoothing and filtering the source sound signal when an effective sound signal exists.
In one embodiment, the reminder module includes:
the judging unit is used for judging whether the sound source signal comprises characteristic audio or not;
and the reminding unit is used for executing the operation of reminding the user according to preset reminding content when the sound source signal comprises the characteristic audio, wherein the preset reminding content comprises the characteristic audio and the position information.
In one embodiment, the reminding unit is further configured to call a mapping relationship between the characteristic audio and a preset reminding mode, and determine the preset reminding mode corresponding to the current preset reminding condition;
and executing operation of reminding the user according to the determined preset reminding mode.
The sound processing device of the embodiment can automatically remind a user according to the characteristic audio and the position information of the sound source signal and the preset reminding mode when the sound source signal meets the preset reminding condition, so that the user can timely and correctly process the sound source signal, and important or urgent situations are avoided being missed.
In one embodiment, the reminder module further includes:
the inquiring unit is used for inquiring whether the user continuously records the sound source signal when the sound source signal comprises the characteristic audio;
and the control unit is used for selecting and controlling the microphone, the first electroacoustic transducer or the second electroacoustic transducer to continuously acquire the sound source signal and marking the sound source signal.
When the earphone is in a scene of listening to music, the microphone can be controlled to continuously collect the sound source signal until the earphone leaves the sound source signal, wherein the leaving of the sound source signal means that the distance information in the position information is larger than a preset value. When the front earphone is in a call scene, the first electroacoustic transducer or the second electroacoustic transducer can be controlled to continuously collect the sound source signal until the earphone leaves the sound source signal. Meanwhile, the continuously collected sound source signals are marked and stored, so that the sound source signals can be conveniently played repeatedly by a user, and information concerned or important by the user can be extracted.
In one embodiment, the sound signal processing apparatus further comprises:
a determining module, configured to determine geographical location information of the sound source signal based on the current geographical location information of the headset and the location information;
the generating module is used for generating a target sound source file according to the sound source signal and the geographical position information of the sound source signal;
and the playing module is used for receiving an operation instruction of a user and playing the target sound source file.
In the apparatus in this embodiment, when receiving the operation instruction, a target sound source file may be played, where the target sound source file includes geographical location information for acquiring the sound source signal, and even includes time information for acquiring the sound source signal. When the user plays the target sound source file again, the location of the sound source signal can be known, so that the user can remember the voice. Meanwhile, when the earphone is used, the user can acquire the external condition through the recorded target file, and the user can know the external conversation content without repeatedly wearing the earphone, so that the user can avoid missing important information.
The division of each module in the sound signal processing apparatus is only for illustration, and in other embodiments, the sound signal processing apparatus may be divided into different modules as needed to complete all or part of the functions of the sound signal processing apparatus.
For the specific definition of the sound signal processing apparatus, reference may be made to the above definition of the sound signal processing method, which is not described herein again. The respective modules in the sound signal processing apparatus may be wholly or partially implemented by software, hardware, and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
The implementation of each module in the sound signal processing apparatus provided in the embodiments of the present application may be in the form of a computer program. The computer program may be run on an electronic device or a server. The program modules constituting the computer program may be stored on a memory of the electronic device or the server. Which when executed by a processor, performs the steps of the method described in the embodiments of the present application.
The embodiment of the present application further provides an earphone, where the earphone includes the sound signal processing apparatus provided in the above technical solution, and for specific limitations of the sound signal processing apparatus, reference may be made to the above limitations on the sound signal processing method, and details are not described here again.
The embodiment of the application also provides a computer readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform the steps of the sound signal processing method.
A computer program product comprising instructions which, when run on a computer, cause the computer to perform a sound signal processing method.
The embodiment of the application also provides the electronic equipment. As shown in fig. 9, for convenience of explanation, only the parts related to the embodiments of the present application are shown, and details of the technology are not disclosed, please refer to the method part of the embodiments of the present application. The electronic device may be any electronic device including a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), a POS (Point of Sales, electronic device), a vehicle-mounted computer, a wearable device, and the like, taking the electronic device as the mobile phone as an example:
fig. 9 is a block diagram of a partial structure of a mobile phone related to an electronic device provided in an embodiment of the present application. Referring to fig. 9, the handset includes: radio Frequency (RF) circuit 910, memory 920, input unit 930, display unit 940, sensor 950, audio circuit 960, wireless fidelity (WiFi) module 970, processor 980, and power supply 990. Those skilled in the art will appreciate that the handset configuration shown in fig. 9 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The RF circuit 910 may be used for receiving and transmitting signals during information transmission or communication, and may receive downlink information of a base station and then process the downlink information to the processor 980; the uplink data may also be transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 910 may also communicate with networks and other devices via wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to Global System for mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE)), e-mail, Short Messaging Service (SMS), and the like.
The memory 920 may be used to store software programs and modules, and the processor 980 may execute various functional applications and data processing of the mobile phone by operating the software programs and modules stored in the memory 920. The memory 920 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function (such as an application program for a sound playing function, an application program for an image playing function, and the like), and the like; the data storage area may store data (such as audio data, an address book, etc.) created according to the use of the mobile phone, and the like. Further, the memory 920 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The input unit 930 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the cellular phone 900. Specifically, the input unit 930 may include an operation panel 931 and other input devices 932. The operation panel 931, which may also be referred to as a touch screen, may collect a touch operation performed by a user on or near the operation panel 931 (for example, an operation performed by the user on the operation panel 931 or near the operation panel 931 using any suitable object or accessory such as a finger or a stylus pen), and drive the corresponding connection device according to a preset program. In one embodiment, the operation panel 931 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 980, and can receive and execute commands sent by the processor 980. In addition, the operation panel 931 may be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. The input unit 930 may include other input devices 932 in addition to the operation panel 931. In particular, other input devices 932 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), and the like.
The display unit 940 may be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 940 may include a display panel 941. In one embodiment, the Display panel 941 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. In one embodiment, the operation panel 931 may cover the display panel 941, and when the operation panel 931 detects a touch operation on or near the operation panel, the operation panel is transmitted to the processor 980 to determine the type of the touch event, and then the processor 980 provides a corresponding visual output on the display panel 941 according to the type of the touch event. Although in fig. 9, the operation panel 931 and the display panel 941 are two independent components to implement the input and output functions of the mobile phone, in some embodiments, the operation panel 931 and the display panel 941 may be integrated to implement the input and output functions of the mobile phone.
WiFi belongs to short-distance wireless transmission technology, and the mobile phone can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 970, and provides wireless broadband Internet access for the user. Although fig. 9 shows WiFi module 970, it is to be understood that it does not belong to the essential components of cell phone 900 and may be omitted as desired.
The processor 980 is a control center of the mobile phone, connects various parts of the entire mobile phone using various interfaces and lines, and performs various functions of the mobile phone and processes data by operating or executing software programs and/or modules stored in the memory 920 and calling data stored in the memory 920, thereby performing an overall listening to the mobile phone. In one embodiment, processor 980 may include one or more processing units. In one embodiment, the processor 980 may integrate an application processor and a modem, wherein the application processor primarily handles operating systems, user interfaces, applications, and the like; the modem handles primarily wireless communications. It is to be appreciated that the modem may not be integrated into the processor 980. For example, the processor 980 may integrate an application processor and a baseband processor, which may constitute a modem with other peripheral chips, etc. The handset 900 also includes a power supply 990 (e.g., a battery) for supplying power to various components, which may preferably be logically connected to the processor 980 via a power management system, such that the power management system may be used to manage charging, discharging, and power consumption.
In one embodiment, the cell phone 900 may also include a camera, a bluetooth module, and the like.
In the embodiment of the present application, the processor included in the mobile phone implements the sound signal processing method described above when executing the computer program stored on the memory.
The embodiment of the present application further provides an earphone, which includes a microphone, a first electroacoustic transducer, a second electroacoustic transducer, a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor is electrically connected to the microphone, the first electroacoustic transducer, the second electroacoustic transducer, and the memory, respectively, and when the processor executes the computer program, the above-described sound signal processing method is implemented.
In one embodiment, the microphone is used to collect a sound source signal; the first electroacoustic transducer is used for collecting the sound source signal and playing the audio signal output by the earphone; the second electroacoustic transducer is used for collecting the sound source signal and playing the audio signal output by the earphone.
Specifically, the microphone, the first electroacoustic transducer and the second electroacoustic transducer synchronously acquire the sound source signal.
Any reference to memory, storage, database, or other medium used herein may include non-volatile and/or volatile memory. Suitable non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and bus dynamic RAM (RDRAM).
The above examples only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A sound signal processing method, the method being based on an earphone comprising a microphone, a first electroacoustic transducer and a second electroacoustic transducer, the method comprising:
when the earphone is in a playing state, acquiring sound source signals acquired based on the microphone, the first electroacoustic transducer and the second electroacoustic transducer;
acquiring position information of the sound source signal relative to the earphone according to the time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer for receiving the sound source signal;
when the sound source signal meets a preset reminding condition, executing operation of reminding a user according to the position information;
the acquiring position information of the sound source signal relative to the earphone according to the time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer for receiving the sound source signal includes:
respectively acquiring three groups of time delays for receiving a current frame sound source signal by taking a microphone, a first electroacoustic transducer and a second electroacoustic transducer as reference microphones;
obtaining an average time delay according to the three groups of time delays;
carrying out positioning estimation on the position information of the sound source signal according to the average time delay, and acquiring the position information of the sound source signal relative to the earphone;
the method further comprises the following steps:
determining geographical position information of the sound source signal based on the geographical position information of the earphone and the position information;
generating a target sound source file according to the sound source signal and the geographical position information of the sound source signal;
receiving an operation instruction of a user, and playing the target sound source file;
when the sound source signal meets the preset reminding condition, the operation of reminding the user is executed according to the position information, and the operation comprises the following steps:
judging whether the sound source signal comprises a characteristic audio frequency; the characteristic audio comprises one or more of character characteristic audio, time characteristic audio, position characteristic audio and event characteristic audio;
when the sound source signal comprises the characteristic audio, executing operation of reminding a user according to preset reminding content, wherein the preset reminding content comprises the characteristic audio and position information;
the operation of reminding the user according to the preset reminding content comprises the following steps:
presetting the priority of the characteristic audio; the priority is from high to low: event characteristic audio, character characteristic audio, time characteristic, position characteristic audio;
setting a reminding mode of a preset reminding mode corresponding to the current level according to the priority of the characteristic audio;
calling a mapping relation between the priority of the characteristic audio and a preset reminding mode, and determining the preset reminding mode corresponding to the current preset reminding condition; the reminding mode comprises a first reminding mode and a second reminding mode, the first reminding mode is earphone reminding, the second reminding mode is electronic equipment reminding communicating with the earphone, and the electronic equipment reminding comprises interface display reminding, interface display and ring combination reminding or interface display and vibration combination reminding;
and executing operation of reminding the user according to the determined preset reminding mode.
2. The method of claim 1, wherein the obtaining three sets of time delays before receiving the current frame sound source signal with the microphone, the first electro-acoustic transducer and the second electro-acoustic transducer as reference microphones, respectively, further comprises:
detecting whether a valid sound signal exists in the sound source signal;
and when the effective sound signal exists, smoothing and filtering the sound source signal.
3. The method of claim 1, further comprising:
when the characteristic audio is included in the sound source signal, inquiring whether a user continuously records the sound source signal;
if so, selecting to control the microphone, the first electroacoustic transducer or the second electroacoustic transducer to continuously acquire the sound source signal, and marking the sound source signal;
if not, the operation of reminding the user is executed according to the position information, and the sound source signal is deleted.
4. A sound signal processing apparatus, the apparatus being based on an earphone comprising a microphone, a first electroacoustic transducer and a second electroacoustic transducer, the apparatus comprising:
the earphone comprises a sound source acquisition module, a first electro-acoustic transducer and a second electro-acoustic transducer, wherein the sound source acquisition module is used for acquiring sound source signals acquired by the microphone, the first electro-acoustic transducer and the second electro-acoustic transducer when the earphone is in a playing state;
the position acquisition module is used for acquiring the position information of the sound source signal relative to the earphone according to the time delay of the microphone, the first electroacoustic transducer and the second electroacoustic transducer for receiving the sound source signal;
the reminding module is used for executing operation of reminding a user according to the position information when the sound source signal meets a preset reminding condition;
the position acquisition module further includes:
a first acquisition unit, configured to respectively acquire three groups of time delays for receiving a current frame sound source signal by using a microphone, a first electroacoustic transducer and a second electroacoustic transducer as reference microphones;
a second obtaining unit, configured to obtain an average time delay according to the three groups of time delays;
a third obtaining unit, configured to perform positioning estimation on the position information of the sound source signal according to the average time delay, and obtain position information of the sound source signal relative to the earphone;
further comprising:
a determining module, configured to determine geographical location information of the sound source signal based on the current geographical location information of the headset and the location information;
the generating module is used for generating a target sound source file according to the sound source signal and the geographical position information of the sound source signal;
the playing module is used for receiving an operation instruction of a user and playing the target sound source file;
the reminding module comprises:
the judging unit is used for judging whether the sound source signal comprises characteristic audio or not; the characteristic audio comprises one or more of character characteristic audio, time characteristic audio, position characteristic audio and event characteristic audio;
the reminding unit is used for executing operation of reminding a user according to preset reminding content when the sound source signal comprises the characteristic audio, wherein the preset reminding content comprises the characteristic audio and the position information;
the reminding unit is also used for presetting the priority of the characteristic audio; the priority is from high to low: event characteristic audio, character characteristic audio, time characteristic, position characteristic audio; setting a reminding mode of a preset reminding mode corresponding to the current level according to the priority of the characteristic audio; calling a mapping relation between the priority of the characteristic audio and a preset reminding mode, and determining the preset reminding mode corresponding to the current preset reminding condition; executing operation of reminding the user according to the determined preset reminding mode; the reminding mode comprises a first reminding mode and a second reminding mode, the first reminding mode is earphone reminding, the second reminding mode is electronic equipment reminding communicating with the earphone, and the electronic equipment reminding comprises interface display reminding, interface display and ringtone combination reminding or interface display and vibration combination reminding.
5. The apparatus of claim 4, wherein the location acquisition module further comprises:
a detection unit for detecting whether a valid sound signal exists in the sound source signal;
and the processing unit is used for smoothing and filtering the sound source signal when an effective sound signal exists.
6. The apparatus of claim 4, wherein the reminder module further comprises:
the inquiring unit is used for inquiring whether the user continuously records the sound source signal when the sound source signal comprises the characteristic audio;
the control unit is used for selecting and controlling the microphone, the first electroacoustic transducer or the second electroacoustic transducer to continuously acquire the sound source signal and marking the sound source signal if the sound source signal is continuously recorded; if not, the operation of reminding the user is executed according to the position information, and the sound source signal is deleted.
7. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 3.
8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 3 are implemented when the computer program is executed by the processor.
9. An earphone comprising a microphone, a first electroacoustic transducer, a second electroacoustic transducer, a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor is electrically connected to the microphone, the first electroacoustic transducer, the second electroacoustic transducer, and the memory, respectively, to implement the steps of the method of any of claims 1 to 3 when the processor executes the computer program.
10. The headset of claim 9, wherein the microphone is configured to collect a sound source signal; the first electroacoustic transducer is used for collecting the sound source signal and playing the audio signal output by the earphone; the second electroacoustic transducer is used for collecting the sound source signal and playing the audio signal output by the earphone.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810276532.6A CN108600885B (en) | 2018-03-30 | 2018-03-30 | Sound signal processing method and related product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810276532.6A CN108600885B (en) | 2018-03-30 | 2018-03-30 | Sound signal processing method and related product |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108600885A CN108600885A (en) | 2018-09-28 |
| CN108600885B true CN108600885B (en) | 2020-05-22 |
Family
ID=63624027
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810276532.6A Expired - Fee Related CN108600885B (en) | 2018-03-30 | 2018-03-30 | Sound signal processing method and related product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108600885B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108540661A (en) * | 2018-03-30 | 2018-09-14 | 广东欧珀移动通信有限公司 | Signal processing method, device, terminal, earphone and readable storage medium storing program for executing |
| CN108521621B (en) | 2018-03-30 | 2020-01-10 | Oppo广东移动通信有限公司 | Signal processing method, device, terminal, earphone and readable storage medium |
| CN109413556B (en) * | 2018-09-30 | 2021-03-02 | Oppo广东移动通信有限公司 | Equipment positioning method and device, earphone device and electronic equipment |
| US11514777B2 (en) | 2018-10-02 | 2022-11-29 | Sonos, Inc. | Methods and devices for transferring data using sound signals |
| CN111326159B (en) * | 2020-03-10 | 2023-07-25 | 苏宁云计算有限公司 | Voice recognition method, device and system |
| CN113571086B (en) * | 2020-04-28 | 2022-07-08 | 阿里巴巴集团控股有限公司 | Sound signal processing method and device, electronic equipment and readable storage medium |
| CN113905302B (en) * | 2021-10-11 | 2023-05-16 | Oppo广东移动通信有限公司 | Method and device for triggering prompt message and earphone |
| CN114189790B (en) * | 2021-10-26 | 2022-11-29 | 北京荣耀终端有限公司 | Audio information processing method, electronic device, system, product and medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8254591B2 (en) * | 2007-02-01 | 2012-08-28 | Personics Holdings Inc. | Method and device for audio recording |
| CN103686574A (en) * | 2013-12-12 | 2014-03-26 | 苏州市峰之火数码科技有限公司 | Stereophonic electronic hearing-aid |
| CN207039828U (en) * | 2017-05-22 | 2018-02-23 | 郭长勇 | A kind of earphone with source of sound identification and positioning |
| CN107682772B (en) * | 2017-10-25 | 2019-05-24 | 倬韵科技（深圳）有限公司 | A kind of hazard recognition is to control the method, apparatus and earphone of audio output |
-
2018
- 2018-03-30 CN CN201810276532.6A patent/CN108600885B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN108600885A (en) | 2018-09-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108600885B (en) | Sound signal processing method and related product | |
| EP3547712B1 (en) | Method for processing signals, terminal device, and non-transitory readable storage medium | |
| CN108430003B (en) | Sound effect compensation method and device, readable storage medium and terminal | |
| CN108521621B (en) | Signal processing method, device, terminal, earphone and readable storage medium | |
| US10482871B2 (en) | Method for processing signals, terminal device, and non-transitory computer-readable storage medium | |
| CN108538320B (en) | Recording control method and device, readable storage medium and terminal | |
| CN108519871B (en) | Audio signal processing method and related product | |
| CN108391205B (en) | Left and right channel switching method and device, readable storage medium and terminal | |
| CN108922537B (en) | Audio recognition method, device, terminal, earphone and readable storage medium | |
| CN108668009B (en) | Input operation control method, device, terminal, earphone and readable storage medium | |
| CN108540900B (en) | Volume adjusting method and related product | |
| CN108763901B (en) | Ear print information acquisition method and device, terminal, earphone and readable storage medium | |
| CN108881568B (en) | Method and device for sounding display screen, electronic device and storage medium | |
| CN108429969B (en) | Audio frequency playing method, device, terminal, earphone and readable storage medium storing program for executing | |
| CN108763978B (en) | Information prompting method, device, terminal, earphone and readable storage medium | |
| CN108540660B (en) | Voice signal processing method and device, readable storage medium and terminal | |
| CN108810198B (en) | Sound production control method and device, electronic device and computer readable medium | |
| CN114189790B (en) | Audio information processing method, electronic device, system, product and medium | |
| CN108810764B (en) | Sound production control method and device and electronic device | |
| CN109088980A (en) | Sounding control method, device, electronic device and computer-readable medium | |
| CN108769364A (en) | Call control method, device, mobile terminal and computer-readable medium | |
| CN108810787B (en) | Foreign matter detection method and device based on audio equipment and terminal | |
| CN108391208B (en) | Signal switching method, device, terminal, earphone and computer readable storage medium | |
| CN109144462B (en) | Sound production control method and device, electronic device and computer readable medium | |
| CN108551648B (en) | Quality detection method and device, readable storage medium and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200522 |