CN108600885A - Audio signal processing method and Related product - Google Patents
Audio signal processing method and Related product Download PDFInfo
- Publication number
- CN108600885A CN108600885A CN201810276532.6A CN201810276532A CN108600885A CN 108600885 A CN108600885 A CN 108600885A CN 201810276532 A CN201810276532 A CN 201810276532A CN 108600885 A CN108600885 A CN 108600885A
- Authority
- CN
- China
- Prior art keywords
- sound
- source signal
- electroacoustic transducer
- earphone
- microphone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005236 sound signal Effects 0.000 title claims abstract description 51
- 238000003672 processing method Methods 0.000 title claims abstract description 30
- 238000012545 processing Methods 0.000 claims abstract description 34
- 238000000034 method Methods 0.000 claims abstract description 25
- 238000004590 computer program Methods 0.000 claims description 22
- 230000001934 delay Effects 0.000 claims description 8
- 230000026683 transduction Effects 0.000 claims description 4
- 238000010361 transduction Methods 0.000 claims description 4
- 238000013507 mapping Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 9
- 230000006854 communication Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 7
- 230000002123 temporal effect Effects 0.000 description 7
- DWDGSKGGUZPXMQ-UHFFFAOYSA-N OPPO Chemical compound OPPO DWDGSKGGUZPXMQ-UHFFFAOYSA-N 0.000 description 5
- 238000004891 communication Methods 0.000 description 5
- 230000004044 response Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 4
- 230000005611 electricity Effects 0.000 description 3
- 238000009432 framing Methods 0.000 description 3
- 230000033001 locomotion Effects 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005314 correlation function Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 238000012905 input function Methods 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241000209140 Triticum Species 0.000 description 1
- 235000021307 Triticum Nutrition 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005674 electromagnetic induction Effects 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- ZRHANBBTXQZFSP-UHFFFAOYSA-M potassium;4-amino-3,5,6-trichloropyridine-2-carboxylate Chemical group [K+].NC1=C(Cl)C(Cl)=NC(C([O-])=O)=C1Cl ZRHANBBTXQZFSP-UHFFFAOYSA-M 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1041—Mechanical or electronic switches, or control elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
- H04R2430/03—Synergistic effects of band splitting and sub-band processing
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Telephone Function (AREA)
- Headphones And Earphones (AREA)
Abstract
This application involves a kind of audio signal processing methods and device, computer readable storage medium, electronic equipment, earphone.This method includes：When earphone is in broadcast state, the sound-source signal acquired based on microphone, the first electroacoustic transducer and the second electroacoustic transducer is obtained；The time delay of sound-source signal is received according to microphone, the first electroacoustic transducer and the second electroacoustic transducer, obtains location information of the sound-source signal relative to earphone；When sound-source signal meets default alert condition, the operation for reminding user is executed according to location information, the positioning to sound-source signal can be realized merely with the intrinsic device of earphone, it simplifies the structure of earphone, saved cost, meanwhile when sound-source signal meets default alert condition, location information automatically prompting user that can be according to sound-source signal relative to earphone, so that user is made correct processing in time to sound-source signal, avoids missing important or urgent thing.
Description
Technical field
This application involves Audiotechnica fields, can more particularly to a kind of audio signal processing method and device, computer
Read storage medium, electronic equipment, earphone.
Background technology
With the development of the communication technology, electronic equipment (mobile phone, tablet computer etc.) incorporates in people's life closely, greatly
Improve people’s lives greatly.
When user puts on the sound that earphone listening electronic equipment plays, the sense of hearing as auxiliary visual perception is because of earphone broadcasting
Sound be greatly limited, user hardly notices external sound-source signal, earphone can not be utilized to the sound-source signal
It is positioned, and makes response properly and timely.
Invention content
A kind of audio signal processing method of the embodiment of the present application offer and device, computer readable storage medium, electronics are set
It is standby, the location information and automatically prompting user of sound-source signal can be obtained based on earphone, improve user experience.
A kind of audio signal processing method, the method are based on including microphone, the first electroacoustic transducer and the second electroacoustic
The earphone of energy converter, wherein first electroacoustic transducer and the second electroacoustic transducer are for playing and recording audio signal, institute
The method of stating includes：
When the earphone is in broadcast state, obtains and be based on microphone, the first electroacoustic transducer and the second electroacoustic transduction
The sound-source signal of device acquisition；
The time that the sound-source signal is received according to the microphone, the first electroacoustic transducer and the second electroacoustic transducer prolongs
Late, location information of the sound-source signal relative to the earphone is obtained；
When the sound-source signal meets default alert condition, the operation for reminding user is executed according to the positional information.
A kind of audio-signal processing apparatus, described device are based on including microphone, the first electroacoustic transducer and the second electroacoustic
The earphone of energy converter, described device include：
Acquisition module, for when the earphone be in broadcast state, obtain be based on microphone, the first electroacoustic transducer and
The sound-source signal of second electroacoustic transducer acquisition；
Acquisition module, for receiving the sound according to the microphone, the first electroacoustic transducer and the second electroacoustic transducer
The time delay of source signal obtains location information of the sound-source signal relative to the earphone；
Reminding module, for when the sound-source signal meets default alert condition, executing carry according to the positional information
The operation of awake user.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor
The step of audio signal processing method in each embodiment of the application is realized when row.
A kind of electronic equipment, including memory, processor and storage are on a memory and the meter that can run on a processor
Calculation machine program, which is characterized in that the processor realizes the sound in each embodiment of the application when executing the computer program
The step of signal processing method.
A kind of earphone, including microphone, the first electroacoustic transducer, the second electroacoustic transducer, memory, processor and storage
On a memory and the computer program that can run on a processor, the processor respectively with the microphone, the first electroacoustic
Energy converter, the second electroacoustic transducer, memory electrical connection, the processor realize that the application is each when executing the computer program
The step of audio signal processing method in a embodiment.
Audio signal processing method and device provided by the embodiments of the present application, computer readable storage medium, electronic equipment,
Earphone can be obtained when the earphone is in broadcast state based on microphone, the first electroacoustic transducer and the second electroacoustic transduction
The sound-source signal of device acquisition；The sound source letter is received according to the microphone, the first electroacoustic transducer and the second electroacoustic transducer
Number time delay, obtain location information of the sound-source signal relative to the earphone；When the sound-source signal meet it is default
When alert condition, the operation for reminding user is executed according to the positional information, can be realized merely with the intrinsic device of earphone
Positioning to sound-source signal simplifies the structure of earphone, has saved cost, meanwhile, when sound-source signal meets default alert condition
When, location information automatically prompting user that can be according to sound-source signal relative to earphone makes user make sound-source signal in time
Correctly processing, avoids missing important or urgent thing.
Description of the drawings
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of application for those of ordinary skill in the art without creative efforts, can be with
Obtain other attached drawings according to these attached drawings.
Fig. 1 is the application environment schematic diagram of audio signal processing method in one embodiment；
Fig. 2 is the internal structure schematic diagram of electronic equipment in one embodiment；
Fig. 3 is the flow chart of audio signal processing method in one embodiment；
Fig. 4 in one embodiment according to the microphone, the first electroacoustic transducer and the second electroacoustic transducer receive institute
The time delay for stating sound-source signal obtains flow chart of the sound-source signal relative to the location information of the earphone；
Fig. 5 be one embodiment in when the sound-source signal meets default alert condition, hold according to the positional information
Row reminds the flow chart of the operation of user；
Fig. 6 is in another embodiment when the sound-source signal meets default alert condition, according to the positional information
Execute the flow chart for reminding the operation of user；
Fig. 7 is the flow chart of audio signal processing method in another embodiment；
Fig. 8 is the structure diagram of audio-signal processing apparatus in one embodiment；
Fig. 9 is the block diagram with the part-structure of the relevant mobile phone of electronic equipment provided by the embodiments of the present application.
Specific implementation mode
It is with reference to the accompanying drawings and embodiments, right in order to make the object, technical solution and advantage of the application be more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, and
It is not used in restriction the application.
It is appreciated that term " first " used in the present invention, " second " etc. can be used to describe herein various elements,
But these elements should not be limited by these terms.These terms are only used to distinguish first element and another element.Citing comes
It says, without departing from the scope of the invention, first acquisition unit can be known as to second acquisition unit, and similarly,
Second acquisition unit can be known as first acquisition unit.First acquisition unit and second acquisition unit both acquiring unit,
But it is not same acquiring unit.
Fig. 1 is the application environment schematic diagram of audio signal processing method in one embodiment.As shown in Figure 1, this applies ring
Border includes electronic equipment 110 and the earphone 120 that is communicated with the electronic equipment 110.
Wherein, the type of earphone 120 can be In-Ear Headphones, PlayGear Stealth, headphone, clip-on type earphone
Deng.Electronic equipment can be communicated with earphone 120 by wired or wireless mode, realize the transmission of data.Earphone 120 wraps
Microphone, left horn and right horn are included, wherein left horn and right horn can be substituted with electroacoustic transducer, had acquisition and played
The function of audio signal.
Fig. 2 is the internal structure schematic diagram of electronic equipment in one embodiment.The electronic equipment 110 includes total by system
Processor, memory and the display screen of line connection.Wherein, which supports entire electricity for providing calculating and control ability
The operation of sub- equipment 110.Memory for storing data, program, and/or instruction code etc., stored on memory at least one
Computer program, the computer program can be executed by processor, to realize that is provided in the embodiment of the present application sets suitable for electronics
Standby 110 acoustic signal processing method.Memory may include magnetic disc, CD, read-only memory (Read-Only
Memory, ROM) etc. non-volatile memory mediums or random access memory (Random-Access-Memory, RAM) etc..Example
Such as, in one embodiment, memory includes non-volatile memory medium and built-in storage.Non-volatile memory medium is stored with
Operating system, database and computer program.One provided for realizing above each embodiment is provided in the database
The kind relevant data of acoustic signal processing method.The computer program can be performed by processor, for realizing that the application is each
A kind of acoustic signal processing method that a embodiment is provided.Built-in storage be non-volatile memory medium in operating system,
Database and computer program provide the running environment of cache.Display screen can be touch screen, for example be capacitance plate or electricity
Son screen, the interface information for showing electronic equipment 110, display screen include bright screen state and screen state of going out.The electronic equipment 110
Can be mobile phone, tablet computer or personal digital assistant or Wearable etc..
It will be understood by those skilled in the art that structure shown in Figure 2, is only tied with the relevant part of application scheme
The block diagram of structure does not constitute the restriction for the electronic equipment 110 being applied thereon to application scheme, specific electronic equipment
110 may include either combining certain components or with different component cloth than more or fewer components as shown in the figure
It sets.
Fig. 3 is the flow chart of audio signal processing method in one embodiment.Sound signal processing side in the present embodiment
Method is described for running on the electronic equipment in Fig. 1 or earphone.A kind of audio signal processing method, the method
Based on the earphone including microphone, the first electroacoustic transducer and the second electroacoustic transducer, wherein first electroacoustic transducer and
Second electroacoustic transducer is for playing and recording audio signal.As shown in figure 3, audio signal processing method include step 302 to
Step 306.
Step 302：When the earphone is in broadcast state, obtain based on microphone, the first electroacoustic transducer and second
The sound-source signal of electroacoustic transducer acquisition.
Earphone can be communicated by wired or wireless mode with electronic equipment, when earphone is in broadcast state,
User can be conversed using earphone, listen song or listen to storytelling.Wherein, broadcast state can be understood as earphone and be in work shape
State, and be worn on the ear of user.
Earphone includes microphone, the first electroacoustic transducer and the second electroacoustic transducer, wherein the microphone users acquisition
The voice signal or external environment sound of user.First electroacoustic transducer, the second electroacoustic transducer can be used as original earphone respectively
The corresponding electric signal of audio signal is converted into the sound wave that user can hear by left horn (loud speaker), right horn (loud speaker)
Signal.Meanwhile electroacoustic transducer is very sensitive to sound wave, can cause the vibration of diffuser, what drive was connected with cone
Coil makees the movement of cutting magnetic line in the magnetic field of permanent magnet, to generate the electric current changed with the variation of sound wave
(the phenomenon that generating electric current is physically being known as electromagnetic induction phenomenon), meanwhile, the electromotive force of audio will be exported at coil both ends,
Therefore, electroacoustic transducer can also acquire and record external environment sound.That is, can be by original first electroacoustic transducer of earphone
(left horn), the second electroacoustic transducer (right horn) are used as microphone.
Electroacoustic transducer, although its type, function or working condition are different, they all include two elements,
That is electric system and mechanical vibrating system pass through certain physics inside electroacoustic transducer between electric system and mechanical vibrating system
Effect connects each other, to complete the conversion of energy.
Obtain the sound-source signal that microphone, the first electroacoustic transducer and the second electroacoustic transducer based on earphone acquire.
That is, the microphone of earphone, the first electroacoustic transducer (left horn) and the second electroacoustic transducer (right horn) can be acquired periodically
Sound-source signal.
It is generated it should be noted that sound-source signal can be loudspeaker, some stereo set or generator, can also be
People's one's voice in speech in the application, does not do any restriction to sound-source signal.
Step 304：The sound-source signal is received according to the microphone, the first electroacoustic transducer and the second electroacoustic transducer
Time delay, obtain location information of the sound-source signal relative to the earphone.
Specifically, the sound source that can be received by the microphone, the first electroacoustic transducer and the second electroacoustic transducer of earphone
Signal receives the sound source using microphone, the first electroacoustic transducer and the second electroacoustic transducer as with reference to microphone acquisition respectively
The time delay of signal carries out estimation positioning to sound-source signal based on the Time Delay Estimation Techniques up to delay inequality, and then obtains sound source
Location information of the signal relative to earphone.Wherein, location information can be understood as range information of the sound-source signal apart from earphone with
And the azimuth information relative to earphone.
It should be noted that sound-source signal can be understood as sound-source signal relative to earphone relative to the location information of earphone
Center (microphone, the first electroacoustic transducer and the second electroacoustic transducer three center) location information,
Sound-source signal be can be understood as relative to microphone, the location information of the first electroacoustic transducer or the second electroacoustic transducer；May be used also
To be interpreted as location information of the sound-source signal relative to any reference point on earphone.
Optionally, the sound-source signal is received according to the microphone, the first electroacoustic transducer and the second electroacoustic transducer
The directional technology for being also based on High-Resolution Spectral Estimation positions the sound-source signal, can also be formed based on steerable beam
Technology positions the sound-source signal；The location technology for being also based on Amplitude ratio of sound pressure positions the sound-source signal.
Step 306：When the sound-source signal meets default alert condition, executes remind user according to the positional information
Operation.
When sound-source signal meets default alert condition, it can be reminded and be used according to the corresponding default reminded contents of location information
Family.Wherein, default alert condition can be that the decibels of sound-source signal are more than preset value, and sound-source signal includes certain preset
Feature audio, such as " whistle, alarm, cry, specific name, place name, time " etc..According to the sound-source signal of acquisition relative to ear
The location information of machine can obtain distance and bearing signal of the sound-source signal apart from current earphone.It can be with according to location information
The alerting pattern of setting Different Strategies corresponds to according to the positional information when the sound-source signal meets default alert condition
Alerting pattern come execute remind user operation.
The above sound signal processing method can be obtained when the earphone is in broadcast state based on microphone, first
The sound-source signal of electroacoustic transducer and the acquisition of the second electroacoustic transducer；According to the microphone, the first electroacoustic transducer and second
Electroacoustic transducer receives the time delay of the sound-source signal, and the position for obtaining the sound-source signal relative to the earphone is believed
Breath；When the sound-source signal meets default alert condition, the operation for reminding user is executed according to the positional information, merely with
The intrinsic device of earphone can realize the positioning to sound-source signal, simplify the structure of earphone, saved cost, meanwhile, when
When sound-source signal meets default alert condition, location information automatically prompting user that can be according to sound-source signal relative to earphone,
So that user is made correct processing in time to sound-source signal, avoids missing important or urgent thing.
Fig. 4 in one embodiment according to the microphone, the first electroacoustic transducer and the second electroacoustic transducer receive institute
The time delay for stating sound-source signal obtains flow chart of the sound-source signal relative to the location information of the earphone.At one
In embodiment, the time of the sound-source signal is received according to the microphone, the first electroacoustic transducer and the second electroacoustic transducer
Delay, obtains location information of the sound-source signal relative to the earphone, including：
Step 402：It is obtained respectively using microphone, the first electroacoustic transducer and the second electroacoustic transducer as with reference to microphone
Receive three groups of time delays of present frame sound-source signal.
Sound-source signal can also be referred to as acoustic signals, and sound wave is in communication process, due to distance microphone, the first electroacoustic
Energy converter, the distance of the second electroacoustic transducer are different, and sound wave reaches microphone, the first electroacoustic transducer, the second electroacoustic transducer
Time it is also just different, sound wave reaches the interval time of microphone, the first electroacoustic transducer, the second electroacoustic transducer when being just called
Prolong.
Since microphone, the first electroacoustic transducer (left horn), the second electroacoustic transducer (right horn) are fixed on earphone,
It can be based on earphone and build coordinate system, then microphone, the first electroacoustic transducer, the position of the second electroacoustic transducer in a coordinate system
For known quantity, meanwhile, microphone, the first electroacoustic transducer (left horn), the second electroacoustic transducer (right horn) it is each two-by-two it
Between distance also be known quantity.In conjunction with the aerial spread speed of sound wave, sound-source signal can be calculated and reach microphone, the
The time interval of any two in one electroacoustic transducer, the second electroacoustic transducer.
Specifically, for convenience, microphone, the first electroacoustic transducer, the second electroacoustic transducer are referred to as wheat
Gram wind, and indicated respectively with M1, M2, M3.Respectively using microphone M1, M2, M3 as microphone is referred to, each two Mike is obtained
Time delay (time interval or) between wind (microphone to), and then obtain three groups of different time delays.Wherein it is possible to logical
The peakdeviation amount for crossing the cross-correlation function for obtaining the signal amplitude that each microphone M1, M2, M3 are received, according to signal
Sample frequency, then estimate time delay.
Step 404：Average time delay is obtained according to three groups of time delays.
It is weighted according to corresponding time delay in the three of acquisition groups of time delay data and averagely obtains average value, as
Average time delay.
Step 406：Location estimation is carried out to the location information of the sound-source signal according to the average time delay, and is obtained
Take the sound-source signal relative to the location information of the earphone.
According to location information known to average time delay and microphone M1, M2, M3, and then can be to sound-source signal
Location information carries out location estimation, and obtains location information of the sound-source signal relative to earphone, that is, the sound source information and earphone
The distance between information and azimuth information.
Method in the present embodiment, respectively using microphone M1, M2, M3 as calculate separately to obtain with reference to microphone and other
Pairs of time delay between microphone, it is finally flat to being weighted to corresponding time delay in obtained three groups of data
Average value is obtained, sound-source signal is positioned according to the average value of acquisition, the accuracy of positioning can be improved.
In one embodiment, according to described in the reception of the microphone, the first electroacoustic transducer and the second electroacoustic transducer
The time delay of sound-source signal obtains location information of the sound-source signal relative to the earphone, further includes：
Step 4011：It detects and whether there is effective voice signal in the sound-source signal.
The presence of ambient noise, the sound-source signal for resulting in acquisition include noise contribution, need the area from sound-source signal
Effective voice signal is separated, avoids influencing caused by the estimation of noise versus time delay.
Short-time zero-crossing rate refers to that the number of different value occurs in waveform collection value in a certain frame voice signal, in voice signal section
In, short-time zero-crossing rate is relatively low, and in noise or noiseless signal segment, there is this higher zero-crossing rate.Pass through zero passage in short-term
The detection method of rate, which can determine, whether there is effective voice signal in sound-source signal.
Optionally, it can also judge whether the sound-source signal of acquisition is effective using the method for the detection of short-time energy.
Step 4013：When there are effective voice signal, to the source acoustical signal carry out it is smooth, be filtered.
When there are when effective voice signal, being believed sound source by way of adding window framing in the sound-source signal of acquisition
It number is smoothed, wherein framing is that sound-source signal frame is divided into multiframe signal according to same time period, and each frame is made to become
More stable, adding window framing is exactly to be weighted to every frame voice signal with window function.In the present embodiment, hamming window letter is used
Number has smaller secondary lobe.
The frequency of noise signal may be distributed in entire frequency space, and filtering refers to the letter to special frequency channel in sound-source signal
Number it is filtered processing, the signal of special frequency channel is retained into drop-down, with the process for other frequency band signals of decaying.It can be with by filtering
Keep the sound-source signal after smoothing processing relatively sharp.
Fig. 5 be one embodiment in when the sound-source signal meets default alert condition, hold according to the positional information
Row reminds the flow chart of the operation of user.It is in one embodiment, described when the sound-source signal meets default alert condition,
The operation for reminding user is executed according to the positional information, including：
Step 502：Judge in the sound-source signal whether to include feature audio；
When there are when effective voice signal, parsing the useful voice signal, and judging that the sound source is believed in sound-source signal
Whether include feature audio in number.Wherein, this feature audio includes but not limited to character features audio, temporal characteristics audio, position
Set feature audio and affair character audio.
Specifically, character features audio can be user crowd of interest, title, the pet name etc. of company；Temporal characteristics
Audio can be include number, year, month, day audio signal；Position feature audio can be user where country, city,
Company, home address etc.；Affair character audio can be special Audio Alert, such as whistle sound, sound of call for help etc..
For example, if user Li Si stores " Li Si ", " Xiao Li " as feature audio.When someone call " Li Si " or
When " Xiao Li ", when similarity reaches the degree of setting, then it is assumed that include feature audio in the sound-source signal, when in sound-source signal
When including feature audio, then it is assumed that the sound-source signal meets default alert condition.
Step 504：When the sound-source signal includes the feature audio, is executed to remind according to default reminded contents and be used
The operation at family.
When including feature audio in sound source letter, the location information relative to earphone and acquisition according to the sound-source signal
Feature audio reminds the operation of user to execute.Wherein, location information includes range information and azimuth information.
Specifically, the operation for reminding user is executed according to default reminded contents, including：
The mapping relations of the feature audio and default alerting pattern are called, are determined and presently described default alert condition phase
Corresponding default alerting pattern；The operation for reminding user is executed according to the determining default alerting pattern.
Feature audio includes but not limited to that character features audio, temporal characteristics audio, position feature audio and event are special
Audio is levied, corresponding default alerting pattern can be set according to the preset priority of feature audio.Wherein, wherein preferential
Grade is followed successively by from high to low：Affair character audio -- title or the pet name of user in character features audio -- character features sound
User in frequency crowd of interest, company title, the pet name -- temporal characteristics audio -- position feature audio.
Specifically, default alerting pattern includes the first alerting pattern and the second alerting pattern, wherein the first alerting pattern is
Earphone is reminded, and user is reminded that is, playing certain specific recording by earphone and being transmitted to user's ear.Second alerting pattern
Reminded for the electronic equipment that is communicated with earphone, wherein it can be that interface display is reminded that electronic equipment, which is reminded, interface display with
The tinkle of bells combination is reminded or interface display and combination of vibrations prompting etc..Those skilled in the art it is conceivable that various alerting patterns all
Should include in embodiments of the present invention.
Default alerting pattern corresponding with current level can be set according to the priority of feature audio, further,
Can by priority it is high correspond to the first alerting pattern, priority it is low correspond to the second alerting pattern.For example, when someone exhales
When being " Li Si " or " Xiao Li ", earphone prompting can be carried out to user with binding characteristic audio and location information, reminded contents are
" 1 meter of left back someone calls ", can prompt user later to be talked with people in time；It, can be with binding characteristic sound when there is whistle sound
Frequency and location information carry out earphone prompting to user, and reminded contents are " there is vehicle in 3 meters of right back ", user can be prompted to exist in time
Visual angle blind zone is taken care, and the safety for improving user is vigilant；When someone inquires into " OPPO mobile phones ", can with binding characteristic audio and
Location information to user carry out electronic equipment interface display remind, reminded contents be " 1 meter of front, OPPO, OPPO,
OPPO ", to prompt 1 meter of someone in front of user if user is interested in it, can be resident for half quarter to obtain phase at discussion " OPPO "
The information etc. of pass.
The sound processing method of the present embodiment can be according to feature audio when sound-source signal meets default alert condition
Location information with sound-source signal makes user be made in time to sound-source signal correctly according to default alerting pattern automatically prompting user
Processing, avoid missing important or urgent thing.
Fig. 6 is in another embodiment when the sound-source signal meets default alert condition, according to the positional information
Execute the flow chart for reminding the operation of user.In one embodiment, when the sound-source signal meets default alert condition, root
The operation for reminding user is executed according to the location information, including：
Step 602：Judge in the sound-source signal whether to include feature audio.
Step 604：When the sound-source signal includes the feature audio, ask the user whether to continue to record the sound
Source signal.
When sound-source signal includes feature audio, ask the user whether to continue to record the sound-source signal.Wherein, it inquires
The mode whether user persistently records the sound-source signal can be to be inquired in such a way that earphone plays voice；It can also lead to
The display interface of the electronic equipment communicated with earphone is crossed to ask the user whether to continue to record the sound-source signal, shows boundary
The display format in face does not limit herein.
The response instruction whether user persistently records this sound-source signal is received, when the response instruction of user's output is
When "Yes", 606 are thened follow the steps：Selection controls the microphone, the first electroacoustic transducer or the second electroacoustic transducer and persistently adopts
Collect the sound-source signal, and the sound-source signal is marked.
Specifically, when current earphone is in the scene listened to music, microphone can be controlled and carry out continuous collecting sound-source signal, directly
The sound-source signal is left to earphone, wherein leaving the sound-source signal, to refer to that range information in location information is more than default
Value.When current earphone is in call scene, the first electroacoustic transducer can be controlled or the second electroacoustic transducer carrys out continuous collecting sound
Source signal, until earphone leaves the sound-source signal.Meanwhile storage is marked to the sound-source signal of continuous collecting, to facilitate use
Family repeats playing the sound-source signal, to extract user's message of interest or important.
The response instruction whether user persistently records this sound-source signal is received, when the response instruction of user's output is
When "No", 606 are thened follow the steps：The operation for reminding user is executed according to the positional information, and deletes the sound-source signal.Root
The operation for reminding user is executed according to the location information of acquisition, and deletes the sound-source signal of acquisition, to discharge memory space.
Fig. 7 is the flow chart of audio signal processing method in another embodiment.In one embodiment, the method is also
Including：
Step 702：When the earphone is in broadcast state, it is based on microphone, the first electroacoustic transducer and the second electroacoustic
Energy converter synchronous acquisition sound-source signal；
Step 704：The sound-source signal is received according to the microphone, the first electroacoustic transducer and the second electroacoustic transducer
Time delay, obtain location information of the sound-source signal relative to the earphone；
Step 706：When the sound-source signal meets default alert condition, executes remind user according to the positional information
Operation；
Step 302-306 is corresponded in above-mentioned steps 702- steps 706 and previous embodiment, secondary, is repeated no more.
Step 708：Geographical location information based on presently described earphone and the location information determine the sound source letter
Number geographical location information.
When earphone is in broadcast state, the current geographical location letter of the electronic equipment communicated with earphone can be obtained
Breath, can be using the current geographical location information of electronic equipment as the geographical location information of earphone.The wherein geographical location of earphone
Information can be obtained by the GPS positioning module built in electronic equipment.According to the geographical location information and sound-source signal of earphone
Relative to the location information of earphone, the geographical location information of the sound-source signal can be obtained.
Step 710：Target sound source file is generated according to the geographical location information of the sound-source signal and the sound-source signal.
The sound-source signal of acquisition and the geographical location information of the sound-source signal are bound, target sound source file is generated.
Further, which can also carry the temporal information for acquiring the sound-source signal, can thus obtain in time
The place of the target sound source file and temporal information, can be abundant show sound-source signal.
Step 712：The operational order for receiving user, plays the target sound source file.
The operational order of user is received, which can be received by earphone, can also be communicated due to the earphone
Electronic equipment receive.When being received by earphone itself, the operational order of user can be received by the physical button of earphone,
The operational order of user can also be received by the touch panel being preset on earphone.Certainly, user can with earphone into
It is input operation instruction on the electronic equipment of row communication.Here, not limiting the object for receiving user operation instruction, operation refers to
The input mode of order is not further yet to be limited.
When receiving the operational order, target sound source file can be played, includes acquisition in the target sound source file
The geographical location information of the sound-source signal, or even further comprise the temporal information for acquiring the sound-source signal.When user plays again
When the target sound source file, the location of the sound-source signal could be aware that, so that user's memory is recalled.Meanwhile when using earphone
When, user can obtain extraneous situation by the file destination of recording, and user need not wear earphone, can know the external world repeatedly
Chat script, avoid missing important message.
It should be understood that although each step in the flow chart of Fig. 1-7 is shown successively according to the instruction of arrow,
These steps are not that the inevitable sequence indicated according to arrow executes successively.Unless expressly stating otherwise herein, these steps
Execution there is no stringent sequences to limit, these steps can execute in other order.Moreover, at least one in Fig. 1-7
Part steps may include that either these sub-steps of multiple stages or stage are not necessarily in synchronization to multiple sub-steps
Completion is executed, but can be executed at different times, the execution sequence in these sub-steps or stage is also not necessarily successively
It carries out, but can either the sub-step of other steps or at least part in stage be in turn or alternately with other steps
It executes.
Fig. 8 is the structure diagram of the audio-signal processing apparatus of one embodiment.Audio-signal processing apparatus, described device
Including：
Sound source acquisition module 810, for when the earphone is in broadcast state, obtaining based on microphone, the first electroacoustic
The sound-source signal of energy converter and the acquisition of the second electroacoustic transducer；
Position acquisition module 820, for being received according to the microphone, the first electroacoustic transducer and the second electroacoustic transducer
The time delay of the sound-source signal obtains location information of the sound-source signal relative to the earphone；
Reminding module 830, for when the sound-source signal meets default alert condition, executing according to the positional information
Remind the operation of user.
It should be noted that the audio-signal processing apparatus can be both arranged in earphone, it can also be arranged and be set in electronics
It is standby interior.
The above sound signal processing apparatus can be obtained when the earphone is in broadcast state based on microphone, first
The sound-source signal of electroacoustic transducer and the acquisition of the second electroacoustic transducer；According to the microphone, the first electroacoustic transducer and second
Electroacoustic transducer receives the time delay of the sound-source signal, and the position for obtaining the sound-source signal relative to the earphone is believed
Breath；When the sound-source signal meets default alert condition, the operation for reminding user is executed according to the positional information, merely with
The intrinsic device of earphone can realize the positioning to sound-source signal, simplify the structure of earphone, saved cost, meanwhile, when
When sound-source signal meets default alert condition, location information automatically prompting user that can be according to sound-source signal relative to earphone,
So that user is made correct processing in time to sound-source signal, avoids missing important or urgent thing.
In one embodiment, position acquisition module includes：
First acquisition unit, for obtain respectively using microphone, the first electroacoustic transducer and the second electroacoustic transducer as
Three groups of time delays of reference microphone；
Second acquisition unit, for obtaining average time delay according to three groups of time delays；
Third acquiring unit, for being positioned to the location information of the sound-source signal according to the average time delay
Estimation, and obtain location information of the sound-source signal relative to the earphone.
Acoustic information system device in the present embodiment, can improve the setting accuracy to sound-source signal.
In one embodiment, position acquisition module further includes：
Detection unit whether there is effective voice signal for detecting in the sound-source signal；
Processing unit, for when there are effective voice signal, to the source acoustical signal carry out it is smooth, be filtered.
In one embodiment, reminding module, including：
Judging unit, for judging in the sound-source signal whether to include feature audio；
Reminding unit, for when the sound-source signal includes the feature audio, being executed according to default reminded contents
Remind the operation of user, wherein the default reminded contents include the feature audio and location information.
In one embodiment, reminding unit is additionally operable to that the feature audio and the mapping of default alerting pattern is called to close
System determines default alerting pattern corresponding with presently described default alert condition；
The operation for reminding user is executed according to the determining default alerting pattern.
The sound processing apparatus of the present embodiment can be according to feature audio when sound-source signal meets default alert condition
Location information with sound-source signal makes user be made in time to sound-source signal correctly according to default alerting pattern automatically prompting user
Processing, avoid missing important or urgent thing.
In one embodiment, reminding module further includes：
Inquiry unit continues recording for when the sound-source signal includes the feature audio, asking the user whether
The sound-source signal；
Control unit, for selecting the control microphone, the first electroacoustic transducer or the second electroacoustic transducer persistently to adopt
Collect the sound-source signal, and the sound-source signal is marked.
When current earphone is in the scene listened to music, microphone can be controlled and carry out continuous collecting sound-source signal, until earphone
Leave the sound-source signal, wherein leave the sound-source signal and refer to that the range information in location information is more than preset value.Currently
When earphone is in call scene, the first electroacoustic transducer can be controlled or the second electroacoustic transducer carrys out continuous collecting sound-source signal,
Until earphone leaves the sound-source signal.Meanwhile storage is marked to the sound-source signal of continuous collecting, to facilitate user to the sound
Source signal repeats playing, to extract user's message of interest or important.
In one embodiment, audio-signal processing apparatus further includes：
Determining module, for based on presently described earphone geographical location information and the location information, determine described in
The geographical location information of sound-source signal；
Generation module, for generating target sound source according to the geographical location information of the sound-source signal and the sound-source signal
File；
Playing module, the operational order for receiving user play the target sound source file.
Device in the present embodiment can play target sound source file when receiving the operational order, the target sound source
Include to acquire the geographical location information of the sound-source signal, or even further comprise the time letter for acquiring the sound-source signal in file
Breath.When user plays the target sound source file again, the location of the sound-source signal is could be aware that, so that user remembers back
Think.Meanwhile when headphones are used, user can obtain extraneous situation by the file destination of recording, and user need not wear repeatedly
Earphone is worn, extraneous chat script can be known, avoid missing important message.
The division of modules is only used for for example, in other embodiments in the above sound signal processing apparatus, can
Audio-signal processing apparatus is divided into different modules as required, with complete the above sound signal processing apparatus whole or
Partial function.
Specific about audio-signal processing apparatus limits the limit that may refer to above for audio signal processing method
Fixed, details are not described herein.Modules in the above sound signal processing apparatus can fully or partially through software, hardware and its
It combines to realize.Above-mentioned each module can be embedded in or in the form of hardware independently of in the processor in computer equipment, can also
It is stored in a software form in the memory in computer equipment, in order to which processor calls the above modules of execution corresponding
Operation.
The realization of modules in the audio-signal processing apparatus provided in the embodiment of the present application can be computer program
Form.The computer program can be run on electronic equipment or server.The program module that the computer program is constituted can deposit
Storage is on the memory of electronic equipment or server.When the computer program is executed by processor, realize in the embodiment of the present application
The step of described method.
The embodiment of the present application also provides a kind of earphone, which includes the sound signal processing that above-mentioned technical proposal provides
Device, specific about audio-signal processing apparatus limit the restriction that may refer to above for audio signal processing method,
Details are not described herein.
The embodiment of the present application also provides a kind of computer readable storage mediums.One or more is executable comprising computer
The non-volatile computer readable storage medium storing program for executing of instruction, when the computer executable instructions are executed by one or more processors
When so that the processor executes the step of audio signal processing method.
A kind of computer program product including instruction, when run on a computer so that computer executes sound
Signal processing method.
The embodiment of the present application also provides a kind of electronic equipment.As shown in figure 9, for convenience of description, illustrating only and this
Apply for that the relevant part of embodiment, particular technique details are not disclosed, please refers to the embodiment of the present application method part.The electronics is set
Include mobile phone, tablet computer, PDA (Personal Digital Assistant, personal digital assistant), POS for that can be
The arbitrary electronic equipment equipment such as (Point of Sales sell electronic equipment), vehicle-mounted computer, Wearable, is set with electronics
For for for mobile phone：
Fig. 9 is the block diagram with the part-structure of the relevant mobile phone of electronic equipment provided by the embodiments of the present application.With reference to figure 9,
Mobile phone includes：Radio frequency (Radio Frequency, RF) circuit 910, input unit 930, display unit 940, passes memory 920
Sensor 950, voicefrequency circuit 960, Wireless Fidelity (wireless fidelity, WiFi) module 970, processor 980, Yi Ji electricity
The components such as source 990.It, can be with it will be understood by those skilled in the art that handset structure shown in Fig. 9 does not constitute the restriction to mobile phone
Including than illustrating more or fewer components, either combining certain components or different components arrangement.
Wherein, RF circuits 910 can be used for receiving and sending messages or communication process in, signal sends and receivees, can be by base station
After downlink information receives, handled to processor 980；The data of uplink can also be sent to base station.In general, RF circuits include but
Be not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier (Low Noise Amplifier,
LNA), duplexer etc..In addition, RF circuits 910 can also be communicated with network and other equipment by radio communication.Above-mentioned channel radio
Letter can use any communication standard or agreement, including but not limited to global system for mobile communications (Global System of
Mobile communication, GSM), general packet radio service (General Packet Radio Service,
GPRS), CDMA (Code Division Multiple Access, CDMA), wideband code division multiple access (Wideband Code
Division Multiple Access, WCDMA), long term evolution (Long Term Evolution, LTE)), Email,
Short message service (Short Messaging Service, SMS) etc..
Memory 920 can be used for storing software program and module, and processor 980 is stored in memory 920 by operation
Software program and module, to execute various function application and the data processing of mobile phone.Memory 920 can include mainly
Program storage area and data storage area, wherein program storage area can storage program area, the application journey needed at least one function
Sequence (such as the application program of sound-playing function, application program of image player function etc.) etc.；Data storage area can store root
Created data (such as audio data, address list etc.) etc. are used according to mobile phone.In addition, memory 920 may include high speed
Random access memory, can also include nonvolatile memory, a for example, at least disk memory, flush memory device or
Other volatile solid-state parts.
Input unit 930 can be used for receiving the number or character information of input, and generate the user setting with mobile phone 900
And the related key signals input of function control.Specifically, input unit 930 may include operation panel 931 and other inputs
Equipment 932.Operation panel 931, alternatively referred to as touch screen collect user on it or neighbouring touch operation (such as user
Use the operation of any suitable object or attachment such as finger, stylus on operation panel 931 or near operation panel 931),
And corresponding attachment device is driven according to preset formula.In one embodiment, operation panel 931 may include touching inspection
Survey two parts of device and touch controller.Wherein, the touch orientation of touch detecting apparatus detection user, and detect touch operation
The signal brought, transmits a signal to touch controller；Touch controller receives touch information from touch detecting apparatus, and will
It is converted into contact coordinate, then gives processor 980, and can receive order that processor 980 is sent and be executed.In addition,
The multiple types such as resistance-type, condenser type, infrared ray and surface acoustic wave may be used and realize operation panel 931.In addition to operating surface
Plate 931, input unit 930 can also include other input equipments 932.Specifically, other input equipments 932 may include but not
It is limited to one or more in physical keyboard, function key (such as volume control button, switch key etc.) etc..
Display unit 940 can be used for showing information input by user or be supplied to user information and mobile phone it is various
Menu.Display unit 940 may include display panel 941.In one embodiment, liquid crystal display (Liquid may be used
Crystal Display, LCD), the forms such as Organic Light Emitting Diode (Organic Light-Emitting Diode, OLED)
To configure display panel 941.In one embodiment, operation panel 931 can cover display panel 941, when operation panel 931 is examined
It measures and sends processor 980 on it or after neighbouring touch operation to determine the type of touch event, be followed by subsequent processing device
980 provide corresponding visual output according to the type of touch event on display panel 941.Although in fig.9, operation panel
931 be to realize input and the input function of mobile phone as two independent components with display panel 941, but in certain implementations
In example, can be integrated by operation panel 931 and display panel 941 and that realizes mobile phone output and input function.
Mobile phone 900 may also include at least one sensor 950, such as optical sensor, motion sensor and other sensings
Device.Specifically, optical sensor may include ambient light sensor and range sensor, wherein ambient light sensor can be according to environment
The light and shade of light adjusts the brightness of display panel 941, and range sensor can close display panel when mobile phone is moved in one's ear
941 and/or backlight.Motion sensor may include acceleration transducer, can detect by acceleration transducer and adds in all directions
The size of speed can detect that size and the direction of gravity when static, can be used to identify application (such as the horizontal/vertical screen of mobile phone posture
Switching), Vibration identification correlation function (such as pedometer, tap) etc.；In addition, mobile phone can also configure gyroscope, barometer, humidity
Other sensors such as meter, thermometer, infrared sensor etc..
Voicefrequency circuit 960, loud speaker 961 and microphone 962 can provide the audio interface between user and mobile phone.Audio-frequency electric
The transformed electric signal of the audio data received can be transferred to loud speaker 961 by road 960, and sound is converted to by loud speaker 961
Signal exports；On the other hand, the voice signal of collection is converted to electric signal by microphone 962, is turned after being received by voicefrequency circuit 960
It is changed to audio data, then by after the processing of audio data output processor 980, another mobile phone can be sent to through RF circuits 910, or
Person exports audio data to memory 920 so as to subsequent processing.
WiFi belongs to short range wireless transmission technology, and mobile phone can help user's transceiver electronics postal by WiFi module 970
Part, browsing webpage and access streaming video etc., it has provided wireless broadband internet to the user and has accessed.Although Fig. 9 is shown
WiFi module 970, but it is understood that, and it is not belonging to must be configured into for mobile phone 900, it can omit as needed.
Processor 980 is the control centre of mobile phone, using the various pieces of various interfaces and connection whole mobile phone, is led to
It crosses operation or executes the software program and/or module being stored in memory 920, and call and be stored in memory 920
Data execute the various functions and processing data of mobile phone, to carry out whole monitoring to mobile phone.In one embodiment, it handles
Device 980 may include one or more processing units.In one embodiment, processor 980 can integrate application processor and modulation
Demodulator, wherein the main processing operation system of application processor, user interface and application program etc.；Modem is mainly located
Reason wireless communication.It is understood that above-mentioned modem can not also be integrated into processor 980.For example, the processor
980 can integrate application processor and baseband processor, baseband processor with and the composable modem such as other peripheral chips.
Mobile phone 900 further includes the power supply 990 (such as battery) powered to all parts, it is preferred that power supply can pass through power management system
System is logically contiguous with processor 980, to realize the work(such as management charging, electric discharge and power managed by power-supply management system
Energy.
In one embodiment, mobile phone 900 can also include camera, bluetooth module etc..
In the embodiment of the present application, when the processor included by the mobile phone executes the computer program of storage on a memory
Realize above-mentioned described audio signal processing method.
The embodiment of the present application also provides a kind of earphone, including microphone, the first electroacoustic transducer, the second electroacoustic transducer,
Memory, processor and storage on a memory and the computer program that can run on a processor, the processor respectively with
The microphone, the first electroacoustic transducer, the second electroacoustic transducer, memory are electrically connected the processor and execute the computer
Above-mentioned described audio signal processing method is realized when program.
In one embodiment, the microphone is for acquiring sound-source signal；First electroacoustic transducer is for acquiring
The sound-source signal and the audio signal for playing the earphone output；Second electroacoustic transducer is for acquiring the sound source letter
Number and play the audio signal of earphone output.
Specifically, the microphone, the first electroacoustic transducer, sound-source signal described in the second electroacoustic transducer synchronous acquisition.
Used in this application may include to any reference of memory, storage, database or other media is non-volatile
And/or volatile memory.Suitable nonvolatile memory may include read-only memory (ROM), programming ROM (PROM),
Electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include arbitrary access
Memory (RAM), it is used as external cache.By way of illustration and not limitation, RAM is available in many forms, such as
It is static RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDR SDRAM), enhanced
SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM).
Above example only expresses the several embodiments of the application, the description thereof is more specific and detailed, but can not
Therefore it is interpreted as the limitation to the application the scope of the claims.It should be pointed out that for those of ordinary skill in the art,
Under the premise of not departing from the application design, various modifications and improvements can be made, these belong to the protection model of the application
It encloses.Therefore, the protection domain of the application patent should be determined by the appended claims.
Claims (12)
1. a kind of audio signal processing method, the method is based on including that microphone, the first electroacoustic transducer and the second electroacoustic change
The earphone of energy device, the method includes：
When the earphone is in broadcast state, obtains and be based on the microphone, the first electroacoustic transducer and the second electroacoustic transduction
The sound-source signal of device acquisition；
The time delay of the sound-source signal is received according to the microphone, the first electroacoustic transducer and the second electroacoustic transducer,
Obtain location information of the sound-source signal relative to the earphone；
When the sound-source signal meets default alert condition, the operation for reminding user is executed according to the positional information.
2. according to the method described in claim 1, it is characterized in that, it is described according to the microphone, the first electroacoustic transducer and
Second electroacoustic transducer receives the time delay of the sound-source signal, obtains position of the sound-source signal relative to the earphone
Information, including：
It is obtained respectively using microphone, the first electroacoustic transducer and the second electroacoustic transducer as with reference to microphone and receives present frame sound
Three groups of time delays of source signal；
Average time delay is obtained according to three groups of time delays；
Location estimation is carried out to the location information of the sound-source signal according to the average time delay, and obtains the sound source letter
Location information number relative to the earphone.
3. according to the method described in claim 2, it is characterized in that, described obtain respectively with microphone, the first electroacoustic transducer
With the second electroacoustic transducer as with reference to microphone receive present frame sound-source signal three groups of time delays before, further include：
It detects and whether there is effective voice signal in the sound-source signal；
When there are effective voice signal, to the source acoustical signal carry out it is smooth, be filtered.
4. according to the method described in claim 1, it is characterized in that, described when the sound-source signal meets default alert condition
When, the operation for reminding user is executed according to the positional information, including：
Judge in the sound-source signal whether to include feature audio；
When the sound-source signal includes the feature audio, the operation for reminding user is executed according to default reminded contents,
In, the default reminded contents include the feature audio and location information.
5. according to the method described in claim 4, it is characterized in that, described executed according to the default reminded contents reminds user
Operation, including：
Call the mapping relations of the feature audio and default alerting pattern, determination corresponding with presently described default alert condition
Default alerting pattern；
The operation for reminding user is executed according to the determining default alerting pattern.
6. according to the method described in claim 4, it is characterized in that, further including：
When the sound-source signal includes the feature audio, ask the user whether to continue to record the sound-source signal；
If so, sound source described in the selection control microphone, the first electroacoustic transducer or the second electroacoustic transducer continuous collecting
Signal, and the sound-source signal is marked；
If it is not, then executing the operation for reminding user according to the positional information, and delete the sound-source signal.
7. according to claim 1-6 any one of them methods, which is characterized in that the method further includes：
Geographical location information based on presently described earphone and the location information, determine the geographical location of the sound-source signal
Information；
Target sound source file is generated according to the geographical location information of the sound-source signal and the sound-source signal；
The operational order for receiving user, plays the target sound source file.
8. a kind of audio-signal processing apparatus, described device is based on including that microphone, the first electroacoustic transducer and the second electroacoustic change
The earphone of energy device, described device include：
Sound source acquisition module, for when the earphone be in broadcast state, obtain be based on microphone, the first electroacoustic transducer and
The sound-source signal of second electroacoustic transducer acquisition；
Position acquisition module, for receiving the sound according to the microphone, the first electroacoustic transducer and the second electroacoustic transducer
The time delay of source signal obtains location information of the sound-source signal relative to the earphone；
Reminding module is used for when the sound-source signal meets default alert condition, executing to remind according to the positional information
The operation at family.
9. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program quilt
The step of any one of claim 1 to 7 the method is realized when processor executes.
10. a kind of electronic equipment, including memory, processor and storage are on a memory and the calculating that can run on a processor
Machine program, which is characterized in that the processor is realized when executing the computer program described in any one of claim 1 to 7
The step of method.
11. a kind of earphone, which is characterized in that including microphone, the first electroacoustic transducer, the second electroacoustic transducer, memory, place
Reason device and storage on a memory and the computer program that can run on a processor, the processor respectively with the Mike
Wind, the first electroacoustic transducer, the second electroacoustic transducer, memory are electrically connected reality when the processor executes the computer program
The step of any one of existing claim 1 to 7 the method.
12. earphone according to claim 11, which is characterized in that the microphone is for acquiring sound-source signal；Described
One electroacoustic transducer is used to acquire the sound-source signal and plays the audio signal of the earphone output；Second electroacoustic transduction
Device is used to acquire the sound-source signal and plays the audio signal of the earphone output.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810276532.6A CN108600885B (en) | 2018-03-30 | 2018-03-30 | Sound signal processing method and related product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810276532.6A CN108600885B (en) | 2018-03-30 | 2018-03-30 | Sound signal processing method and related product |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108600885A true CN108600885A (en) | 2018-09-28 |
| CN108600885B CN108600885B (en) | 2020-05-22 |
Family
ID=63624027
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810276532.6A Expired - Fee Related CN108600885B (en) | 2018-03-30 | 2018-03-30 | Sound signal processing method and related product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108600885B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109413556A (en) * | 2018-09-30 | 2019-03-01 | Oppo广东移动通信有限公司 | Equipment localization method, device, Headphone device and electronic equipment |
| US10349176B1 (en) | 2018-03-30 | 2019-07-09 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method for processing signals, terminal device, and non-transitory computer-readable storage medium |
| EP3547712A1 (en) * | 2018-03-30 | 2019-10-02 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method for processing signals, terminal device, and non-transitory readable storage medium |
| CN111326159A (en) * | 2020-03-10 | 2020-06-23 | 苏宁云计算有限公司 | Voice recognition method, device and system |
| CN113169802A (en) * | 2018-10-02 | 2021-07-23 | 搜诺思公司 | Method and apparatus for transmitting data using sound signals |
| CN113571086A (en) * | 2020-04-28 | 2021-10-29 | 阿里巴巴集团控股有限公司 | Sound signal processing method and device, electronic equipment and readable storage medium |
| CN113905302A (en) * | 2021-10-11 | 2022-01-07 | Oppo广东移动通信有限公司 | Method and device for triggering prompt message and earphone |
| WO2023071519A1 (en) * | 2021-10-26 | 2023-05-04 | 北京荣耀终端有限公司 | Audio information processing method, electronic device, system, product, and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080187163A1 (en) * | 2007-02-01 | 2008-08-07 | Personics Holdings Inc. | Method and device for audio recording |
| CN103686574A (en) * | 2013-12-12 | 2014-03-26 | 苏州市峰之火数码科技有限公司 | Stereophonic electronic hearing-aid |
| CN107682772A (en) * | 2017-10-25 | 2018-02-09 | 倬韵科技（深圳）有限公司 | A kind of hazard recognition is to control the method, apparatus of audio output and earphone |
| CN207039828U (en) * | 2017-05-22 | 2018-02-23 | 郭长勇 | A kind of earphone with source of sound identification and positioning |
-
2018
- 2018-03-30 CN CN201810276532.6A patent/CN108600885B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080187163A1 (en) * | 2007-02-01 | 2008-08-07 | Personics Holdings Inc. | Method and device for audio recording |
| CN103686574A (en) * | 2013-12-12 | 2014-03-26 | 苏州市峰之火数码科技有限公司 | Stereophonic electronic hearing-aid |
| CN207039828U (en) * | 2017-05-22 | 2018-02-23 | 郭长勇 | A kind of earphone with source of sound identification and positioning |
| CN107682772A (en) * | 2017-10-25 | 2018-02-09 | 倬韵科技（深圳）有限公司 | A kind of hazard recognition is to control the method, apparatus of audio output and earphone |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10923129B2 (en) | 2018-03-30 | 2021-02-16 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method for processing signals, terminal device, and non-transitory readable storage medium |
| US10349176B1 (en) | 2018-03-30 | 2019-07-09 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method for processing signals, terminal device, and non-transitory computer-readable storage medium |
| EP3547712A1 (en) * | 2018-03-30 | 2019-10-02 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method for processing signals, terminal device, and non-transitory readable storage medium |
| WO2019184398A1 (en) * | 2018-03-30 | 2019-10-03 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method for processing signals, terminal device, and non-transitory computer-readable storage medium |
| CN109413556A (en) * | 2018-09-30 | 2019-03-01 | Oppo广东移动通信有限公司 | Equipment localization method, device, Headphone device and electronic equipment |
| CN113169802A (en) * | 2018-10-02 | 2021-07-23 | 搜诺思公司 | Method and apparatus for transmitting data using sound signals |
| US11514777B2 (en) | 2018-10-02 | 2022-11-29 | Sonos, Inc. | Methods and devices for transferring data using sound signals |
| CN113169802B (en) * | 2018-10-02 | 2023-10-24 | 搜诺思公司 | Method and apparatus for transmitting data using sound signals |
| CN111326159A (en) * | 2020-03-10 | 2020-06-23 | 苏宁云计算有限公司 | Voice recognition method, device and system |
| CN113571086A (en) * | 2020-04-28 | 2021-10-29 | 阿里巴巴集团控股有限公司 | Sound signal processing method and device, electronic equipment and readable storage medium |
| CN113571086B (en) * | 2020-04-28 | 2022-07-08 | 阿里巴巴集团控股有限公司 | Sound signal processing method and device, electronic equipment and readable storage medium |
| CN113905302A (en) * | 2021-10-11 | 2022-01-07 | Oppo广东移动通信有限公司 | Method and device for triggering prompt message and earphone |
| CN113905302B (en) * | 2021-10-11 | 2023-05-16 | Oppo广东移动通信有限公司 | Method and device for triggering prompt message and earphone |
| WO2023071519A1 (en) * | 2021-10-26 | 2023-05-04 | 北京荣耀终端有限公司 | Audio information processing method, electronic device, system, product, and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108600885B (en) | 2020-05-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108540661A (en) | Signal processing method, device, terminal, earphone and readable storage medium storing program for executing | |
| CN108600885A (en) | Audio signal processing method and Related product | |
| CN108391206A (en) | Signal processing method, device, terminal, earphone and readable storage medium storing program for executing | |
| CN108521621B (en) | Signal processing method, device, terminal, earphone and readable storage medium | |
| CN108538320A (en) | Recording control method and device, readable storage medium storing program for executing, terminal | |
| CN108430003A (en) | Audio compensation method and device, readable storage medium storing program for executing, terminal | |
| CN108922537B (en) | Audio recognition method, device, terminal, earphone and readable storage medium | |
| CN108803859A (en) | Information processing method, device, terminal, earphone and readable storage medium storing program for executing | |
| CN108391205B (en) | Left and right channel switching method and device, readable storage medium and terminal | |
| US10051368B2 (en) | Mobile apparatus and control method thereof | |
| CN108668009A (en) | Input method of controlling operation thereof, device, terminal, earphone and readable storage medium storing program for executing | |
| CN108540900A (en) | Volume adjusting method and related product | |
| CN108763978A (en) | Information cuing method, device, terminal, earphone and readable storage medium storing program for executing | |
| CN108710486A (en) | Audio frequency playing method, device, earphone and computer readable storage medium | |
| US11126398B2 (en) | Smart speaker | |
| CN108429969A (en) | Audio frequency playing method, device, terminal, earphone and readable storage medium storing program for executing | |
| CN108391207A (en) | Data processing method, device, terminal, earphone and readable storage medium storing program for executing | |
| CN106488376A (en) | The method and apparatus that a kind of audio components to mobile terminal carry out fault diagnosis | |
| CN106506437B (en) | Audio data processing method and device | |
| CN106126160A (en) | A kind of effect adjusting method and user terminal | |
| CN106384597A (en) | Audio frequency data processing method and device | |
| CN208402071U (en) | Audio playing apparatus, earphone and audio frequency broadcast system | |
| CN108810787A (en) | Foreign matter detecting method and device based on audio frequency apparatus, terminal | |
| CN110489571A (en) | Audio-frequency processing method and device, electronic equipment, computer readable storage medium | |
| CN106231499A (en) | A kind of audio Enhancement Method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200522 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |