CN110856068A - Communication method of earphone device - Google Patents
Communication method of earphone device Download PDFInfo
- Publication number
- CN110856068A CN110856068A CN201911073314.3A CN201911073314A CN110856068A CN 110856068 A CN110856068 A CN 110856068A CN 201911073314 A CN201911073314 A CN 201911073314A CN 110856068 A CN110856068 A CN 110856068A
- Authority
- CN
- China
- Prior art keywords
- audio signal
- audio
- played
- local
- allowed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 66
- 230000006854 communication Effects 0.000 title description 51
- 238000004891 communication Methods 0.000 title description 50
- 230000005236 sound signal Effects 0.000 claims abstract description 242
- 238000012545 processing Methods 0.000 claims abstract description 118
- 230000000694 effects Effects 0.000 claims abstract description 55
- 230000009467 reduction Effects 0.000 claims description 30
- 238000006243 chemical reaction Methods 0.000 claims description 16
- 230000003321 amplification Effects 0.000 claims description 6
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 6
- 230000015572 biosynthetic process Effects 0.000 claims description 3
- 238000003786 synthesis reaction Methods 0.000 claims description 3
- 230000002708 enhancing effect Effects 0.000 abstract 1
- 230000008569 process Effects 0.000 description 17
- 230000006870 function Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 7
- 230000007613 environmental effect Effects 0.000 description 6
- 230000008859 change Effects 0.000 description 5
- 230000002194 synthesizing effect Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000017105 transposition Effects 0.000 description 2
- 230000005534 acoustic noise Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1083—Reduction of ambient noise
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/003—Changing voice quality, e.g. pitch or formants
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
- H04R1/22—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired frequency characteristic only
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02165—Two microphones, one receiving mainly the noise signal and the other one mainly the speech signal
Abstract
The invention provides a conversation method of an earphone device, which is characterized in that when local audio is allowed to be played and/or conversation is allowed, local audio signals including local environment sounds are collected, and audio processing steps to be sent are executed on the local audio signals to obtain first audio signals; when local audio is allowed to be played, executing a to-be-played audio processing step on the first audio signal to obtain a second audio signal, and playing the second audio signal by the earphone device; and when the conversation is allowed, the earphone device sends the first audio signal to the external equipment. The device and the method can ensure the proximity of the sound effect heard by the user from the loudspeaker and the sound effect heard by the other party of the call to the maximum extent, thereby helping the user to check the sound effect finally sent to the other party and confirm whether the current sound effect is the effect that the user wants, greatly enhancing the confidence of the user in using the earphone and improving the experience.
Description
[ technical field ] A method for producing a semiconductor device
The present invention relates to the field of earphones, and in particular, to a method for communicating with an earphone device.
[ background of the invention ]
With the wide application of mobile internet terminals such as mobile phones and network audio and video software, the communication between people can be realized more and more conveniently at any time and any place. At present, the earphone is widely applied, and in most cases, people can talk and listen to music and the like through the earphone. In view of the complexity and diversity of the call environment, people are more and more likely to be in a noisy environment while making calls, and the negative impact of noise in the call environment on the call quality is increasingly evident. For example, in a noisy street, room, or square, or in a vehicle such as a car or train, the negative influence of the surrounding background noise on the communication quality of both parties can be very serious. For users of portable multimedia digital devices wearing earphones to listen to music, watch movies, or play video games, the negative impact of noise on the user experience is more intolerable. Therefore, the current earphone device needs to perform corresponding audio processing before transmitting the audio signal collected by the microphone to the opposite-end device or before playing the audio signal. When a user of the earphone makes a voice call, the audio processing module to be transmitted is used for carrying out audio processing such as analog-to-digital conversion, noise reduction and the like on the audio signal which is acquired by the microphone and contains the local environment sound and the voice signal of the user, and then transmitting the audio signal to the opposite party, and the audio processing module to be played is used for carrying out digital-to-analog conversion, volume control, power amplification and the like on the audio signal which is from the opposite party and contains the voice signal of the opposite party, and then playing is carried out through the loudspeaker. Along with the time, the noise reduction technology is rapidly developed, especially, after some emerging technologies are applied to the noise reduction field, the performance of the earphone noise reduction is greatly improved, various functions such as accurate noise reduction and selective noise reduction can be realized, and an earphone user and a conversation counterpart can enjoy high-purity and high-intelligence audio-visual environment.
But at the same time, the user of the headset is embarrassed that the user cannot hear his speaking voice after wearing the headset. In addition, due to the influence of noise environment, wearing manner, device performance, audio processing technology design and other aspects, the audio processing effect of many earphones is not always satisfactory, and especially, instability that the effect is good at some times and the effect is poor at some times easily occurs. When people do not want to hear the environmental sound of the other party, people cannot determine whether the other party can hear the environmental sound, so that the user lacks confidence in the audio processing effect of the earphone of the user.
Therefore, there is a need for an improved solution to the above problems.
[ summary of the invention ]
The invention aims to provide a communication method of an earphone device, which can enable an earphone user to effectively confirm the audio processing effect of an earphone when in communication, master the listening condition of an opposite end and facilitate the use of the user.
The invention provides a communication method of an earphone device, which comprises the following steps:
detecting whether to play local audio or not after detecting a call request from an external device, detecting whether to allow a call or not,
when local audio is allowed to be played and/or conversation is allowed, acquiring a local audio signal containing local environment sound, and executing an audio processing step to be sent on the local audio signal to obtain a first audio signal;
when local audio is allowed to be played, executing a to-be-played audio processing step on the first audio signal to obtain a second audio signal, and playing the second audio signal by the earphone device;
and when the conversation is allowed, the earphone device sends the first audio signal to the external equipment.
Further, the audio processing step to be transmitted may include performing one or more of analog-to-digital conversion, digital noise reduction, dual-microphone noise reduction, and sound effect processing on the local audio signal;
the audio to be played processing step may include one or more audio signal processing of digital-to-analog conversion, power amplification and volume adjustment for the input audio signal.
Furthermore, after a call request from the external device is detected, whether answering is allowed or not can be detected, and whether local audio is played or not and whether the call is allowed or not can be detected; or whether the local audio is played or not is detected, and then whether the answering and the conversation are allowed or not is detected.
Further, the detecting whether to play the local audio and whether to allow the call may be detecting whether to play the local audio, and playing the second audio signal when the playing is allowed, until the time for playing the local audio reaches a predetermined time or detecting an instruction to stop playing the local audio; when detecting that the local audio is not allowed to be played or the second audio signal is stopped to be played, detecting whether the call is allowed or not; alternatively, the first and second electrodes may be,
the detecting whether to play the local audio and whether to allow the call is to simultaneously detect whether to allow the local audio and whether to allow the call, and when both are allowed, executing the audio processing step to be played on the first audio signal, and executing the step of sending the first audio signal to the external device.
Further, after the listening is allowed, if it is detected that the local audio is allowed to be played, but if it is not detected or whether the call is allowed is not detected, a preset fifth audio signal may be sent to the external device.
Further, when it is detected that the listening is allowed, a third audio signal from an external device may be received, and the audio processing step to be played may be performed on the third audio signal to obtain a fourth audio signal, and the earphone device plays the fourth audio signal.
Further, the headphone apparatus may play the second audio signal using one of a left channel speaker and a right channel speaker thereof, and play the fourth audio signal using the other.
Further, the audio to be played processing step may further include synthesizing, and after synthesizing the second audio signal and the fourth audio signal, playing through a speaker.
Further, at the time of the synthesizing process, the volume of one of the second audio signal and the fourth audio signal is controlled to be smaller than the volume of the other.
Further, the sound effect processing may include one or more of a transposition processing and a mixing processing.
Further, the earphone device may be a bluetooth earphone.
Compared with the prior art, the communication method of the earphone device provided by the invention can ensure the proximity of the sound effect heard by the user from the loudspeaker and the sound effect heard by the opposite party of the communication to the greatest extent, thereby helping the user to check the sound effect finally sent to the opposite party and confirm whether the current sound effect is the effect required by the user. Obviously, the confidence of the user in using the earphone can be greatly enhanced, and the experience feeling is improved.
Specific, further advantageous effects that can be achieved by the present invention will be described in detail below with reference to specific embodiments.
[ description of the drawings ]
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise. Wherein:
fig. 1 is a schematic circuit diagram of a part of an earphone device according to a first embodiment of the present invention;
fig. 2 is a flow chart of a communication method of an earphone device according to a second embodiment of the present invention;
fig. 3 is a flow chart of a communication method of the earphone device according to a third embodiment of the invention;
fig. 4 is a flowchart illustrating a communication method of an earphone device according to a fourth embodiment of the present invention;
fig. 5 is a schematic circuit diagram of a part of an earphone device in a fifth embodiment of the present invention.
[ detailed description ] embodiments
In order to make the technical solutions and advantages of the embodiments of the present application more apparent, the following further detailed description of the exemplary embodiments of the present application with reference to the accompanying drawings makes it clear that the described embodiments are only a part of the embodiments of the present application, and are not exhaustive of all embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
The embodiment of the invention aims to provide an earphone device with a novel structure and a using method and a communication method thereof, so as to improve the using experience of a user and enhance the using confidence of the user.
Embodiments of the present invention provide an earphone device, which may be a known or future possible wired or wireless earphone, mainly comprising a main control unit, a microphone, an audio processing unit, a speaker, and a communication unit, wherein,
the audio processing unit comprises an audio processing module to be sent and an audio processing module to be played, wherein the audio processing module to be sent receives audio signals collected by a microphone and outputs first audio signals to the communication unit and the audio processing module to be played respectively; the audio processing module to be played receives the first audio signal and outputs a second audio signal to the loudspeaker;
the main control unit is used for detecting whether to play local audio or not and detecting whether to allow communication or not after detecting a communication request from external equipment;
when local audio is allowed to be played and/or conversation is allowed, controlling the microphone to collect a local audio signal containing local environment sound, and carrying out audio signal processing on the local audio signal by the to-be-sent audio processing module so as to output a first audio signal;
when local audio is allowed to be played, controlling the audio processing module to be played to perform audio signal processing on the first audio signal so as to output a second audio signal, controlling the loudspeaker to play the second audio signal,
and when the call is allowed, controlling the communication unit to transmit the first audio signal to an external device.
Further, after detecting a call request from an external device, the main control unit may first detect whether to allow answering, and then detect whether to play a local audio and whether to allow a call; alternatively, it may be detected whether the local audio is played first, and then whether the answering and the talking are allowed.
Further, the detecting whether to play the local audio and whether to allow the call is to detect whether to play the local audio first, and control the speaker to play the second audio signal when the playing is allowed until the time for playing the local audio reaches a predetermined time or an instruction for stopping playing the local audio is detected; and when detecting that the local audio is not allowed to be played or the second audio signal is stopped to be played, detecting whether the call is allowed or not.
The earphone device may be any of various known or future portable audio output devices such as in-ear earphones, headphones, wireless earphones, wired earphones, bone conduction earphones, and the like.
The external device may be an electronic communication device such as a mobile phone, a computer, a tablet computer, or an intercom, which establishes a wired or wireless signal transmission link with the earphone device during a call to forward a call request and audio information from a call partner to the earphone device.
The external device may also be a remote device for a call of a call partner, such as an electronic communication device like a mobile phone, a computer, a tablet computer, an intercom, etc.
In the earphone device, because the audio signal played by the loudspeaker is obtained by processing the local audio signal collected by the microphone through the audio processing process to be sent, and the audio signal sent to the remote equipment in the conversation process is also obtained by processing the audio signal to be sent, the audio processing processes of the audio signal and the audio signal are completely the same, thereby ensuring the proximity of the sound effect heard by the user from the loudspeaker and the sound effect heard by the conversation opposite side to the maximum extent. Therefore, no matter which specific audio processing mode is included in the audio processing process to be sent and which audio processed effect is obtained, the user can check the sound effect finally sent to the other party through the loudspeaker and confirm whether the current sound effect is the effect desired by the user. Obviously, the confidence of the user in using the earphone can be greatly enhanced, and the experience feeling is improved.
Furthermore, the process of checking the sound effect by the user can be firstly checked before the call, if the call request is received and the earphone prompts the incoming call, then the answering and the call are allowed, and the process of checking the sound effect is completed before the call is connected, so the call with the other party is not influenced completely; or after receiving the call request, allowing the user to answer the call to hear the opposite-end sound, and allowing the user to check the sound effect according to the situation, so that the user can answer the call at the first time, the process of checking the sound effect by the user does not influence the speaking of the opposite side, and the opposite side does not have obvious discomfort. Therefore, the invention is convenient for users to use, does not influence the conversation quality, and can complete the process of detecting the sound effect under the condition of no feeling of the other party.
Example 1
As a preferred embodiment, fig. 1 shows an earphone device 100 according to a first embodiment of the present invention, in which:
the power module 110 is used for supplying power to the earphone device;
the input unit 120 is configured to serve as a human-computer interaction command interface, and receive various control instructions input by a user, where the control instructions at least include an instruction for allowing answering, allowing talking, and allowing or stopping playing local audio, or at least include an instruction for allowing getting on a call, allowing or stopping playing local audio, and may further include an earphone on-off instruction, a volume adjustment instruction, a mute instruction, and the like, and may be an input module such as a touch panel and a key; wherein the instruction of allowing to connect to the telephone means allowing to answer and talk at the same time.
A storage unit 130 for storing various data necessary for the operation of the apparatus, such as a control program and control information; in a preferred embodiment, the storage unit 130 may be further configured to store a preset fifth audio signal, and the headset apparatus may send the preset fifth audio signal to a call counterpart when the second audio signal is played for the headset user to check the sound effect, such as a predetermined artificial voice "hello, please don't hang up, a phone called by you is in a call", a predetermined beep, noise, and music, or a prerecorded greeting when the headset user answers the call, such as "feed, feed" sound, "hello, my Sam", and the like.
The main control unit 140 is a control center of the headset, and is connected to other modules in the headset by using various interfaces and lines, and integrally monitors and schedules each module of the headset to realize each function of the headset;
a communication unit 150 for performing data interaction with an external device according to a predetermined communication protocol; the predetermined communication protocol may be a wired communication protocol or a wireless communication protocol, which may be a standard wired/wireless protocol in the same industry, or a proprietary or proprietary protocol. In a preferred embodiment, the headset device is a bluetooth headset, which establishes a wireless communication link with an external device based on the bluetooth specification.
The encoding unit 151 is configured to encode data that the earphone device needs to output to an external device, and output the encoded data to the communication unit for transmission.
The decoding unit 152 is configured to decode data received by the communication unit 150 from an external device.
The microphone 180 may include one microphone, may include a plurality of microphones, or may be a microphone array. In a preferred embodiment, the microphones 180 include a main microphone disposed near the user's lips and a noise reduction microphone disposed away from the user's lips.
The audio processing unit 160 is configured to process audio data, and includes a to-be-transmitted audio processing module 1603, a to-be-played audio processing module 1601, and an active noise reduction module 1602. The to-be-transmitted audio processing module 1603 receives an audio signal collected by the microphone 180 and outputs a first audio signal to the communication unit 150 and the to-be-played audio processing module 1601 respectively; the to-be-played audio processing module 1601 receives the first audio signal or a third audio signal transmitted from an external device received by the communication unit 150, and outputs a second audio signal obtained after processing the first audio signal to the speaker 170 for playing, or outputs a fourth audio signal obtained after processing the third audio signal to the speaker 170 for playing.
The to-be-transmitted audio processing module 1603 is configured to perform one or more audio signal processing such as analog-to-digital conversion (a/D), digital noise reduction, dual-microphone noise reduction, and sound effect processing on the input audio signal, so as to improve or change the sound effect of the input audio signal. The analog-to-digital conversion is used for converting an analog audio signal collected by a microphone into a digital audio signal, and the digital noise reduction is used for performing digital acoustic noise elimination in a digital domain to remove steady-state noise, white noise and the like. The dual-microphone noise reduction is used for carrying out noise reduction processing on an audio signal acquired by a main microphone based on the audio signal acquired by a noise reduction microphone so as to eliminate environmental noise in the audio signal acquired by the main microphone, so that the audio signal acquired by the main microphone can be transmitted to a far-end opposite party in a clear manner, and the dual-microphone noise reduction can be completed before analog-to-digital conversion and also can be completed after the analog-to-digital conversion. The sound effect processing may be various, such as one or more of transposition processing, mixing processing, or other sound effect processing. The tone-changing process is to change the tone of the voice signal in the audio signal collected by the microphone to obtain the sound-changing sound effects of female voice changing male voice, male voice changing female voice, baby voice, electric voice, etc., and one specific implementation method can refer to chinese patent ZL201010164983.4, a voice tone-changing method and device. The audio mixing processing may be adding background sound such as noise, musical sound, train whistle, bell sound and the like to the audio signal collected by the microphone 180, so as to protect the privacy of the user, help the user not to be known by the other party of the communication, or delegate the comfort of the other party, or play the sound, play the fun, add the fun to the communication, and a specific implementation method may refer to chinese patent application 2011cn10422527. x, a method for adding background sound and a bluetooth headset.
The audio processing module 1601 to be played is configured to perform one or more audio signal processing such as digital-to-analog conversion, Power Amplification (PA), volume adjustment, and the like on an input audio signal, so as to obtain an audio signal suitable for being played by a speaker. Therefore, in practical implementation, a person skilled in the art can implement the to-be-played audio processing module 1601 by using various suitable audio signal processing methods according to actual needs, and is not limited to the variety listed herein. For example, in a two-channel headphone or a stereo headphone, audio signal processing for dividing channels of a received audio signal may be added to play the audio signal in different channels.
The active noise reduction module 1602 is configured to analyze a noise audio signal collected by the noise reduction microphone, generate a noise reduction signal with a phase opposite to that of the noise audio signal, and play the noise reduction signal through the speaker 170.
The speaker 170 may be a mono speaker or a multi-channel speaker. As a preferred embodiment, the speaker 170 includes a left channel speaker and a right channel speaker, so that when only used for playing the fourth audio signal, the same fourth audio signal can be played simultaneously in two channels, the left channel audio in the fourth audio signal can also be played through the left channel speaker, and the right channel audio in the fourth audio signal can be played through the right channel speaker, thereby realizing a stereo playing function. When the second audio signal and the fourth audio signal need to be played simultaneously, one of the left channel speaker and the right channel speaker may be used to play the second audio signal, and the other may be used to play the fourth audio signal. And after the second audio signal is stopped to be played, the initial setting is restored, the same fourth audio signal is played by adopting two sound channels simultaneously, or the left and right sound channels in the fourth audio signal are respectively played by adopting the two sound channels, so that the stereo playing is realized.
In the process of a call, the main control unit 140 is configured to detect whether to play a local audio and detect whether to allow the call after detecting a call request from an external device;
when local audio is allowed to be played and/or a call is allowed, the microphone 180 is controlled to collect a local audio signal including local environmental sound, and the to-be-transmitted audio processing module 1603 performs audio signal processing on the local audio signal to output a first audio signal;
when local audio is allowed to be played, the to-be-played audio processing module 1601 is controlled to perform audio signal processing on the first audio signal to output a second audio signal, and the speaker 170 is controlled to play the second audio signal;
when the call is allowed, the communication unit 150 is controlled to transmit the first audio signal to an external device,
in addition, the main control unit 140 is further configured to detect whether to allow answering, and when detecting that answering is allowed, control the communication unit 150 to receive a third audio signal from an external device, and output the third audio signal to the audio module to be played 1601 for audio signal processing to obtain a fourth audio signal, and control the speaker 170 to play the fourth audio signal.
In one embodiment, the first audio signal is encoded by the encoding unit 151 and then transmitted to the external device through the communication unit 150; after receiving the data stream from the external device, the communication unit 150 obtains the third audio signal after decoding by the decoding unit 152.
Based on the same inventive concept, an embodiment of the present invention further provides a communication method of an earphone device, including:
detecting whether to play local audio or not after detecting a call request from an external device, detecting whether to allow a call or not,
when local audio is allowed to be played and/or conversation is allowed, acquiring a local audio signal containing local environment sound, and executing an audio processing step to be sent on the local audio signal to obtain a first audio signal;
when local audio is allowed to be played, executing a to-be-played audio processing step on the first audio signal to obtain a second audio signal, and playing the second audio signal by the earphone device;
and when the conversation is allowed, the earphone device sends the first audio signal to the external equipment.
Example 2
Fig. 2 shows a communication method of an earphone device according to a second embodiment of the present invention. Obviously, this method can be applied to the headphone device in embodiment 1, in which:
step 201, detecting whether answering is allowed;
the instruction for allowing or rejecting listening may be given by the user operating an input unit on the earphone device or operating a mobile communication device such as a mobile phone connected to the earphone device.
When the incoming call is allowed to be answered, step 202 is entered, and step 211 is executed at the same time, otherwise, the answering allowing instruction is continuously waited. In a preferred embodiment, if no instruction for allowing answering is received, the on-hook operation can be automatically executed after the preset time is exceeded, and the call is ended.
After receiving the instruction of rejecting answering, the method jumps to step 220 to execute an on-hook operation and end the call.
as a preferred embodiment, steps 203 and 205 may also be performed simultaneously when local audio is allowed to be played.
the audio processing step to be transmitted is used for performing one or more audio signal processing such as analog-to-digital conversion (A/D), digital noise reduction, dual-microphone noise reduction, sound effect processing and the like on the input audio signal so as to improve or change the sound effect of the input audio signal.
the audio processing step to be played is used for processing one or more audio signals such as digital-to-analog conversion, power amplification, volume adjustment and the like of the input audio signal so as to obtain an audio signal suitable for being played by the loudspeaker.
as a preferred mode, in order to reduce the uncomfortable feeling of the call counterpart as much as possible because the earphone user does not participate in the call in time, when the earphone user selects to play the local audio, a group of predetermined fifth audio signals is sent to the call counterpart, for example, a predetermined artificial voice "you are good, please don't hang up, and the phone called by you is in the call", so that the call comfort of the call counterpart is ensured, and therefore, the good experience feeling of the user on the earphone device of the present invention is further increased;
step 206, detecting whether the time for playing the local audio reaches a preset time or whether an instruction for stopping playing the local audio is received;
when detecting that the playing time reaches the preset time or receiving a playing stopping instruction sent by the user, entering step 207, and stopping playing the local audio; otherwise, returning to step 203, continuing to collect the local audio signal, and playing the second audio signal.
The predetermined time period may be set to a short time period of 3s, 5s, etc., so that the user does not feel to wait too long even though he has enough time to listen to the local audio.
when a call permission instruction input by the user is detected, step 208 is entered, and when the user selects not to permit the call, step 220 is entered.
Alternatively, this step may be omitted, that is, after detecting that the playing time has reached the predetermined time or receiving the playing stop command from the user, the step proceeds to step 208 directly as a default to allow the call.
Therefore, the user finishes listening to the sound effect of the local audio before normal conversation and enters a normal conversation state with the opposite conversation terminal.
the third audio signal may be an audio signal such as a voice sent by the other party of the call.
in step 213, the earphone device plays the fourth audio signal.
Since step 204 and step 213 play two audio signals respectively, in one embodiment, the to-be-played audio processing step may further include a synthesizing process, that is, the second audio signal and the fourth audio signal to be played are synthesized into one audio signal and played through a speaker. During the synthesis, the volume of one of the audio signals may be controlled to be smaller than that of the other audio signal, so as to highlight the audio signal that the user currently wants to listen to, for example, the volume of the second audio signal is made larger than that of the fourth audio signal, so that the user can listen to the local audio collected by the microphone after the audio processing to be transmitted. After the second audio signal is stopped from being played in step 206, the volume of the fourth audio signal is resumed. In another preferred embodiment, the speakers include a left channel speaker and a right channel speaker, and one of the channels of the speakers plays one of the channels of audio signals, and the other channel of the speakers plays the other channel of audio signals, so that the user can listen to the sounds from different sources from the two channels, and can listen to the sound of the other party clearly without affecting the listening to the local audio collected by the microphone. The second audio signal is stopped in step 206 and the speakers of the two channels are resumed to play the fourth audio signal.
Based on the method for the earphone device to communicate, after receiving the incoming call request, the earphone user can allow to answer the call. At this time, the user of the earphone can listen to the voice of the incoming call party, and after selecting to allow the local audio to be played, the user can speak a certain voice, and listen to the sound effect from the earphone in an attempt, such as filtering out the environmental sound, adding the background sound, changing the tone of the user, changing the voice of the user from male to female, and the like. After confirming that the sound effect is the effect desired by the user, the user starts the call function to make a normal call with the other party.
For the other party of the call, the other party of the call begins speaking after hearing the call is answered. However, at this time, the user of the headset does not allow the user to talk, and cannot hear the real sound emitted by the user of the headset, if the user of the headset sets the fifth audio signal in advance, the user of the headset can hear the fifth audio signal at this time, and if the user of the headset does not set the fifth audio signal, the user of the headset cannot hear any sound transmitted by the user of the headset at this time. Until the earphone user allows the call, the other party can hear the first audio signal transmitted from the opposite party, namely the audio signal which is sent by the earphone user and processed by the audio to be sent. If the earphone user finally selects not to allow the call to hang up, the call partner is usually regarded as a communication signal failure because the call is hung up after being answered, and the call is not misunderstood and complained because the call is hung up.
Therefore, the embodiment provides a brand-new earphone conversation method, on one hand, the function of confirming the sound effect of conversation in advance is added in the conversation process, the worry of privacy disclosure is avoided, or the awkwardness of changing the conversation environment and even hanging up is avoided, the privacy protection capability is improved, and the use confidence of an earphone user is improved; on the other hand, the traditional mode that the invited calling party allows answering and calling at the same time is changed, confirmation and decision time is reserved for the earphone user before the earphone user decides to normally call with the other party, the use comfort level of the earphone is improved, and the earphone system is more beneficial to the user to maintain good interpersonal communication.
Example 3
Fig. 3 shows a communication method of an earphone device according to a third embodiment of the present invention. Obviously, this method can also be applied to the headphone device in embodiment 1, in which:
when the incoming call is allowed to be answered, steps 310, 320 and 330 are executed, otherwise, the answering allowing instruction is continuously waited. In a preferred embodiment, if no instruction for allowing answering is received, the on-hook operation can be automatically executed after the preset time is exceeded, and the call is ended.
After receiving the instruction of rejecting answering, the method jumps to step 340 to execute an on-hook operation and end the call.
the audio processing step to be transmitted is used for performing one or more audio signal processing such as analog-to-digital conversion (A/D), digital noise reduction, dual-microphone noise reduction, sound effect processing and the like on the input audio signal so as to improve or change the sound effect of the input audio signal.
the audio processing step to be played is used for processing one or more audio signals such as digital-to-analog conversion, power amplification, volume adjustment and the like of the input audio signal so as to obtain an audio signal suitable for being played by the loudspeaker.
Step 313, detecting whether the time for playing the local audio reaches a preset time or whether an instruction for stopping playing the local audio is received;
when it is detected that the playing time has reached the predetermined time or a playing stop instruction sent by the user is received, the method proceeds to step 314, so as to stop playing the local audio; otherwise, returning to step 311, continuing to collect the local audio signal, and playing the second audio signal.
when the call permission instruction input by the user is detected, the step 321 is entered, and when the user selects not to permit the call, the step 340 is entered to end the call.
When the instruction of whether to allow the call input by the user is not detected, in a preferred embodiment, a predetermined time period can be waited so that the user has enough time to select whether to allow the call. As a further preferable implementation, within the predetermined time period of waiting for the instruction of whether to allow the call input by the user, the method of example 2 may be referred to, and a preset fifth audio signal may be sent to the external device until the instruction of whether to allow the call input by the user is detected.
it should be appreciated that step 321 and step 311 may be the same step when the local audio is played and the first audio signal is transmitted simultaneously. I.e. the first audio signal obtained in this step may be used for both steps 312 and 322.
Step 322, sending the first audio signal to an external device.
in step 332, the earphone device plays the fourth audio signal.
And step 340, ending the call and hanging up.
Based on the method for the earphone device to communicate, after receiving the incoming call request, the earphone user can allow to answer the call first, and then allow to communicate and play the local audio at the same time. In this case, the user of the earphone can listen to the voice transmitted to the other party from the speaker of the earphone while talking normally with the other party. At this time, the user can confirm the sound effect during the call, and can adjust the sound effect of the earphone at any time during the call, for example, when the noise is too large, the wearing mode of the earphone is adjusted to avoid the failure of the noise reduction function of the dual microphones or change the environment of the body to avoid the complexity of the environmental noise and the unsatisfactory noise reduction of the earphone; or starting sound changing processing at any time during the call, increasing background sound and the like, and sharing joyful time with the call counterpart.
Therefore, the earphone communication method provided by the embodiment can not only find the defect of the communication sound effect at any time, but also add much fun to the earphone communication process.
As another variation of embodiment 3, step 300 and steps 310 and 320 may also be combined into one step, i.e. whether to allow listening and talking at the same time, if so, it is considered that local audio is also allowed to be played, and then steps 311, 321 and 331 are performed, and steps 311 and 321 may be combined into one step. Thus, similar to the one-key telephone answering function in the prior art, the function of playing the local audio is also started. The earphone user can use the earphone more conveniently without privacy concerns.
Example 4
Fig. 4 shows a communication method of an earphone device according to a fourth embodiment of the present invention. Obviously, this method can be applied to the headphone device in embodiment 1, in which:
when detecting that the playing time reaches a preset time or receiving a playing stopping instruction sent by a user, entering step 405, thereby stopping playing the local audio; otherwise, returning to step 401, continuing to collect the local audio signal, and playing the second audio signal.
when the answering and the talking are allowed, steps 406 and 408 are executed; after receiving the instruction of rejecting answering, the method goes to step 411 to execute an on-hook operation and end the call.
the third audio signal may be an audio signal such as a voice sent by the other party of the call.
in step 410, the earphone device plays the fourth audio signal.
Based on the communication method of the earphone device provided by the embodiment, after receiving the incoming call request, the earphone user can firstly allow the local audio to be played so as to detect the sound effect of the communication, and then allow the normal communication when confirming that the sound effect is ideal. Unlike embodiments 2 and 3, step 405 in this embodiment is similar to the function of a one-key phone call in the prior art, and simultaneously starts the answering and calling functions. Compared with the embodiment 2 and the embodiment 3, in the embodiment, the process of confirming the call sound effect by the user is set in the incoming call ringing stage of the earphone, so that the time for the user to check and adjust the call sound effect of the earphone is reserved, and no influence is brought to the call counterpart. The user operation is simple, the use is convenient, and the privacy protection performance is good.
Example 5
Fig. 5 shows a headphone device 500 according to a fifth embodiment of the present invention, wherein the difference between the headphone device 100 of embodiment 1 and the audio processing unit of the headphone device 500 is that the audio processing unit only includes the audio processing module to be transmitted and the audio processing module to be played. And the sending audio processing module only carries out analog-to-digital conversion and digital noise reduction processing on the input audio signal. Therefore, the audio processing process is relatively simple with respect to the headphone apparatus 100. It is obvious that the earphone device 500 of the present embodiment can still be used to implement the conversation method in embodiments 2, 3 and 4.
By adopting the earphone device and the communication method in the embodiment of the application, the audio signal with the sound effect which is closest to the sound effect of the other party in the communication can be played in the earphone, so that the user can confirm or adjust the communication in time, the privacy of the user is protected, and the earphone is more convenient and comfortable to use.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.
Claims (11)
1. A conversation method of an earphone device is characterized in that:
detecting whether to play local audio or not after detecting a call request from an external device, detecting whether to allow a call or not,
when local audio is allowed to be played and/or conversation is allowed, acquiring a local audio signal containing local environment sound, and executing an audio processing step to be sent on the local audio signal to obtain a first audio signal;
when local audio is allowed to be played, executing a to-be-played audio processing step on the first audio signal to obtain a second audio signal, and playing the second audio signal by the earphone device;
and when the conversation is allowed, the earphone device sends the first audio signal to the external equipment.
2. The method of claim 1, wherein: the audio processing step to be transmitted comprises one or more audio signal processing of analog-to-digital conversion, digital noise reduction, double-microphone noise reduction and sound effect processing aiming at the local audio signal;
the audio processing step to be played comprises one or more audio signal processing steps of digital-to-analog conversion, power amplification and volume adjustment aiming at the input audio signals.
3. The method of claim 1, wherein: after detecting a call request from an external device, detecting whether answering is allowed or not, and then detecting whether local audio is played and whether the call is allowed or not; or whether the local audio is played or not is detected, and then whether the answering and the conversation are allowed or not is detected.
4. The method of claim 3, wherein: the detecting whether to play the local audio and whether to allow the call is to detect whether to play the local audio at first, and play the second audio signal when the playing is allowed until the time for playing the local audio reaches a preset time or an instruction for stopping playing the local audio is detected; when detecting that the local audio is not allowed to be played or the second audio signal is stopped to be played, detecting whether the call is allowed or not; alternatively, the first and second electrodes may be,
the detecting whether to play the local audio and whether to allow the call is to simultaneously detect whether to allow the local audio and whether to allow the call, and when both are allowed, executing the audio processing step to be played on the first audio signal, and executing the step of sending the first audio signal to the external device.
5. The method of claim 3, wherein: and after the listening is allowed, when the fact that the local audio is allowed to be played is detected, and whether the conversation is allowed is not detected or not is not detected, sending a preset fifth audio signal to the external equipment.
6. A method as claimed in claim 1 or 3, characterized by: when the condition that answering is allowed is detected, a third audio signal from external equipment is received, the audio processing step to be played is executed on the third audio signal to obtain a fourth audio signal, and the fourth audio signal is played by the earphone device.
7. The method of claim 6, wherein: the earphone device adopts one of a left channel loudspeaker and a right channel loudspeaker to play the second audio signal and adopts the other loudspeaker to play the fourth audio signal.
8. The method of claim 6, wherein: and the step of processing the audio to be played further comprises synthesis processing, wherein the second audio signal and the fourth audio signal are synthesized and played through a loudspeaker.
9. The method of claim 8, wherein: and controlling the volume of one of the second audio signal and the fourth audio signal to be smaller than that of the other audio signal during the synthesis processing.
10. The method of claim 2, wherein: the sound effect processing comprises one or more of tone changing processing and mixing processing.
11. The method of claim 1, wherein: the earphone device is a Bluetooth earphone.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911073314.3A CN110856068B (en) | 2019-11-05 | 2019-11-05 | Communication method of earphone device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911073314.3A CN110856068B (en) | 2019-11-05 | 2019-11-05 | Communication method of earphone device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110856068A true CN110856068A (en) | 2020-02-28 |
| CN110856068B CN110856068B (en) | 2022-09-09 |
Family
ID=69599540
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911073314.3A Active CN110856068B (en) | 2019-11-05 | 2019-11-05 | Communication method of earphone device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110856068B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112954528A (en) * | 2021-02-20 | 2021-06-11 | 英华达（上海）科技有限公司 | Method for transmitting audio data |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060262944A1 (en) * | 2003-02-25 | 2006-11-23 | Oticon A/S | Method for detection of own voice activity in a communication device |
| CN102594975A (en) * | 2011-01-08 | 2012-07-18 | 深圳富泰宏精密工业有限公司 | Call control system and method |
| CN103825993A (en) * | 2014-03-11 | 2014-05-28 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for treating environment sound during conversation |
| CN105872884A (en) * | 2016-05-24 | 2016-08-17 | Tcl通力电子（惠州）有限公司 | Headset as well as downlink noise reduction circuit and method for headset |
| CN106162413A (en) * | 2016-09-07 | 2016-11-23 | 合肥中感微电子有限公司 | The Headphone device of specific environment sound prompting pattern |
| CN106210960A (en) * | 2016-09-07 | 2016-12-07 | 合肥中感微电子有限公司 | There is the Headphone device of local call situation affirmation mode |
| CN109873894A (en) * | 2019-02-28 | 2019-06-11 | 维沃移动通信有限公司 | A kind of volume adjusting method and mobile terminal |
-
2019
- 2019-11-05 CN CN201911073314.3A patent/CN110856068B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060262944A1 (en) * | 2003-02-25 | 2006-11-23 | Oticon A/S | Method for detection of own voice activity in a communication device |
| CN102594975A (en) * | 2011-01-08 | 2012-07-18 | 深圳富泰宏精密工业有限公司 | Call control system and method |
| CN103825993A (en) * | 2014-03-11 | 2014-05-28 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for treating environment sound during conversation |
| CN105872884A (en) * | 2016-05-24 | 2016-08-17 | Tcl通力电子（惠州）有限公司 | Headset as well as downlink noise reduction circuit and method for headset |
| CN106162413A (en) * | 2016-09-07 | 2016-11-23 | 合肥中感微电子有限公司 | The Headphone device of specific environment sound prompting pattern |
| CN106210960A (en) * | 2016-09-07 | 2016-12-07 | 合肥中感微电子有限公司 | There is the Headphone device of local call situation affirmation mode |
| CN109873894A (en) * | 2019-02-28 | 2019-06-11 | 维沃移动通信有限公司 | A kind of volume adjusting method and mobile terminal |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112954528A (en) * | 2021-02-20 | 2021-06-11 | 英华达（上海）科技有限公司 | Method for transmitting audio data |
| CN112954528B (en) * | 2021-02-20 | 2023-01-24 | 英华达（上海）科技有限公司 | Method for transmitting audio data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110856068B (en) | 2022-09-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP1869793B1 (en) | A communication apparatus | |
| US8488820B2 (en) | Spatial audio processing method, program product, electronic device and system | |
| CN110602594A (en) | Earphone device with specific environment sound reminding mode | |
| CN106028208A (en) | Wireless karaoke microphone headset | |
| CN106170108B (en) | Earphone device with decibel reminding mode | |
| WO2006025493A1 (en) | Information terminal | |
| CN110636402A (en) | Earphone device with local call condition confirmation mode | |
| US20220286538A1 (en) | Earphone device and communication method | |
| US20100248704A1 (en) | Process and device for the acquisition, transmission, and reproduction of sound events for communication applications | |
| CN110933555A (en) | TWS noise reduction earphone and noise reduction method and device thereof | |
| CN110662204B (en) | Music and voice transmission operation method based on Bluetooth | |
| CN110856068B (en) | Communication method of earphone device | |
| WO2013131367A1 (en) | Multi-decoder audio system, system signal procedure, and formed mobile device | |
| CN111246331A (en) | Wireless panorama sound mixing sound earphone | |
| US8526589B2 (en) | Multi-channel telephony | |
| EP2216975A1 (en) | Telecommunication device | |
| US11665271B2 (en) | Controlling audio output | |
| JP2662825B2 (en) | Conference call terminal | |
| JP2004274147A (en) | Sound field fixed multi-point talking system | |
| JP2006174198A (en) | Voice reproduction terminal, voice reproduction method, voice reproduction program, and recording medium of voice reproduction program | |
| TW202341763A (en) | Multi-user voice communication system having broadcast mechanism | |
| CN116939509A (en) | Multi-person voice call system with broadcasting mechanism | |
| CN114786106A (en) | Bluetooth hearing aid and audio distribution method thereof | |
| JP2502539B2 (en) | Loudspeaker | |
| JP2008311848A (en) | Voice signal processor and voice signal processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |