CN106686259B - The method and device of background sound is shared when a kind of call - Google Patents
The method and device of background sound is shared when a kind of call Download PDFInfo
- Publication number
- CN106686259B CN106686259B CN201710153304.5A CN201710153304A CN106686259B CN 106686259 B CN106686259 B CN 106686259B CN 201710153304 A CN201710153304 A CN 201710153304A CN 106686259 B CN106686259 B CN 106686259B
- Authority
- CN
- China
- Prior art keywords
- background sound
- voice
- unit
- sound
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72433—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for voice messaging, e.g. dictaphones
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Mobile Radio Communication Systems (AREA)
- Telephone Function (AREA)
Abstract
The invention discloses a kind of methods that background sound is shared when call, for in the communication process of local communication device and at least one opposite end communication equipment, this method comprises: after the background sound that application processor receives user shares instruction, under the first call mode, target background sound is then obtained according to the background sound selection instruction of user, and generate the first background sound, if not receiving the first audio mixing halt instruction, application processor is sent to opposite end communication equipment after the first background sound and the voice of acquisition are carried out audio mixing in real time；Under the second call mode, application processor obtains the target background sound being stored in background sound storage unit, and communication processor is reached after generating the second background sound, if not receiving the second audio mixing halt instruction, communication processor carries out the second background sound with the voice that local communication device obtains to be sent to opposite end communication equipment after audio mixing generation second mixes sound.This method improves usage experience when user's communication.
Description
Technical field
The present invention relates to the method and devices that background sound is shared when mobile communication technology field more particularly to a kind of call.
Background technique
Currently, mobile device is due to easy to use, more and more important in people's daily life, people set movement
Standby functional requirement is also more and more.Such as when call, once the air time is too long, both call sides will be allowed to feel dull, weary
Taste.
It, can be in joining background voice in call in order to increase atmosphere for above situation.In the prior art, patent
200420111442.5 disclose one kind can provide the electronic device of background sound for phone, be by increasing newly for mobile device
External equipment is added to play background sound, which not only adds user costs, and in actual use, due to external environment
The factors such as influence, will lead to other side instead and hear a riot of sound, and then affect atmosphere.
How under the premise of not influencing user's communication quality, increase background sound when call, to improve user's
Usage experience is the current mobile device call technical issues that need to address.
Summary of the invention
In view of this, the present invention proposes a kind of method and device of shared background sound when call, to solve in the prior art
Existing technological deficiency.
In order to achieve the above objectives, the technical solution of the embodiment of the present invention is achieved in that
The embodiment of the invention discloses a kind of methods that background sound is shared when call, are used for local communication device and at least one
In the communication process of a opposite end communication equipment, the local communication device includes: application processor, communication processor, background sound
It storage unit, voice playing unit, voice collecting unit, first control unit, the second control unit, network communication unit and penetrates
Frequency unit；
The background sound storage unit, the communication processor, the voice playing unit, the voice collecting unit,
The first control unit and the network communication unit are connect with the application processor, and the communication processor is distinguished
It is connect with the voice playing unit, the voice collecting unit, second control unit and the radio frequency unit；
The described method includes:
After the background sound that a1, the application processor receive user shares instruction, judge present talk mode for first
Call mode or the second call mode then enter step a2 if the first call mode, if the second call mode, then into
Enter step a4；
A2, the application processor are obtained and are stored in background sound storage unit according to the background sound selection instruction of user
Target background sound, and generate first background sound with the first audio format and the first sample rate, and execute step a3；
A3, the application processor check whether to receive the first audio mixing halt instruction of first control unit, if not receiving,
A31 is then entered step, if receiving, enters step a32；
A31, the application processor obtain the voice collecting unit of first background sound and local communication device
After voice carries out audio mixing generation the first mixing sound, the first mixing sound is sent to opposite end via network communication unit in real time
Communication equipment；
A32, the application processor directly pass through the voice that the voice collecting unit of local communication device obtains in real time
Opposite end communication equipment is sent to by network communication unit；
A4, the application processor are obtained and are stored in background sound storage unit according to the background sound selection instruction of user
Target background sound, and generate second background sound with the second audio format and the second sample rate, and by the second background sound
Communication processor is reached, step a5 is then executed；
A5, the communication processor check whether to receive the second audio mixing halt instruction of the second control unit, if not receiving,
A51 is then entered step, if receiving, enters step a52；
A51, the communication processor obtain the voice collecting unit of second background sound and local communication device
After voice carries out audio mixing generation the second mixing sound, the second mixing sound is sent to opposite end communication via radio frequency unit in real time
Equipment；
A52, the communication processor directly pass through the voice that the voice collecting unit of local communication device obtains in real time
Opposite end communication equipment is sent to by radio frequency unit.
Optionally, after the step a2, further includes:
A60, the application processor receive what opposite end communication equipment sended over via the network communication unit in real time
Voice, and execute step a61；
A61, the application processor check whether to receive the third audio mixing halt instruction of first control unit, if not receiving
It arrives, then enters step a62, if receiving, enter step a63；
A62, the application processor mix the voice that opposite end communication equipment sends over first background sound
After sound generates third mixing sound, third is mixed into the voice playing unit that sound is sent to local communication device in real time；
The voice of the opposite end communication equipment received is directly sent to local logical by a63, the application processor in real time
Believe the voice playing unit of equipment.
Optionally, after the step a4, further includes:
A70, the communication processor receive the voice that opposite end communication equipment sends over via the radio frequency unit in real time,
And execute step a71；
A71, the communication processor check whether to receive the 4th audio mixing halt instruction of the second control unit, if not receiving
It arrives, then enters step a72, if receiving, enter step a73；
A72, the communication processor mix the voice that opposite end communication equipment sends over second background sound
After sound generates the 4th mixing sound, the 4th mixing sound is sent to the voice playing unit of local communication device in real time；
The voice of the opposite end communication equipment received is directly sent to local logical by a73, the communication processor in real time
Believe the voice playing unit of equipment.
Optionally, in step a2, the application processor obtains according to the background sound selection instruction of user and is stored in back
Target background sound in scape sound storage unit, and first background sound with the first audio format and the first sample rate is generated,
Include:
The application processor obtains the mesh being stored in background sound storage unit according to the background sound selection instruction of user
Mark background sound receives target background sound；
The application processor check its audio format whether under the first call mode needed for the first audio format one
It causes, if unanimously, without decoding, if inconsistent, the audio format of target background sound is decoded as the first audio format；
The application processor check the target background sound sample rate whether under the first call mode needed for first
Sample rate is consistent, if unanimously, the first back with the first audio format and the first sample rate is generated without resampling
Target background sound resampling is generated first back with the first audio format and the first sample rate if inconsistent by Jing Yin
Jing Yin；
In step a4, the application processor is stored in background sound and deposits according to the background sound selection instruction of user, acquisition
Target background sound in storage unit, and generate second background sound with the second audio format and the second sample rate, comprising:
The application processor obtains the mesh being stored in background sound storage unit according to the background sound selection instruction of user
Mark background sound receives target background sound；
The application processor check its audio format whether under the second call mode needed for the second audio format one
It causes, if unanimously, without decoding, if inconsistent, the audio format of target background sound is decoded as the second audio format；
The application processor check the target background sound sample rate whether under the second call mode needed for second
Sample rate is consistent, if unanimously, the second back with the second audio format and the second sample rate is generated without resampling
Target background sound resampling is generated second back with the second audio format and the second sample rate if inconsistent by Jing Yin
Jing Yin.
Optionally, first sample rate is 16k or 64k；Second sample rate is 8k or 16k.
The embodiment of the invention also discloses the devices that background sound is shared when a kind of call, are set in local communication device,
It include: application processor, communication processor, background sound storage unit, voice playing unit, voice collecting unit, the first control
Unit, the second control unit, network communication unit and radio frequency unit；
The background sound storage unit, the communication processor, the voice playing unit, the voice collecting unit,
The first control unit and the network communication unit are connect with the application processor, and the communication processor and institute
Voice playing unit, the voice collecting unit, second control unit is stated to connect with the radio frequency unit；
Wherein, the application processor includes:
Call mode judgment module is sentenced after the background sound that the call mode judgment module receives user shares instruction
Disconnected present talk mode is the second call mode or the first call mode, and the first sampling module is then notified to act；
First sampling module, first sampling module refer under the first call mode according to the selection of the background sound of user
The target background sound for obtaining and being stored in background sound storage unit is enabled, and is generated with the first audio format and the first sample rate
The first background sound, and the first background sound is reached into the first mix module；
First sampling module is stored in back under the second call mode, according to the acquisition of the background sound selection instruction of user
Target background sound in scape sound storage unit, and second background sound with the second audio format and the second sample rate is generated,
And the second background sound is reached into the second mix module；
First audio mixing halt instruction receiving module, the first audio mixing halt instruction receiving module check whether to receive described
First audio mixing halt instruction of first control unit notifies the first mix module to act, if receiving, notifies if not receiving
The movement of first voice sending module；
First mix module, first mix module is by the voice collecting of first background sound and local communication device
After the voice that unit obtains carries out audio mixing generation the first mixing sound, in real time by the first mixing sound via network communication unit
It is sent to opposite end communication equipment；
First voice sending module, the first voice sending module is directly by the voice collecting unit of local communication device
The voice of acquisition is sent to opposite end communication equipment via network communication unit in real time；
The communication processor includes:
Second audio mixing halt instruction receiving module, the second audio mixing halt instruction receiving module check whether to receive second
Second audio mixing halt instruction of control unit notifies the second mix module to act, if receiving, notifies second if not receiving
The movement of voice sending module；
Second mix module, second mix module is by the voice collecting of second background sound and local communication device
After the voice that unit obtains carries out audio mixing generation the second mixing sound, the second mixing sound is sent via radio frequency unit in real time
To opposite end communication equipment；
Second voice sending module, the second voice sending module is directly by the voice collecting unit of local communication device
The voice of acquisition is sent to opposite end communication equipment via radio frequency unit in real time.
Optionally, it after the first sampling module, is also connected with:
First speech reception module, first speech reception module receive opposite end via the network communication unit in real time
The voice that communication equipment sends over, and third audio mixing halt instruction receiving module is notified to act；
Third audio mixing halt instruction receiving module, the third audio mixing halt instruction receiving module check whether to receive first
The third audio mixing halt instruction of control unit notifies the first mix module to act, if receiving, notifies first if not receiving
Speech reception module movement；
First mix module receives the voice of the opposite end communication equipment of the first speech reception module, and by the voice with
After first background sound carries out audio mixing generation third mixing sound, third is mixed into sound in real time and is sent to local communication device
Voice playing unit；
The voice of the opposite end communication equipment received is directly sent to local in real time by first speech reception module
The voice playing unit of communication equipment.
Optionally, it after the second sampling module, is also connected with:
Second speech reception module, second speech reception module receive opposite end communication via the radio frequency unit in real time
The voice that equipment sends over, and the 4th audio mixing halt instruction receiving module is notified to act；
4th audio mixing halt instruction receiving module, the 4th audio mixing halt instruction receiving module check whether to receive second
4th audio mixing halt instruction of control unit notifies the second mix module to act, if receiving, notifies second if not receiving
Speech reception module movement；
Second mix module receives the voice of the opposite end communication equipment of the second speech reception module, and by the voice with
After second background sound carries out the 4th mixing sound of audio mixing generation, and the 4th mixing sound is sent to local communication device in real time
Voice playing unit；
The voice of the opposite end communication equipment received is directly sent to local in real time by second speech reception module
The voice playing unit of communication equipment.
Optionally, first sampling module obtains under the first call mode according to the background sound selection instruction of user
The target background sound being stored in background sound storage unit, and generation has the first of the first audio format and the first sample rate
Background sound specifically includes:
First sampling module is obtained and is stored in background sound storage unit according to the background sound selection instruction of user
Target background sound receives target background sound；
First sampling module check its audio format whether under the first call mode needed for the first audio format
Unanimously, if meeting, without decoding, if not meeting, the audio format of target background sound is decoded as the first audio format；
First sampling module check the target background sound sample rate whether under the first call mode needed for the
One sample rate is consistent, if unanimously, first back with the first audio format and the first sample rate is generated without resampling
Target background sound resampling is generated first back with the first audio format and the first sample rate if inconsistent by Jing Yin
Jing Yin；
First sampling module is stored in back under the second call mode, according to the acquisition of the background sound selection instruction of user
Target background sound in scape sound storage unit, and second background sound with the second audio format and the second sample rate is generated,
And the second background sound is reached into the second mix module, comprising:
First sampling module is obtained and is stored in background sound storage unit according to the background sound selection instruction of user
Target background sound receives target background sound；
First sampling module check its audio format whether under the one mode of call needed for the second audio format
Unanimously, if meeting, without decoding, if not meeting, the audio format of target background sound is decoded as the second audio format；
First sampling module check the target background sound sample rate whether under the second call mode needed for the
Two sample rates are consistent, if unanimously, second back with the second audio format and the second sample rate is generated without resampling
Target background sound resampling is generated second back with the second audio format and the second sample rate if inconsistent by Jing Yin
Jing Yin.
Optionally, first sample rate is 16k or 64k, and second sample rate is 8k or 16k.
The method and apparatus of shared background sound, can pass through local communication device in communication process when call of the invention
Target background sound is read according to background sound selection instruction, and reaches opposite end communication equipment after carrying out audio mixing, thus not influencing to use
Under the premise of family is conversed, usage experience when user's communication is improved.
Also, the present invention can be automatically selected according to different call modes by communication processor or application
Device is managed to realize the process of audio mixing, to adapt to the shared background sound under different call modes, further promotes making for user
With experience.
In addition, the present invention can realize the various control to stereo process, according to the instruction of control unit so as to reality
Existing background sound is only heard by peer user or is only heard by local user, and the usage experience of user is further increased.
Detailed description of the invention
The method flow diagram of shared background sound when Fig. 1 is the call of the embodiment of the present invention；
The structure drawing of device of shared background sound when Fig. 2 is the call of the embodiment of the present invention；
The detail flowchart of step a2 in the method for background sound is shared when Fig. 3 is the call of the embodiment of the present invention；
The detail flowchart of step a4 in the method for background sound is shared when Fig. 4 is the call of the embodiment of the present invention；
The method sub-process figure one of shared background sound when Fig. 5 is the call of the embodiment of the present invention；
The method sub-process figure two of shared background sound when Fig. 6 is the call of the embodiment of the present invention；
Fig. 7 is the structural schematic diagram of application processor in the device of the embodiment of the present invention；
Fig. 8 is the structural schematic diagram of communication processor in the device of the embodiment of the present invention.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, below by way of specific embodiment and join
See attached drawing, the present invention is described in detail.
In order to influence the technological deficiency of user's communication quality, the present invention when solving increase background sound existing in the prior art
Embodiment discloses a kind of method of shared background sound when call, to improve use under the premise of not influencing user's communication
Usage experience when family is conversed.
To achieve the goals above, the embodiment of the invention discloses a kind of methods that background sound is shared when call, such as Fig. 1 institute
Show, in the communication process of local communication device and at least one opposite end communication equipment.
Before the method for introducing the shared background sound of the present embodiment, the device for using this method is illustrated first.
The structure of local communication device is as shown in Figure 2, comprising: application processor, communication processor, background sound storage are single
Member, voice playing unit, voice collecting unit, first control unit, the second control unit, network communication unit and radio frequency list
Member.
Wherein, background sound storage unit, communication processor, voice playing unit, voice collecting unit, the first control are single
Member, network communication unit connect with application processor, and communication processor respectively with voice playing unit, voice collecting list
Member, radio frequency unit, the connection of the second control unit.
Application processor is the core component of communication equipment, handles the operation executed needed for each application in communication equipment,
Such as multimedia operations.
Communication processor (Communicate Processor, CP) is used as secondary processor, logical for handling mobile phone speech
Talk about relevant work.
The effect of radio frequency unit is to send and receive data by wireless network.Local communication device and opposite end communication equipment
It is realized and is communicated to connect by radio frequency unit.
The effect of voice collecting unit is acquisition voice.This voice not only includes the speech utterance of user, further includes making
The sound of the ambient enviroment of user.When applied in mobile phone, generally microphone.
The effect of voice playing unit is to play voice.There are multiple example, in hardware when applied in mobile phone, such as earphone, raises
Sound device or earpiece.
First control unit can send the first audio mixing halt instruction and the halt instruction of third audio mixing to application processor,
Two control units can send the second audio mixing halt instruction and the 4th audio mixing stop instruction signal to communication processor, to play
The effect of control access.Above-metioned instruction can be generated by user in the movement that clicks of mobile phone screen.
Referring to Fig. 1, the method for the shared background sound of the present embodiment includes:
After the background sound that a1, application processor receive user shares instruction, judge present talk mode for the first call
Mode or the second call mode then enter step a2 if the first call mode, if the second call mode, then enter step
Rapid a4.
It should be noted that the background sound shares instruction can be generated and clicking for user.In one embodiment,
The call page that mobile phone is shown increases background sound virtual key, and user clicks the virtual key, pops up background sound list, for
Family selection.The background sound can be to be a variety of, such as music or the homemade Duan Luyin of user.
It is to be understood that the first call mode is directly to be led to voice messaging using application processor in the present embodiment
It crosses network communication unit and is sent to opposite end communication equipment, such as the VOIP software such as wechat, QQ, Skype, by transmitting data mode
To send voice messaging；Second call mode is that voice messaging is sent to opposite end by radio frequency unit using communication processor
Call under communication equipment, such as existing mobile phone GSM standard.
A2, application processor obtain the mesh being stored in background sound storage unit according to the background sound selection instruction of user
Background sound is marked, and generates first background sound with the first audio format and the first sample rate, and execute step a3.
Optionally, background sound selection instruction is user and clicking background sound listed in background sound list and linking
It generates.Some background sound is selected to link when the user clicks, application processor just accordingly actively goes to obtain background sound storage unit
In the corresponding target background sound, and the target background sound that will acquire is decoded and re-sampling operations.
More specifically, referring to Fig. 3, in step a2, the application processor according to the background sound selection instruction of user,
The target background sound that is stored in background sound storage unit is obtained, and generates there is the first audio format and the first sample rate
First background sound, comprising:
A21, the application processor are obtained and are stored in background sound storage unit according to the background sound selection instruction of user
Target background sound receive target background sound；
A22, the application processor check its audio format whether under the first call mode needed for the first audio lattice
Formula is consistent, if unanimously, without decoding, if inconsistent, the audio format of target background sound is decoded as the first audio lattice
Formula；
A23, the application processor check the target background sound sample rate whether under the first call mode needed for
First sample rate is consistent, if unanimously, with the first audio format and the first sample rate is generated without resampling
One background sound, if inconsistent, target background sound resampling, which is generated, has the of the first audio format and the first sample rate
One background sound.
In the present embodiment, the first sample rate be can be, but not limited to as 16k or 64k, specifically as needed for the first call mode
Sample rate determines；First audio format can be PCM format.Such as after getting target background sound, application processor is first
It checks its audio format, if PCM format, then does not need to decode；If mp3 format, then need to decode.Then its sampling is checked
If rate does not need resampling consistent with the first sample rate, if inconsistent, carries out resampling, ultimately generates and adopt with first
First background sound of sample rate and the first audio format.
A3, application processor check whether to receive the first audio mixing halt instruction of first control unit, if not receiving, into
Enter step a31, if receiving, enters step a32.
The effect of first audio mixing halt instruction is to stop application processor for the first background sound and this under the first call mode
The voice that the voice collecting unit of ground communication equipment obtains carries out audio mixing.It can click movement in mobile phone screen by user
And it generates.Such as user selects the broadcast mode of background sound for " only oneself is listened " under the first call mode, then accordingly giving birth to
At the first audio mixing halt instruction, then can only local communication device background sound is audible, and opposite end communication equipment can't hear background sound.
The first audio mixing halt instruction, the second audio mixing halt instruction referred in the present embodiment is corresponding under the first call mode
The control of audio mixing is carried out with processor；The halt instruction of third audio mixing, the 4th audio mixing halt instruction are under the second call mode to logical
Believe that processor carries out the control of audio mixing.Also, the second audio mixing halt instruction, the halt instruction of third audio mixing, the stopping of the 4th audio mixing refer to
The effect of order is similar with the effect of the first audio mixing halt instruction, hereinafter just no longer narration in detail one by one.
The voice that a31, application processor obtain the voice collecting unit of first background sound and local communication device
After carrying out audio mixing generation the first mixing sound, the first mixing sound is sent to opposite end communication via network communication unit in real time
Equipment.
It should be noted that for the process of audio mixing, and where the improvement of non-present invention, it is not reinflated superfluous herein
It states.
The voice that a32, application processor directly obtain the voice collecting unit of local communication device is in real time via net
Network communication unit is sent to opposite end communication equipment.
Above-mentioned steps a2~a32 is the step under the first call mode, and below step a4~a52 introduces the second call mode
Under step.
A4, application processor obtain the mesh being stored in background sound storage unit according to the background sound selection instruction of user
Background sound is marked, and generates second background sound with the second audio format and the second sample rate, and the second background sound is reached
Communication processor, and execute step a5.
More specifically, referring to fig. 4, in step a4, the application processor according to the background sound selection instruction of user,
The target background sound that is stored in background sound storage unit is obtained, and generates there is the second audio format and the second sample rate
Second background sound, comprising:
A41, the application processor are obtained and are stored in background sound storage unit according to the background sound selection instruction of user
Target background sound receive target background sound；
A42, the application processor check its audio format whether under the one mode of call needed for the second audio lattice
Formula is consistent, if unanimously, without decoding, if inconsistent, the audio format of target background sound is decoded as the second audio lattice
Formula；
A43, the application processor check the target background sound sample rate whether under the second call mode needed for
Second sample rate is consistent, if unanimously, with the second audio format and the second sample rate is generated without resampling
Two background sounds, if inconsistent, target background sound resampling, which is generated, has the of the second audio format and the second sample rate
Two background sounds.
In the present embodiment, the second sample rate can be, but not limited to specifically be formulated by operator, the second sound for 8k or 16k
Frequency format can be PCM format.Such as after getting target background sound, application processor first checks its audio format, if
PCM format does not need then to decode；If mp3 format, then need to decode.Then its sample rate is checked, if with the first sample rate one
It causes, does not then need resampling, if inconsistent, carry out resampling, ultimately generate with the second audio format and the second sample rate
The second background sound.
A5, communication processor check whether to receive the second audio mixing halt instruction of the second control unit, if not receiving, into
Enter step a51, if receiving, enters step a52.
The voice that a51, communication processor obtain the voice collecting unit of second background sound and local communication device
After carrying out audio mixing generation the second mixing sound, the second mixing sound is sent to opposite end communication via radio frequency unit in real time and is set
It is standby；
A52, communication processor are directly by voice that the voice collecting unit of local communication device obtains in real time via penetrating
Frequency unit is sent to opposite end communication equipment.
Above-mentioned steps are that local communication device issues sending voice and back in the second call mode and the first call mode respectively
The audio mixing of scape sound to opposite end communication equipment flow chart.In actual use, local communication device is also required to background sound and other side
The voice sent carries out audio mixing and plays, and stream when receiving opposite end communication equipment for local communication device is described below
Journey.
Optionally, under the first call mode, referring to Fig. 5, after step a2, further includes:
A60, the application processor receive the voice that opposite end communication equipment sends over via network communication unit in real time,
And execute step a61；
A61, the application processor check whether to receive the third audio mixing halt instruction of first control unit, if not receiving
It arrives, then enters step a62, if receiving, enter step a63；
A62, the application processor mix the voice that opposite end communication equipment sends over first background sound
After sound generates third mixing sound, third is mixed into the voice playing unit that sound is sent to local communication device in real time；
The voice of the opposite end communication equipment received is directly sent to local logical by a63, the application processor in real time
Believe the voice playing unit of equipment.
By step a60~a63, under the first call mode, application processor can be in real time by opposite end communication equipment
Voice (such as voice of peer user) audio mixing after be sent to the voice playing unit of local communication device.
Optionally, under the second call mode, referring to Fig. 6, after step a4, further includes:
A70, the communication processor receive the voice that opposite end communication equipment sends over via the radio frequency unit in real time,
And execute step a71；
A71, the communication processor check whether to receive the 4th audio mixing halt instruction of the second control unit, if not receiving
It arrives, then enters step a72, if receiving, enter step a73；
A72, the communication processor mix the voice that opposite end communication equipment sends over second background sound
After sound generates the 4th mixing sound, the 4th mixing sound is sent to the voice playing unit of local communication device in real time；
The voice of the opposite end communication equipment received is directly sent to local logical by a73, the communication processor in real time
Believe the voice playing unit of equipment.
By step a70~a73, under the second call mode, application processor can be in real time by opposite end communication equipment
Voice (such as voice of peer user) audio mixing after be sent to the voice playing unit of local communication device.
Above method process realizes the process of shared background sound when call of the local communication device with opposite end communication equipment.
Also, by control unit, it can also realize following functions:
1) when conversing, only local user hears that background sound, peer user can't hear background sound (such as when meeting)
2) when conversing, peer user is only allowed to hear background sound, local user can't hear background sound.
In conclusion when call of the invention shared background sound method, local communication can be passed through in communication process
Equipment reads target background sound according to background sound selection instruction, and reaches opposite end communication equipment after carrying out audio mixing, thus in not shadow
Under the premise of ringing user's communication, usage experience when user's communication is improved.
Also, the present invention can be automatically selected according to different call modes by communication processor or application
Device is managed to realize the process of audio mixing, to adapt to the shared background sound under different call modes, further promotes making for user
With experience.
In addition, the present invention can realize the various control to stereo process, according to the instruction of control unit so as to reality
Existing background sound is only heard by peer user or is only heard by local user, and the usage experience of user is further increased.
The embodiment of the invention also discloses the devices that background sound is shared when a kind of call, as shown in figs. 2,7 and 8, if
It is placed in local communication device, comprising: application processor, communication processor, background sound storage unit, voice playing unit, language
Sound acquisition unit, first control unit, the second control unit and radio frequency unit；
Background sound storage unit, the communication processor, the voice playing unit, the voice collecting unit, first
Control unit and network communication unit are connect with application processor, and the communication processor and voice playing unit, voice
Acquisition unit, the second control unit are connected with radio frequency unit.
Wherein, referring to Fig. 7, application processor includes:
Call mode judgment module is sentenced after the background sound that the call mode judgment module receives user shares instruction
Disconnected present talk mode is the second call mode or the first call mode, and the first sampling module is then notified to act；First adopts
Egf block, first sampling module is under the first call mode, and according to the background sound selection instruction of user, acquisition is stored in back
Target background sound in scape sound storage unit, and first background sound with the first audio format and the first sample rate is generated,
And the first background sound is reached into the first mix module；
First sampling module is stored in back under the second call mode, according to the acquisition of the background sound selection instruction of user
Target background sound in scape sound storage unit, and second background sound with the second audio format and the second sample rate is generated,
And the second background sound is reached into the second mix module,；
First audio mixing halt instruction receiving module, the first audio mixing halt instruction receiving module check whether to receive first
First audio mixing halt instruction of control unit notifies the first mix module to act, if receiving, notifies first if not receiving
The movement of voice sending module；
First mix module, first mix module is by the voice collecting of first background sound and local communication device
After the voice that unit obtains carries out audio mixing generation the first mixing sound, in real time by the first mixing sound via network communication unit
It is sent to opposite end communication equipment；
First voice sending module, the first voice sending module is directly by the voice collecting unit of local communication device
The voice of acquisition is sent to opposite end communication equipment via network communication unit in real time.
Optionally, the first sample rate is 16k or 64k, and the second sample rate is 8k or 16k.
Referring to Fig. 8, communication processor includes:
Second audio mixing halt instruction receiving module, the second audio mixing halt instruction receiving module check whether to receive second
Second audio mixing halt instruction of control unit notifies the second mix module to act, if receiving, notifies second if not receiving
The movement of voice sending module；
Second mix module, second mix module is by the voice collecting of second background sound and local communication device
After the voice that unit obtains carries out audio mixing generation the second mixing sound, the second mixing sound is sent via radio frequency unit in real time
To opposite end communication equipment；
Second voice sending module, the second voice sending module is directly by the voice collecting unit of local communication device
The voice of acquisition is sent to opposite end communication equipment via radio frequency unit in real time.
Optionally, in order to realize that the voice of the opposite end communication equipment under the first call mode carries out audio mixing, referring to Fig. 7,
It is also connected with after first sampling module:
First speech reception module, first speech reception module receive opposite end communication via network communication unit in real time
The voice that equipment sends over, and third audio mixing halt instruction receiving module is notified to act；
Third audio mixing halt instruction receiving module, the third audio mixing halt instruction receiving module check whether to receive first
The third audio mixing halt instruction of control unit notifies the first mix module to act, if receiving, notifies first if not receiving
Speech reception module movement；
First mix module receives the voice of the opposite end communication equipment of the first speech reception module, and by the voice with
After first background sound carries out audio mixing generation third mixing sound, third is mixed into sound in real time and is sent to local communication device
Voice playing unit；
The voice of the opposite end communication equipment received is directly sent to local in real time by first speech reception module
The voice playing unit of communication equipment.
Optionally, in order to realize that the voice of the opposite end communication equipment under the second call mode carries out audio mixing, referring to Fig. 8,
It is also connected with after second sampling module:
Second speech reception module, second speech reception module receive opposite end communication via the radio frequency unit in real time
The voice that equipment sends over, and the 4th audio mixing halt instruction receiving module is notified to act；
4th audio mixing halt instruction receiving module, the 4th audio mixing halt instruction receiving module check whether to receive second
4th audio mixing halt instruction of control unit notifies the second mix module to act, if receiving, notifies second if not receiving
Speech reception module movement；
Second mix module receives the voice of the opposite end communication equipment of the second speech reception module, and by the voice with
After second background sound carries out the 4th mixing sound of audio mixing generation, and the 4th mixing sound is sent to local communication device in real time
Voice playing unit；
The voice of the opposite end communication equipment received is directly sent to local in real time by second speech reception module
The voice playing unit of communication equipment.
Optionally, the first sampling module is obtained according to the background sound selection instruction of user and is stored under the first call mode
Target background sound in background sound storage unit, and generate first background with the first audio format and the first sample rate
Sound specifically includes:
First sampling module obtains the target being stored in background sound storage unit according to the background sound selection instruction of user
Background sound receives target background sound；
First sampling module checks whether its audio format is consistent with the first audio format required under the first call mode,
If meeting, without decoding, if not meeting, the audio format of target background sound is decoded as the first audio format；
First sampling module check the target background sound sample rate whether under the first call mode needed for first adopt
Sample rate is consistent, if unanimously, first background sound with the first audio format and the first sample rate is generated without resampling,
If inconsistent, target background sound resampling is generated to first background sound with the first audio format and the first sample rate.
First sampling module is stored in background sound under the second call mode, according to the acquisition of the background sound selection instruction of user
Target background sound in storage unit, and second background sound with the second audio format and the second sample rate is generated, and will
Second background sound reaches the second mix module, comprising:
First sampling module obtains the target being stored in background sound storage unit according to the background sound selection instruction of user
Background sound receives target background sound；
First sampling module checks whether its audio format is consistent with the second audio format required under the second call mode,
If meeting, without decoding, if not meeting, the audio format of target background sound is decoded as the second audio format；
First sampling module check the target background sound sample rate whether under the second call mode needed for second adopt
Sample rate is consistent, if unanimously, second background sound with the second audio format and the second sample rate is generated without resampling,
If inconsistent, target background sound resampling is generated to second background sound with the second audio format and the second sample rate.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention
Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the present invention.
Claims (10)
1. sharing the method for background sound when a kind of call, which is characterized in that logical for local communication device and at least one opposite end
Believe equipment communication process in, the local communication device include: application processor, communication processor, background sound storage unit,
Voice playing unit, voice collecting unit, first control unit, the second control unit, network communication unit and radio frequency unit；
It is the background sound storage unit, the communication processor, the voice playing unit, the voice collecting unit, described
First control unit and the network communication unit are connect with the application processor, and the communication processor respectively with institute
Voice playing unit, the voice collecting unit, second control unit is stated to connect with the radio frequency unit；
The described method includes:
After the background sound that a1, the application processor receive user shares instruction, judge present talk mode for the first call
Mode or the second call mode then enter step a2 if the first call mode, if the second call mode, then enter step
Rapid a4；
A2, the application processor obtain the mesh being stored in background sound storage unit according to the background sound selection instruction of user
Background sound is marked, and generates first background sound with the first audio format and the first sample rate, and execute step a3；
A3, the application processor check whether to receive the first audio mixing halt instruction of first control unit, if not receiving, into
Enter step a31, if receiving, enters step a32；
The voice that a31, the application processor obtain the voice collecting unit of first background sound and local communication device
After carrying out audio mixing generation the first mixing sound, the first mixing sound is sent to opposite end communication via network communication unit in real time
Equipment；
The voice that a32, the application processor directly obtain the voice collecting unit of local communication device is in real time via net
Network communication unit is sent to opposite end communication equipment；
A4, the application processor obtain the mesh being stored in background sound storage unit according to the background sound selection instruction of user
Background sound is marked, and generates second background sound with the second audio format and the second sample rate, and the second background sound is reached
Then communication processor executes step a5；
A5, the communication processor check whether to receive the second audio mixing halt instruction of the second control unit, if not receiving, into
Enter step a51, if receiving, enters step a52；
The voice that a51, the communication processor obtain the voice collecting unit of second background sound and local communication device
After carrying out audio mixing generation the second mixing sound, the second mixing sound is sent to opposite end communication via radio frequency unit in real time and is set
It is standby；
A52, the communication processor are directly by voice that the voice collecting unit of local communication device obtains in real time via penetrating
Frequency unit is sent to opposite end communication equipment.
2. sharing the method for background sound when call according to claim 1, which is characterized in that after the step a2,
Further include:
A60, the application processor receive the voice that opposite end communication equipment sends over via the network communication unit in real time,
And execute step a61；
A61, the application processor check whether to receive the third audio mixing halt instruction of first control unit, if not receiving,
A62 is entered step, if receiving, enters step a63；
It is raw that the voice and first background sound that a62, the application processor send over opposite end communication equipment carry out audio mixing
After mixing sound at third, third is mixed into the voice playing unit that sound is sent to local communication device in real time；
The voice of the opposite end communication equipment received is directly sent to local communication in real time and set by a63, the application processor
Standby voice playing unit.
3. sharing the method for background sound when call according to claim 1, which is characterized in that after the step a4,
Further include:
A70, the communication processor receive the voice that opposite end communication equipment sends over via the radio frequency unit in real time, and hold
Row step a71；
A71, the communication processor check whether to receive the 4th audio mixing halt instruction of the second control unit, if not receiving,
A72 is entered step, if receiving, enters step a73；
It is raw that the voice and second background sound that a72, the communication processor send over opposite end communication equipment carry out audio mixing
After the 4th mixing sound, the 4th mixing sound is sent to the voice playing unit of local communication device in real time；
The voice of the opposite end communication equipment received is directly sent to local communication in real time and set by a73, the communication processor
Standby voice playing unit.
4. sharing the method for background sound when call according to claim 1, which is characterized in that
In step a2, for the application processor according to the background sound selection instruction of user, it is single that acquisition is stored in background sound storage
Target background sound in member, and generate first background sound with the first audio format and the first sample rate, comprising:
The application processor obtains the target back being stored in background sound storage unit according to the background sound selection instruction of user
Scape sound receives target background sound；
The application processor checks whether its audio format is consistent with the first audio format required under the first call mode, if
Unanimously, then, if inconsistent, the audio format of target background sound is decoded as the first audio format without decoding；
The application processor check the target background sound sample rate whether under the first call mode needed for first sampling
Rate is consistent, if unanimously, the first background sound with the first audio format and the first sample rate is generated without resampling,
If inconsistent, target background sound resampling is generated to first background sound with the first audio format and the first sample rate；
In step a4, for the application processor according to the background sound selection instruction of user, it is single that acquisition is stored in background sound storage
Target background sound in member, and generate second background sound with the second audio format and the second sample rate, comprising:
The application processor obtains the target back being stored in background sound storage unit according to the background sound selection instruction of user
Scape sound receives target background sound；
The application processor checks whether its audio format is consistent with the second audio format required under the second call mode, if
Unanimously, then, if inconsistent, the audio format of target background sound is decoded as the second audio format without decoding；
The application processor check the target background sound sample rate whether under the second call mode needed for second sampling
Rate is consistent, if unanimously, the second background sound with the second audio format and the second sample rate is generated without resampling,
If inconsistent, target background sound resampling is generated to second background sound with the second audio format and the second sample rate.
5. sharing the method for background sound when call according to claim 1, which is characterized in that
First sample rate is 16k or 64k；
Second sample rate is 8k or 16k.
6. sharing the device of background sound when a kind of call, which is characterized in that be set in local communication device, comprising: at application
Manage device, communication processor, background sound storage unit, voice playing unit, voice collecting unit, first control unit, the second control
Unit, network communication unit and radio frequency unit processed；
It is the background sound storage unit, the communication processor, the voice playing unit, the voice collecting unit, described
First control unit and the network communication unit are connect with the application processor, and the communication processor and institute's predicate
Sound broadcast unit, the voice collecting unit, second control unit are connected with the radio frequency unit；
Wherein, the application processor includes:
Call mode judgment module, after the background sound that the call mode judgment module receives user shares instruction, judgement is worked as
Preceding call mode is the second call mode or the first call mode, and the first sampling module is then notified to act；
First sampling module, first sampling module obtain under the first call mode according to the background sound selection instruction of user
It takes the target background sound being stored in background sound storage unit, and generates and have the of the first audio format and the first sample rate
One background sound, and the first background sound is reached into the first mix module；
First sampling module is stored in background sound under the second call mode, according to the acquisition of the background sound selection instruction of user
Target background sound in storage unit, and second background sound with the second audio format and the second sample rate is generated, and will
Second background sound reaches the second mix module；
First audio mixing halt instruction receiving module, the first audio mixing halt instruction receiving module check whether to receive described first
First audio mixing halt instruction of control unit notifies the first mix module to act, if receiving, notifies first if not receiving
The movement of voice sending module；
First mix module, first mix module is by the voice collecting unit of first background sound and local communication device
After the voice of acquisition carries out audio mixing generation the first mixing sound, the first mixing sound is sent via network communication unit in real time
To opposite end communication equipment；
First voice sending module, the first voice sending module directly obtain the voice collecting unit of local communication device
Voice be sent to opposite end communication equipment via network communication unit in real time；
The communication processor includes:
Second audio mixing halt instruction receiving module, the second audio mixing halt instruction receiving module check whether to receive the second control
Second audio mixing halt instruction of unit notifies the second mix module to act, if receiving, notifies the second voice if not receiving
Sending module movement；
Second mix module, second mix module is by the voice collecting unit of second background sound and local communication device
The voice of acquisition carries out after audio mixing generates the second mixing sound, is in real time sent to the second mixing sound pair via radio frequency unit
Hold communication equipment；
Second voice sending module, the second voice sending module directly obtain the voice collecting unit of local communication device
Voice be sent to opposite end communication equipment via radio frequency unit in real time.
7. when call according to claim 6 share background sound device, which is characterized in that the first sampling module it
Afterwards, it is also connected with:
First speech reception module, first speech reception module receive opposite end communication via the network communication unit in real time
The voice that equipment sends over, and third audio mixing halt instruction receiving module is notified to act；
Third audio mixing halt instruction receiving module, the third audio mixing halt instruction receiving module check whether to receive the first control
The third audio mixing halt instruction of unit notifies the first mix module to act, if receiving, notifies the first voice if not receiving
Receiving module movement；
First mix module receives the voice of the opposite end communication equipment of the first speech reception module, and by the voice with it is described
After first background sound carries out audio mixing generation third mixing sound, third is mixed into the voice that sound is sent to local communication device in real time
Broadcast unit；
The voice of the opposite end communication equipment received is directly sent to local communication in real time by first speech reception module
The voice playing unit of equipment.
8. when call according to claim 6 share background sound device, which is characterized in that the first sampling module it
Afterwards, it is also connected with:
Second speech reception module, second speech reception module receive opposite end communication equipment via the radio frequency unit in real time
The voice sended over, and the 4th audio mixing halt instruction receiving module is notified to act；
4th audio mixing halt instruction receiving module, the 4th audio mixing halt instruction receiving module check whether to receive the second control
4th audio mixing halt instruction of unit notifies the second mix module to act, if receiving, notifies the second voice if not receiving
Receiving module movement；
Second mix module receives the voice of the opposite end communication equipment of the second speech reception module, and by the voice with it is described
After second background sound carries out the 4th mixing sound of audio mixing generation, and the 4th mixing sound is sent to the language of local communication device in real time
Sound broadcast unit；
The voice of the opposite end communication equipment received is directly sent to local communication in real time by second speech reception module
The voice playing unit of equipment.
9. sharing the device of background sound when call according to claim 6, which is characterized in that
First sampling module is stored in background sound under the first call mode, according to the acquisition of the background sound selection instruction of user
Target background sound in storage unit, and first background sound with the first audio format and the first sample rate is generated, specifically
Include:
First sampling module obtains the target being stored in background sound storage unit according to the background sound selection instruction of user
Background sound receives target background sound；
First sampling module checks whether its audio format is consistent with the first audio format required under the first call mode,
If meeting, without decoding, if not meeting, the audio format of target background sound is decoded as the first audio format；
First sampling module check the target background sound sample rate whether under the first call mode needed for first adopt
Sample rate is consistent, if unanimously, first background sound with the first audio format and the first sample rate is generated without resampling,
If inconsistent, target background sound resampling is generated to first background sound with the first audio format and the first sample rate；
First sampling module is stored in background sound under the second call mode, according to the acquisition of the background sound selection instruction of user
Target background sound in storage unit, and second background sound with the second audio format and the second sample rate is generated, and will
Second background sound reaches the second mix module, comprising:
First sampling module obtains the target being stored in background sound storage unit according to the background sound selection instruction of user
Background sound receives target background sound；
First sampling module checks whether its audio format is consistent with the second audio format required under one mode of call,
If meeting, without decoding, if not meeting, the audio format of target background sound is decoded as the second audio format；
First sampling module check the target background sound sample rate whether under the second call mode needed for second adopt
Sample rate is consistent, if unanimously, second background sound with the second audio format and the second sample rate is generated without resampling,
If inconsistent, target background sound resampling is generated to second background sound with the second audio format and the second sample rate.
10. sharing the device of background sound when call according to claim 6, which is characterized in that first sample rate is
16k or 64k, second sample rate are 8k or 16k.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710153304.5A CN106686259B (en) | 2017-03-15 | 2017-03-15 | The method and device of background sound is shared when a kind of call |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710153304.5A CN106686259B (en) | 2017-03-15 | 2017-03-15 | The method and device of background sound is shared when a kind of call |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106686259A CN106686259A (en) | 2017-05-17 |
| CN106686259B true CN106686259B (en) | 2019-06-28 |
Family
ID=58829065
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710153304.5A Active CN106686259B (en) | 2017-03-15 | 2017-03-15 | The method and device of background sound is shared when a kind of call |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106686259B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020175722A1 (en) * | 2019-02-28 | 2020-09-03 | Samsung Electronics Co., Ltd. | A method of make call with background music and share voice fragment in calling |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2871824A1 (en) * | 2013-10-22 | 2015-05-13 | Nokia Corporation | Audio capture with multiple microphones |
| CN104917893A (en) * | 2015-05-30 | 2015-09-16 | 广东欧珀移动通信有限公司 | Convers Conversation processing method and terminal |
| CN105959489A (en) * | 2016-06-28 | 2016-09-21 | 广东欧珀移动通信有限公司 | Call voice processing method and system, and communication terminal |
| CN106027752A (en) * | 2016-04-28 | 2016-10-12 | 努比亚技术有限公司 | Self-adaption method and device for mobile terminal call background sounds |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9807058B2 (en) * | 2015-07-02 | 2017-10-31 | T-Mobile Usa, Inc. | Monitoring wireless data consumption |
-
2017
- 2017-03-15 CN CN201710153304.5A patent/CN106686259B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2871824A1 (en) * | 2013-10-22 | 2015-05-13 | Nokia Corporation | Audio capture with multiple microphones |
| CN104917893A (en) * | 2015-05-30 | 2015-09-16 | 广东欧珀移动通信有限公司 | Convers Conversation processing method and terminal |
| CN106027752A (en) * | 2016-04-28 | 2016-10-12 | 努比亚技术有限公司 | Self-adaption method and device for mobile terminal call background sounds |
| CN105959489A (en) * | 2016-06-28 | 2016-09-21 | 广东欧珀移动通信有限公司 | Call voice processing method and system, and communication terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106686259A (en) | 2017-05-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102340599B (en) | Processing method for call of terminal, terminal and processing system | |
| CN103402171B (en) | Method and the terminal of background music is shared in call | |
| CN111199743B (en) | Audio coding format determining method and device, storage medium and electronic equipment | |
| CN102111468A (en) | Denoising calling mobile phone and method thereof | |
| CN102055828A (en) | Method for prompting important incoming call under mute state of mobile phone | |
| US8744524B2 (en) | User interface tone echo cancellation | |
| CN103024224B (en) | Speech control method and device in multi-person speech communication | |
| WO2013155777A1 (en) | Wireless conference terminal and voice signal transmission method therefor | |
| CN110139184A (en) | A kind of the intelligent sound box system and operation method of telephone function | |
| US10313502B2 (en) | Automatically delaying playback of a message | |
| WO2022227392A1 (en) | Handheld transceiver and communication method therefor, electronic device, and storage medium | |
| CN101674382B (en) | Notification of dropped audio in a teleconference call | |
| CN106686259B (en) | The method and device of background sound is shared when a kind of call | |
| CN102075218A (en) | Short-distance mobile phone multi-party conversation method | |
| CN110381215A (en) | Audio shunt method, device, storage medium and computer equipment | |
| CN101883164A (en) | Adaptive volume gain device and method | |
| KR20110070507A (en) | Method and system of one-to-one and group communication simultaneously in wireless ip network | |
| CN204795612U (en) | Talkback bluetooth headset communication system of function of utensil group | |
| CN105635427A (en) | Information processing method, information processing device and terminal | |
| CN204231472U (en) | A kind of intelligent meeting telephone set with feature identification | |
| CN204231484U (en) | A kind of intelligent meeting telephone set of feature based sound | |
| CN111356062A (en) | Data acquisition method, microphone and computer readable storage medium | |
| CN204465674U (en) | A kind of remote speech translation terminal | |
| CN201937687U (en) | Mobile phone with speech input function | |
| CN101699834A (en) | Terminal message method, wireless network card and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |