WO2020175722A1 - A method of make call with background music and share voice fragment in calling - Google Patents

A method of make call with background music and share voice fragment in calling Download PDF

Info

Publication number
WO2020175722A1
WO2020175722A1 PCT/KR2019/002426 KR2019002426W WO2020175722A1 WO 2020175722 A1 WO2020175722 A1 WO 2020175722A1 KR 2019002426 W KR2019002426 W KR 2019002426W WO 2020175722 A1 WO2020175722 A1 WO 2020175722A1
Authority
WO
WIPO (PCT)
Prior art keywords
background sound
voice
audio format
communication device
sampling rate
Prior art date
Application number
PCT/KR2019/002426
Other languages
French (fr)
Inventor
Jie Fan
Chuancheng DONG
Songjie GONG
Original Assignee
Samsung Electronics Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co., Ltd. filed Critical Samsung Electronics Co., Ltd.
Priority to PCT/KR2019/002426 priority Critical patent/WO2020175722A1/en
Publication of WO2020175722A1 publication Critical patent/WO2020175722A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72442—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for playing music files

Definitions

  • the present invention relates to the field of mobile communications technologies, and in particular, to a method and device for sharing a background sound during a call.
  • Patent 200420111442.5 discloses an electronic device capable of providing a background sound for a telephone.
  • the electronic device plays the background sound by adding a peripheral device to a mobile device, which not only increases the cost of user, but also makes the voice heard by the other party become noisy because of the influence of external environment, which in turn affects the atmosphere.
  • the present invention provides a method and device for sharing a background sound during a call, so as to solve the technical defect in the prior art.
  • the embodiments of the present invention disclose a method for sharing a background sound during a call, which is used in a call between a local communication device with at least one peer communication device, wherein the local communication device comprising: an application processor, a communication processor, a background sound storage unit, a voice playing unit, a voice acquisition unit, a first control unit, a second control unit, a network communication unit and a radio frequency (RF) unit;
  • the local communication device comprising: an application processor, a communication processor, a background sound storage unit, a voice playing unit, a voice acquisition unit, a first control unit, a second control unit, a network communication unit and a radio frequency (RF) unit;
  • RF radio frequency
  • the background sound storage unit, the communication processor, the voice playing unit, the voice acquisition unit, the first control unit and the network communication unit are all connected to the application processor, and the communication processor is respectively connected to the voice playing unit, the voice acquisition unit, the second control unit and the RF unit;
  • the method comprises:
  • step a1 after receiving, by the application processor, a background sound sharing instruction of a user, determining whether a current call mode is a first call mode or a second call mode; if the current call mode is the first call mode, performing step a2, and if the current call mode is the second call mode, performing step a4;
  • step a2 acquiring, by the application processor, a target background sound stored in the background sound storage unit according to a background sound selection instruction of the user, generating a first background sound with a first audio format and a first sampling rate, and performing step a3;
  • step a3 determining, by the application processor, whether a first mix stop instruction is received from the first control unit; if the first mix stop instruction is not received, performing step a31, and if the first mix stop instruction is received, performing step a32;
  • step a31 mixing, by the application processor, the first background sound with a voice acquired by the voice acquisition unit of the local communication device to generate a first mixed sound, and sending the first mixed sound to the peer communication device via the network communication unit in real time;
  • step a32 sending directly, by the application processor, the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the network communication unit in real time;
  • step a4 acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generating a second background sound with a second audio format and a second sampling rate, sending the second background sound to the communication processor, and performing step a5;
  • step a5 determining, by the communication processor, whether a second mix stop instruction is received from the second control unit; if the second mix stop instruction is not received, performing step a51, and if the second mix stop instruction is received, performing step a52;
  • step a51 mixing, by the communication processor, the second background sound with the voice acquired by the voice acquisition unit of the local communication device to generate a second mixed sound, and sending the second mixed sound to the peer communication device via the RF unit in real time;
  • step a52 sending directly, by the communication processor, the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the RF unit in real time.
  • step a2 the method further comprises:
  • step a60 receiving, by the application processor, a voice sent by the peer communication device via the network communication unit in real time, and performing step a61;
  • step a61 determining, by the application processor, whether a third mix stop instruction is received from the first control unit; if the third mix stop instruction is not received, performing step a62, and if the third mix stop instruction is received, performing step a63;
  • step a62 mixing, by the application processor, the voice sent by the peer communication device with the first background sound to generate a third mixed sound, and sending the third mixed sound to the voice playing unit of the local communication device in real time;
  • step a63 sending directly, by the application processor, the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
  • step a4 the method further comprises:
  • step a70 receiving, by the communication processor, the voice sent by the peer communication device via the RF unit in real time, and performing step a71;
  • step a71 determining, by the communication processor, whether a fourth mix stop instruction is received from the second control unit; if the fourth mix stop instruction is not received, performing step a72, and if the fourth mix stop instruction is received, performing step a73;
  • step a72 mixing, by the communication processor, the voice sent by the peer communication device with the second background sound to generate a fourth mixed sound, and sending the fourth mixed sound to the voice playing unit of the local communication device in real time;
  • step a73 sending directly, by the communication processor, the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
  • step a2 the process of acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the first background sound with the first audio format and the first sampling rate comprises:
  • the application processor determines, by the application processor, whether the audio format of the target background sound is consistent with the first audio format required in the first call mode; if the audio format of the target background sound is consistent with the first audio format required in the first call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the first audio format required in the first call mode, decoding the audio format of the target background sound into the first audio format;
  • the application processor determines, by the application processor, whether the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode; if the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode, generating the first background sound with the first audio format and the first sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the first sampling rate required in the first call mode, resampling the target background sound to generate the first background sound with the first audio format and the first sampling rate;
  • step a4 the process of acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the second background sound with the second audio format and the second sampling rate comprises:
  • the application processor determines, by the application processor, whether the audio format of the target background sound is consistent with the second audio format required in the second call mode; if the audio format of the target background sound is consistent with the second audio format required in the second call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the second audio format required in the second call mode, decoding the audio format of the target background sound into the second audio format;
  • the application processor determines, by the application processor, whether the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode; if the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode, generating the second background sound with the second audio format and the second sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the second sampling rate required in the second call mode, resampling the target background sound to generate the second background sound with the second audio format and the second sampling rate.
  • the first sampling rate is 16k or 64k
  • the second sampling rate is 8k or 16k.
  • the embodiments of the present invention further discloses a device for sharing a background sound during a call, which is configured in a local communication device and comprises: an application processor, a communication processor, a background sound storage unit, a voice playing unit, a voice acquisition unit, a first control, a second control unit, a network communication unit and a RF unit;
  • the background sound storage unit, the communication processor, the voice playing unit, the voice acquisition unit, the first control unit and the network communication unit are all connected to the application processor, and the communication processor is respectively connected to the voice playing unit, the voice acquisition unit, the second control unit and the RF unit;
  • the application processor comprises:
  • a call mode determining module determines, after receiving a background sound sharing instruction of a user, whether a current call mode is a second call mode or a first call mode, and notifies a first sampling module to act;
  • the first sampling module acquires, in the first call mode, a target background sound stored in the background sound storage unit according to a background sound selection instruction of the user, generates a first background sound with a first audio format and a first sampling rate, and sends the first background sound to a first mix module;
  • the first sampling module acquires, in the second call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generates a second background sound with a second audio format and a second sampling rate, and sends the second background sound to a second mix module;
  • a first mix stop instruction receiving module determines whether a first mix stop instruction is received from the first control unit; if the first mix stop instruction is not received, notifies the first mix module to act, and if the first mix stop instruction is received, notifies a first voice sending module to act;
  • the first mix module mixes the first background sound with a voice acquired by the voice acquisition unit of the local communication device to generate a first mixed sound, and sends the first mixed sound to the peer communication device via the network communication unit in real time;
  • the first voice sending module wherein the first voice sending module sends directly the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the network communication unit in real time;
  • the communication processor comprises:
  • a second mix stop instruction receiving module determines whether a second mix stop instruction is received from the second control unit, and if the second mix stop instruction is not received, notifies the second mix module to act, and if the second mix stop instruction is received, notifies a second voice sending module to act;
  • the second mix module mixes the second background sound with the voice acquired by the voice acquisition unit of the local communication device to generate a second mixed sound, and sends the second mixed sound to the peer communication device via the RF unit in real time;
  • the second voice sending module wherein the second voice sending module sends directly the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the RF unit in real time.
  • the device is further connected with:
  • a first voice receiving module wherein the first voice receiving module receives a voice sent by the peer communication device via the network communication unit in real time, and notifies a third mix stop instruction receiving module to act;
  • the third mix stop instruction receiving module determines whether a third mix stop instruction is received from the first control unit; if the third mix stop instruction is not received, notifies the first mix module to act, and if the third mix stop instruction is received, notifies the first voice receiving module to act;
  • the first mix module receives the voice from the peer communication device of the first voice receiving module, mixes the voice with the first background sound to generate a third mixed sound, and sends the third mixed sound to the voice playing unit of the local communication device in real time;
  • the first voice receiving module sends directly the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
  • the device is further connected with:
  • a second voice receiving module receives the voice sent by the peer communication device via the RF unit in real time, and notifies a fourth mix stop instruction receiving module to act;
  • the fourth mix stop instruction receiving module determines whether a fourth mix stop instruction is received from the second control unit; if the fourth mix stop instruction is not received, notifies the second mix module to act, and if the fourth mix stop instruction is received, notifies the second voice receiving module to act;
  • the second mix module receives the voice from the peer communication device of the second voice receiving module, mixes the voice with the second background sound to generate a fourth mixed sound, and sends the fourth mixed sound to the voice playing unit of the local communication device in real time;
  • the second voice receiving module sends directly the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
  • the process of the first sampling module acquiring, in the first call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the first background sound with the first audio format and the first sampling rate comprises:
  • the first sampling module acquiring the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound;
  • the first sampling module determining whether the audio format of the target background sound is consistent with the first audio format required in the first call mode; if the audio format of the target background sound is consistent with the first audio format required in the first call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the first audio format required in the first call mode, decoding the audio format of the target background sound into the first audio format;
  • the first sampling module determining whether the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode; if the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode, generating the first background sound with the first audio format and the first sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the first sampling rate required in the first call mode, resampling the target background sound to generate the first background sound with the first audio format and the first sampling rate;
  • the process of the first sampling module acquiring, in the second call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generating the second background sound with the second audio format and the second sampling rate, and sending the second background sound to the second mix module comprises:
  • the first sampling module acquiring the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound;
  • the first sampling module determining whether the audio format of the target background sound is consistent with the second audio format required in the second call mode; if the audio format of the target background sound is consistent with the second audio format required in the second call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the second audio format required in the second call mode, decoding the audio format of the target background sound into the second audio format;
  • the first sampling module determining whether the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode; if the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode, generating the second background sound with the second audio format and the second sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the second sampling rate required in the second call mode, resampling the target background sound to generate the second background sound with the second audio format and the second sampling rate.
  • the first sampling rate is 16k or 64k
  • the second sampling rate is 8k or 16k.
  • the local communication device can read the target background sound according to the background sound selection instruction during the call, then perform the mixing process and send the mixed sound to the peer communication device, thereby improving user experiences during the call without affecting the call.
  • the present invention can automatically select one of a communication processor and an application processor according to different call modes to perform the mixing process, thereby adapting to the shared background sound in different call modes, and further improving the user experiences.
  • the present invention can implement various controls to the mixing process according to the instructions of the control unit, so that the background sound can be heard only by the peer user or only by the local user, thereby further improving the user experiences.
  • FIG. 1 is a flowchart illustrating a method for sharing a background sound during a call according to an embodiment of the present invention.
  • FIG. 2 is a diagram illustrating the structure of a device for sharing a background sound during a call according to an embodiment of the present invention.
  • FIG. 3 is a detailed flowchart illustrating the step a2 of the method for sharing a background sound during a call according to an embodiment of the present invention.
  • FIG. 4 is a detailed flowchart illustrating the step a4 of the method for sharing a background sound during a call according to an embodiment of the present invention.
  • FIG. 5 is a first sub-flowchart of the method for sharing a background sound during a call according to an embodiment of the present invention.
  • FIG. 6 is a second sub-flowchart of the method for sharing a background sound during a call according to an embodiment of the present invention.
  • FIG. 7 is a diagram illustrating the structure of an application processor in the device according to an embodiment of the present invention.
  • FIG. 8 is a diagram illustrating the structure of a communication processor in the device according to an embodiment of the present invention.
  • the embodiments of the present invention discloses a method for sharing a background sound during a call, thereby improving the user experiences during the call without affecting the quality of the call.
  • an embodiment of the present invention discloses a method for sharing a background sound during a call, as shown in FIG. 1.
  • the method is used during a call between a local communication device and at least one peer communication device.
  • the structure of the local communication device is shown in FIG. 2.
  • the local communication device includes an application processor, a communication processor, a background sound storage unit, a voice playing unit, a voice acquisition unit, a first control unit, a second control unit, a network communication unit and a RF unit.
  • the background sound storage unit, the communication processor, the voice playing unit, the voice acquisition unit, the first control unit and the network communication unit are all connected to the application processor, and the communication processor is respectively connected to the voice playing unit, the voice acquisition unit, the RF unit and the second control unit.
  • the application processor is a core component of the communication device and is configured to handle operations to be executed by various applications in the communication device, such as multimedia operations.
  • the communicating processor is configured to handle works related to mobile phone voice calls.
  • the RF unit is configured to send and receive data via a wireless network.
  • the communication connection between the local communication device and the peer communication device is implemented through the RF unit.
  • the voice acquisition unit is configured to acquire a voice.
  • the voice not only includes the talking voice of a user, but also includes the sound of the surrounding environment of the user.
  • the voice acquisition unit is usually a microphone when applied in a mobile phone.
  • the voice playing unit is configured to play a voice.
  • the voice playing unit may be applied in a mobile phone in various hardware forms, such as a headphone, a speaker or an earpiece.
  • the first control unit may send a first mix stop instruction and a third mix stop instruction to the application processor, and the second control unit may send a second mix stop instruction and a fourth mix stop instruction to the communication processor, thereby playing the role of a control channel.
  • the above instructions may be generated by clicking and selecting operations of the user on the screen of the mobile phone.
  • the method for sharing a background sound in this embodiment includes following steps.
  • the application processor determines whether a current call mode is a first call mode or a second call mode; if the current call mode is the first call mode, step a2 is performed, and if the current call mode is the second call mode, step a4 is performed.
  • the background sound sharing instruction may be generated by clicking and selecting operations of the user.
  • a virtual button for background sound is added in a call interface displayed by the mobile phone, and a list of background sounds will be popped up for the user after the user clicks the virtual button, so as to be selected by the user.
  • the background sounds may include various sounds, such as music, or a user-made recording.
  • the first call mode uses the application processor to send directly voice information to the peer communication device via the network communication unit.
  • Voice over Internet Protocol (VOIP) software such as WeChat, QQ, Skype, etc., sends the voice information through a data transmission mode.
  • the second call mode uses the communication processor to send the voice information to the peer communication device through the RF unit, for example, a call in the existing mobile phone GSM system.
  • VOIP Voice over Internet Protocol
  • the application processor acquires a target background sound stored in the background sound storage unit according to a background sound selection instruction of the user, generates a first background sound with a first audio format and a first sampling rate, and performs step a3.
  • the background sound selection instruction is generated by clicking and selecting a background sound link listed in the list of background sounds by the user.
  • the application processor actively acquires the target background sound corresponding to the background sound link from the background sound storage unit, and decodes and resamples the acquired target background sound.
  • the process of acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the first background sound with the first audio format and the first sampling rate includes following steps.
  • the application processor acquires the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound.
  • the application processor determines whether the audio format of the target background sound is consistent with the first audio format required in the first call mode; if the audio format of the target background sound is consistent with the first audio format required in the first call mode, the application processor does not perform decoding, and if the audio format of the target background sound is inconsistent with the first audio format required in the first call mode , the application processor decodes the audio format of the target background sound into the first audio format.
  • the application processor determines whether the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode; if the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode, the application processor generates the first background sound with the first audio format and the first sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the first sampling rate required in the first call mode, the application processor resamples the target background sound to generate the first background sound with the first audio format and the first sampling rate.
  • the first sampling rate may be, but is not limited to, 16k or 64k, which is determined by the sampling rate required in the first call mode;
  • the first audio format may be a PCM format.
  • the application processor first determines the audio format of the target background sound. If the audio format is the PCM format, the target background sound is not needed to be decoded; and if the audio format is a mp3 format, the target background sound needs to be decoded. Then, the application processor determines the sampling rate of the target background sound. If the sampling rate is consistent with the first sampling rate, resampling is not needed; and if the sampling rate is inconsistent with the first sampling rate, the application processor resamples to finally generate the first background sound with the first sampling rate and the first audio format.
  • the application processor determines whether a first mix stop instruction is received from the first control unit; if the first mix stop instruction is not received, step a31 is performed, and if the first mix stop instruction is received, step a32 is performed.
  • the first mix stop instruction is used to make the application processor stop mixing the first background sound with a voice acquired by the voice acquisition unit of the local communication device in the first call mode.
  • the first mix stop instruction may be generated by the clicking and selecting operations of the user on the screen of the mobile phone. For example, if the playing mode of the background sound selected by the user is "only hear by oneself" in the first call mode, the first mix stop instruction is generated correspondingly. In this case, only the local communication device can hear the background sound, but the peer communication device cannot hear the background sound.
  • the first mix stop instruction and the second mix stop instruction mentioned in this embodiment are controls for mixing operations performed by the application processor in the first call mode
  • the third mix stop instruction and the fourth mix stop instruction are controls for mixing operations performed by the communication processor in the second call mode.
  • the second mix stop instruction, the third mix stop instruction and the fourth mix stop instruction act similarly as the first mix stop instruction, and therefore will not be described in detail below.
  • the application processor mixes the first background sound with a voice acquired by the voice acquisition unit of the local communication device to generate a first mixed sound, and sends the first mixed sound to the peer communication device via the network communication unit in real time.
  • the application processor sends directly the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the network communication unit in real time.
  • steps a2-a32 are processes in the first call mode, and processes in the second call mode will be introduced in the following steps a4-a52.
  • the application processor acquires the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generates a second background sound with a second audio format and a second sampling rate, sends the second background sound to the communication processor, and performs step a5.
  • the process of acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the second background sound with the second audio format and the second sampling rate includes the following steps.
  • the application processor acquires the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound.
  • the application processor determines whether the audio format of the target background sound is consistent with the second audio format required in the second call mode; if the audio format of the target background sound is consistent with the second audio format required in the second call mode, the application processor does not perform decoding, and if the audio format of the target background sound is inconsistent with the second audio format required in the second call mode, the application processor decodes the audio format of the target background sound into the second audio format.
  • the application processor determines whether the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode; if the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode, the application processor generates the second background sound with the second audio format and the second sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the second sampling rate required in the second call mode, the application processor resamples the target background sound to generate the second background sound with the second audio format and the second sampling rate.
  • the second sampling rate may be, but is not limited to, 8k or 16k, which is determined by operators.
  • the second audio format may be a PCM format. For example, after acquiring the target background sound, the application processor first determines the audio format of the target background sound. If the audio format is the PCM format, the target background sound is not needed to be decoded; and if the audio format is a mp3 format, the target background sound needs to be decoded. Then, the application processor determines the sampling rate of the target background sound. If the sampling rate is consistent with the first sampling rate, resampling is not needed; and if the sampling rate is inconsistent with the first sampling rate, the application processor resamples to finally generate the second background sound with the second sampling rate and the second audio format.
  • the communication processor determines whether a second mix stop instruction is received from the second control unit; if the second mix stop instruction is not received, step a51 is performed, and if the second mix stop instruction is received, step a52 is performed.
  • the communication processor mixes the second background sound with the voice acquired by the voice acquisition unit of the local communication device to generate a second mixed sound, and sends the second mixed sound to the peer communication device via the RF unit in real time.
  • the communication processor sends directly the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the RF unit in real time.
  • the above steps are a flowchart illustrating a process of sending by the local communication device the mixed sound of the voice and the background sound to the peer communication device in the second call mode and the first call mode respectively.
  • the local communication device also needs to mix the background sound with the voice sent by the other party and play the mixed sound.
  • a flow of receiving a voice by the local communication device from the peer communication device will be described hereinafter.
  • the method further includes following steps.
  • the application processor receives a voice sent by the peer communication device via the network communication unit in real time, and performs step a61.
  • step a61 the application processor determines whether a third mix stop instruction is received from the first control unit; if the third mix stop instruction is not received, step a62 is performed, and if the third mix stop instruction is received, a63 is performed.
  • the application processor mixes the voice sent by the peer communication device with the first background sound to generate a third mixed sound, and sends the third mixed sound to the voice playing unit of the local communication device in real time.
  • the application processor sends directly the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
  • the application processor may mix the voice of the peer communication device (for example, the voice of the peer user) in real time and send the mixed sound to the voice playing unit of the local communication device.
  • the peer communication device for example, the voice of the peer user
  • the method further includes following steps.
  • the communication processor receives the voice sent by the peer communication device via the RF unit in real time, and performs step a71.
  • the communication processor determines whether a fourth mix stop instruction is received from the second control unit; if the fourth mix stop instruction is not received , step a72 is performed, and if the fourth mix stop instruction is received, step a73 is performed.
  • the communication processor mixes the voice sent by the peer communication device with the second background sound to generate a fourth mixed sound, and sends the fourth mixed sound to the voice playing unit of the local communication device in real time.
  • the communication processor sends directly the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
  • the application processor may mix the voice of the peer communication device (for example, the voice of the peer user) in real time and send the mixed sound to the voice playing unit of the local communication device.
  • the peer communication device for example, the voice of the peer user
  • the above method flow implements a process of sharing a background sound during a call between the local communication device and the peer communication device.
  • the method may further enable the following functions.
  • the local communication device can read the target background sound according to the background sound selection instruction during the call, then perform the mixing process and send the mixed sound to the peer communication device, thereby improving user experiences during the call without affecting the call.
  • the present invention can automatically select one of a communication processor or an application processor according to different call modes to perform the mixing process, thereby adapting to the shared background sound in different call modes, and further improving the user experiences.
  • the present invention can implement various controls to the mixing process according to the instructions of the control unit, so that the background sound can be heard only by the peer user or only by the local user, thereby further improving the user experiences.
  • An embodiment of the present invention further discloses a device for sharing a background sound during a call, as shown in FIGs. 2, 7 and 8.
  • the device is configured in a local communication device, and includes an application processor, a communication processor, a background sound storage unit, a voice playing unit, a voice acquisition unit, and a first control unit, a second control unit and a RF unit.
  • the background sound storage unit, the communication processor, the voice playing unit, the voice acquisition unit, the first control unit and the network communication unit are all connected to the application processor, and the communication processor is respectively connected to the voice playing unit, the voice acquisition unit, the second control unit and the RF unit.
  • the application processor includes:
  • a call mode determining module determines, after receiving a background sound sharing instruction of a user, whether a current call mode is a second call mode or a first call mode, and notifies a first sampling module to act; the first sampling module, wherein the first sampling module acquires, in the first call mode, a target background sound stored in the background sound storage unit according to a background sound selection instruction of the user, generates a first background sound with a first audio format and a first sampling rate, and sends the first background sound to a first mix module;
  • the first sampling module acquires, in the second call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generates a second background sound with a second audio format and a second sampling rate, and sends the second background sound to a second mix module;
  • a first mix stop instruction receiving module determines whether a first mix stop instruction is received from the first control unit; if the first mix stop instruction is not received, notifies the first mix module to act, and if the first mix stop instruction is received, notifies a first voice sending module to act;
  • the first mix module mixes the first background sound with a voice acquired by the voice acquisition unit of the local communication device to generate a first mixed sound, and sends the first mixed sound to the peer communication device via the network communication unit in real time;
  • the first voice sending module wherein the first voice sending module sends directly the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the network communication unit in real time.
  • the first sampling rate is 16k or 64k
  • the second sampling rate is 8k or 16k.
  • the communication processor includes:
  • a second mix stop instruction receiving module determines whether a second mix stop instruction is received from the second control unit, and if the second mix stop instruction is not received, notifies the second mix module to act, and if the second mix stop instruction is received, notifies a second voice sending module to act;
  • the second mix module mixes the second background sound with the voice acquired by the voice acquisition unit of the local communication device to generate a second mixed sound, and sends the second mixed sound to the peer communication device via the RF unit in real time;
  • the second voice sending module wherein the second voice sending module sends directly the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the RF unit in real time.
  • the device in order to mix the voice of the peer communication device in the first call mode, referring to FIG. 7, after the first sampling module, the device is further connected with:
  • a first voice receiving module wherein the first voice receiving module receives a voice sent by the peer communication device via the network communication unit in real time, and notifies a third mix stop instruction receiving module to act;
  • the third mix stop instruction receiving module determines whether a third mix stop instruction is received from the first control unit; if the third mix stop instruction is not received, notifies the first mix module to act, and if the third mix stop instruction is received, notifies the first voice receiving module to act;
  • the first mix module receives the voice from the peer communication device of the first voice receiving module, mixes the voice with the first background sound to generate a third mixed sound, and sends the third mixed sound to the voice playing unit of the local communication device in real time;
  • the first voice receiving module sends directly the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
  • the device is further connected with:
  • a second voice receiving module receives the voice sent by the peer communication device via the RF unit in real time, and notifies a fourth mix stop instruction receiving module to act;
  • the fourth mix stop instruction receiving module determines whether a fourth mix stop instruction is received from the second control unit, if the fourth mix stop instruction is not received, notifies the second mix module to act, and if the fourth mix stop instruction is received, notifies the second voice receiving module to act;
  • the second mix module receives the voice from the peer communication device of the second voice receiving module, mixes the voice with the second background sound to generate a fourth mixed sound, and sends the fourth mixed sound to the voice playing unit of the local communication device in real time;
  • the second voice receiving module sends directly the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
  • the process of the first sampling module acquiring, in the first call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the first background sound with the first audio format and the first sampling rate includes:
  • the first sampling module acquiring the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound;
  • the first sampling module determining whether the audio format of the target background sound is consistent with the first audio format required in the first call mode; if the audio format of the target background sound is consistent with the first audio format required in the first call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the first audio format required in the first call mode, decoding the audio format of the target background sound into the first audio format;
  • the first sampling module determining whether the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode; if the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode, generating the first background sound with the first audio format and the first sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the first sampling rate required in the first call mode, resampling the target background sound to generate the first background sound with the first audio format and the first sampling rate.
  • the process of the first sampling module acquiring, in the second call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generating the second background sound with the second audio format and the second sampling rate, and sending the second background sound to the second mix module includes:
  • the first sampling module acquiring the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound;
  • the first sampling module determining whether the audio format of the target background sound is consistent with the second audio format required in the second call mode; if the audio format of the target background sound is consistent with the second audio format required in the second call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the second audio format required in the second call mode, decoding the audio format of the target background sound into the second audio format;
  • the first sampling module determining whether the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode; if the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode, generating the second background sound with the second audio format and the second sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the second sampling rate required in the second call mode, resampling the target background sound to generate the second background sound with the second audio format and the second sampling rate.

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Telephone Function (AREA)

Abstract

The present invention discloses a method for sharing a background sound during a call, which is used during a call between a local communication device and at least one peer communication device. The method comprises: after receiving a background sound sharing instruction of a user, in a first call mode, acquiring, by an application processor, a target background sound according to a background sound selection instruction of the user, and generating a first background sound; if a first mix stop instruction is not received, mixing, by the application processor, the first background sound with an acquired voice, and sending the mixed sound to the peer communication device in real time; in a second call mode, acquiring, by the application processor, a target background sound stored in a background sound storage unit, generating a second background sound, and sending the second background sound to a communication processor; if a second mix stop instruction is not received, mixing, by the communication processor, the second background sound with a voice acquired by the local communication device to generate a second mixed sound, and sending the second mixed sound to the peer communication device. This method improves the user experiences during a call.

Description

A METHOD OF MAKE CALL WITH BACKGROUND MUSIC AND SHARE VOICE FRAGMENT IN CALLING
The present invention relates to the field of mobile communications technologies, and in particular, to a method and device for sharing a background sound during a call.
At present, mobile devices are becoming more and more important in people's daily life due to their convenient use, and people have more and more functional requirements for mobile devices. For example, both parties of a call will feel monotonous and boring if the call takes too long time.
In response to the above situation, a background sound may be added to the call to enliven atmosphere. In the prior art, Patent 200420111442.5 discloses an electronic device capable of providing a background sound for a telephone. The electronic device plays the background sound by adding a peripheral device to a mobile device, which not only increases the cost of user, but also makes the voice heard by the other party become noisy because of the influence of external environment, which in turn affects the atmosphere.
How to add a background sound to a call of a user without affecting the quality of the call, thereby improving user experiences, has become a technical problem desirable to be solved in the current mobile device call.
In view of this, the present invention provides a method and device for sharing a background sound during a call, so as to solve the technical defect in the prior art.
To this end, the technical solutions of the embodiments of the present invention are implemented as follows.
The embodiments of the present invention disclose a method for sharing a background sound during a call, which is used in a call between a local communication device with at least one peer communication device, wherein the local communication device comprising: an application processor, a communication processor, a background sound storage unit, a voice playing unit, a voice acquisition unit, a first control unit, a second control unit, a network communication unit and a radio frequency (RF) unit;
the background sound storage unit, the communication processor, the voice playing unit, the voice acquisition unit, the first control unit and the network communication unit are all connected to the application processor, and the communication processor is respectively connected to the voice playing unit, the voice acquisition unit, the second control unit and the RF unit;
the method comprises:
step a1, after receiving, by the application processor, a background sound sharing instruction of a user, determining whether a current call mode is a first call mode or a second call mode; if the current call mode is the first call mode, performing step a2, and if the current call mode is the second call mode, performing step a4;
step a2, acquiring, by the application processor, a target background sound stored in the background sound storage unit according to a background sound selection instruction of the user, generating a first background sound with a first audio format and a first sampling rate, and performing step a3;
step a3, determining, by the application processor, whether a first mix stop instruction is received from the first control unit; if the first mix stop instruction is not received, performing step a31, and if the first mix stop instruction is received, performing step a32;
step a31, mixing, by the application processor, the first background sound with a voice acquired by the voice acquisition unit of the local communication device to generate a first mixed sound, and sending the first mixed sound to the peer communication device via the network communication unit in real time;
step a32, sending directly, by the application processor, the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the network communication unit in real time;
step a4, acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generating a second background sound with a second audio format and a second sampling rate, sending the second background sound to the communication processor, and performing step a5;
step a5, determining, by the communication processor, whether a second mix stop instruction is received from the second control unit; if the second mix stop instruction is not received, performing step a51, and if the second mix stop instruction is received, performing step a52;
step a51, mixing, by the communication processor, the second background sound with the voice acquired by the voice acquisition unit of the local communication device to generate a second mixed sound, and sending the second mixed sound to the peer communication device via the RF unit in real time; and
step a52, sending directly, by the communication processor, the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the RF unit in real time.
Optionally, after step a2, the method further comprises:
step a60, receiving, by the application processor, a voice sent by the peer communication device via the network communication unit in real time, and performing step a61;
step a61, determining, by the application processor, whether a third mix stop instruction is received from the first control unit; if the third mix stop instruction is not received, performing step a62, and if the third mix stop instruction is received, performing step a63;
step a62, mixing, by the application processor, the voice sent by the peer communication device with the first background sound to generate a third mixed sound, and sending the third mixed sound to the voice playing unit of the local communication device in real time; and
step a63, sending directly, by the application processor, the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
Optionally, after step a4, the method further comprises:
step a70, receiving, by the communication processor, the voice sent by the peer communication device via the RF unit in real time, and performing step a71;
step a71, determining, by the communication processor, whether a fourth mix stop instruction is received from the second control unit; if the fourth mix stop instruction is not received, performing step a72, and if the fourth mix stop instruction is received, performing step a73;
step a72, mixing, by the communication processor, the voice sent by the peer communication device with the second background sound to generate a fourth mixed sound, and sending the fourth mixed sound to the voice playing unit of the local communication device in real time;
step a73, sending directly, by the communication processor, the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
Optionally, in step a2, the process of acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the first background sound with the first audio format and the first sampling rate comprises:
acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound;
determining, by the application processor, whether the audio format of the target background sound is consistent with the first audio format required in the first call mode; if the audio format of the target background sound is consistent with the first audio format required in the first call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the first audio format required in the first call mode, decoding the audio format of the target background sound into the first audio format;
determining, by the application processor, whether the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode; if the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode, generating the first background sound with the first audio format and the first sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the first sampling rate required in the first call mode, resampling the target background sound to generate the first background sound with the first audio format and the first sampling rate;
in step a4, the process of acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the second background sound with the second audio format and the second sampling rate comprises:
acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound;
determining, by the application processor, whether the audio format of the target background sound is consistent with the second audio format required in the second call mode; if the audio format of the target background sound is consistent with the second audio format required in the second call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the second audio format required in the second call mode, decoding the audio format of the target background sound into the second audio format;
determining, by the application processor, whether the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode; if the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode, generating the second background sound with the second audio format and the second sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the second sampling rate required in the second call mode, resampling the target background sound to generate the second background sound with the second audio format and the second sampling rate.
Optionally, the first sampling rate is 16k or 64k, and the second sampling rate is 8k or 16k.
The embodiments of the present invention further discloses a device for sharing a background sound during a call, which is configured in a local communication device and comprises: an application processor, a communication processor, a background sound storage unit, a voice playing unit, a voice acquisition unit, a first control, a second control unit, a network communication unit and a RF unit;
the background sound storage unit, the communication processor, the voice playing unit, the voice acquisition unit, the first control unit and the network communication unit are all connected to the application processor, and the communication processor is respectively connected to the voice playing unit, the voice acquisition unit, the second control unit and the RF unit;
wherein the application processor comprises:
a call mode determining module, wherein the call mode determining module determines, after receiving a background sound sharing instruction of a user, whether a current call mode is a second call mode or a first call mode, and notifies a first sampling module to act;
the first sampling module, wherein the first sampling module acquires, in the first call mode, a target background sound stored in the background sound storage unit according to a background sound selection instruction of the user, generates a first background sound with a first audio format and a first sampling rate, and sends the first background sound to a first mix module;
the first sampling module acquires, in the second call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generates a second background sound with a second audio format and a second sampling rate, and sends the second background sound to a second mix module;
a first mix stop instruction receiving module, wherein the first mix stop instruction receiving module determines whether a first mix stop instruction is received from the first control unit; if the first mix stop instruction is not received, notifies the first mix module to act, and if the first mix stop instruction is received, notifies a first voice sending module to act;
the first mix module, wherein the first mix module mixes the first background sound with a voice acquired by the voice acquisition unit of the local communication device to generate a first mixed sound, and sends the first mixed sound to the peer communication device via the network communication unit in real time;
the first voice sending module, wherein the first voice sending module sends directly the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the network communication unit in real time;
the communication processor comprises:
a second mix stop instruction receiving module, wherein the second mix stop instruction receiving module determines whether a second mix stop instruction is received from the second control unit, and if the second mix stop instruction is not received, notifies the second mix module to act, and if the second mix stop instruction is received, notifies a second voice sending module to act;
the second mix module, wherein the second mix module mixes the second background sound with the voice acquired by the voice acquisition unit of the local communication device to generate a second mixed sound, and sends the second mixed sound to the peer communication device via the RF unit in real time;
the second voice sending module, wherein the second voice sending module sends directly the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the RF unit in real time.
Optionally, after the first sampling module, the device is further connected with:
a first voice receiving module, wherein the first voice receiving module receives a voice sent by the peer communication device via the network communication unit in real time, and notifies a third mix stop instruction receiving module to act;
the third mix stop instruction receiving module, wherein the third mix stop instruction receiving module determines whether a third mix stop instruction is received from the first control unit; if the third mix stop instruction is not received, notifies the first mix module to act, and if the third mix stop instruction is received, notifies the first voice receiving module to act;
the first mix module receives the voice from the peer communication device of the first voice receiving module, mixes the voice with the first background sound to generate a third mixed sound, and sends the third mixed sound to the voice playing unit of the local communication device in real time;
the first voice receiving module sends directly the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
Optionally, after the second sampling module, the device is further connected with:
a second voice receiving module, wherein the second voice receiving module receives the voice sent by the peer communication device via the RF unit in real time, and notifies a fourth mix stop instruction receiving module to act;
the fourth mix stop instruction receiving module, wherein the fourth mix stop instruction receiving module determines whether a fourth mix stop instruction is received from the second control unit; if the fourth mix stop instruction is not received, notifies the second mix module to act, and if the fourth mix stop instruction is received, notifies the second voice receiving module to act;
the second mix module receives the voice from the peer communication device of the second voice receiving module, mixes the voice with the second background sound to generate a fourth mixed sound, and sends the fourth mixed sound to the voice playing unit of the local communication device in real time;
the second voice receiving module sends directly the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
Optionally, the process of the first sampling module acquiring, in the first call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the first background sound with the first audio format and the first sampling rate comprises:
the first sampling module acquiring the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound;
the first sampling module determining whether the audio format of the target background sound is consistent with the first audio format required in the first call mode; if the audio format of the target background sound is consistent with the first audio format required in the first call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the first audio format required in the first call mode, decoding the audio format of the target background sound into the first audio format;
the first sampling module determining whether the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode; if the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode, generating the first background sound with the first audio format and the first sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the first sampling rate required in the first call mode, resampling the target background sound to generate the first background sound with the first audio format and the first sampling rate;
the process of the first sampling module acquiring, in the second call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generating the second background sound with the second audio format and the second sampling rate, and sending the second background sound to the second mix module comprises:
the first sampling module acquiring the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound;
the first sampling module determining whether the audio format of the target background sound is consistent with the second audio format required in the second call mode; if the audio format of the target background sound is consistent with the second audio format required in the second call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the second audio format required in the second call mode, decoding the audio format of the target background sound into the second audio format;
the first sampling module determining whether the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode; if the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode, generating the second background sound with the second audio format and the second sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the second sampling rate required in the second call mode, resampling the target background sound to generate the second background sound with the second audio format and the second sampling rate.
Optionally, the first sampling rate is 16k or 64k, and the second sampling rate is 8k or 16k.
By the method and device for sharing a background sound during a call provided by the present invention, the local communication device can read the target background sound according to the background sound selection instruction during the call, then perform the mixing process and send the mixed sound to the peer communication device, thereby improving user experiences during the call without affecting the call.
Moreover, the present invention can automatically select one of a communication processor and an application processor according to different call modes to perform the mixing process, thereby adapting to the shared background sound in different call modes, and further improving the user experiences.
In addition, the present invention can implement various controls to the mixing process according to the instructions of the control unit, so that the background sound can be heard only by the peer user or only by the local user, thereby further improving the user experiences.
FIG. 1 is a flowchart illustrating a method for sharing a background sound during a call according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating the structure of a device for sharing a background sound during a call according to an embodiment of the present invention.
FIG. 3 is a detailed flowchart illustrating the step a2 of the method for sharing a background sound during a call according to an embodiment of the present invention.
FIG. 4 is a detailed flowchart illustrating the step a4 of the method for sharing a background sound during a call according to an embodiment of the present invention.
FIG. 5 is a first sub-flowchart of the method for sharing a background sound during a call according to an embodiment of the present invention.
FIG. 6 is a second sub-flowchart of the method for sharing a background sound during a call according to an embodiment of the present invention.
FIG. 7 is a diagram illustrating the structure of an application processor in the device according to an embodiment of the present invention.
FIG. 8 is a diagram illustrating the structure of a communication processor in the device according to an embodiment of the present invention.
To make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be described in detail below through detailed embodiments and with reference to the accompanying drawings.
In order to solve the technical defect of affecting the quality of the user's call when adding a background sound in the prior art, the embodiments of the present invention discloses a method for sharing a background sound during a call, thereby improving the user experiences during the call without affecting the quality of the call.
In order to achieve the above objectives, an embodiment of the present invention discloses a method for sharing a background sound during a call, as shown in FIG. 1. The method is used during a call between a local communication device and at least one peer communication device.
Before describing the method for sharing the background sound according to this embodiment, the device performing the method will first be described.
The structure of the local communication device is shown in FIG. 2. The local communication device includes an application processor, a communication processor, a background sound storage unit, a voice playing unit, a voice acquisition unit, a first control unit, a second control unit, a network communication unit and a RF unit.
The background sound storage unit, the communication processor, the voice playing unit, the voice acquisition unit, the first control unit and the network communication unit are all connected to the application processor, and the communication processor is respectively connected to the voice playing unit, the voice acquisition unit, the RF unit and the second control unit.
The application processor is a core component of the communication device and is configured to handle operations to be executed by various applications in the communication device, such as multimedia operations.
As an auxiliary processor, the communicating processor (CP) is configured to handle works related to mobile phone voice calls.
The RF unit is configured to send and receive data via a wireless network. The communication connection between the local communication device and the peer communication device is implemented through the RF unit.
The voice acquisition unit is configured to acquire a voice. The voice not only includes the talking voice of a user, but also includes the sound of the surrounding environment of the user. The voice acquisition unit is usually a microphone when applied in a mobile phone.
The voice playing unit is configured to play a voice. The voice playing unit may be applied in a mobile phone in various hardware forms, such as a headphone, a speaker or an earpiece.
The first control unit may send a first mix stop instruction and a third mix stop instruction to the application processor, and the second control unit may send a second mix stop instruction and a fourth mix stop instruction to the communication processor, thereby playing the role of a control channel. The above instructions may be generated by clicking and selecting operations of the user on the screen of the mobile phone.
Referring to FIG. 1, the method for sharing a background sound in this embodiment includes following steps.
At step a1, after receiving a background sound sharing instruction of a user, the application processor determines whether a current call mode is a first call mode or a second call mode; if the current call mode is the first call mode, step a2 is performed, and if the current call mode is the second call mode, step a4 is performed.
It should be noted that the background sound sharing instruction may be generated by clicking and selecting operations of the user. In an embodiment, a virtual button for background sound is added in a call interface displayed by the mobile phone, and a list of background sounds will be popped up for the user after the user clicks the virtual button, so as to be selected by the user. The background sounds may include various sounds, such as music, or a user-made recording.
It should be noted that, in this embodiment, the first call mode uses the application processor to send directly voice information to the peer communication device via the network communication unit. For example, Voice over Internet Protocol (VOIP) software, such as WeChat, QQ, Skype, etc., sends the voice information through a data transmission mode. The second call mode uses the communication processor to send the voice information to the peer communication device through the RF unit, for example, a call in the existing mobile phone GSM system.
At step a2, the application processor acquires a target background sound stored in the background sound storage unit according to a background sound selection instruction of the user, generates a first background sound with a first audio format and a first sampling rate, and performs step a3.
Optionally, the background sound selection instruction is generated by clicking and selecting a background sound link listed in the list of background sounds by the user. When the user clicks and selects a background sound link, the application processor actively acquires the target background sound corresponding to the background sound link from the background sound storage unit, and decodes and resamples the acquired target background sound.
In particular, referring to FIG. 3, at step a2, the process of acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the first background sound with the first audio format and the first sampling rate includes following steps.
At step a21, the application processor acquires the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound.
At step a22, the application processor determines whether the audio format of the target background sound is consistent with the first audio format required in the first call mode; if the audio format of the target background sound is consistent with the first audio format required in the first call mode, the application processor does not perform decoding, and if the audio format of the target background sound is inconsistent with the first audio format required in the first call mode , the application processor decodes the audio format of the target background sound into the first audio format.
At step a23, the application processor determines whether the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode; if the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode, the application processor generates the first background sound with the first audio format and the first sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the first sampling rate required in the first call mode, the application processor resamples the target background sound to generate the first background sound with the first audio format and the first sampling rate.
In this embodiment, the first sampling rate may be, but is not limited to, 16k or 64k, which is determined by the sampling rate required in the first call mode; the first audio format may be a PCM format. For example, after acquiring the target background sound, the application processor first determines the audio format of the target background sound. If the audio format is the PCM format, the target background sound is not needed to be decoded; and if the audio format is a mp3 format, the target background sound needs to be decoded. Then, the application processor determines the sampling rate of the target background sound. If the sampling rate is consistent with the first sampling rate, resampling is not needed; and if the sampling rate is inconsistent with the first sampling rate, the application processor resamples to finally generate the first background sound with the first sampling rate and the first audio format.
At step a3, the application processor determines whether a first mix stop instruction is received from the first control unit; if the first mix stop instruction is not received, step a31 is performed, and if the first mix stop instruction is received, step a32 is performed.
The first mix stop instruction is used to make the application processor stop mixing the first background sound with a voice acquired by the voice acquisition unit of the local communication device in the first call mode. The first mix stop instruction may be generated by the clicking and selecting operations of the user on the screen of the mobile phone. For example, if the playing mode of the background sound selected by the user is "only hear by oneself" in the first call mode, the first mix stop instruction is generated correspondingly. In this case, only the local communication device can hear the background sound, but the peer communication device cannot hear the background sound.
The first mix stop instruction and the second mix stop instruction mentioned in this embodiment are controls for mixing operations performed by the application processor in the first call mode, and the third mix stop instruction and the fourth mix stop instruction are controls for mixing operations performed by the communication processor in the second call mode. In addition, the second mix stop instruction, the third mix stop instruction and the fourth mix stop instruction act similarly as the first mix stop instruction, and therefore will not be described in detail below.
At step a31, the application processor mixes the first background sound with a voice acquired by the voice acquisition unit of the local communication device to generate a first mixed sound, and sends the first mixed sound to the peer communication device via the network communication unit in real time.
It should be noted that the mixing process is not the improvements of the present invention, and therefore are not described in detail herein.
At step a32, the application processor sends directly the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the network communication unit in real time.
The above steps a2-a32 are processes in the first call mode, and processes in the second call mode will be introduced in the following steps a4-a52.
At step a4, the application processor acquires the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generates a second background sound with a second audio format and a second sampling rate, sends the second background sound to the communication processor, and performs step a5.
In particular, referring to FIG. 4, at step a4, the process of acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the second background sound with the second audio format and the second sampling rate includes the following steps.
At step a41, the application processor acquires the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound.
At step a42, the application processor determines whether the audio format of the target background sound is consistent with the second audio format required in the second call mode; if the audio format of the target background sound is consistent with the second audio format required in the second call mode, the application processor does not perform decoding, and if the audio format of the target background sound is inconsistent with the second audio format required in the second call mode, the application processor decodes the audio format of the target background sound into the second audio format.
At step a43, the application processor determines whether the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode; if the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode, the application processor generates the second background sound with the second audio format and the second sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the second sampling rate required in the second call mode, the application processor resamples the target background sound to generate the second background sound with the second audio format and the second sampling rate.
In this embodiment, the second sampling rate may be, but is not limited to, 8k or 16k, which is determined by operators. The second audio format may be a PCM format. For example, after acquiring the target background sound, the application processor first determines the audio format of the target background sound. If the audio format is the PCM format, the target background sound is not needed to be decoded; and if the audio format is a mp3 format, the target background sound needs to be decoded. Then, the application processor determines the sampling rate of the target background sound. If the sampling rate is consistent with the first sampling rate, resampling is not needed; and if the sampling rate is inconsistent with the first sampling rate, the application processor resamples to finally generate the second background sound with the second sampling rate and the second audio format.
At step a5, the communication processor determines whether a second mix stop instruction is received from the second control unit; if the second mix stop instruction is not received, step a51 is performed, and if the second mix stop instruction is received, step a52 is performed.
At step a51, the communication processor mixes the second background sound with the voice acquired by the voice acquisition unit of the local communication device to generate a second mixed sound, and sends the second mixed sound to the peer communication device via the RF unit in real time.
At step a52, the communication processor sends directly the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the RF unit in real time.
The above steps are a flowchart illustrating a process of sending by the local communication device the mixed sound of the voice and the background sound to the peer communication device in the second call mode and the first call mode respectively. In a practical application, the local communication device also needs to mix the background sound with the voice sent by the other party and play the mixed sound. A flow of receiving a voice by the local communication device from the peer communication device will be described hereinafter.
Optionally, in the first call mode, referring to FIG. 5, after step a2, the method further includes following steps.
At step a60, the application processor receives a voice sent by the peer communication device via the network communication unit in real time, and performs step a61.
At step a61, the application processor determines whether a third mix stop instruction is received from the first control unit; if the third mix stop instruction is not received, step a62 is performed, and if the third mix stop instruction is received, a63 is performed.
At step a62, the application processor mixes the voice sent by the peer communication device with the first background sound to generate a third mixed sound, and sends the third mixed sound to the voice playing unit of the local communication device in real time.
At step a63, the application processor sends directly the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
Through steps a60-a63, in the first call mode, the application processor may mix the voice of the peer communication device (for example, the voice of the peer user) in real time and send the mixed sound to the voice playing unit of the local communication device.
Optionally, in the second call mode, referring to FIG. 6, after step a4, the method further includes following steps.
At step a70, the communication processor receives the voice sent by the peer communication device via the RF unit in real time, and performs step a71.
At step a71, the communication processor determines whether a fourth mix stop instruction is received from the second control unit; if the fourth mix stop instruction is not received , step a72 is performed, and if the fourth mix stop instruction is received, step a73 is performed.
At step a72, the communication processor mixes the voice sent by the peer communication device with the second background sound to generate a fourth mixed sound, and sends the fourth mixed sound to the voice playing unit of the local communication device in real time.
At step a73, the communication processor sends directly the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
Through steps a70-a73, in the second call mode, the application processor may mix the voice of the peer communication device (for example, the voice of the peer user) in real time and send the mixed sound to the voice playing unit of the local communication device.
The above method flow implements a process of sharing a background sound during a call between the local communication device and the peer communication device. In addition, through the control unit, the method may further enable the following functions.
1) During the call, only the local user hears the background sound, and the peer user cannot hear the background sound (for example, during a meeting).
2) During the call, only the peer user hears the background sound, and the local user cannot hear the background sound.
To sum up, by the method for sharing a background sound during a call provided by the present invention, the local communication device can read the target background sound according to the background sound selection instruction during the call, then perform the mixing process and send the mixed sound to the peer communication device, thereby improving user experiences during the call without affecting the call.
Moreover, the present invention can automatically select one of a communication processor or an application processor according to different call modes to perform the mixing process, thereby adapting to the shared background sound in different call modes, and further improving the user experiences.
In addition, the present invention can implement various controls to the mixing process according to the instructions of the control unit, so that the background sound can be heard only by the peer user or only by the local user, thereby further improving the user experiences.
An embodiment of the present invention further discloses a device for sharing a background sound during a call, as shown in FIGs. 2, 7 and 8. The device is configured in a local communication device, and includes an application processor, a communication processor, a background sound storage unit, a voice playing unit, a voice acquisition unit, and a first control unit, a second control unit and a RF unit.
The background sound storage unit, the communication processor, the voice playing unit, the voice acquisition unit, the first control unit and the network communication unit are all connected to the application processor, and the communication processor is respectively connected to the voice playing unit, the voice acquisition unit, the second control unit and the RF unit.
As shown in FIG. 7, the application processor includes:
a call mode determining module, wherein the call mode determining module determines, after receiving a background sound sharing instruction of a user, whether a current call mode is a second call mode or a first call mode, and notifies a first sampling module to act; the first sampling module, wherein the first sampling module acquires, in the first call mode, a target background sound stored in the background sound storage unit according to a background sound selection instruction of the user, generates a first background sound with a first audio format and a first sampling rate, and sends the first background sound to a first mix module;
the first sampling module acquires, in the second call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generates a second background sound with a second audio format and a second sampling rate, and sends the second background sound to a second mix module;
a first mix stop instruction receiving module, wherein the first mix stop instruction receiving module determines whether a first mix stop instruction is received from the first control unit; if the first mix stop instruction is not received, notifies the first mix module to act, and if the first mix stop instruction is received, notifies a first voice sending module to act;
the first mix module, wherein the first mix module mixes the first background sound with a voice acquired by the voice acquisition unit of the local communication device to generate a first mixed sound, and sends the first mixed sound to the peer communication device via the network communication unit in real time;
the first voice sending module, wherein the first voice sending module sends directly the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the network communication unit in real time.
Optionally, the first sampling rate is 16k or 64k, and the second sampling rate is 8k or 16k.
Referring to FIG. 8, the communication processor includes:
a second mix stop instruction receiving module, wherein the second mix stop instruction receiving module determines whether a second mix stop instruction is received from the second control unit, and if the second mix stop instruction is not received, notifies the second mix module to act, and if the second mix stop instruction is received, notifies a second voice sending module to act;
the second mix module, wherein the second mix module mixes the second background sound with the voice acquired by the voice acquisition unit of the local communication device to generate a second mixed sound, and sends the second mixed sound to the peer communication device via the RF unit in real time;
the second voice sending module, wherein the second voice sending module sends directly the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the RF unit in real time.
Optionally, in order to mix the voice of the peer communication device in the first call mode, referring to FIG. 7, after the first sampling module, the device is further connected with:
a first voice receiving module, wherein the first voice receiving module receives a voice sent by the peer communication device via the network communication unit in real time, and notifies a third mix stop instruction receiving module to act;
the third mix stop instruction receiving module, wherein the third mix stop instruction receiving module determines whether a third mix stop instruction is received from the first control unit; if the third mix stop instruction is not received, notifies the first mix module to act, and if the third mix stop instruction is received, notifies the first voice receiving module to act;
the first mix module receives the voice from the peer communication device of the first voice receiving module, mixes the voice with the first background sound to generate a third mixed sound, and sends the third mixed sound to the voice playing unit of the local communication device in real time;
the first voice receiving module sends directly the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
Optionally, in order to mix the voice of the peer communication device in the second call mode, referring to FIG. 8, after the second sampling module, the device is further connected with:
a second voice receiving module, wherein the second voice receiving module receives the voice sent by the peer communication device via the RF unit in real time, and notifies a fourth mix stop instruction receiving module to act;
the fourth mix stop instruction receiving module, wherein the fourth mix stop instruction receiving module determines whether a fourth mix stop instruction is received from the second control unit, if the fourth mix stop instruction is not received, notifies the second mix module to act, and if the fourth mix stop instruction is received, notifies the second voice receiving module to act;
the second mix module receives the voice from the peer communication device of the second voice receiving module, mixes the voice with the second background sound to generate a fourth mixed sound, and sends the fourth mixed sound to the voice playing unit of the local communication device in real time;
the second voice receiving module sends directly the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
Optionally, the process of the first sampling module acquiring, in the first call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the first background sound with the first audio format and the first sampling rate includes:
the first sampling module acquiring the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound;
the first sampling module determining whether the audio format of the target background sound is consistent with the first audio format required in the first call mode; if the audio format of the target background sound is consistent with the first audio format required in the first call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the first audio format required in the first call mode, decoding the audio format of the target background sound into the first audio format;
the first sampling module determining whether the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode; if the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode, generating the first background sound with the first audio format and the first sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the first sampling rate required in the first call mode, resampling the target background sound to generate the first background sound with the first audio format and the first sampling rate.
The process of the first sampling module acquiring, in the second call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generating the second background sound with the second audio format and the second sampling rate, and sending the second background sound to the second mix module includes:
the first sampling module acquiring the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound;
the first sampling module determining whether the audio format of the target background sound is consistent with the second audio format required in the second call mode; if the audio format of the target background sound is consistent with the second audio format required in the second call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the second audio format required in the second call mode, decoding the audio format of the target background sound into the second audio format;
the first sampling module determining whether the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode; if the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode, generating the second background sound with the second audio format and the second sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the second sampling rate required in the second call mode, resampling the target background sound to generate the second background sound with the second audio format and the second sampling rate.
The foregoing is only preferred embodiments of the present invention and is not used to limit the protection scope of the present invention. Any modification, equivalent substitution and improvement without departing from the spirit and principle of the present invention are within the protection scope of the present invention.

Claims (10)

  1. A method for sharing a background sound during a call, used during a call between a local communication device and at least one peer communication device, wherein the local communication device comprises: an application processor, a communication processor, a background sound storage unit, a voice playing unit, a voice acquisition unit, a first control unit, a second control unit, a network communication unit and a radio frequency (RF) unit;
    the background sound storage unit, the communication processor, the voice playing unit, the voice acquisition unit, the first control unit and the network communication unit are all connected to the application processor, and the communication processor is respectively connected to the voice playing unit, the voice acquisition unit, the second control unit and the RF unit;
    the method comprises:
    step a1, after receiving, by the application processor, a background sound sharing instruction of a user, determining whether a current call mode is a first call mode or a second call mode; if the current call mode is the first call mode, performing step a2, and if the current call mode is the second call mode, performing step a4;
    step a2, acquiring, by the application processor, a target background sound stored in the background sound storage unit according to a background sound selection instruction of the user, generating a first background sound with a first audio format and a first sampling rate, and performing step a3;
    step a3, determining, by the application processor, whether a first mix stop instruction is received from the first control unit; if the first mix stop instruction is not received, performing step a31, and if the first mix stop instruction is received, performing step a32;
    step a31, mixing, by the application processor, the first background sound with a voice acquired by the voice acquisition unit of the local communication device to generate a first mixed sound, and sending the first mixed sound to the peer communication device via the network communication unit in real time;
    step a32, sending directly, by the application processor, the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the network communication unit in real time;
    step a4, acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generating a second background sound with a second audio format and a second sampling rate, sending the second background sound to the communication processor, and performing step a5;
    step a5, determining, by the communication processor, whether a second mix stop instruction is received from the second control unit; if the second mix stop instruction is not received, performing step a51, and if the second mix stop instruction is received, performing step a52;
    step a51, mixing, by the communication processor, the second background sound with the voice acquired by the voice acquisition unit of the local communication device to generate a second mixed sound, and sending the second mixed sound to the peer communication device via the RF unit in real time; and
    step a52, sending directly, by the communication processor, the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the RF unit in real time.
  2. The method of claim 1, after step a2, further comprising:
    step a60, receiving, by the application processor, a voice sent by the peer communication device via the network communication unit in real time, and performing step a61;
    step a61, determining, by the application processor, whether a third mix stop instruction is received from the first control unit; if the third mix stop instruction is not received, performing step a62, and if the third mix stop instruction is received, performing step a63;
    step a62, mixing, by the application processor, the voice sent by the peer communication device with the first background sound to generate a third mixed sound, and sending the third mixed sound to the voice playing unit of the local communication device in real time; and
    step a63, sending directly, by the application processor, the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
  3. The method of claim 1, after step a4, further comprising:
    step a70, receiving, by the communication processor, the voice sent by the peer communication device via the RF unit in real time, and performing step a71;
    step a71, determining, by the communication processor, whether a fourth mix stop instruction is received from the second control unit; if the fourth mix stop instruction is not received, performing step a72, and if the fourth mix stop instruction is received, performing step a73;
    step a72, mixing, by the communication processor, the voice sent by the peer communication device with the second background sound to generate a fourth mixed sound, and sending the fourth mixed sound to the voice playing unit of the local communication device in real time;
    step a73, sending directly, by the communication processor, the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
  4. The method of claim 1, wherein
    in step a2, the process of acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the first background sound with the first audio format and the first sampling rate comprises:
    acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound;
    determining, by the application processor, whether the audio format of the target background sound is consistent with the first audio format required in the first call mode; if the audio format of the target background sound is consistent with the first audio format required in the first call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the first audio format required in the first call mode, decoding the audio format of the target background sound into the first audio format;
    determining, by the application processor, whether the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode; if the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode, generating the first background sound with the first audio format and the first sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the first sampling rate required in the first call mode, resampling the target background sound to generate the first background sound with the first audio format and the first sampling rate;
    in step a4, the process of acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the second background sound with the second audio format and the second sampling rate comprises:
    acquiring, by the application processor, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound;
    determining, by the application processor, whether the audio format of the target background sound is consistent with the second audio format required in the second call mode; if the audio format of the target background sound is consistent with the second audio format required in the second call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the second audio format required in the second call mode, decoding the audio format of the target background sound into the second audio format;
    determining, by the application processor, whether the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode; if the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode, generating the second background sound with the second audio format and the second sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the second sampling rate required in the second call mode, resampling the target background sound to generate the second background sound with the second audio format and the second sampling rate.
  5. The method of claim 1, wherein
    the first sampling rate is 16k or 64k;
    the second sampling rate is 8k or 16k.
  6. A device for sharing a background sound during a call, configured in a local communication device and comprising: an application processor, a communication processor, a background sound storage unit, a voice playing unit, a voice acquisition unit, a first control unit, a second control unit, a network communication unit and a radio frequency (RF) unit;
    the background sound storage unit, the communication processor, the voice playing unit, the voice acquisition unit, the first control unit and the network communication unit are all connected to the application processor, and the communication processor is respectively connected to the voice playing unit, the voice acquisition unit, the second control unit and the RF unit;
    wherein the application processor comprises:
    a call mode determining module, wherein the call mode determining module determines, after receiving a background sound sharing instruction of a user, whether a current call mode is a second call mode or a first call mode, and notifies a first sampling module to act;
    the first sampling module, wherein the first sampling module acquires, in the first call mode, a target background sound stored in the background sound storage unit according to a background sound selection instruction of the user, generates a first background sound with a first audio format and a first sampling rate, and sends the first background sound to a first mix module;
    the first sampling module acquires, in the second call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generates a second background sound with a second audio format and a second sampling rate, and sends the second background sound to a second mix module;
    a first mix stop instruction receiving module, wherein the first mix stop instruction receiving module determines whether a first mix stop instruction is received from the first control unit; if the first mix stop instruction is not received, notifies the first mix module to act, and if the first mix stop instruction is received, notifies a first voice sending module to act;
    the first mix module, wherein the first mix module mixes the first background sound with a voice acquired by the voice acquisition unit of the local communication device to generate a first mixed sound, and sends the first mixed sound to the peer communication device via the network communication unit in real time;
    the first voice sending module, wherein the first voice sending module sends directly the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the network communication unit in real time;
    the communication processor comprises:
    a second mix stop instruction receiving module, wherein the second mix stop instruction receiving module determines whether a second mix stop instruction is received from the second control unit, and if the second mix stop instruction is not received, notifies the second mix module to act, and if the second mix stop instruction is received, notifies a second voice sending module to act;
    the second mix module, wherein the second mix module mixes the second background sound with the voice acquired by the voice acquisition unit of the local communication device to generate a second mixed sound, and sends the second mixed sound to the peer communication device via the RF unit in real time;
    the second voice sending module, wherein the second voice sending module sends directly the voice acquired by the voice acquisition unit of the local communication device to the peer communication device via the RF unit in real time.
  7. The device of claim 6, wherein, after the first sampling module, the device is further connected with:
    a first voice receiving module, wherein the first voice receiving module receives a voice sent by the peer communication device via the network communication unit in real time, and notifies a third mix stop instruction receiving module to act;
    the third mix stop instruction receiving module, wherein the third mix stop instruction receiving module determines whether a third mix stop instruction is received from the first control unit; if the third mix stop instruction is not received, notifies the first mix module to act, and if the third mix stop instruction is received, notifies the first voice receiving module to act;
    the first mix module receives the voice from the peer communication device of the first voice receiving module, mixes the voice with the first background sound to generate a third mixed sound, and sends the third mixed sound to the voice playing unit of the local communication device in real time;
    the first voice receiving module sends directly the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
  8. The device of claim 6, wherein, after the second sampling module, the device is further connected with:
    a second voice receiving module, wherein the second voice receiving module receives the voice sent by the peer communication device via the RF unit in real time, and notifies a fourth mix stop instruction receiving module to act;
    the fourth mix stop instruction receiving module, wherein the fourth mix stop instruction receiving module determines whether a fourth mix stop instruction is received from the second control unit; if the fourth mix stop instruction is not received, notifies the second mix module to act, and if the fourth mix stop instruction is received, notifies the second voice receiving module to act;
    the second mix module receives the voice from the peer communication device of the second voice receiving module, mixes the voice with the second background sound to generate a fourth mixed sound, and sends the fourth mixed sound to the voice playing unit of the local communication device in real time;
    the second voice receiving module sends directly the voice received from the peer communication device to the voice playing unit of the local communication device in real time.
  9. The device of claim 6, wherein:
    the process of the first sampling module acquiring, in the first call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, and generating the first background sound with the first audio format and the first sampling rate comprises:
    the first sampling module acquiring the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound;
    the first sampling module determining whether the audio format of the target background sound is consistent with the first audio format required in the first call mode; if the audio format of the target background sound is consistent with the first audio format required in the first call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the first audio format required in the first call mode, decoding the audio format of the target background sound into the first audio format;
    the first sampling module determining whether the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode; if the sampling rate of the target background sound is consistent with the first sampling rate required in the first call mode, generating the first background sound with the first audio format and the first sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the first sampling rate required in the first call mode, resampling the target background sound to generate the first background sound with the first audio format and the first sampling rate;
    the process of the first sampling module acquiring, in the second call mode, the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user, generating the second background sound with the second audio format and the second sampling rate, and sending the second background sound to the second mix module comprises:
    the first sampling module acquiring the target background sound stored in the background sound storage unit according to the background sound selection instruction of the user to receive the target background sound;
    the first sampling module determining whether the audio format of the target background sound is consistent with the second audio format required in the second call mode; if the audio format of the target background sound is consistent with the second audio format required in the second call mode, not performing decoding, and if the audio format of the target background sound is inconsistent with the second audio format required in the second call mode, decoding the audio format of the target background sound into the second audio format;
    the first sampling module determining whether the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode; if the sampling rate of the target background sound is consistent with the second sampling rate required in the second call mode, generating the second background sound with the second audio format and the second sampling rate without resampling, and if the sampling rate of the target background sound is inconsistent with the second sampling rate required in the second call mode, resampling the target background sound to generate the second background sound with the second audio format and the second sampling rate.
  10. The device of claim 6, wherein the first sampling rate is 16k or 64k, and the second sampling rate is 8k or 16k.
PCT/KR2019/002426 2019-02-28 2019-02-28 A method of make call with background music and share voice fragment in calling WO2020175722A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/KR2019/002426 WO2020175722A1 (en) 2019-02-28 2019-02-28 A method of make call with background music and share voice fragment in calling

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2019/002426 WO2020175722A1 (en) 2019-02-28 2019-02-28 A method of make call with background music and share voice fragment in calling

Publications (1)

Publication Number Publication Date
WO2020175722A1 true WO2020175722A1 (en) 2020-09-03

Family

ID=72238715

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/002426 WO2020175722A1 (en) 2019-02-28 2019-02-28 A method of make call with background music and share voice fragment in calling

Country Status (1)

Country Link
WO (1) WO2020175722A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060117136A (en) * 2005-05-13 2006-11-16 김준 Background sound transmission method and a portable terminal capable of the present invention
KR20090098168A (en) * 2008-03-13 2009-09-17 유엔젤주식회사 Voice over internet protocol communication system for providing users with background music while phone conversation in peer-to-peer
KR20150000997A (en) * 2013-06-26 2015-01-06 유성연 Smart phone for sending background music and backgroud moving picture during call and method of calling using the same
CN104464743A (en) * 2014-11-17 2015-03-25 贵阳朗玛信息技术股份有限公司 Method for playing background music in voice chatting room and mobile terminal
CN106686259A (en) * 2017-03-15 2017-05-17 三星电子（中国）研发中心 Method and device for sharing background sound in talking process

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060117136A (en) * 2005-05-13 2006-11-16 김준 Background sound transmission method and a portable terminal capable of the present invention
KR20090098168A (en) * 2008-03-13 2009-09-17 유엔젤주식회사 Voice over internet protocol communication system for providing users with background music while phone conversation in peer-to-peer
KR20150000997A (en) * 2013-06-26 2015-01-06 유성연 Smart phone for sending background music and backgroud moving picture during call and method of calling using the same
CN104464743A (en) * 2014-11-17 2015-03-25 贵阳朗玛信息技术股份有限公司 Method for playing background music in voice chatting room and mobile terminal
CN106686259A (en) * 2017-03-15 2017-05-17 三星电子（中国）研发中心 Method and device for sharing background sound in talking process

Similar Documents

Publication Publication Date Title
WO2015016604A1 (en) Home appliance and control method thereof
WO2021003955A1 (en) Method and device for controlling playback state of earphone, mobile terminal and storage medium
WO2020055048A1 (en) Method for determining earphone wearing state, method for controlling electronic apparatus, and electronic apparatus
WO2014065631A1 (en) Method for operating application providing group call service using mobile voice over internet protocol
WO2010140781A2 (en) Dual sim mobile terminal and operating method thereof
WO2012102464A1 (en) Ear microphone and voltage control device for ear microphone
WO2021246692A1 (en) Method and device for residing in network, and method and device for assisting to reside in network
WO2017067375A1 (en) Video background configuration method and terminal device
WO2016204483A1 (en) Electronic device and method for controlling industrial communication device, and industrial communication device thereof
EP2559269A2 (en) Device capable of notifying operation state change thereof through network and communication method of the device
WO2017185647A1 (en) Softsim-based imsi number management and calling methods, server and network side device
WO2014035171A1 (en) Method and apparatus for transmitting file during video call in electronic device
WO2016076472A1 (en) Call control method and system
WO2019223600A1 (en) Bluetooth audio transmission method, device, and computer readable storage medium
WO2013151298A1 (en) System, terminal, and method for operating a communication service function
WO2022270904A1 (en) Method and electronic device for bluetooth audio multi-streaming
WO2017096955A1 (en) Call reminding setting method and apparatus, and related device
WO2017113976A1 (en) Wireless local area network communication method, terminal, and system
WO2017206881A1 (en) Method and apparatus for processing associated applications, storage medium, and electronic device
WO2020175722A1 (en) A method of make call with background music and share voice fragment in calling
WO2009151248A2 (en) Method for displaying thumbnail group on idle screen and mobile communication terminal
WO2022197023A1 (en) Service providing system, and terminal and processing method of service providing system
WO2022197026A1 (en) Server, service providing system, and processing method of server
WO2020135022A1 (en) Display panel image optimization method and device and computer readable storage medium
WO2017171304A1 (en) Ptt communication hands-free, and ptt communication system and method using same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19917355

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19917355

Country of ref document: EP

Kind code of ref document: A1