WO2016184295A1 - 即时通讯方法、用户设备及系统 - Google Patents

即时通讯方法、用户设备及系统 Download PDF

Info

Publication number
WO2016184295A1
WO2016184295A1 PCT/CN2016/080130 CN2016080130W WO2016184295A1 WO 2016184295 A1 WO2016184295 A1 WO 2016184295A1 CN 2016080130 W CN2016080130 W CN 2016080130W WO 2016184295 A1 WO2016184295 A1 WO 2016184295A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
indicated
instruction
local client
client
Prior art date
Application number
PCT/CN2016/080130
Other languages
English (en)
French (fr)
Inventor
赵娜
郑凯泽
姚远
Original Assignee
腾讯科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技（深圳）有限公司 filed Critical 腾讯科技（深圳）有限公司
Publication of WO2016184295A1 publication Critical patent/WO2016184295A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H04L51/046—Interoperability with other network applications or services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/10—Multimedia information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/14—Session management

Definitions

  • the present invention relates to the field of communications, and in particular, to an instant messaging method, user equipment, and system.
  • the communication application also known as Instant Messenger (IM: IM) software
  • IM Instant Messenger
  • the communication application is an Internet-based business software for real-time exchange of information, such as QQ, WeChat, and so on.
  • the audio chat usually interacts with the voice content of the chat user through a microphone; the video chat uses the camera and the microphone to simultaneously interact with the voice content and the video content of the chat user.
  • the user can also input text, expression, screenshot and other chat content through the chat dialog box while communicating through the instant messaging interface.
  • the embodiment of the invention provides an instant messaging method, user equipment and system.
  • the technical solution is as follows:
  • an instant messaging method comprising:
  • the local client receives the audio play command through the music plugin portal set in the instant messaging interface;
  • the local client acquires audio indicated by the audio play instruction
  • the local client plays the audio indicated by the audio play instruction as background music of the audio and video session;
  • the local client transmits the audio indicated by the audio play instruction to the peer client, so that the peer client plays the audio indicated by the audio play instruction as the background music of the audio and video session.
  • an instant messaging method comprising:
  • the peer client receives the audio indicated by the audio play command transmitted by the local client, and the audio play command is received by the local client through the music plugin interface set in the instant messaging interface;
  • the peer client plays the audio indicated by the audio play instruction as background music of the audio and video session.
  • a user equipment for running a local client, where the user equipment includes:
  • One or more processors are One or more processors.
  • the memory stores one or more programs, the one or more programs being configured to be executed by the one or more processors, the one or more programs including instructions for:
  • the audio play command is received through a music plugin portal set in the instant messaging interface
  • a fourth aspect provides a user equipment, configured to run a peer client, where the user equipment includes:
  • One or more processors are One or more processors.
  • the memory stores one or more programs, the one or more programs being configured to be executed by the one or more processors, the one or more programs including instructions for:
  • the audio indicated by the audio play command is played as the background music of the audio and video session.
  • an instant messaging system including:
  • the instant messaging method, the user equipment and the system provided by the invention can be obtained through the music plug-in portal set in the instant messaging interface, while the client communicates through the instant messaging interface during the instant messaging audio and video session.
  • FIG. 1 is an application scenario diagram of an instant messaging method according to an embodiment of the present invention.
  • FIG. 2 is a flowchart of an instant messaging method according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of another instant messaging method according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a scenario of an instant messaging method according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of a scenario of another instant messaging method according to an embodiment of the present invention.
  • FIG. 7 is a flowchart of a receiving audio playing method according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of a local expression of a QQ chat interface according to an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of an audio list according to an embodiment of the present invention.
  • Figure 10 is a detailed schematic view corresponding to Figure 9;
  • FIG. 11 is a schematic diagram of a method for using a search box of an interface where a song list is provided according to an embodiment of the present invention
  • FIG. 12 is a flowchart of a method for an local client to obtain an audio instruction indication of an audio play instruction according to an embodiment of the present invention
  • FIG. 13 is a flowchart of a method for a local client to transmit audio indicated by an audio play instruction to a peer client according to an embodiment of the present invention
  • FIG. 14 is a schematic structural diagram of an instant messaging apparatus according to an embodiment of the present invention.
  • FIG. 15 is a schematic structural diagram of another instant messaging apparatus according to an embodiment of the present invention.
  • 16 is a schematic structural diagram of still another instant messaging device according to an embodiment of the present invention.
  • FIG. 17 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
  • FIG. 1 is a schematic diagram of an application scenario of an instant messaging method according to an embodiment of the present invention.
  • an instant audio/video session such as a voice call, ie, an audio chat
  • an instant messaging software such as QQ
  • the user equipment for example, a computer in FIG. 1
  • the user can voice the voice of both users through a microphone.
  • Content interacts.
  • the user names of users who use QQ chat are "Zhang San" and "Li Si”
  • the specific voice content can be:
  • any user who is chatting can select a suitable background music to play, which can be selected in the scene of FIG.
  • a New Year's Eve song is used as the background music for the chat, so that the two sides can really feel the festive atmosphere and the warmth of the family and friends during the festival.
  • FIG. 2 is a flowchart of an instant messaging method according to an embodiment of the present invention, which is applied to a local client, where the local client can be installed on a user device, and the user device can be a mobile phone, a computer, a tablet, etc., as shown in FIG. 2
  • the instant messaging method can include:
  • Step 201 During the instant messaging audio and video session, the local client receives the audio playback instruction through a music plugin portal set in the instant messaging interface.
  • Step 202 The local client acquires audio indicated by the audio play instruction.
  • Step 203 The local client plays the audio indicated by the audio play instruction as the background music of the audio and video session.
  • Step 204 The local client transmits the audio indicated by the audio play instruction to the peer client, so that the peer client performs the audio indicated by the audio play instruction as the background music of the audio and video session. Play.
  • the peer client is a client used by the user's chat object.
  • the instant messaging method provided by the embodiment of the present invention can be obtained through the music plug-in portal set in the instant messaging interface, because the local client communicates through the instant messaging interface during the instant messaging audio and video session.
  • the background music can be played in addition to the simple chat content such as text, expression, screenshot, etc., without affecting the user's audio and video communication. , enriched the communication scene of instant messaging.
  • the local client transmits the audio indicated by the audio play instruction to the peer client, including:
  • the local client collects audio generated by the user's call through the microphone and audio played as background music of the audio and video session;
  • the local client performs noise reduction processing on the audio collected by the microphone
  • the local client transmits the audio collected by the noise-reduced microphone to the peer client.
  • the local client transmits the audio indicated by the audio play instruction to the peer client, including:
  • the local client transmits the file of the audio indicated by the audio play instruction to the network server, so that the network server delivers the file of the audio indicated by the audio play instruction to the local client and the peer client at the same time.
  • the local client transmits the audio indicated by the audio play instruction to the peer client, including:
  • the local client transmits the file of the audio indicated by the audio playback instruction to the network server, so that the network server delivers the file of the audio indicated by the audio playback instruction to the peer client.
  • the local client transmits the audio indicated by the audio play instruction to the peer client, including:
  • the local client transmits the Uniform Resource Locator (English: Uniform Resource Locator; short name: URL) of the audio indicated by the audio playback instruction to the peer client, so that the peer client downloads the audio indicated by the audio playback instruction according to the URL, and The audio indicated by the audio playback instruction is played as the background music of the audio and video session.
  • Uniform Resource Locator English: Uniform Resource Locator; short name: URL
  • the local client receives audio play instructions through a music plugin portal set in the instant messaging interface, including:
  • the local client receives an audio list display instruction through a music plugin portal set in the instant messaging interface
  • the local client displays the audio list and audio on the instant messaging interface according to the audio list display command.
  • the list record has at least one audio;
  • the local client receives the audio play command, and the audio indicated by the audio play command is the audio selected in the audio list.
  • the audio list includes a song list
  • the method before the local client receives the audio play instruction, the method further includes:
  • the local client receives the song addition instruction by setting a search box on the interface where the song list is located;
  • the local client acquires a link corresponding to the song indicated by the song adding instruction on the network according to the song adding instruction;
  • the local client records the information of the song indicated by the song addition instruction in the song list, the information of the song is a link corresponding to the song indicated by the song addition instruction, or the song file downloaded according to the link.
  • the audio list further includes a short audio list, where each short audio recorded in the short audio list is stored in the local client, and the short audio is the preset audio whose occupied storage space is smaller than the preset space threshold.
  • the local client obtains the audio indicated by the audio play instruction, including:
  • the local client detects whether the user has the preset permission, and the preset permission is that the server grants according to whether the user pays or the user's level;
  • the local client gets the audio indicated by the audio playback command.
  • the instant messaging method can enable the local client to enter the music plug-in interface of the multiple instant messaging interface while the user communicates through the instant messaging interface during the instant messaging audio and video session.
  • the audio of the background music as the audio and video session, and playing the audio, so as not to affect the user's audio and video communication, in addition to the simple chat content such as text, expressions, screenshots, etc.
  • the background music can also be played. Therefore, the communication scenario of instant messaging is enriched.
  • FIG. 3 is a flowchart of another instant messaging method according to an embodiment of the present invention, which is applied to a peer client, where the peer client can be installed on a user equipment, and the user equipment can be a mobile phone, a computer, a tablet, and the like.
  • the instant messaging method may include:
  • Step 301 During the instant messaging audio and video session, the peer client receives the audio indicated by the audio playback instruction transmitted by the local client, and the audio playback command is received by the local client through the music plugin portal set in the instant messaging interface.
  • the peer client is the client used by the user's chat object.
  • Step 302 The peer client uses the audio indicated by the audio playback instruction as the background of the audio and video session. Music is played.
  • the instant messaging method provided by the embodiment of the present invention can receive the audio transmitted by the local client while the chat client of the user communicates through the instant messaging interface during the instant audio and video session.
  • the background music player without affecting the audio and video communication of the user's chat object, in addition to the simple chat content such as text, expressions, screenshots, etc., the background music can also be played, thus enriching the instant messaging Communication scenario.
  • the peer client receives the audio indicated by the audio play command transmitted by the local client, including:
  • the peer client receives the audio file indicated by the audio play instruction delivered by the network server, and the file of the audio indicated by the audio play command is uploaded by the local client to the network server;
  • the peer client plays the audio indicated by the audio playback instruction as the background music of the audio and video session, including:
  • the peer client plays the audio file while buffering the audio file indicated by the audio playback instruction.
  • the peer client receives the audio indicated by the audio play command transmitted by the local client, including:
  • the peer client receives the URL of the audio indicated by the audio playback instruction transmitted by the local client;
  • the peer client plays the audio indicated by the audio playback instruction as the background music of the audio and video session, including:
  • the peer client downloads the audio indicated by the audio playback instruction according to the URL, and plays the audio indicated by the audio playback instruction as the background music of the audio and video session.
  • the instant messaging method provided by the embodiment of the present invention can receive the audio transmitted by the local client while the chat client of the user communicates through the instant messaging interface during the instant audio and video session.
  • the background music player without affecting the audio and video communication of the user's chat object, in addition to the simple chat content such as text, expressions, screenshots, etc., the background music can also be played, thus enriching the instant messaging Communication scenario.
  • FIG. 4 is a flowchart of still another instant messaging method according to an embodiment of the present invention.
  • the instant messaging method may include:
  • Step 401 During the instant messaging audio and video session, the local client is set in instant messaging.
  • the music plug-in portal of the interface receives an audio playback command.
  • the local client is the client used by the user.
  • the instant messaging audio and video session includes audio communication or video communication.
  • the audio communication or video communication is the communication method of the instant messaging software based on the Internet.
  • instant messaging software such as MSN. QQ, WeChat, Mo Mo, CECISEIM, UC, etc.
  • both users can perform voice content interaction through a microphone, that is, a voice call, and can simultaneously perform voice content and video content interaction through a camera and a microphone, that is, a video call (video chat).
  • a microphone that is, a voice call
  • video chat video chat
  • the music plug-in entry icon 50 for the local client the client used by the QQ chat user "Zhang San”
  • FIG. 5 is only an example of the location of the music plugin entry icon 50. This is not a limitation on the scope of protection of the present invention.
  • the music plugin entry icon 50 The location on the current QQ voice call interface, in addition to the left side of the microphone icon, may be located on the right side of the microphone icon or other location; as shown in FIG. 6, when the user performs a video call, the local The client (the client used by the QQ chat user "Zhang San") receives the audio play command.
  • the music plugin entry icon 50 can be set to the right of the camera icon on the current QQ video call interface, wherein it also needs to be explained.
  • Figure 6 is only an example of the location of the music plugin entry icon 50, which is not a limitation of the scope of the present invention.
  • the position of the music plug-in entry icon 50 on the current QQ video call interface may be located on the right side of the camera icon or other location, in addition to being located on the left side of the camera icon.
  • Step 402 The local client acquires audio indicated by the audio play instruction.
  • Step 403 The local client plays the audio indicated by the audio play instruction as the background music of the audio and video session.
  • Step 404 The local client transmits the audio indicated by the audio play instruction to the peer client.
  • the local client transmits the audio indicated by the audio play instruction to the peer client, so that the peer client plays the audio indicated by the audio play instruction as the background music of the audio and video session, and the peer client is the chat object of the user.
  • the client used.
  • the process in which the local client transmits the audio indicated by the audio playback instruction to the peer client is also the process of digital signal processing.
  • the steps performed by the local client (sender) are mainly divided into four steps: 1 analog-to-digital conversion, and the analog signal ( That is, the audio collected by the microphone is digitized.
  • This step consists of three small steps: sampling-quantization-encoding, which can also be called source encoding and compression information; 2 encrypting the digitized source signal to prevent being blocked by a third party Identification; 3 channel coding the encrypted signal to ensure Data reliability; 4 digital modulation, that is, moving the spectrum of the baseband signal to a high frequency to make the signal suitable for transmission in the channel.
  • the steps performed by the peer client (receiver) are symmetric with the local client, and the steps of noise reduction, digital demodulation, channel decoding, decryption, and source decoding are sequentially performed in reverse order, and the original analog signal is finally obtained.
  • Step 405 The peer client plays the audio indicated by the audio play instruction as the background music of the audio and video session.
  • step 401 may specifically include:
  • Step 4011 The local client receives an audio list display instruction through a music plugin portal set in the instant messaging interface.
  • the local client receives the audio through the music plug-in portal set in the current QQ voice call interface or the QQ video call interface.
  • the list displays instructions to display an audio list on the instant messaging interface.
  • the current call interface is the QQ voice call interface
  • the third click on the music plugin entry icon 50 of the current QQ voice call interface triggering the generation of the audio list display instruction, and the client used by Zhang San is ready to receive the call.
  • An audio list display instruction indicating the audio list. Referring to FIG.
  • Zhang San can click the music plugin entry icon 50 of the current QQ video call interface, triggering the generation of the audio list display instruction, and the client used by Zhang San is ready to receive. Displays an instruction in the audio list indicating the audio list.
  • Step 4012 The local client displays an audio list on the instant messaging interface according to the audio list display instruction.
  • the audio list may record at least one piece of audio.
  • the audio list may include a short audio list in addition to the song list.
  • the display form of the song list may be a list of songs displayed by any music player.
  • Each short audio recorded in the short audio list is stored in the local client, and the short audio is the preset audio whose occupied storage space is smaller than the preset space threshold.
  • the form of the trigger interface for each short audio recorded in the short audio list can be various.
  • the trigger interface can be the name of each short audio, such as "elevation", "sad crying", each short audio The name corresponds to a kind of short audio.
  • the trigger interface can also record the contents of each short audio in text form, such as “hahahaha”, “ ⁇ ", “love you", “handsome”, etc., such as the user clicks on the audio content "love You”, the audio played is "love you”; in particular, the trigger interface can also be like the local expression of the QQ chat interface, Figure 8 It is a schematic diagram of the local expression of the QQ chat interface.
  • the trigger interface of each short audio in the short audio list provided by the embodiment of the present invention may also be the display form in FIG.
  • Each emoticon icon corresponds to a short audio.
  • the corresponding short audio is triggered to play.
  • the short audio corresponding to the elated expression icon may be “hahahaha”.
  • Zhang San and Li Si are making a voice call
  • Zhang San finishes “financial roll” he can select a short audio corresponding to the elated expression icon in the short audio list, so that Li Si can hear it. .
  • Zhang San clicks the music plug-in entry icon 50 of the current QQ voice call interface, and then the client used by Zhang San receives the audio list display command, and then displays the audio on the current QQ voice call interface according to the audio list display command.
  • Listing 90 is shown in Figure 9. It should be noted that the audio list may be displayed on the current QQ voice call interface, or may not be displayed on the current QQ voice call interface, but may be displayed as an interface, which is not limited in the embodiment of the present invention.
  • FIG. 9 is a schematic diagram of an audio list provided by an embodiment of the present invention.
  • the song list 901 is displayed on the left side and the short audio list 902 is displayed on the right side. Since the local client does not add any song information, the displayed song list 901 is an empty list.
  • FIG. 10 is a detailed schematic diagram corresponding to FIG. 9 , and details are not described herein again.
  • Step 4013 The local client receives the song addition instruction by setting a search box on the interface where the song list is located.
  • the local client can receive a song addition instruction by setting a search box on the interface where the song list is located. For example, referring to FIG. 10, the local client can receive a song addition instruction through a search box 101 set on the interface where the song list is located.
  • the input format of the search box 101 can be an input format of a search box of any music player, such as a song/singer/album.
  • the character "/" indicates that the contextual object is an "or” relationship. Taking Figure 9 as an example, Zhang San wants to use a "Cong Xi Fa Cai" as the background music for the Li Si voice call.
  • FIG. 11 is a schematic diagram showing the results displayed by Zhang San after inputting "Gong Xi Fa Cai" in the search box of the current QQ voice call interface.
  • Step 4014 The local client acquires the information of the song indicated by the song adding instruction according to the song adding instruction, and the information of the song indicated by the song adding instruction may be a link corresponding to the song indicated by the song adding instruction, or may be a song downloaded according to the link. file.
  • the client used by Zhang San obtains a link corresponding to the song indicated by the song adding instruction (ie, the New Year's greeting song) on the network according to the song adding instruction. After the local client obtains the link corresponding to the song indicated by the song adding instruction, the first song can be obtained by downloading.
  • the song adding instruction ie, the New Year's greeting song
  • step 4015 the local client records the information of the song indicated by the song addition instruction in the song list.
  • the information of the song indicated by the song addition instruction may be a link corresponding to the song indicated by the song addition instruction, or may be a song file downloaded according to the link.
  • the local client can receive the song adding instruction through the search box set on the interface of the song list, and the local song file can be selected by the user in addition to the link corresponding to the song indicated by the song adding instruction on the network.
  • Step 4014 may specifically include: the local client acquiring, according to the song adding instruction, a folder corresponding to the song indicated by the adding instruction (song name) on the user equipment installed by the local client.
  • Step 4015 may specifically include: the local client records the local song file indicated by the song adding instruction in the song list.
  • Step 4016 The local client receives an audio play instruction.
  • the user can select an audio as the background music in the audio list, and when the user selects, the user device where the local client is located generates an audio play instruction, and the audio indicated by the audio play instruction is the audio selected in the audio list.
  • the client used by Zhang San receives the audio play command, and the audio indicated by the audio play command is the selected audio in the song list 901 included in the audio list in FIG. 11 (eg, 01-Cong Xi Fa Cai-Andy Lau).
  • the audio indicated by the audio playback instruction is the selected short audio (the "hahahaha" corresponding to the emoji expression icon) in the short audio list 902 included in the audio list in FIG.
  • the local client obtains the audio indicated by the audio play command.
  • the client used by Zhang San obtains the New Year's Eve song audio, or obtains the "hahahaha” audio corresponding to the elated expression icon.
  • the audio recorded in the above song list may include pay audio. Therefore, the local client can also It is detected whether the audio indicated by the audio play instruction is paid audio. If the audio indicated by the audio play instruction is paid audio, the local client needs to perform the right verification on the user before obtaining the audio indicated by the audio play instruction. If the user passes the authority verification, the client used by the user can obtain the right. The audio indicated by the audio playback command. If the user does not pass the authorization verification and needs to complete the payment, the local client obtains the audio indicated by the audio playback instruction.
  • the step 402 is as shown in FIG. 12, and specifically includes:
  • Step 4021 The local client detects whether the user has preset authority.
  • the preset permission is granted by the server according to whether the user pays or the user's level. For example, the server may charge according to whether the user is selected audio. If the user has paid, the user may determine that the user has the right to play the audio indicated by the audio play instruction; if the user does not pay, the user may determine that the user does not play the audio play.
  • the permission of the audio indicated by the instruction There are many ways to pay, for example, you can pay by Q coins (which is an electronic money) or you can pay through online banking.
  • the authority can be judged according to the user's level, assuming that there is a star level, a moon level, a sun level, and a crown level, and the level of the level is sequentially increased; if the user's level is a star level, a moon level, or a sun level, the user can be judged. There is no permission to play the audio indicated by the audio play command; if the user's level is the crown level, it can be determined that the user has the right to play the audio indicated by the audio play command.
  • Step 4022 If the user has the preset authority, the local client acquires the audio indicated by the audio play instruction.
  • step 4021 it is determined whether the local client can acquire the audio indicated by the audio play instruction. For example, referring to FIG. 9, assuming that the current QQ user level of Zhang San is the Crown level, the client used by Zhang San can obtain the New Year's Eve song audio, or obtain the "hahahaha" audio corresponding to the elated expression icon.
  • the step 402 may further include: the local client detects whether the user is a preset level user, and the preset level user has the right to use the audio list; Set the level user, the local client gets the audio indicated by the audio playback command.
  • the preset level user may be a yellow diamond user or a green diamond user, or may be a VIP user (a yellow diamond user, a green diamond user, and a VIP user are preset user levels).
  • step 403 if the user of the local client passes the authority verification, or the user is a preset level user, the client used by the user can obtain the audio indicated by the audio play instruction, and then, The local client can play the audio indicated by the audio playback command as the background music of the audio and video session.
  • Zhang San passed the permission verification.
  • the client used by Zhang San got the New Year's Eve song, or the "hahahaha" audio corresponding to the elated expression icon, you can use these two audios as The background music of Li Si voice call is played.
  • the local client may transmit the audio indicated by the audio playback instruction to the peer client in multiple manners.
  • the following methods may be included:
  • the local client collects audio through the microphone and transmits it to the peer client.
  • the method may include:
  • Step 4041 The local client collects audio generated by the user's call and audio played as background music of the audio and video session through the microphone.
  • the client used by Zhang San collects the audio generated during the voice conversation between Zhang San and Li Si through the microphone, that is, the voice content referred to in FIG. 1 and the background music as a voice call. Play New Year's Eve song audio.
  • Step 4042 The local client performs noise reduction processing on the audio collected by the microphone.
  • Speech noise reduction is an effective processing technique for noise processing.
  • the purpose of noise reduction is to eliminate the influence of noise, improve audio clarity and improve audio quality.
  • the local client can perform noise reduction processing on the audio generated by the user's call collected by the microphone and the audio played as the background music of the audio and video session by using the two-stage Wiener filtering method to achieve the maximum possible separation of audio and noise. .
  • a suitable audio noise reduction method can be selected according to the actual requirements, which is not limited by the embodiment of the present invention.
  • Step 4043 The local client transmits the audio collected by the noise-reduced microphone to the peer client.
  • the local client sends the audio file indicated by the audio playback instruction to the local client and the peer client through the network server.
  • the client used by Zhang San transmits the audio file of the New Year's Eve song to the web server.
  • the audio file can be downloaded from the network or uploaded locally, so that the web server can convert the new year.
  • the Lunar New Year song was sent to the client used by Zhang San and Li Si.
  • the client is used so that when Zhang San and Li Si make a voice call, the audio that the two parties hear as background music is played synchronously.
  • the local client sends the audio file indicated by the audio playback instruction to the peer client through the network server.
  • the client used by Zhang San transmits the New Year's Eve song to the web server, and the client used by Zhang San plays the New Year's Eve song as the background music, so that the web server can put the New Year's greetings under the song.
  • the client used by Li Si can play the file of the New Year's Eve song while the file of the New Year's Eve song is cached, that is, play while downloading, so that Zhang San and Li Si can be guaranteed.
  • the audio that the two parties hear as background music is as synchronized as possible.
  • the local client transmits the URL of the audio indicated by the audio playback instruction to the peer client.
  • the local client transmits the URL of the audio indicated by the audio playback instruction (ie, the link corresponding to the song indicated by the song adding instruction) to the peer client, and the peer client can download the audio indicated by the audio playback instruction according to the URL, and the audio is The audio indicated by the playback command is played as the background music of the audio and video session.
  • the audio playback instruction ie, the link corresponding to the song indicated by the song adding instruction
  • the client used by Zhang San did not transmit the New Year's Eve song to the web server, but transmitted the URL of the song directly to the client used by Li Si.
  • the client used by Li Si needs to download the New Year's Eve song according to the URL sent by Zhang San, and play it after downloading.
  • the local client may send the file of the audio indicated by the audio play instruction to the peer client through the network server, or may transmit the URL of the audio indicated by the audio play command to the peer client, and therefore,
  • the peer client playing the audio indicated by the audio play instruction as the background music of the audio and video session may include: playing the audio file while the peer client caches the audio file indicated by the audio play instruction;
  • the peer client playing the audio indicated by the audio play instruction as the background music of the audio and video session may include: the peer client downloads the audio indicated by the audio play instruction according to the URL, and uses the audio indicated by the audio play instruction as the audio and video session. The background music is played.
  • the client used by Zhang San transmits the New Year's Eve song to the web server.
  • the web server sends the New Year's Eve song to the client used by Zhang San and the client used by Li Si, or only Delivered to the client used by Li Si, the client used by Li Si can be cached.
  • the New Year's Eve song is played at the same time, and the effect of playing while buffering is realized.
  • the client used by Zhang San transmits the URL of the New Year's Eve song to the client used by Li Si.
  • the client used by Li Si downloads the New Year's Eve song according to the URL sent by Zhang San, and plays the song as the background music with Zhang San's voice call.
  • the instant messaging method provided by the embodiment of the present invention has high ease of use, and the function implemented by the method can be used as a value-added function. For example, it can be used by a yellow diamond or a VIP user, or a specific music in a function list is used for payment.
  • a compromise solution may be adopted: a song request is sent to the user, and the user receives the prompt box. : "Do you want to play the song?" If you agree to play the song, interrupt the voice call process and start playing the song. After the game is finished, you can pop up a dialog box: "The song has been played, please continue the voice call". At the same time, both users can continue the voice call.
  • the instant messaging method provided by the embodiment of the present invention can be obtained through the music plug-in interface set in the instant messaging interface, while the client communicates through the instant messaging interface during the instant messaging audio and video session.
  • FIG. 14 is a schematic structural diagram of an instant messaging device 70 according to an embodiment of the present invention.
  • the instant messaging device 70 is used for a local client, and the local client is a client used by the user.
  • the instant messaging device 70 can include:
  • the first receiving module 701 is configured to receive an audio play instruction by using a music plug-in interface set in the instant messaging interface during the instant messaging audio and video session;
  • the obtaining module 702 is configured to obtain audio indicated by the audio play instruction
  • the playing module 703 is configured to use the audio indicated by the audio playback instruction as the background sound of the audio and video session Play for music;
  • the sending module 704 is configured to transmit the audio indicated by the audio play instruction to the peer client, so that the peer client plays the audio indicated by the audio play instruction as the background music of the audio and video session.
  • the peer client is the client used by the user's chat object.
  • the instant messaging device provided by the embodiment of the present invention can be obtained through the music plug-in interface set in the instant messaging interface, because the local client communicates through the instant messaging interface during the instant messaging audio and video session.
  • the audio of the background music of the audio and video session, and playing the audio the background music can be played in addition to the simple chat content such as text, expression, screenshot, etc., without affecting the user's audio and video communication. , enriched the communication scene of instant messaging.
  • FIG. 15 is a schematic structural diagram of another instant messaging device 70 according to an embodiment of the present invention.
  • the instant messaging device 70 is used for a local client, and the local client is a client used by the user.
  • the instant messaging device is shown in FIG. 70 can include:
  • the first receiving module 701 is configured to receive an audio play instruction by using a music plug-in interface set in the instant messaging interface during the instant messaging audio and video session;
  • the obtaining module 702 is configured to obtain audio indicated by the audio play instruction
  • the playing module 703 is configured to play the audio indicated by the audio play instruction as the background music of the audio and video session;
  • the sending module 704 is configured to transmit the audio indicated by the audio play instruction to the peer client, so that the peer client plays the audio indicated by the audio play instruction as the background music of the audio and video session.
  • the peer client is the client used by the user's chat object.
  • the sending module 704 is configured to:
  • the audio collected by the noise-reduced microphone is transmitted to the peer client.
  • the sending module 704 is configured to:
  • the sending module 704 is configured to:
  • the file of the audio indicated by the audio playback instruction is transmitted to the network server, so that the network server delivers the file of the audio indicated by the audio playback instruction to the peer client.
  • the sending module 704 is configured to:
  • the first receiving module 701 is configured to:
  • the audio indicated by the audio play command is the audio selected in the audio list.
  • the audio list includes a list of songs.
  • the instant messaging device 70 may further include:
  • a second receiving module 705, configured to receive a song adding instruction by using a search box disposed on an interface where the song list is located;
  • the adding module 706 is configured to acquire, according to the song adding instruction, a link corresponding to the song indicated by the song adding instruction on the network;
  • the recording module 707 is configured to record information of the song indicated by the song adding instruction in the song list, the information of the song is a link corresponding to the song indicated by the song adding instruction, or the song file downloaded according to the link.
  • the audio list further includes a short audio list, where each short audio recorded in the short audio list is stored in the local client, and the short audio is the preset audio whose occupied storage space is smaller than the preset space threshold.
  • the obtaining module 702 is configured to:
  • the audio indicated by the audio playback command is obtained.
  • the instant messaging device provided by the embodiment of the present invention can be set in the instant communication audio and video session, because the local client communicates through the instant messaging interface.
  • the music plug-in portal of the instant messaging interface acquires the audio of the background music as the audio and video session, and plays the audio, so that in addition to affecting the user's audio and video communication, in addition to the simple chat content such as text, expression, screenshot, etc. can be input at the same time. It can also play background music, thus enriching the communication scene of instant messaging.
  • FIG. 16 is a schematic structural diagram of still another instant messaging device 70 according to an embodiment of the present invention.
  • the instant messaging device 70 is used by a client for peers and a peer client for a chat object of a user, as shown in FIG. 16 .
  • the instant messaging device 70 can include:
  • the receiving module 708 is configured to receive, during the instant messaging audio and video session, the audio indicated by the audio playback instruction transmitted by the local client, where the audio playback command is received by the local client through the music plug-in interface set in the instant messaging interface;
  • the playing module 709 is configured to play the audio indicated by the audio play instruction as the background music of the audio and video session.
  • the instant messaging device provided by the embodiment of the present invention can receive the audio transmitted by the local client while the chat client of the user communicates through the instant messaging interface during the instant audio and video session.
  • the background music player without affecting the audio and video communication of the user's chat object, in addition to the simple chat content such as text, expressions, screenshots, etc., the background music can also be played, thus enriching the instant messaging Communication scenario.
  • the receiving module 708 is configured to:
  • the above playing module 709 is configured to:
  • the audio file is played while the audio file indicated by the audio playback instruction is cached.
  • the receiving module 708 is configured to:
  • the above playing module 709 is configured to:
  • the audio indicated by the audio playback instruction is downloaded according to the URL, and the audio indicated by the audio playback instruction is played as the background music of the audio and video session.
  • the instant messaging device provided by the embodiment of the present invention can receive the audio transmitted by the local client while the chat client of the user communicates through the instant messaging interface during the instant audio and video session. And play as background music, without affecting the user's chat object Under the premise of audio and video communication, in addition to the ability to input text, expressions, screenshots and other simple chat content, you can also play background music, thus enriching the communication scene of instant messaging.
  • the embodiment of the invention provides an instant messaging system, including the instant messaging device shown in FIG. 14, FIG. 15, or FIG.
  • FIG. 17 is a schematic structural diagram of a terminal 500 according to an embodiment of the present invention.
  • the terminal 500 can be the user equipment in the above embodiment.
  • the terminal 500 may include a communication unit 510, a memory 520 including one or more computer readable storage media, an input unit 530, a display unit 540, a sensor 550, an audio circuit 560, and a WIFI (Wireless Fidelity).
  • the terminal structure shown in FIG. 17 does not constitute a limitation to the terminal, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements. among them:
  • the communication unit 510 can be used for transmitting and receiving information and receiving and transmitting signals during a call.
  • the communication unit 510 can be an RF (Radio Frequency) circuit, a router, a modem, or the like.
  • RF circuits as communication units include, but are not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, and a LNA (Low Noise Amplifier, low).
  • SIM Subscriber Identity Module
  • the communication unit 510 can also communicate with the network and other devices through wireless communication.
  • Wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access) Divisional Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, SMS (Short Messaging Service), and the like.
  • Memory 520 can be used to store software programs and modules, and processor 580 runs software stored in memory 520 Programs and modules to perform various functional applications and data processing.
  • the memory 520 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to The data created by the use of the terminal 500 (such as audio data, phone book, etc.) and the like.
  • memory 520 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, memory 520 may also include a memory controller to provide access to memory 520 by processor 580 and input unit 530.
  • Input unit 530 can be used to receive input numeric or character information, as well as to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.
  • input unit 530 can include touch-sensitive surface 531 as well as other input devices 532.
  • a touch-sensitive surface 531 also referred to as a touch display or trackpad, can collect touch operations on or near the user (eg, the user uses a finger, stylus, etc., any suitable object or accessory on the touch-sensitive surface 531 or The operation near the touch-sensitive surface 531) and driving the corresponding connecting device according to a preset program.
  • the touch-sensitive surface 531 can include two portions of a touch detection device and a touch controller.
  • the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
  • the processor 580 is provided and can receive commands from the processor 580 and execute them.
  • the touch sensitive surface 531 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • the input unit 530 can also include other input devices 532.
  • other input devices 532 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
  • Display unit 540 can be used to display information entered by the user or information provided to the user and various graphical user interfaces of terminal 500, which can be composed of graphics, text, icons, video, and any combination thereof.
  • the display unit 540 may include a display panel 541.
  • the display panel 541 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like.
  • the touch-sensitive surface 531 can cover the display panel 541, and when the touch-sensitive surface 531 detects a touch operation thereon or nearby, it is transmitted to the processor 580 to determine the type of the touch event, and then the processor 580 according to the touch event The type provides a corresponding visual output on display panel 541.
  • the touch-sensitive surface 531 and the display panel 541 are implemented as two separate components to implement input and input functions, in some implementations In an example, the touch-sensitive surface 531 can be integrated with the display panel 541 to implement input and output functions.
  • Terminal 500 can also include at least one type of sensor 550, such as a light sensor, motion sensor, and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 541 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 541 and/or the backlight when the terminal 500 moves to the ear.
  • the gravity acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity.
  • the terminal 500 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here Let me repeat.
  • Audio circuit 560, speaker 561, and microphone 562 can provide an audio interface between the user and terminal 500.
  • the audio circuit 560 can transmit the converted electrical data of the received audio data to the speaker 561, and convert it into a sound signal output by the speaker 561.
  • the microphone 562 converts the collected sound signal into an electrical signal, and the audio circuit 560 is used by the audio circuit 560. After receiving, it is converted into audio data, and then processed by the audio data output processor 580, transmitted to the other terminal, for example, via the communication unit 510, or outputted to the memory 520 for further processing.
  • the audio circuit 560 may also include an earbud jack to provide communication of the peripheral earphones with the terminal 500.
  • the terminal may be configured with a wireless communication unit 570, which may be a WIFI module.
  • the WIFI is a short-range wireless transmission technology, and the terminal 500 can help the user to send and receive emails, browse web pages, and access streaming media through the wireless communication unit 570, which provides wireless broadband Internet access for users.
  • the wireless communication unit 570 is shown in the drawing, it can be understood that it does not belong to the essential configuration of the terminal 500, and may be omitted as needed within the scope of not changing the essence of the invention.
  • Processor 580 is the control center of terminal 500, which connects various portions of the entire handset using various interfaces and lines, by running or executing software programs and/or modules stored in memory 520, and recalling data stored in memory 520, The various functions and processing data of the terminal 500 are performed to perform overall monitoring of the mobile phone.
  • the processor 580 may include one or more processing cores; preferably, the processor 580 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application, and the like.
  • the modem processor primarily handles wireless communications. It will be appreciated that the above described modem processor may also not be integrated into the processor 580.
  • the terminal 500 also includes a power source 590 (such as a battery) that supplies power to the various components.
  • a power source 590 such as a battery
  • the power source can It is logically connected to the processor 580 through the power management system to manage functions such as charging, discharging, and power management through the power management system.
  • Power supply 560 may also include any one or more of a DC or AC power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
  • the terminal 500 may further include a camera, a Bluetooth module, and the like, and details are not described herein again.
  • the terminal further includes one or more programs, the one or more programs being stored in the memory and configured to be executed by one or more processors, on the one hand, one or more programs include The instructions for performing the following instant messaging method provided by the embodiments of the present invention:
  • the local client receives the audio playback command through the music plugin portal set in the instant messaging interface.
  • the local client obtains the audio indicated by the audio playback command.
  • the local client plays the audio indicated by the audio playback command as the background music of the audio and video session.
  • the local client transmits the audio indicated by the audio play instruction to the peer client, so that the peer client plays the audio indicated by the audio play instruction as the background music of the audio and video session, and the peer client is the chat object of the user.
  • the client used.
  • the local client transmits the audio indicated by the audio play instruction to the peer client, including:
  • the local client collects audio generated by the user's call through the microphone and audio played as background music of the audio and video session;
  • the local client performs noise reduction processing on the audio collected by the microphone
  • the local client transmits the audio collected by the noise-reduced microphone to the peer client.
  • the local client transmits the audio indicated by the audio play instruction to the peer client, including:
  • the local client transmits the file of the audio indicated by the audio play instruction to the network server, so that the network server delivers the file of the audio indicated by the audio play instruction to the local client and the peer client at the same time.
  • the local client transmits the audio indicated by the audio play instruction to the peer client, including:
  • the local client transmits the file of the audio indicated by the audio playback instruction to the network server, so that the network server delivers the file of the audio indicated by the audio playback instruction to the peer client.
  • the local client transmits the audio indicated by the audio play instruction to the peer client, including:
  • the local client transmits the URL of the audio indicated by the audio playback instruction to the peer client, so that The peer client downloads the audio indicated by the audio playback instruction according to the URL, and plays the audio indicated by the audio playback instruction as the background music of the audio and video session.
  • the local client receives audio play instructions through a music plugin portal set in the instant messaging interface, including:
  • the local client receives an audio list display instruction through a music plugin portal set in the instant messaging interface
  • the local client displays an audio list on the instant messaging interface according to the audio list display instruction, and the audio list records at least one audio;
  • the local client receives the audio play command, and the audio indicated by the audio play command is the audio selected in the audio list.
  • the audio list includes a list of songs.
  • the method further includes:
  • the local client receives the song addition instruction by setting a search box on the interface where the song list is located;
  • the local client acquires a link corresponding to the song indicated by the song adding instruction on the network according to the song adding instruction;
  • the local client records the information of the song indicated by the song addition instruction in the song list, the information of the song is a link corresponding to the song indicated by the song addition instruction, or the song file downloaded according to the link.
  • the audio list further includes a short audio list, where each short audio recorded in the short audio list is stored in the local client, and the short audio is the preset audio whose occupied storage space is smaller than the preset space threshold.
  • the local client obtains the audio indicated by the audio play instruction, including:
  • the local client detects whether the user has the preset permission, and the preset permission is that the server grants according to whether the user pays or the user's level;
  • the local client gets the audio indicated by the audio playback command.
  • the one or more programs include instructions for performing the instant messaging method as provided by the embodiments of the present invention:
  • the peer client receives the audio indicated by the audio playback command transmitted by the local client, and the audio playback command is received by the local client through the music plug-in portal set in the instant messaging interface, and the opposite client The client used by the user's chat object.
  • the peer client plays the audio indicated by the audio playback instruction as the background music of the audio and video session.
  • the peer client receives the audio indicated by the audio playback instruction transmitted by the local client, and the package include:
  • the peer client receives the audio file indicated by the audio play instruction delivered by the network server, and the file of the audio indicated by the audio play command is uploaded by the local client to the network server;
  • the peer client plays the audio indicated by the audio playback instruction as the background music of the audio and video session, including:
  • the peer client plays the audio file while buffering the audio file indicated by the audio playback instruction.
  • the peer client receives the audio indicated by the audio play command transmitted by the local client, including:
  • the peer client receives the URL of the audio indicated by the audio playback instruction transmitted by the local client;
  • the peer client plays the audio indicated by the audio playback instruction as the background music of the audio and video session, including:
  • the peer client downloads the audio indicated by the audio playback instruction according to the URL, and plays the audio indicated by the audio playback instruction as the background music of the audio and video session.
  • the terminal provided by the embodiment of the present invention can obtain the audio and video input through the music plug-in interface of the instant messaging interface while the user communicates through the instant messaging interface during the instant messaging audio and video session.
  • the audio of the background music of the session and play the audio, so that in addition to the simple chat content such as text, expressions, screenshots, etc., the background music can be played without affecting the user's audio and video communication, thus enriching the background music Instant messaging communication scenario.
  • non-transitory computer readable storage medium comprising instructions, such as a memory comprising instructions executable by a processor of a terminal to perform the instant messaging method described above.
  • the non-transitory computer readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.
  • a person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium.
  • the storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.

Abstract

本发明公开了一种即时通讯方法、用户设备及系统，属于通讯领域。所述方法包括：在即时通讯音视频会话过程中，本地客户端通过设置在即时通讯界面的音乐插件入口接收音频播放指令；本地客户端获取音频播放指令指示的音频；本地客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放；本地客户端将音频播放指令指示的音频传输至对端客户端，以使得对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。本发明用于解决即时通讯的通讯场景单一的问题，实现了丰富即时通讯的通讯场景的效果，用于即时通讯。

Description

即时通讯方法、用户设备及系统
本申请要求于2015年5月19日提交中国专利局、申请号为201510257973.8、发明名称为“即时通讯方法、装置及系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及通讯领域，特别涉及一种即时通讯方法、用户设备及系统。
背景技术
通讯类应用也称为即时通讯(英文：Instant Messenger；简称：IM)软件，是一种基于互联网的即时交流信息的业务软件，例如QQ、微信等。随着通讯技术的发展，越来越多的通讯类应用支持多媒体通讯，即音频或视频通讯。
相关技术中，音频聊天通常是通过麦克风将聊天用户双方的语音内容进行交互；视频聊天是通过摄像头和麦克风同时将聊天用户双方的语音内容和视频内容进行交互。在即时通讯音视频会话的过程中，用户在通过即时通讯界面通讯的同时，也可以通过聊天对话框输入文字、表情、截图等聊天内容。
但是，在即时通讯的过程中，在不影响聊天用户双方的音视频通讯的前提下，仅仅能同时输入文字、表情、截图等简单的聊天内容，即时通讯的通讯场景单一。
发明内容
为了解决即时通讯的通讯场景单一的问题，本发明实施例提供了一种即时通讯方法、用户设备及系统。所述技术方案如下：
第一方面，提供一种即时通讯方法，所述方法包括：
在即时通讯音视频会话过程中，本地客户端通过设置在即时通讯界面的音乐插件入口接收音频播放指令；
所述本地客户端获取所述音频播放指令指示的音频；
所述本地客户端将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放；
所述本地客户端将所述音频播放指令指示的音频传输至对端客户端，以使得所述对端客户端将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
第二方面，提供一种即时通讯方法，所述方法包括：
在即时通讯音视频会话过程中，对端客户端接收本地客户端传输的音频播放指令指示的音频，所述音频播放指令是所述本地客户端通过设置在即时通讯界面的音乐插件入口接收的；
所述对端客户端将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
第三方面，提供一种用户设备，用于运行本地客户端，所述用户设备包括：
一个或多个处理器；和
存储器；
所述存储器存储有一个或多个程序，所述一个或多个程序被配置成由所述一个或多个处理器执行，所述一个或多个程序包含用于进行以下操作的指令：
在即时通讯音视频会话过程中，通过设置在即时通讯界面的音乐插件入口接收音频播放指令；
获取所述音频播放指令指示的音频；
将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放；
将所述音频播放指令指示的音频传输至对端客户端，以使得所述对端客户端将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
第四方面，提供一种用户设备，用于运行对端客户端，所述用户设备包括：
一个或多个处理器；和
存储器；
所述存储器存储有一个或多个程序，所述一个或多个程序被配置成由所述一个或多个处理器执行，所述一个或多个程序包含用于进行以下操作的指令：
在即时通讯音视频会话过程中，接收本地客户端传输的音频播放指令指示的音频，所述音频播放指令是所述本地客户端通过设置在即时通讯界面的音乐插件入口接收的；
将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
第五方面，提供一种即时通讯系统，包括：
第三方面任一所述的用户设备；
以及，第四方面任一所述的用户设备。
本发明实施例提供的技术方案带来的有益效果是：
本发明提供的一种即时通讯方法、用户设备及系统，在即时通讯音视频会话过程中，由于客户端在用户通过即时通讯界面通讯的同时，能够通过设置在即时通讯界面的音乐插件入口获取作为音视频会话的背景音乐的音频，并播放该音频，从而在不影响用户双方的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。
附图说明
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本发明实施例提供的一种即时通讯方法的应用场景图；
图2是本发明实施例提供的一种即时通讯方法的流程图；
图3是本发明实施例提供的另一种即时通讯方法的流程图；
图4是本发明实施例提供的又一种即时通讯方法的流程图；
图5是本发明实施例提供的一种即时通讯方法的场景示意图；
图6是本发明实施例提供的另一种即时通讯方法的场景示意图；
图7是本发明实施例提供的一种接收音频播放方法的流程图；
图8是本发明实施例提供的一种QQ聊天界面的本地表情的示意图；
图9是本发明实施例提供的一种音频列表的示意图；
图10为图9对应的详细示意图；
图11是本发明实施例提供的一种歌曲列表所在界面的搜索框使用方法的示意图；
图12是本发明实施例提供的一种本地客户端获取音频播放指令指示的音频方法的流程图；
图13是本发明实施例提供的一种本地客户端将音频播放指令指示的音频传输至对端客户端方法的流程图；
图14是本发明实施例提供的一种即时通讯装置的结构示意图；
图15是本发明实施例提供的另一种即时通讯装置的结构示意图；
图16是本发明实施例提供的又一种即时通讯装置的结构示意图；
图17是本发明实施例提供的一种终端的结构示意图。
具体实施方式
为使本发明的目的、技术方案和优点更加清楚，下面将结合附图对本发明实施方式作进一步地详细描述。
图1是本发明实施例提供的一种即时通讯方法的应用场景图。参见图1，用户在用户设备(图1以电脑为例)上通过即时通讯软件(如QQ)进行即时通讯音视频会话(如语音通话，即音频聊天)时，可以通过麦克风将用户双方的语音内容进行交互。示例的，图1中，使用QQ聊天的用户的用户名分别为“张三”和“李四”，具体的语音内容可以为：
“张三：老李，新春快乐！
李四：老张，同乐同乐！
张三：祝你在新的一年里心想事成，财源滚滚，哈哈哈哈～。
李四：祝你在新的一年里身体健康，工作顺利。”
在上述音频通讯过程中，为了营造浓厚的节日氛围，正在聊天的用户双方除了交互语音内容之外，任一用户可以选定一个适宜的背景音乐进行播放，在如图1的场景中可以选定一首新年贺岁歌曲作为聊天的背景音乐，这样，更能让双方真切感受到浓厚的节日氛围以及节日里亲朋好友的温暖。
图2是本发明实施例提供的一种即时通讯方法的流程图，应用于本地客户端，该本地客户端可以安装于用户设备，该用户设备可以为手机、电脑和平板电脑等，参见图2，该即时通讯方法可以包括：
步骤201、在即时通讯音视频会话过程中，本地客户端通过设置在即时通讯界面的音乐插件入口接收音频播放指令。
步骤202、本地客户端获取音频播放指令指示的音频。
步骤203、本地客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
步骤204、本地客户端将音频播放指令指示的音频传输至对端客户端，以使得对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行 播放。
其中，该对端客户端为用户的聊天对象所使用的客户端。
综上所述，本发明实施例提供的即时通讯方法，在即时通讯音视频会话过程中，由于本地客户端在用户通过即时通讯界面通讯的同时，能够通过设置在即时通讯界面的音乐插件入口获取作为音视频会话的背景音乐的音频，并播放该音频，从而在不影响用户的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。
可选的，本地客户端将音频播放指令指示的音频传输至对端客户端，包括：
本地客户端通过麦克风采集用户通话产生的音频以及作为音视频会话的背景音乐播放的音频；
本地客户端对麦克风采集的音频进行降噪处理；
本地客户端将经过降噪处理的麦克风采集的音频传输至对端客户端。
可选的，本地客户端将音频播放指令指示的音频传输至对端客户端，包括：
本地客户端将音频播放指令指示的音频的文件传输至网络服务器，以使得网络服务器将音频播放指令指示的音频的文件同时下发给本地客户端和对端客户端。
可选的，本地客户端将音频播放指令指示的音频传输至对端客户端，包括：
本地客户端将音频播放指令指示的音频的文件传输至网络服务器，以使得网络服务器将音频播放指令指示的音频的文件下发给对端客户端。
可选的，本地客户端将音频播放指令指示的音频传输至对端客户端，包括：
本地客户端将音频播放指令指示的音频的统一资源定位符(英文：Uniform Resource Locator；简称：URL)传输至对端客户端，以使得对端客户端根据URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
可选的，本地客户端通过设置在即时通讯界面的音乐插件入口接收音频播放指令，包括：
本地客户端通过设置在即时通讯界面的音乐插件入口接收音频列表显示指令；
本地客户端根据音频列表显示指令，在即时通讯界面显示音频列表，音频 列表记录有至少一条音频；
本地客户端接收音频播放指令，音频播放指令指示的音频为在音频列表中被选择的音频。
可选的，音频列表包括歌曲列表，在本地客户端接收音频播放指令之前，该方法还包括：
本地客户端通过设置在歌曲列表所在界面的搜索框接收歌曲添加指令；
本地客户端根据歌曲添加指令在网络获取歌曲添加指令指示的歌曲对应的链接；
本地客户端将歌曲添加指令指示的歌曲的信息记录在歌曲列表中，歌曲的信息为歌曲添加指令指示的歌曲对应的链接，或者根据链接下载的歌曲文件。
可选的，音频列表还包括短音频列表，短音频列表中记录的每个短音频存储在本地客户端，短音频为占用的存储空间小于预设空间阈值的预设音频。
可选的，本地客户端获取音频播放指令指示的音频，包括：
本地客户端检测用户是否拥有预设权限，预设权限是服务器根据用户是否付费或者用户的等级授予的；
如果用户拥有预设权限，本地客户端获取音频播放指令指示的音频。
综上所述，本发明实施例提供的即时通讯方法，在即时通讯音视频会话过程中，由于本地客户端在用户通过即时通讯界面通讯的同时，能够通过设置在多即时通讯界面的音乐插件入口获取作为音视频会话的背景音乐的音频，并播放该音频，从而在不影响用户的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。
图3是本发明实施例提供的另一种即时通讯方法的流程图，应用于对端客户端，该对端客户端可以安装于用户设备，该用户设备可以为手机、电脑和平板电脑等，参见图3，该即时通讯方法可以包括：
步骤301、在即时通讯音视频会话过程中，对端客户端接收本地客户端传输的音频播放指令指示的音频，该音频播放指令是本地客户端通过设置在即时通讯界面的音乐插件入口接收的。
其中，对端客户端为用户的聊天对象所使用的客户端。
步骤302、对端客户端将音频播放指令指示的音频作为音视频会话的背景 音乐进行播放。
综上所述，本发明实施例提供的即时通讯方法，在即时通讯音视频会话过程中，由于对端客户端在用户的聊天对象通过即时通讯界面通讯的同时，能够接收本地客户端传输的音频并作为背景音乐播放，在不影响该用户的聊天对象的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。
可选的，对端客户端接收本地客户端传输的音频播放指令指示的音频，包括：
对端客户端接收网络服务器下发的音频播放指令指示的音频的文件，该音频播放指令指示的音频的文件是本地客户端上传至网络服务器的；
对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放，包括：
对端客户端在缓存音频播放指令指示的音频的文件的同时，播放音频的文件。
可选的，对端客户端接收本地客户端传输的音频播放指令指示的音频，包括：
对端客户端接收本地客户端传输的音频播放指令指示的音频的URL；
对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放，包括：
对端客户端根据URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
综上所述，本发明实施例提供的即时通讯方法，在即时通讯音视频会话过程中，由于对端客户端在用户的聊天对象通过即时通讯界面通讯的同时，能够接收本地客户端传输的音频并作为背景音乐播放，在不影响该用户的聊天对象的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。
图4是本发明实施例提供的又一种即时通讯方法的流程图，参见图4，该即时通讯方法可以包括：
步骤401、在即时通讯音视频会话过程中，本地客户端通过设置在即时通 讯界面的音乐插件入口接收音频播放指令。
本地客户端为用户所使用的客户端，即时通讯音视频会话包括音频通讯或视频通讯，音频通讯或视频通讯都是基于互联网的即时通讯软件的通讯方式，即时通讯软件有很多种，如MSN、QQ、微信、陌陌、CECISEIM、UC等。
其中，以QQ为例，用户双方可以通过麦克风进行语音内容的交互，即语音通话，也可以同时通过摄像头和麦克风进行语音内容和视频内容的交互，即视频通话(视频聊天)。如图5所示，当用户双方进行语音通话时，用于本地客户端(QQ聊天的用户“张三”所使用的客户端)接收音频播放指令的音乐插件入口图标50可以设置在当前QQ语音通话界面上的麦克风图标的左侧，其中，需要说明的是：图5只是举例说明了音乐插件入口图标50的位置，此不能作为对本发明保护范围的限制，在实际实现时音乐插件入口图标50在当前QQ语音通话界面上的位置，除了位于麦克风图标的左侧之外，还可以位于麦克风图标的右侧或其他位置等；如图6所示，当用户双方进行视频通话时，用于本地客户端(通过QQ聊天的用户“张三”所使用的客户端)接收音频播放指令的音乐插件入口图标50可以设置在当前QQ视频通话界面上的摄像头图标的右侧，其中，还需要说明的是：图6也只是举例说明了音乐插件入口图标50的位置，此不能作为对本发明保护范围的限制，在实际实现时音乐插件入口图标50在当前QQ视频通话界面上的位置，除了位于摄像头图标的左侧之外，还可以位于摄像头图标的右侧或其他位置等。
步骤402、本地客户端获取音频播放指令指示的音频。
步骤403、本地客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
步骤404、本地客户端将音频播放指令指示的音频传输至对端客户端。
本地客户端将音频播放指令指示的音频传输至对端客户端，以使得对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放，该对端客户端为用户的聊天对象所使用的客户端。
本地客户端将音频播放指令指示的音频传输至对端客户端的过程也就是数字信号处理的过程，本地客户端(发送端)执行的步骤主要分为四步：①模数转换，将模拟信号(即麦克风采集到的音频)数字化，该步骤包含三小步：抽样-量化-编码，该过程也可以称作信源编码和压缩信息；②对数字化的信源信号进行加密，防止被第三者识别；③对加密后的信号进行信道编码，以保证 数据的可靠性；④数字调制，即把基带信号的频谱搬移到高频处，以使该信号适合信道中的传输。对端客户端(接收端)执行的步骤与本地客户端对称，依次逆序进行降噪，数字解调，信道解码，解密，信源译码等步骤，最终得原始模拟信号。
步骤405、对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
进一步的，如图7所示，步骤401具体可以包括：
步骤4011、本地客户端通过设置在即时通讯界面的音乐插件入口接收音频列表显示指令。
示例的，如图5或6所示，本地客户端(通过QQ聊天的用户“张三”所使用的客户端)通过设置在当前QQ语音通话界面或QQ视频通话界面中的音乐插件入口接收音频列表显示指令，以便在即时通讯界面显示音频列表。参见图5，如果当前通话界面为QQ语音通话界面时，张三点击当前QQ语音通话界面的音乐插件入口图标50，则触发音频列表显示指令的生成，张三所使用的客户端准备接收用于指示音频列表的音频列表显示指令。参见图6，如果当前通话界面为QQ视频通话界面时，张三可以点击当前QQ视频通话界面的音乐插件入口图标50，则触发音频列表显示指令的生成，张三所使用的客户端准备接收用于指示音频列表的音频列表显示指令。
步骤4012、本地客户端根据音频列表显示指令，在即时通讯界面显示音频列表。
本发明实施例中，音频列表可以记录有至少一条音频。需要说明的是，音频列表除了可以包括歌曲列表之外，还可以包括短音频列表。其中，歌曲列表的显示形式可以为任一音乐播放器显示的歌曲列表。短音频列表中记录的每个短音频存储在本地客户端，短音频为占用的存储空间小于预设空间阈值的预设音频。短音频列表中记录的每个短音频的触发接口的形式可以有多种，可选的，触发接口可以为每个短音频的名称，如“兴高采烈”、“伤心哭泣”，每个短音频的名称对应一种短音频，如用户点击“兴高采烈”，播放出的音频内容为“哈哈哈哈”，用户点击“伤心哭泣”，播放出的音频内容为“呜呜呜呜”；如图10所示，触发接口也可以为以文字形式记录每个短音频的内容，如“哈哈哈哈”、“呜呜呜呜”、“爱你”、“帅呆了”等等，如用户点击音频内容“爱你”，播放出的音频为“爱你”；特别的，触发接口也可以如同QQ聊天界面的本地表情一样，图8 是QQ聊天界面的本地表情的示意图，同样的，本发明实施例提供的短音频列表中的每个短音频的触发接口也可以为图8中的显示形式，不同的是，如图11所示，每一个表情图标对应一个短音频，当用户点击表情图标时，则触发相应的短音频进行播放，示例的，兴高采烈的表情图标对应的短音频可以为“哈哈哈哈”。如图5中，张三和李四在进行语音通话时，张三说完“财源滚滚”之后，可以选择一个短音频列表中兴高采烈的表情图标对应的短音频，这样，李四便可以听到。以图5为例，张三点击当前QQ语音通话界面的音乐插件入口图标50，然后张三所使用的客户端接收音频列表显示指令，再根据音频列表显示指令，在当前QQ语音通话界面显示音频列表90，如图9所示。需要说明的是，音频列表可以显示在当前QQ语音通话界面上，也可以不在当前QQ语音通话界面上显示，而是单独作为一个界面来显示，本发明实施例对此不作限定。
示例的，图9是本发明实施例提供的一种音频列表的示意图，参见图9，该音频列表90中，左侧显示的是歌曲列表901，右侧显示的是短音频列表902。由于本地客户端未添加任何歌曲信息，因此，显示出来的歌曲列表901是一个空列表。具体的，图10为图9对应的详细示意图，在此不再赘述。
步骤4013、本地客户端通过设置在歌曲列表所在界面的搜索框接收歌曲添加指令。
本地客户端可以通过设置在歌曲列表所在界面的搜索框接收歌曲添加指令。示例的，参见图10，本地客户端可以通过设置在歌曲列表所在界面的搜索框101接收歌曲添加指令。搜索框101的输入格式可以为任一音乐播放器的搜索框的输入格式，如歌曲/歌手/专辑。字符“/”表示前后关联对象是一种“或”的关系。以图9为例，张三想以一首《恭喜发财》作为和李四语音通话的背景音乐，则在当前QQ语音通话界面的搜索框内可以直接输入歌曲名称“恭喜发财”，也可以直接输入该歌曲对应的歌手姓名“刘德华”，或者可以同时输入该歌曲的歌曲名称和歌手姓名，如“恭喜发财刘德华”，然后点击搜索按钮，触发本地客户端进行搜索得到至少一个搜索结果，然后可以选择其中一搜索结果，在用户选择该搜索结果时，用户的终端(张三使用的终端)产生歌曲添加指令，该歌曲添加指令指示该搜索结果对应的音频，且该歌曲添加指令被本地客户端所接收。例如，参见图11，张三根据显示出来的所有结果选择第一首歌曲“01恭喜发财刘德华”时，用户的终端产生歌曲添加指令，该歌曲添加指令指示刘德华演唱的“恭喜发财”，张三所使用的客户端接 收歌曲添加指令。图11为张三在当前QQ语音通话界面的搜索框内输入“恭喜发财”之后，显示出来的结果的示意图。
步骤4014、本地客户端根据歌曲添加指令在网络获取歌曲添加指令指示的歌曲的信息，歌曲添加指令指示的歌曲的信息可以为歌曲添加指令指示的歌曲对应的链接，也可以为根据链接下载的歌曲文件。
在4013的基础上，参见图9，张三所使用的客户端根据歌曲添加指令在网络上获取歌曲添加指令指示的歌曲(即新年贺岁歌曲)对应的链接。当本地客户端获取到歌曲添加指令指示的歌曲对应的链接后，便可以通过下载的方式获取该首歌曲。
步骤4015、本地客户端将歌曲添加指令指示的歌曲的信息记录在歌曲列表中。
歌曲添加指令指示的歌曲的信息可以为歌曲添加指令指示的歌曲对应的链接，也可以为根据链接下载的歌曲文件。
需要补充说明的是，本地客户端除了通过设置在歌曲列表所在界面的搜索框接收歌曲添加指令，在网络获取歌曲添加指令指示的歌曲对应的链接外，还可以由用户选择本地的歌曲文件，那么步骤4014则具体可以包括：本地客户端根据歌曲添加指令在该本地客户端所安装的用户设备上获取添加指令(歌曲名称)指示的歌曲对应的文件夹。而步骤4015则具体可以包括：本地客户端将歌曲添加指令指示的本地歌曲文件记录在歌曲列表中。
步骤4016、本地客户端接收音频播放指令。
用户可以在音频列表中选择一个音频作为背景音乐，且在用户选择时本地客户端所在的用户设备产生音频播放指令，该音频播放指令指示的音频为在音频列表中被选择的音频。参见图9，张三所使用的客户端接收音频播放指令，音频播放指令指示的音频为图11中的音频列表包括的歌曲列表901中被选择的音频(如01-恭喜发财-刘德华)。或者，音频播放指令指示的音频为图11中的音频列表包括的短音频列表902中被选择的短音频(兴高采烈的表情图标对应的“哈哈哈哈”)。
在步骤402中，本地客户端获取音频播放指令指示的音频。参见图9，张三所使用的客户端获取新年贺岁歌曲音频，或者，获取兴高采烈的表情图标对应的“哈哈哈哈”音频。
上述歌曲列表中记录的音频可以包括付费音频。因此，本地客户端还可以 检测音频播放指令指示的音频是否为付费音频。如果音频播放指令指示的音频为付费音频，本地客户端在获取音频播放指令指示的音频之前，还需要对用户进行权限验证，如果该用户通过了权限验证，那么该用户所使用的客户端才能获取音频播放指令指示的音频。如果该用户没有未通过权限验证，需要完成付费后，本地客户端再获取音频播放指令指示的音频。
如果音频播放指令指示的音频是付费音频，则步骤402如图12所示，具体可以包括：
步骤4021、本地客户端检测用户是否拥有预设权限。
该预设权限是服务器根据用户是否付费或者用户的等级授予的。示例的，服务器可以根据用户是否为选定的音频付费，如果用户已付费，则可以判断该用户拥有播放音频播放指令指示的音频的权限；如果用户未付费，则可以判断该用户没有播放音频播放指令指示的音频的权限。付费的方式很多，例如可以通过Q币(是一种电子货币)进行付费，也可以通过在线银行进行付费。此外，还可以根据用户的等级进行权限判断，假设存在星星等级、月亮等级、太阳等级和皇冠等级，且等级程度依次递增；如果用户的等级为星星等级、月亮等级或太阳等级，则可以判断用户没有播放音频播放指令指示的音频的权限；如果用户的等级为皇冠等级，则可以判断用户有播放音频播放指令指示的音频的权限。
步骤4022、如果用户拥有预设权限，本地客户端获取音频播放指令指示的音频。
根据步骤4021的判断结果，决定本地客户端是否可以获取音频播放指令指示的音频。示例的，参见图9，假设张三当前的QQ用户等级为皇冠等级，则张三所使用的客户端可以获取新年贺岁歌曲音频，或者，获取兴高采烈的表情图标对应的“哈哈哈哈”音频。
需要说明的是，如果音频播放指令指示的音频不是付费音频，步骤402还可以包括：本地客户端检测用户是否为预设级别用户，预设级别用户拥有使用该音频列表的权利；如果用户为预设级别用户，本地客户端获取音频播放指令指示的音频。示例的，预设级别用户可以为黄钻用户或者绿钻用户，也可以为VIP用户等(黄钻用户、绿钻用户和VIP用户均为预设级别用户)。
在步骤403中，如果本地客户端的用户通过了权限验证，或者该用户为预设级别用户，该用户所使用的客户端可以获取音频播放指令指示的音频，接着， 本地客户端便可以将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
示例的，参见图9，张三通过了权限验证，张三所使用的客户端获取到了新年贺岁歌曲，或者，兴高采烈的表情图标对应的“哈哈哈哈”音频，便可以将这两个音频作为与李四语音通话的背景音乐进行播放。
在步骤404中，本发明实施例中，本地客户端将音频播放指令指示的音频传输至对端客户端的方法可以有多种，示例的，可以包括如下四种方法：
第一种方法，本地客户端通过麦克风采集音频并传输至对端客户端。如图13所示，具体可以包括：
步骤4041、本地客户端通过麦克风采集用户通话产生的音频以及作为音视频会话的背景音乐播放的音频。
示例的，参见图9，张三所使用的客户端通过麦克风采集张三与李四进行语音通话的过程中产生的音频，也就是图1中所涉及到的语音内容，以及作为语音通话背景音乐播放的新年贺岁歌曲音频。
步骤4042、本地客户端对麦克风采集的音频进行降噪处理。
本地客户端通过麦克风采集用户通话产生的音频以及作为音视频会话的背景音乐播放的音频时，由于操作不当或者周边环境吵杂，容易使语音信号在采集过程中受到噪声干扰，如果不对麦克风采集到的音频进行降噪处理，传输至对端客户端的音频将会发生变化，甚至变质。语音降噪是针对噪声处理的一种有效的处理技术，降噪的目的就是为了消除噪声的影响，提高音频清晰度、改善音频的质量。示例的，本地客户端可以采用两级维纳滤波方法分别对麦克风采集的用户通话产生的音频以及作为音视频会话的背景音乐播放的音频进行降噪处理，达到音频和噪声的最大可能分离的目的。音频降噪的方法很多，可以根据实际需求来选择合适的音频降噪方法，本发明实施例对此不作限定。
步骤4043、本地客户端将经过降噪处理的麦克风采集的音频传输至对端客户端。
第二种方法，本地客户端通过网络服务器将音频播放指令指示的音频的文件同时下发给本地客户端和对端客户端。
以图9为例，张三所使用的客户端将新年贺岁歌曲的音频文件传输至网络服务器，该音频文件可以是从网络下载的，也可以是从本地上传的，这样，网络服务器可以将新年贺岁歌曲再同时下发给张三所使用的客户端和李四所使 用的客户端，从而使得张三和李四在进行语音通话时，双方听到的作为背景音乐的音频是被同步播放的。
第三种方法，本地客户端通过网络服务器将音频播放指令指示的音频的文件下发给对端客户端。
以图9为例，张三所使用的客户端将新年贺岁歌曲传输至网络服务器，同时张三所使用的客户端将新年贺岁歌曲作为背景音乐进行播放，这样，网络服务器可以将新年贺岁歌曲下发给李四所使用的客户端，李四所使用的客户端可以在缓存新年贺岁歌曲的文件的同时，播放新年贺岁歌曲的文件，即边下载边播放，这样可以保证张三和李四在进行语音通话时，双方听到的作为背景音乐的音频尽可能同步。
第四种方法，本地客户端将音频播放指令指示的音频的URL传输至对端客户端。
本地客户端将音频播放指令指示的音频的URL(即歌曲添加指令指示的歌曲对应的链接)传输至对端客户端，对端客户端可以根据该URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
以图9为例，张三所使用的客户端并没有将新年贺岁歌曲传输至网络服务器，而是将这首歌曲的URL直接传输至李四所使用的客户端。此时，李四所使用的客户端需要根据张三发送的URL下载新年贺岁歌曲，在下载之后进行播放。
在步骤405中，本地客户端可以通过网络服务器将音频播放指令指示的音频的文件下发给对端客户端，也可以将音频播放指令指示的音频的URL传输至对端客户端，因此，一方面，对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放可以包括：对端客户端在缓存音频播放指令指示的音频的文件的同时，播放音频的文件；另一方面，对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放可以包括：对端客户端根据URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
以图9为例，张三所使用的客户端将新年贺岁歌曲传输至网络服务器，网络服务器将新年贺岁歌曲同时下发给张三所使用的客户端和李四所使用的客户端，或者只下发给李四所使用的客户端，则李四所使用的客户端可以在缓存 新年贺岁歌曲的同时对其进行播放，实现边缓存边播放的效果。
同样以图9为例，张三所使用的客户端将新年贺岁歌曲的URL传输至李四所使用的客户端。李四所使用的客户端根据张三发送的URL下载新年贺岁歌曲，并将该歌曲作为与张三语音通话的背景音乐进行播放。
本发明实施例提供的即时通讯方法易用性较高，该方法实现的功能可以作为增值功能，示例的，可以供黄钻或者VIP用户使用，或者功能列表内特定音乐付费使用。该方法在实现的过程中，如QQ软件，如果现有的开发环境无法支持同时播放作为背景音乐的音频与语音通话的音频，可以采取折中方案：向用户发送歌曲请求，用户收到提示框：“是否播放该首歌曲”，如果同意播放该首歌曲，则中断语音通话过程，开始播放歌曲，播放完毕后，可以再弹出对话框：“歌曲播放已完成，请继续进行语音通话”，此时，用户双方可继续进行语音通话。
需要说明的是，本发明实施例提供的即时通讯方法步骤的先后顺序可以进行适当调整，步骤也可以根据情况进行相应增减，如步骤403与步骤404的先后顺序可以调换，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到变化的方法，都应涵盖在本发明的保护范围之内，因此不再赘述。
综上所述，本发明实施例提供的即时通讯方法，在即时通讯音视频会话过程中，由于客户端在用户通过即时通讯界面通讯的同时，能够通过设置在即时通讯界面的音乐插件入口获取作为音视频会话的背景音乐的音频，并播放该音频，从而在不影响用户双方的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。
图14是本发明实施例提供的一种即时通讯装置70的结构示意图，该即时通讯装置70用于本地客户端，本地客户端为用户所使用的客户端，参见图14，即时通讯装置70可以包括：
第一接收模块701，用于在即时通讯音视频会话过程中，通过设置在即时通讯界面的音乐插件入口接收音频播放指令；
获取模块702，用于获取音频播放指令指示的音频；
播放模块703，用于将音频播放指令指示的音频作为音视频会话的背景音 乐进行播放；
发送模块704，用于将音频播放指令指示的音频传输至对端客户端，以使得对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
其中，对端客户端为用户的聊天对象所使用的客户端。
综上所述，本发明实施例提供的即时通讯装置，在即时通讯音视频会话过程中，由于本地客户端在用户通过即时通讯界面通讯的同时，能够通过设置在即时通讯界面的音乐插件入口获取作为音视频会话的背景音乐的音频，并播放该音频，从而在不影响用户的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。
图15是本发明实施例提供的另一种即时通讯装置70的结构示意图，该即时通讯装置70用于本地客户端，本地客户端为用户所使用的客户端，参见图15，该即时通讯装置70可以包括：
第一接收模块701，用于在即时通讯音视频会话过程中，通过设置在即时通讯界面的音乐插件入口接收音频播放指令；
获取模块702，用于获取音频播放指令指示的音频；
播放模块703，用于将音频播放指令指示的音频作为音视频会话的背景音乐进行播放；
发送模块704，用于将音频播放指令指示的音频传输至对端客户端，以使得对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
其中，对端客户端为用户的聊天对象所使用的客户端。
可选的，上述发送模块704，用于：
通过麦克风采集用户通话产生的音频以及作为音视频会话的背景音乐播放的音频；
对麦克风采集的音频进行降噪处理；
将经过降噪处理的麦克风采集的音频传输至对端客户端。
可选的，上述发送模块704，用于：
将音频播放指令指示的音频的文件传输至网络服务器，以使得网络服务器 将音频播放指令指示的音频的文件同时下发给本地客户端和对端客户端。
可选的，上述发送模块704，用于：
将音频播放指令指示的音频的文件传输至网络服务器，以使得网络服务器将音频播放指令指示的音频的文件下发给对端客户端。
可选的，上述发送模块704，用于：
将音频播放指令指示的音频的URL传输至对端客户端，以使得对端客户端根据URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
可选的，上述第一接收模块701，用于：
通过设置在即时通讯界面的音乐插件入口接收音频列表显示指令；
根据音频列表显示指令，在即时通讯界面显示音频列表，音频列表记录有至少一条音频；
接收音频播放指令，音频播放指令指示的音频为在音频列表中被选择的音频。
可选的，音频列表包括歌曲列表。参见图15，该即时通讯装置70还可以包括：
第二接收模块705，用于通过设置在歌曲列表所在界面的搜索框接收歌曲添加指令；
添加模块706，用于根据歌曲添加指令在网络获取歌曲添加指令指示的歌曲对应的链接；
记录模块707，用于将歌曲添加指令指示的歌曲的信息记录在歌曲列表中，歌曲的信息为歌曲添加指令指示的歌曲对应的链接，或者根据链接下载的歌曲文件。
可选的，音频列表还包括短音频列表，短音频列表中记录的每个短音频存储在本地客户端，短音频为占用的存储空间小于预设空间阈值的预设音频。
可选的，上述获取模块702，用于：
检测用户是否拥有预设权限，预设权限是服务器根据用户是否付费或者用户的等级授予的；
如果用户拥有预设权限，获取音频播放指令指示的音频。
综上所述，本发明实施例提供的即时通讯装置，在即时通讯音视频会话过程中，由于本地客户端在用户通过即时通讯界面通讯的同时，能够通过设置在 即时通讯界面的音乐插件入口获取作为音视频会话的背景音乐的音频，并播放该音频，从而在不影响用户的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。
图16是本发明实施例提供的又一种即时通讯装置70的结构示意图，该即时通讯装置70用于对端客户端，对端客户端为用户的聊天对象所使用的客户端，参见图16，该即时通讯装置70可以包括：
接收模块708，用于在即时通讯音视频会话过程中，接收本地客户端传输的音频播放指令指示的音频，音频播放指令是本地客户端通过设置在即时通讯界面的音乐插件入口接收的；
播放模块709，用于将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
综上所述，本发明实施例提供的即时通讯装置，在即时通讯音视频会话过程中，由于对端客户端在用户的聊天对象通过即时通讯界面通讯的同时，能够接收本地客户端传输的音频并作为背景音乐播放，在不影响该用户的聊天对象的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。
可选的，上述接收模块708，用于：
接收网络服务器下发的音频播放指令指示的音频的文件，音频播放指令指示的音频的文件是本地客户端上传至网络服务器的；
上述播放模块709，用于：
在缓存音频播放指令指示的音频的文件的同时，播放音频的文件。
可选的，上述接收模块708，用于：
接收本地客户端传输的音频播放指令指示的音频的URL；
上述播放模块709，用于：
根据URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
综上所述，本发明实施例提供的即时通讯装置，在即时通讯音视频会话过程中，由于对端客户端在用户的聊天对象通过即时通讯界面通讯的同时，能够接收本地客户端传输的音频并作为背景音乐播放，在不影响该用户的聊天对象 的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。
本发明实施例提供了一种即时通讯系统，包括图14、图15或图16所示的即时通讯装置。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
图17是本发明实施例提供的一种终端500的结构示意图。该终端500可以为上述实施例中的用户设备。参见图17，终端500可以包括通信单元510、包括有一个或一个以上计算机可读存储介质的存储器520、输入单元530、显示单元540、传感器550、音频电路560、WIFI(Wireless Fidelity，无线保真)模块570、包括有一个或者一个以上处理核心的处理器580、以及电源590等部件。本领域技术人员可以理解，图17中示出的终端结构并不构成对终端的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。其中：
通信单元510可用于收发信息或通话过程中，信号的接收和发送，该通信单元510可以为RF(Radio Frequency，射频)电路、路由器、调制解调器、等网络通信设备。特别地，当通信单元510为RF电路时，将基站的下行信息接收后，交由一个或者一个以上处理器580处理；另外，将涉及上行的数据发送给基站。通常，作为通信单元的RF电路包括但不限于天线、至少一个放大器、调谐器、一个或多个振荡器、用户身份模块(SIM)卡、收发信机、耦合器、LNA(Low Noise Amplifier，低噪声放大器)、双工器等。此外，通信单元510还可以通过无线通信与网络和其他设备通信。无线通信可以使用任一通信标准或协议，包括但不限于GSM(Global System of Mobile communication，全球移动通讯系统)、GPRS(General Packet Radio Service，通用分组无线服务)、CDMA(Code Division Multiple Access，码分多址)、WCDMA(Wideband Code Division Multiple Access，宽带码分多址)、LTE(Long Term Evolution，长期演进)、电子邮件、SMS(Short Messaging Service，短消息服务)等。存储器520可用于存储软件程序以及模块，处理器580通过运行存储在存储器520的软件 程序以及模块，从而执行各种功能应用以及数据处理。存储器520可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等；存储数据区可存储根据终端500的使用所创建的数据(比如音频数据、电话本等)等。此外，存储器520可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。相应地，存储器520还可以包括存储器控制器，以提供处理器580和输入单元530对存储器520的访问。
输入单元530可用于接收输入的数字或字符信息，以及产生与用户设置以及功能控制有关的键盘、鼠标、操作杆、光学或者轨迹球信号输入。优选地，输入单元530可包括触敏表面531以及其他输入设备532。触敏表面531，也称为触摸显示屏或者触控板，可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触敏表面531上或在触敏表面531附近的操作)，并根据预先设定的程式驱动相应的连接装置。可选地，触敏表面531可包括触摸检测装置和触摸控制器两个部分。其中，触摸检测装置检测用户的触摸方位，并检测触摸操作带来的信号，将信号传送给触摸控制器；触摸控制器从触摸检测装置上接收触摸信息，并将它转换成触点坐标，再送给处理器580，并能接收处理器580发来的命令并加以执行。此外，可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触敏表面531。除了触敏表面531，输入单元530还可以包括其他输入设备532。优选地，其他输入设备532可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
显示单元540可用于显示由用户输入的信息或提供给用户的信息以及终端500的各种图形用户接口，这些图形用户接口可以由图形、文本、图标、视频和其任意组合来构成。显示单元540可包括显示面板541，可选地，可以采用LCD(Liquid Crystal Display，液晶显示器)、OLED(Organic Light-Emitting Diode，有机发光二极管)等形式来配置显示面板541。进一步的，触敏表面531可覆盖显示面板541，当触敏表面531检测到在其上或附近的触摸操作后，传送给处理器580以确定触摸事件的类型，随后处理器580根据触摸事件的类型在显示面板541上提供相应的视觉输出。虽然在图17中，触敏表面531与显示面板541是作为两个独立的部件来实现输入和输入功能，但是在某些实施 例中，可以将触敏表面531与显示面板541集成而实现输入和输出功能。
终端500还可包括至少一种传感器550，比如光传感器、运动传感器以及其他传感器。光传感器可包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节显示面板541的亮度，接近传感器可在终端500移动到耳边时，关闭显示面板541和/或背光。作为运动传感器的一种，重力加速度传感器可检测各个方向上(一般为三轴)加速度的大小，静止时可检测出重力的大小及方向，可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等；至于终端500还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器，在此不再赘述。
音频电路560、扬声器561，传声器562可提供用户与终端500之间的音频接口。音频电路560可将接收到的音频数据转换后的电信号，传输到扬声器561，由扬声器561转换为声音信号输出；另一方面，传声器562将收集的声音信号转换为电信号，由音频电路560接收后转换为音频数据，再将音频数据输出处理器580处理后，经通信单元510以发送给比如另一终端，或者将音频数据输出至存储器520以便进一步处理。音频电路560还可能包括耳塞插孔，以提供外设耳机与终端500的通信。
为了实现无线通信，该终端上可以配置有无线通信单元570，该无线通信单元570可以为WIFI模块。WIFI属于短距离无线传输技术，终端500通过无线通信单元570可以帮助用户收发电子邮件、浏览网页和访问流式媒体等，它为用户提供了无线的宽带互联网访问。虽然图中示出了无线通信单元570，但是可以理解的是，其并不属于终端500的必须构成，完全可以根据需要在不改变发明的本质的范围内而省略。
处理器580是终端500的控制中心，利用各种接口和线路连接整个手机的各个部分，通过运行或执行存储在存储器520内的软件程序和/或模块，以及调用存储在存储器520内的数据，执行终端500的各种功能和处理数据，从而对手机进行整体监控。可选地，处理器580可包括一个或多个处理核心；优选的，处理器580可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器580中。
终端500还包括给各个部件供电的电源590(比如电池)，优选的，电源可 以通过电源管理系统与处理器580逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。电源560还可以包括一个或一个以上的直流或交流电源、再充电系统、电源故障检测电路、电源转换器或者逆变器、电源状态指示器等任意组件。
尽管未示出，终端500还可以包括摄像头、蓝牙模块等，在此不再赘述。
在本实施例中，终端还包括有一个或者一个以上的程序，这一个或者一个以上程序存储于存储器中，且经配置以由一个或者一个以上处理器执行，一方面，一个或者一个以上程序包含用于进行本发明实施例提供的如下的即时通讯方法的指令：
在即时通讯音视频会话过程中，本地客户端通过设置在即时通讯界面的音乐插件入口接收音频播放指令。
本地客户端获取音频播放指令指示的音频。
本地客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
本地客户端将音频播放指令指示的音频传输至对端客户端，以使得对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放，对端客户端为用户的聊天对象所使用的客户端。
可选的，本地客户端将音频播放指令指示的音频传输至对端客户端，包括：
本地客户端通过麦克风采集用户通话产生的音频以及作为音视频会话的背景音乐播放的音频；
本地客户端对麦克风采集的音频进行降噪处理；
本地客户端将经过降噪处理的麦克风采集的音频传输至对端客户端。
可选的，本地客户端将音频播放指令指示的音频传输至对端客户端，包括：
本地客户端将音频播放指令指示的音频的文件传输至网络服务器，以使得网络服务器将音频播放指令指示的音频的文件同时下发给本地客户端和对端客户端。
可选的，本地客户端将音频播放指令指示的音频传输至对端客户端，包括：
本地客户端将音频播放指令指示的音频的文件传输至网络服务器，以使得网络服务器将音频播放指令指示的音频的文件下发给对端客户端。
可选的，本地客户端将音频播放指令指示的音频传输至对端客户端，包括：
本地客户端将音频播放指令指示的音频的URL传输至对端客户端，以使 得对端客户端根据URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
可选的，本地客户端通过设置在即时通讯界面的音乐插件入口接收音频播放指令，包括：
本地客户端通过设置在即时通讯界面的音乐插件入口接收音频列表显示指令；
本地客户端根据音频列表显示指令，在即时通讯界面显示音频列表，音频列表记录有至少一条音频；
本地客户端接收音频播放指令，音频播放指令指示的音频为在音频列表中被选择的音频。
可选的，音频列表包括歌曲列表，
在本地客户端接收音频播放指令之前，该方法还包括：
本地客户端通过设置在歌曲列表所在界面的搜索框接收歌曲添加指令；
本地客户端根据歌曲添加指令在网络获取歌曲添加指令指示的歌曲对应的链接；
本地客户端将歌曲添加指令指示的歌曲的信息记录在歌曲列表中，歌曲的信息为歌曲添加指令指示的歌曲对应的链接，或者根据链接下载的歌曲文件。
可选的，音频列表还包括短音频列表，短音频列表中记录的每个短音频存储在本地客户端，短音频为占用的存储空间小于预设空间阈值的预设音频。
可选的，本地客户端获取音频播放指令指示的音频，包括：
本地客户端检测用户是否拥有预设权限，预设权限是服务器根据用户是否付费或者用户的等级授予的；
如果用户拥有预设权限，本地客户端获取音频播放指令指示的音频。
另一方面，一个或者一个以上程序包含用于进行本发明实施例提供的如下的即时通讯方法的指令：
在即时通讯音视频会话过程中，对端客户端接收本地客户端传输的音频播放指令指示的音频，该音频播放指令是本地客户端通过设置在即时通讯界面的音乐插件入口接收的，对端客户端为用户的聊天对象所使用的客户端。
对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
可选的，对端客户端接收本地客户端传输的音频播放指令指示的音频，包 括：
对端客户端接收网络服务器下发的音频播放指令指示的音频的文件，该音频播放指令指示的音频的文件是本地客户端上传至网络服务器的；
对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放，包括：
对端客户端在缓存音频播放指令指示的音频的文件的同时，播放音频的文件。
可选的，对端客户端接收本地客户端传输的音频播放指令指示的音频，包括：
对端客户端接收本地客户端传输的音频播放指令指示的音频的URL；
对端客户端将音频播放指令指示的音频作为音视频会话的背景音乐进行播放，包括：
对端客户端根据URL下载音频播放指令指示的音频，并将音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
综上所述，本发明实施例提供的终端，在即时通讯音视频会话过程中，由于客户端在用户通过即时通讯界面通讯的同时，能够通过设置在即时通讯界面的音乐插件入口获取作为音视频会话的背景音乐的音频，并播放该音频，从而在不影响用户的音视频通讯的前提下，除了能同时输入文字、表情、截图等简单的聊天内容，还可以播放背景音乐，因此，丰富了即时通讯的通讯场景。
在示例性实施例中，还提供了一种包括指令的非临时性计算机可读存储介质，例如包括指令的存储器，上述指令可由终端的处理器执行以完成上述即时通信方法。例如，所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通过硬件来完成，也可以通过程序来指令相关的硬件完成，所述的程序可以存储于一种计算机可读存储介质中，上述提到的存储介质可以是只读存储器，磁盘或光盘等。
以上所述仅为本发明的较佳实施例，并不用以限制本发明，凡在本发明的 精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。

Claims (25)

  1. 一种即时通讯方法，其特征在于，所述方法包括：
    在即时通讯音视频会话过程中，本地客户端通过设置在即时通讯界面的音乐插件入口接收音频播放指令；
    所述本地客户端获取所述音频播放指令指示的音频；
    所述本地客户端将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放；
    所述本地客户端将所述音频播放指令指示的音频传输至对端客户端，以使得所述对端客户端将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
  2. 根据权利要求1所述的方法，其特征在于，所述本地客户端将所述音频播放指令指示的音频传输至对端客户端，包括：
    所述本地客户端通过麦克风采集用户通话产生的音频以及作为所述音视频会话的背景音乐播放的音频；
    所述本地客户端对所述麦克风采集的音频进行降噪处理；
    所述本地客户端将经过降噪处理的所述麦克风采集的音频传输至所述对端客户端。
  3. 根据权利要求1所述的方法，其特征在于，所述本地客户端将所述音频播放指令指示的音频传输至对端客户端，包括：
    所述本地客户端将所述音频播放指令指示的音频的文件传输至网络服务器，所述音频播放指令用于指示所述网络服务器将所述音频播放指令指示的音频的文件下发给所述对端客户端。
  4. 根据权利要求3所述的方法，其特征在于，所述音频播放指令还用于指示所述网络服务器将所述音频播放指令指示的音频的文件下发给所述本地客户端。
  5. 根据权利要求1所述的方法，其特征在于，所述本地客户端将所述音频 播放指令指示的音频传输至对端客户端，包括：
    所述本地客户端将所述音频播放指令指示的音频的统一资源定位符URL传输至所述对端客户端，以使得所述对端客户端根据所述URL下载所述音频播放指令指示的音频，并将所述音频播放指令指示的音频作为所述音视频会话的背景音乐进行播放。
  6. 根据权利要求1至5任一所述的方法，其特征在于，所述本地客户端通过设置在即时通讯界面的音乐插件入口接收音频播放指令，包括：
    所述本地客户端通过设置在所述即时通讯界面的音乐插件入口接收音频列表显示指令；
    所述本地客户端根据所述音频列表显示指令，在所述即时通讯界面显示所述音频列表，所述音频列表记录有至少一条音频；
    所述本地客户端接收所述音频播放指令，所述音频播放指令指示的音频为在所述音频列表中被选择的音频。
  7. 根据权利要求6所述的方法，其特征在于，所述音频列表包括歌曲列表，在所述本地客户端接收所述音频播放指令之前，所述方法还包括：
    所述本地客户端通过设置在所述歌曲列表所在界面的搜索框接收歌曲添加指令；
    所述本地客户端根据所述歌曲添加指令在网络获取所述歌曲添加指令指示的歌曲的信息，所述信息包括所述歌曲添加指令指示的歌曲对应的链接，或者根据所述链接下载的歌曲文件；
    所述本地客户端将所述信息记录在所述歌曲列表中。
  8. 根据权利要求7所述的方法，其特征在于，所述音频列表还包括短音频列表，所述短音频列表中记录的每个短音频存储在所述本地客户端，所述短音频为占用的存储空间小于预设空间阈值的预设音频。
  9. 根据权利要求6所述的方法，其特征在于，
    所述本地客户端获取所述音频播放指令指示的音频，包括：
    所述本地客户端检测所述用户是否拥有预设权限，所述预设权限是服务器 根据所述用户是否付费或者所述用户的等级授予的；
    如果所述用户拥有所述预设权限，所述本地客户端获取所述音频播放指令指示的音频。
  10. 一种即时通讯方法，其特征在于，所述方法包括：
    在即时通讯音视频会话过程中，对端客户端接收本地客户端传输的音频播放指令指示的音频，所述音频播放指令是所述本地客户端通过设置在即时通讯界面的音乐插件入口接收的；
    所述对端客户端将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
  11. 根据权利要求10所述的方法，其特征在于，所述对端客户端接收本地客户端传输的音频播放指令指示的音频，包括：
    所述对端客户端接收网络服务器下发的所述音频播放指令指示的音频的文件，所述音频播放指令指示的音频的文件是所述本地客户端上传至所述网络服务器的；
    所述对端客户端将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放，包括：
    所述对端客户端在缓存所述音频播放指令指示的音频的文件的同时，播放所述音频的文件。
  12. 根据权利要求11所述的方法，其特征在于，所述对端客户端接收本地客户端传输的音频播放指令指示的音频，包括：
    所述对端客户端接收所述本地客户端传输的所述音频播放指令指示的音频的统一资源定位符URL，根据所述URL下载所述音频播放指令指示的音频。
  13. 一种用户设备，其特征在于，用于运行本地客户端，所述用户设备包括：
    一个或多个处理器；和
    存储器；
    所述存储器存储有一个或多个程序，所述一个或多个程序被配置成由所述 一个或多个处理器执行，所述一个或多个程序包含用于进行以下操作的指令：
    在即时通讯音视频会话过程中，通过设置在即时通讯界面的音乐插件入口接收音频播放指令；
    获取所述音频播放指令指示的音频；
    将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放；
    将所述音频播放指令指示的音频传输至对端客户端，以使得所述对端客户端将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
  14. 根据权利要求13所述的用户设备，其特征在于，所述一个或多个程序还包含用于进行以下操作的指令：
    通过麦克风采集用户通话产生的音频以及作为所述音视频会话的背景音乐播放的音频；
    对所述麦克风采集的音频进行降噪处理；
    将经过降噪处理的所述麦克风采集的音频传输至所述对端客户端。
  15. 根据权利要求13所述的用户设备，其特征在于，所述一个或多个程序还包含用于进行以下操作的指令：
    将所述音频播放指令指示的音频的文件传输至网络服务器，所述音频播放指令用于指示所述网络服务器将所述音频播放指令指示的音频的文件下发给所述对端客户端。
  16. 根据权利要求13所述的用户设备，其特征在于，所述音频播放指令还用于指示所述网络服务器将所述音频播放指令指示的音频的文件下发给所述本地客户端。
  17. 根据权利要求13所述的用户设备，其特征在于，所所述一个或多个程序还包含用于进行以下操作的指令：
    将所述音频播放指令指示的音频的统一资源定位符URL传输至所述对端客户端，以使得所述对端客户端根据所述URL下载所述音频播放指令指示的音频，并将所述音频播放指令指示的音频作为所述音视频会话的背景音乐进行播放。
  18. 根据权利要求13至17任一所述的用户设备，其特征在于，所述一个或多个程序还包含用于进行以下操作的指令：
    通过设置在所述即时通讯界面的音乐插件入口接收音频列表显示指令；
    根据所述音频列表显示指令，在所述即时通讯界面显示所述音频列表，所述音频列表记录有至少一条音频；
    接收所述音频播放指令，所述音频播放指令指示的音频为在所述音频列表中被选择的音频。
  19. 根据权利要求18所述的用户设备，其特征在于，所述音频列表包括歌曲列表，所述一个或多个程序还包含用于进行以下操作的指令：
    通过设置在所述歌曲列表所在界面的搜索框接收歌曲添加指令；
    根据所述歌曲添加指令在网络获取所述歌曲添加指令指示的歌曲的信息，所述信息包括所述歌曲添加指令指示的歌曲对应的链接，或者根据所述链接下载的歌曲文件；
    将所述信息记录在所述歌曲列表中。
  20. 根据权利要求19所述的用户设备，其特征在于，所述音频列表还包括短音频列表，所述短音频列表中记录的每个短音频存储在所述本地客户端，所述短音频为占用的存储空间小于预设空间阈值的预设音频。
  21. 根据权利要求18所述的用户设备，其特征在于，所述一个或多个程序还包含用于进行以下操作的指令：
    检测所述用户是否拥有预设权限，所述预设权限是服务器根据所述用户是否付费或者所述用户的等级授予的；
    如果所述用户拥有所述预设权限，获取所述音频播放指令指示的音频。
  22. 一种用户设备，其特征在于，用于运行对端客户端，所述用户设备包括：
    一个或多个处理器；和
    存储器；
    所述存储器存储有一个或多个程序，所述一个或多个程序被配置成由所述 一个或多个处理器执行，所述一个或多个程序包含用于进行以下操作的指令：
    在即时通讯音视频会话过程中，接收本地客户端传输的音频播放指令指示的音频，所述音频播放指令是所述本地客户端通过设置在即时通讯界面的音乐插件入口接收的；
    播放模块，用于将所述音频播放指令指示的音频作为音视频会话的背景音乐进行播放。
  23. 根据权利要求22所述的用户设备，其特征在于，所述一个或多个程序还包含用于进行以下操作的指令：
    接收网络服务器下发的所述音频播放指令指示的音频的文件，所述音频播放指令指示的音频的文件是所述本地客户端上传至所述网络服务器的；
    在缓存所述音频播放指令指示的音频的文件的同时，播放所述音频的文件。
  24. 根据权利要求23所述的用户设备，其特征在于，所述一个或多个程序还包含用于进行以下操作的指令：
    接收所述本地客户端传输的所述音频播放指令指示的音频的统一资源定位符URL，根据所述URL下载所述音频播放指令指示的音频。
  25. 一种即时通讯系统，包括：
    权利要求13至21任一权利要求所述的用户设备；
    以及，权利要求22至24任一权利要求所述的用户设备。
PCT/CN2016/080130 2015-05-19 2016-04-25 即时通讯方法、用户设备及系统 WO2016184295A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510257973.8A CN106302087A (zh) 2015-05-19 2015-05-19 即时通讯方法、装置及系统
CN201510257973.8 2015-05-19

Publications (1)

Publication Number Publication Date
WO2016184295A1 true WO2016184295A1 (zh) 2016-11-24

Family

ID=57319410

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/080130 WO2016184295A1 (zh) 2015-05-19 2016-04-25 即时通讯方法、用户设备及系统

Country Status (2)

Country Link
CN (1) CN106302087A (zh)
WO (1) WO2016184295A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109510906A (zh) * 2017-09-15 2019-03-22 中国移动通信集团公司 上网业务实现方法、装置、系统、实体、服务器及存储介质
CN110392273A (zh) * 2019-07-16 2019-10-29 北京达佳互联信息技术有限公司 音视频处理的方法、装置、电子设备及存储介质
CN112737920A (zh) * 2020-12-16 2021-04-30 交通运输部南海航海保障中心广州通信中心 一种基于音频能量检测的多方即时通信系统
CN113595869A (zh) * 2021-06-28 2021-11-02 青岛海尔科技有限公司 语音播放方法和装置、存储介质及电子装置

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109005436A (zh) * 2017-06-07 2018-12-14 武汉斗鱼网络科技有限公司 一种在网络直播间推送广告的方法和装置
CN109194899A (zh) * 2018-11-22 2019-01-11 维沃移动通信有限公司 一种音视频同步的方法和终端
CN109920457A (zh) * 2019-03-01 2019-06-21 广州酷狗计算机科技有限公司 播放歌曲的方法、装置、设备及存储介质
CN110278402B (zh) * 2019-06-24 2022-05-17 烟台思卓实业有限责任公司 一种双声道音频处理方法、设备及计算机可读存储介质
CN112433802A (zh) * 2020-12-01 2021-03-02 广州酷狗计算机科技有限公司 信息展示方法、装置、电子设备及存储介质
CN113132794A (zh) * 2021-05-13 2021-07-16 北京字节跳动网络技术有限公司 直播背景音处理方法、装置、设备、介质及程序产品
CN113573143B (zh) * 2021-07-21 2023-09-19 维沃移动通信有限公司 音频播放方法和电子设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1988461A (zh) * 2005-12-23 2007-06-27 腾讯科技（深圳）有限公司 一种即时通信工具的聊天场景音乐播放方法和系统
CN101753479A (zh) * 2008-12-05 2010-06-23 中国移动通信集团北京有限公司 即时通信系统、方法及其相关装置
CN102055683A (zh) * 2009-10-30 2011-05-11 腾讯科技（深圳）有限公司 一种分享音乐数据的方法、装置和系统

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8260882B2 (en) * 2007-12-14 2012-09-04 Yahoo! Inc. Sharing of multimedia and relevance measure based on hop distance in a social network
KR101226560B1 (ko) * 2011-03-29 2013-01-25 (주)티아이스퀘어 커뮤니케이션 서비스 수행 도중 멀티미디어 콘텐츠 공유 서비스 제공 방법 및 시스템

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1988461A (zh) * 2005-12-23 2007-06-27 腾讯科技（深圳）有限公司 一种即时通信工具的聊天场景音乐播放方法和系统
CN101753479A (zh) * 2008-12-05 2010-06-23 中国移动通信集团北京有限公司 即时通信系统、方法及其相关装置
CN102055683A (zh) * 2009-10-30 2011-05-11 腾讯科技（深圳）有限公司 一种分享音乐数据的方法、装置和系统

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109510906A (zh) * 2017-09-15 2019-03-22 中国移动通信集团公司 上网业务实现方法、装置、系统、实体、服务器及存储介质
CN109510906B (zh) * 2017-09-15 2020-12-01 中国移动通信集团公司 上网业务实现方法、装置、系统及存储介质
CN110392273A (zh) * 2019-07-16 2019-10-29 北京达佳互联信息技术有限公司 音视频处理的方法、装置、电子设备及存储介质
CN110392273B (zh) * 2019-07-16 2023-08-08 北京达佳互联信息技术有限公司 音视频处理的方法、装置、电子设备及存储介质
CN112737920A (zh) * 2020-12-16 2021-04-30 交通运输部南海航海保障中心广州通信中心 一种基于音频能量检测的多方即时通信系统
CN112737920B (zh) * 2020-12-16 2022-10-04 交通运输部南海航海保障中心广州通信中心 一种基于音频能量检测的多方即时通信系统
CN113595869A (zh) * 2021-06-28 2021-11-02 青岛海尔科技有限公司 语音播放方法和装置、存储介质及电子装置
CN113595869B (zh) * 2021-06-28 2023-10-24 青岛海尔科技有限公司 语音播放方法和装置、存储介质及电子装置

Also Published As

Publication number Publication date
CN106302087A (zh) 2017-01-04

Similar Documents

Publication Publication Date Title
WO2016184295A1 (zh) 即时通讯方法、用户设备及系统
US10841661B2 (en) Interactive method, apparatus, and system in live room
CN104967900B (zh) 一种生成视频的方法和装置
US10824251B2 (en) Devices and methods for sharing user interaction
WO2018184488A1 (zh) 视频配音方法及装置
WO2019101015A1 (zh) 音频信号处理方法、装置和存储介质
WO2016169465A1 (zh) 一种显示弹幕信息的方法、装置和系统
WO2016150270A1 (zh) 群组会话消息处理方法和装置
WO2017215649A1 (zh) 音效调节方法及用户终端
WO2017008627A1 (zh) 多媒体直播方法、装置和系统
CN106973330B (zh) 一种屏幕直播方法、装置和系统
CN105979312B (zh) 一种信息分享方法及装置
JP2018516396A (ja) 推奨コンテンツに基づく対話方法、端末及びサーバ
CN111698145A (zh) 包含语音的虚拟物品包的接收、发送方法、装置及介质
US9444927B2 (en) Methods for voice management, and related devices
WO2018205786A1 (zh) 分享录屏视频的方法、装置及设备
JP6910300B2 (ja) チャット履歴記録を表示するための方法およびチャット履歴記録を表示するための装置
WO2015085951A1 (zh) 邀请好友观看视频的方法、终端、服务器及系统
WO2017215661A1 (zh) 一种场景音效的控制方法、及电子设备
US9965733B2 (en) Method, apparatus, and communication system for updating user data based on a completion status of a combination of business task and conversation task
TW201541337A (zh) 移動終端中訊息的顯示方法、裝置和系統
WO2019076250A1 (zh) 推送消息的管理方法及相关产品
CN107786427B (zh) 一种信息交互方法、终端和计算机可读存储介质
CN111628925A (zh) 歌曲交互方法、装置、终端及存储介质
CN105812956B (zh) 视频直播过程中的节目信息提示方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16795782

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 10.04.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16795782

Country of ref document: EP

Kind code of ref document: A1