WO2018053987A1 - Audio and video data offloading transmission method and device for video call, and server - Google Patents

Audio and video data offloading transmission method and device for video call, and server Download PDF

Info

Publication number
WO2018053987A1
WO2018053987A1 PCT/CN2017/072975 CN2017072975W WO2018053987A1 WO 2018053987 A1 WO2018053987 A1 WO 2018053987A1 CN 2017072975 W CN2017072975 W CN 2017072975W WO 2018053987 A1 WO2018053987 A1 WO 2018053987A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
user terminal
video call
voice
data
Prior art date
Application number
PCT/CN2017/072975
Other languages
French (fr)
Chinese (zh)
Inventor
赵俊
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2018053987A1 publication Critical patent/WO2018053987A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341Demultiplexing of audio and video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Definitions

  • the present application relates to, but is not limited to, the field of wireless data transmission technologies, and in particular, to a video call method and apparatus for voice and video offload transmission and a server.
  • Video calls are mainly based on the Internet and mobile Internet-based end-to-end video and audio synchronization transmission process.
  • IP Internet Protocol
  • video calls such as calls through WeChat phonebook, qq, facetime, etc.
  • VOLTE Voice Over LTE, which makes calls through the LTE network
  • VOLTE is the iconic service of 4G, and it is also a service promoted by operators. More and more users will be in the later stage. Compared with Internet-based video calls, VOLTE has many advantages:
  • the mobile terminal has convenience;
  • VOLTE video calls Compared with VOLTE audio calls, the main difference between VOLTE video calls and VOLTE audio calls is that there are more resources when establishing bearers, and the requirements for network quality are higher.
  • the protocol pairs of VOLTE video calls and VOLTE audio calls are shown in Table 1.
  • the SRB (Signaling Radio Bearers) is only used to transmit RRC (Radio Resource Control) and NAS (Non-Access Stratum) messages.
  • SRB1 is used to transmit RRC messages
  • SRB2 is used to transmit NAS messages.
  • DRB Data Radio Bearer
  • the AM DRB is the DRB in the acknowledgment mode
  • the UM DRB is the DRB in the acknowledgment mode.
  • QoS Quality of Service
  • QCI (QoS Class Identifier) 1 indicates voice bearer
  • the bandwidth resources of the base station will also become limited, and the resources provided to the terminal will be less.
  • using the video call function will greatly increase the base station load, and at the same time, due to the lack of bandwidth resources, Affect the quality of video calls and affect the user experience, such as in some public places, railway stations, sports fields, downtown squares, etc. Therefore, when there are many LTE network users, the bandwidth is insufficient, and the use of video calls will greatly increase the network bandwidth load.
  • the server can only reduce the video call quality or reduce the bandwidth used by other users to complete the call request, which affects the call. User experience and feelings.
  • video calls with limited network resources can also lead to an increase in call failure rate.
  • the embodiments of the present invention provide a video call method, a device, and a server for voice and video offload transmission, which are used to solve the problem that a video call is caused when the LTE network resources are insufficient, resulting in poor call quality and high call failure rate.
  • the embodiment of the invention provides a video call method for voice and video offload transmission, including:
  • the video data and the voice data in the video call of the user terminal are respectively transmitted through the WLAN and ETURAN (Evolved Universal Terrestrial Radio Access Network).
  • ETURAN Evolved Universal Terrestrial Radio Access Network
  • the process of determining whether the user terminal meets the offload transmission condition includes:
  • the video call method further includes: setting a manner of a video call, and the manner of the video call includes a split mode.
  • the process of determining whether the user terminal meets the offload transmission condition includes:
  • determining whether the resource of the ETURAN connected by the user terminal is sufficient includes determining whether the resource of the ETURAN is sufficient according to the current network user quantity and resource remaining condition of the ETURAN.
  • determining whether the user terminal is connected to the available WLAN includes:
  • video data in the video call is transmitted over a WLAN, and voice data in the video call is transmitted through ETURAN.
  • the embodiment of the invention further provides a video communication device for voice and video offload transmission, comprising:
  • the offloading transmission condition determining unit is configured to determine, according to the network condition currently connected by the user terminal, whether the user terminal meets the offload transmission condition when the user terminal performs a video call;
  • a data transmission unit configured to transmit video data and voice data in the video call of the user terminal through the WLAN and the ETURAN, respectively, when the user terminal meets the offload transmission condition.
  • the offload transmission condition determining unit includes:
  • a video call mode detecting subunit configured to determine whether the user terminal is configured to perform a video call by using a offloading manner
  • the network connection detecting subunit is configured to determine whether the user terminal is connected to the available WLAN and ETURAN.
  • the video communication device further includes:
  • the video call mode setting unit is connected to the video call mode detecting subunit and configured to set a video call mode.
  • the offload transmission condition determining unit includes:
  • a resource detecting subunit configured to determine whether the resources of the ETURAN connected to the user terminal are sufficient
  • the WLAN connection detecting subunit is configured to determine whether the user terminal is connected to an available WLAN.
  • the data transmission unit includes:
  • a video acquisition subunit configured to acquire video data in a video call of the user terminal
  • a video codec subunit connected to the video acquisition subunit, configured to encode and decode the obtained video data
  • a video transmission subunit connected to the video codec subunit, configured to transmit the coded video data through a WLAN;
  • a voice acquisition subunit configured to acquire voice data in a video call of the user terminal
  • a voice codec subunit connected to the voice acquisition subunit, configured to encode and decode the obtained voice data
  • the voice transmission subunit is connected to the voice codec subunit and configured to transmit the coded voice data through the ETURAN.
  • the embodiment of the invention further provides a server for providing voice and video offload transmission, including:
  • the network transmission conversion unit is configured to convert the data transmitted in the WLAN to the ETURAN for transmission during data transmission with the user terminal, or convert the data transmitted in the ETURAN to the WLAN for transmission.
  • the embodiment of the invention further provides a computer readable storage medium storing computer executable instructions, which are implemented by the processor to implement the video call method of the voice and video offload transmission described above.
  • the video data and the voice data in the video call are separately transmitted through the WLAN and the ETURAN, and the bandwidth of the LTE network occupied by the VOLET video call is reduced in the case of insufficient LTE network resources, thereby ensuring the quality of the video call. , improved the success rate of video call calls.
  • FIG. 1 is a flowchart of a video call method for voice and video offload transmission according to Embodiment 2 of the present invention
  • FIG. 3 is a flowchart of a video call method for voice and video offload transmission according to Embodiment 4 of the present invention.
  • FIG. 4 is a structural diagram of a video call device for voice and video offload transmission according to Embodiment 5 of the present invention.
  • FIG. 5 is a structural diagram of a video call device for voice and video offload transmission according to Embodiment 6 of the present invention.
  • FIG. 6 is a schematic diagram of an audio and video offload transmission to a server according to Embodiment 7 of the present invention.
  • FIG. 7 is a flowchart of a process for initiating a video call by a calling terminal according to Embodiment 8 of the present invention.
  • FIG. 8 is a flow chart of receiving a video call by a called terminal according to Embodiment 9 of the present invention.
  • the embodiment of the invention provides a video call method and device for voice and video offload transmission and a server.
  • the embodiments of the present invention are further described in detail below with reference to the accompanying drawings and embodiments. It is to be understood that the embodiments described herein are merely illustrative of the application and are not limiting.
  • the video call method for voice and video offload transmission in the embodiment of the present invention first determines whether the user terminal meets the offload transmission condition according to the network condition currently connected by the user terminal when the user terminal performs a video call; When the user terminal meets the offload transmission condition, the video data and the voice data in the video call of the user terminal are transmitted through the WLAN and the ETURAN, respectively.
  • WLANs are used more and more widely.
  • the hotspot service packages provided by operators are also cheaper than mobile traffic, and some are even free.
  • the embodiment uses the wifi hotspot arranged by the operator of the public place to carry the video signal on the WLAN network, and the voice signal is still carried on the ETURAN network.
  • VOLTE transmission This will reduce VOLTE
  • the system bandwidth occupied by the video call improves the network usage rate, and fully utilizes the advantages of the quality assurance of the LTE network to ensure accurate and clear transmission of voice information during the video call, thereby ensuring the quality of the voice call and also completing the video. transmission.
  • a video call method for voice and video offload transmission according to an embodiment of the present invention is as shown in FIG. 1 , and includes the following steps:
  • step s101 a method of setting a video call is set.
  • the manner of the video call is set to a split mode.
  • step s102 the video call process is entered.
  • step s103 it is determined whether the user terminal is configured to perform a video call by using a split mode. If yes, go to step s104, otherwise perform a normal VOLTE video call.
  • step s104 it is determined whether the user terminal is connected to the available WLAN and ETURAN. If yes, go to step s105, otherwise the call will fail.
  • Step s105 The video data and the voice data in the video call of the user terminal are transmitted through the WLAN and the ETURAN, respectively.
  • the video data in the video call is transmitted through the WLAN
  • the voice data in the video call is transmitted through the ETURAN.
  • the video call mode of this embodiment when the video call mode is set to the offload mode, regardless of whether the current LTE network resource is sufficient, the video call is performed in a offload manner as long as the available WLAN and ETURAN are connected.
  • a video call method for voice and video offload transmission according to an embodiment of the present invention is as shown in FIG. 2, and includes the following steps:
  • step s201 the video call process is entered.
  • step s202 it is determined whether the resources of the ETURAN connected to the user terminal are sufficient. If yes, a normal VOLTE video call is made, otherwise step s203 is performed. In this embodiment, it is determined whether the resources of the ETURAN are sufficient according to the current network user number and resource remaining condition of the ETURAN.
  • step s203 it is determined whether the user terminal is connected to an available WLAN. If yes, go to step s204, otherwise the call will fail. In this embodiment, even if the WLAN is currently connected, it is determined whether the WLAN currently connected to the user terminal is within the legal range of the operator service.
  • Step s204 The video data and the voice data in the video call of the user terminal are transmitted through the WLAN and the ETURAN, respectively.
  • the video data in the video call is transmitted through the WLAN
  • the voice data in the video call is transmitted through the ETURAN.
  • the video call is performed in a shunt manner as long as the LTE network resources are insufficient and the available WLAN is connected.
  • a video call method for voice and video offload transmission according to an embodiment of the present invention is as shown in FIG. 3, and includes the following steps:
  • step s301 a method of setting a video call is set.
  • the manner of the video call is set to a split mode.
  • step s302 the video call process is entered.
  • step s303 it is determined whether the user terminal is configured to perform a video call by using the offloading mode. If yes, go to step s304, otherwise perform a normal VOLTE video call.
  • step s304 it is determined whether the resources of the ETURAN connected to the user terminal are sufficient. If yes, a normal VOLTE video call is made, otherwise step s305 is performed. In this embodiment, it is determined whether the resources of the ETURAN are sufficient according to the current network user number and resource remaining condition of the ETURAN.
  • step s305 it is determined whether the user terminal is connected to an available WLAN. If yes, go to step s306, otherwise the call will fail. In this embodiment, even if the WLAN is currently connected, it is determined whether the WLAN currently connected to the user terminal is within the legal range of the operator service.
  • Step s306 the video data and the voice data in the video call of the user terminal are transmitted through the WLAN and the ETURAN, respectively.
  • the video data in the video call is transmitted through the WLAN
  • the voice data in the video call is transmitted through the ETURAN.
  • step s303, step s304, and step s305 can be adjusted to each other.
  • a video call device for voice and video offload transmission includes a video call mode setting unit 41, a offload transmission condition determination unit 42, and a data transmission unit 43, wherein the offload transmission condition determination unit 42 It is connected to the video call mode setting unit 41 and the data transfer unit 43, respectively.
  • the video call mode setting unit 41 is configured to set a video call mode; the offload transmission condition determining unit 42 is configured to determine, according to the network condition currently connected by the user terminal, whether the user terminal meets the offload transmission when the user terminal performs a video call.
  • the data transmission unit 43 is configured to transmit the video data and the voice data in the video call of the user terminal through the WLAN and the ETURAN, respectively, when the user terminal meets the offload transmission condition.
  • the offload transmission condition determining unit 42 includes a video call mode detecting subunit 421 and a network connection detecting subunit 422, wherein the video call mode setting unit 41 is connected to the video call mode detecting subunit 421.
  • the video call mode detecting sub-unit 421 is configured to determine whether the user terminal is configured to perform a video call by using a split mode; the network connection detecting sub-unit 422 is configured to determine whether the user terminal is connected to an available WLAN and ETURAN.
  • the data transmission unit 43 includes a video acquisition subunit 431, a video codec subunit 432, a video transmission subunit 433, a voice acquisition subunit 434, a speech codec subunit 435, and a voice transmission subunit 436.
  • the video codec sub-unit 432 is connected to the video acquisition sub-unit 431 and the video transmission sub-unit 433, respectively
  • the speech codec sub-unit 435 is connected to the speech acquisition sub-unit 434 and the voice transmission sub-unit 436, respectively.
  • the video acquisition sub-unit 431 is configured to acquire video data in a video call of the user terminal; the video codec sub-unit 432 is configured to encode and decode the acquired video data; and the video transmission sub-unit 433 is configured to encode and decode the video data.
  • the video data is transmitted through the WLAN; the voice acquisition sub-unit 434 is configured to acquire voice data in the video call of the user terminal; the voice codec sub-unit 435 is configured to encode and decode the acquired voice data; and the voice transmission sub-unit 436 is configured. In order to transmit the coded voice data through ETURAN.
  • a video call device for voice and video offload transmission includes a shunt transmission condition judging unit 51 and a data transmission unit 52, wherein the shunt transmission condition judging unit 51 and the data transmission unit 52 are connected.
  • the offloading transmission condition determining unit 51 is configured to determine, according to the network condition currently connected by the user terminal, whether the user terminal meets the offload transmission condition when the user terminal performs a video call; the data transmission unit 52 is configured to be in compliance with the user terminal.
  • the transmission condition is offloaded, the video data and the voice data in the video call of the user terminal are transmitted through the WLAN and the ETURAN, respectively.
  • the shunt transmission condition judging unit 51 includes a resource detecting subunit 511 and a WLAN connection detecting subunit 512.
  • the resource detection sub-unit 511 is configured to determine whether the resources of the ETURAN connected to the user terminal are sufficient; the WLAN connection detection sub-unit 512 is configured to determine whether the user terminal is connected to an available WLAN.
  • the data transmission unit 52 includes a video acquisition sub-unit 521, a video codec sub-unit 522, a video transmission sub-unit 523, a speech acquisition sub-unit 524, a speech codec sub-unit 525, and a voice transmission sub-unit 526.
  • the video codec subunit 522 is connected to the video acquisition subunit 521 and the video transmission subunit 523, respectively
  • the speech codec subunit 525 is connected to the voice acquisition subunit 524 and the voice transmission subunit 526, respectively.
  • the video acquisition sub-unit 521 is configured to acquire video data in a video call of the user terminal; the video codec sub-unit 522 is configured to encode and decode the acquired video data; and the video transmission sub-unit 523 is configured to encode and decode the video data.
  • the video data is transmitted through the WLAN; the voice acquisition sub-unit 524 is configured to acquire voice data in the video call of the user terminal; the voice codec sub-unit 525 is configured to encode and decode the acquired voice data; and the voice transmission sub-unit 526 is configured. In order to transmit the coded voice data through ETURAN.
  • a server for providing voice and video offload transmission includes a network transmission conversion unit configured to convert data transmitted in a WLAN to an ETURAN for transmission during data transmission with a user terminal, or to transmit in ETURAN
  • the data transmitted in is converted to WLAN for transmission. That is, the server must have the ability to convert the transport bearer, which can convert the WLAN bearer into EUTRAN and convert the EUTRAN bearer into WLAN.
  • FIG. 6 a schematic diagram of audio and video offload transmission to the server is shown in FIG. 6, and the video is separated in the video call content. And audio, the video is transmitted to the server on the WLAN or EUTRAN through codec, and the audio is transmitted to the server on the EUTRAN after being coded and decoded.
  • the terminal collects video and audio separately during the video call, and the camera and the microphone are separately collected.
  • the traditional VOLTE video call is also transmitted separately, but the video can only be transmitted to the server through the EUTRAN.
  • This embodiment improves on the transmission of video information, increases the structure in which video information transmission can be transmitted to the server through WLAN, and the video and audio information are finally aggregated to the server.
  • a process for initiating a video call of a calling terminal to transmit a video call includes the following steps:
  • step s701 the terminal initiates a VOLTE video call.
  • step s702 it is determined whether the network resource is sufficient. If yes, go to step s705, otherwise go to step s703.
  • the terminal determines whether a normal bearer can be performed through a series of measurements and information acquisition of the current network status, for example, current network bandwidth usage, resource allocation, and mobile phone reporting information, current Whether the WLAN network is within the legal scope of the carrier service, whether the current setting status of the mobile phone is permitted, and the like. If the current network cannot meet the VOLTE video call that is completely carried on the EUTRAN, the terminal will send a video call to the terminal to try the video offload mode.
  • step s703 it is judged whether or not the condition for performing the offload transmission is satisfied. If yes, go to step s704, otherwise go to step s706.
  • step s704 the terminal starts to offload the transmitted video call.
  • the video call of the offloaded transmission starts.
  • step s705 a normal VOLTE video call carried on the EUTRAN is performed.
  • step s706 the video call fails to be established.
  • the terminal or the network determines that the video call of the voice and video offload transmission cannot be performed in the current environment, the current call fails.
  • This embodiment is a method for the calling terminal to implement the video and audio offloading function.
  • the existing terminals supporting the VOLTE and the WLAN can meet the requirements required by the embodiment in hardware.
  • the current upper layer control protocol does not need to be greatly improved, but a new one is added when the bearer is built.
  • the bearer method is adopted, so that the original video signal transmission mode is changed from EUTRAN to WLAN to the server; and the audio signal transmission mode is unchanged, thereby completing the function of the offload transmission.
  • This bearer method can be selected by the user or automatically executed after the network judges the condition. It can be judged by the number of current network users, the remaining resources, and whether the wifi currently connected by the user is legal. When all the conditions are met, the VOLTE video call of the offload transmission mode is started.
  • the receiving process of the called terminal for offloading the video call in the embodiment of the present invention is as shown in FIG. 8 and includes the following steps:
  • step s801 the terminal receives a video call application.
  • step s802 it is determined whether the network resource is sufficient. If yes, go to step s805, otherwise go to step s803.
  • the terminal determines whether the normal bearer can be performed through a series of measurements and information acquisition of the current network status, for example, current network bandwidth usage, resource allocation, and mobile phone reporting information. Whether the WLAN network is within the legal scope of the carrier service, whether the current setting status of the mobile phone is permitted, and the like. If the current network cannot meet the VOLTE video call that is completely carried on the EUTRAN, it will be sent to the terminal to try to receive video calls in the video offload mode.
  • step s803 it is judged whether or not the condition for performing the offload transmission is satisfied. If yes, go to step s804, otherwise go to step s806.
  • step s804 the terminal starts to offload the transmitted video call.
  • the video call of the offloaded transmission starts.
  • step s805 a normal VOLTE video call carried on the EUTRAN is performed.
  • step s806 receiving the video call fails.
  • the terminal or the network determines that the video call of the voice and video offload transmission cannot be performed in the current environment, the video call fails to be received this time.
  • the called terminal implements a video and audio offload function, and the called terminal determines the current network status. If the network is good, or the condition is not implemented, the network is notified to change the receiver bearer to the normal EUTRAN mode; Split transmission, the server will match The transmission mode is split transmission.
  • This bearer method can be selected by the user or automatically executed after the network judges.
  • the video data and the voice data in the video call are separately transmitted through the WLAN and the ETURAN, and the bandwidth of the LTE network occupied by the VOLET video call is reduced in the case of insufficient LTE network resources, thereby ensuring the quality of the video call. , improved the success rate of video call calls.
  • an embodiment of the present invention further provides a computer readable storage medium storing computer executable instructions, the computer executable instructions being implemented by a processor to implement the video call method of the voice and video offload transmission.
  • computer storage medium includes volatile and nonvolatile, implemented in any method or technology for storing information, such as computer readable instructions, data structures, program modules or other data. Sex, removable and non-removable media.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridge, magnetic tape, magnetic disk storage or other magnetic storage device, or may Any other medium used to store the desired information and that can be accessed by the computer.
  • communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and can include any information delivery media. .
  • the embodiment of the present invention provides a video call method and device for voice and video offload transmission, and a server, which is configured to transmit video data and voice data in a video call separately through WLAN and ETURAN, in case of insufficient LTE network resources.
  • the VOLET video call reduces the bandwidth of the LTE network, ensures the quality of the video call, and improves the success rate of the video call.

Abstract

Disclosed is an audio and video data offloading transmission method for a video call, comprising: when a user terminal is in a video call, determining, according to a state of a network to which the user terminal is currently connected, whether the user terminal satisfies an offloading transmission requirement; and if so, respectively transmitting, by means of a WLAN and an ETURAN, video data and audio data in the video call conducted by the user terminal. Also disclosed are an audio and video data offloading transmission device for a video call and a server providing audio and video data offloading transmission.

Description

语音和视频分流传输的视频通话方法和装置及服务器Video call method and device for voice and video offload transmission and server 技术领域Technical field
本申请涉及但不限于无线数据传输技术领域,尤指一种语音和视频分流传输的视频通话方法和装置及服务器。The present application relates to, but is not limited to, the field of wireless data transmission technologies, and in particular, to a video call method and apparatus for voice and video offload transmission and a server.
背景技术Background technique
随着移动终端的普及和LTE(Long Term Evolution,长期演进)网络的大规模部署,LTE的使用率越来越高,基于LTE的视频通话功能的使用也越来越多。视频通话主要是基于互联网和基于移动互联网的端到端之间的视频音频同步传输过程。目前视频通话的技术方案主要分为纯IP(Internet Protocol,网络之间互连的协议)为主的视频通话(比如通过微信电话本、qq、facetime等聊天软件进行通话),以及走普通电话流程的视频通话。With the popularization of mobile terminals and the large-scale deployment of LTE (Long Term Evolution) networks, the usage rate of LTE is getting higher and higher, and the use of LTE-based video calling functions is also increasing. Video calls are mainly based on the Internet and mobile Internet-based end-to-end video and audio synchronization transmission process. At present, the technical solutions of video calls are mainly divided into pure IP (Internet Protocol, a protocol interconnected by networks), and video calls (such as calls through WeChat phonebook, qq, facetime, etc.), and the ordinary phone process. Video call.
最早的移动互联下的视频通话是通过3G网络实现的,其优势在于无需重新维护一份呼叫通话的名单和账户,直接使用手机号码来识别用户,依托于手机号码的庞大用户群和唯一性,可以和任意手机号码进行视频通话。但是由于3G的带宽有限,资费较贵,因此普及度不高。随着LTE的普及,VOLTE(Voice Over LTE,通过LTE网络拨打电话)承担起移动互联网下的语音视频通话功能。VOLTE是4G的标志性业务,也是运营商大力推广的业务,后期用户也会越来越多。和基于互联网的视频通话相比,VOLTE有着多方面的提升:The earliest video call under the mobile internet is realized through the 3G network. The advantage is that it does not need to re-maintain a call list and account, and directly uses the mobile phone number to identify the user, relying on the huge user group and uniqueness of the mobile phone number. You can make a video call with any mobile number. However, due to the limited bandwidth of 3G, the tariff is relatively expensive, so the popularity is not high. With the popularity of LTE, VOLTE (Voice Over LTE, which makes calls through the LTE network) assumes the voice and video call function under the mobile Internet. VOLTE is the iconic service of 4G, and it is also a service promoted by operators. More and more users will be in the later stage. Compared with Internet-based video calls, VOLTE has many advantages:
1、移动终端具有便捷性;1. The mobile terminal has convenience;
2、视频和音频通话质量高,时延小,并且资费也逐渐降低。2. The quality of video and audio calls is high, the delay is small, and the tariff is gradually reduced.
因此,可以预见VOLTE的视频通话功能在未来将会大量普及,用户数量也会越来越多。Therefore, it can be foreseen that the video calling function of VOLTE will be widely popular in the future, and the number of users will also increase.
VOLTE的视频通话与VOLTE的音频通话相比,主要区别就是在建立承载的时候要多一些资源,并且对于网络质量的要求也更高。VOLTE的视频通话与VOLTE的音频通话的协议对比如表1所示。 Compared with VOLTE audio calls, the main difference between VOLTE video calls and VOLTE audio calls is that there are more resources when establishing bearers, and the requirements for network quality are higher. The protocol pairs of VOLTE video calls and VOLTE audio calls are shown in Table 1.
表1Table 1
Figure PCTCN2017072975-appb-000001
Figure PCTCN2017072975-appb-000001
其中,SRB(Signaling Radio Bearers,信令无线承载)仅仅用来传输RRC(Radio Resource Control,无线资源控制)和NAS(非接入层)消息,SRB1用来传输RRC消息,SRB2用来传输NAS消息;对于DRB(Data Radio Bearer,数据无线承载),AM DRB为确认模式的DRB,UM DRB为无确认模式的DRB。在QoS(Quality of Service,服务质量)承载中:The SRB (Signaling Radio Bearers) is only used to transmit RRC (Radio Resource Control) and NAS (Non-Access Stratum) messages. SRB1 is used to transmit RRC messages, and SRB2 is used to transmit NAS messages. For the DRB (Data Radio Bearer), the AM DRB is the DRB in the acknowledgment mode, and the UM DRB is the DRB in the acknowledgment mode. In the QoS (Quality of Service) bearer:
QCI(QoS Class Identifier,QoS等级标识)=1表示语音承载;QCI (QoS Class Identifier) = 1 indicates voice bearer;
QCI=2表示视频承载;QCI=2 indicates video bearer;
QCI=5表示SIP(Session Initiation Protocol,会话发起协议)/SDP(Session Description Protocol,会话描述协议)传输IMS(IP Multimedia Subsystem,IP多媒体子系统)信令承载;The QCI=5 indicates that the SIP (Session Initiation Protocol)/SDP (Session Description Protocol) transmits an IMS (IP Multimedia Subsystem) signaling bearer;
QCI=8/9表示一般上网业务承载。QCI=8/9 indicates the general Internet service bearer.
从表1可以看出视频通话比纯音频通话要多配置一个QCI=2的UM DRB。It can be seen from Table 1 that a video call has more UM DRBs with QCI=2 than pure audio calls.
现有视频通话的传输方式单一,要么使用移动网络,要么使用互联网络(如有线、WLAN(Wireless Local Area Networks,无线局域网)等)。很多运营商推出了VOWIFI(Voice Over WIFI,通过wifi(WIreless-FIdelity,无线保真)网络拨打电话)的功能来解决家庭范围的网络覆盖和语音服务,但是不论VOWIFI还是VOLTE的视频通话,要么承载在wifi上,要么承载在LTE上。当承载在wifi上,由于wifi缺少QoS保障,语音和视频通话效果都难以得到保障;而承载在LTE上,虽然LTE的带宽利用率和带宽都比较高,但是在某些特殊的条件,比如网络拥塞或者网络信号复杂环境下,基站的带宽资源也会变的很有限,而提供给终端的资源也会更少。这个时候再使用视频通话功能,将会大大增加基站负荷,同时由于带宽资源的缺少,也会 影响视频通话的质量,影响用户的体验,比如在一些公共场所、火车站、运动场、闹市区广场等。因此,当LTE网络用户较多时,带宽不足,使用视频通话将会大大增加网络带宽负荷,为了满足用户要求,服务器只能降低视频通话质量或者减少其他用户使用带宽来完成通话要求,这就影响到用户体验和感受。而且在网络资源有限的情况下进行视频通话也会导致呼叫失败率上升。Existing video calls are transmitted in a single way, either using a mobile network or using an internetwork (such as wired, WLAN (Wireless Local Area Networks), etc.). Many operators have introduced VOWIFI (Voice Over WIFI) to solve home-wide network coverage and voice services, but whether it is VOWIFI or VOLTE video calls, or bear On wifi, it is either carried on LTE. When it is carried on wifi, due to the lack of QoS guarantee of wifi, the voice and video call effects are difficult to be guaranteed; while the bearer is on LTE, although the bandwidth utilization and bandwidth of LTE are relatively high, but in some special conditions, such as the network. In a complex environment with congestion or network signals, the bandwidth resources of the base station will also become limited, and the resources provided to the terminal will be less. At this time, using the video call function will greatly increase the base station load, and at the same time, due to the lack of bandwidth resources, Affect the quality of video calls and affect the user experience, such as in some public places, railway stations, sports fields, downtown squares, etc. Therefore, when there are many LTE network users, the bandwidth is insufficient, and the use of video calls will greatly increase the network bandwidth load. In order to meet the user requirements, the server can only reduce the video call quality or reduce the bandwidth used by other users to complete the call request, which affects the call. User experience and feelings. Moreover, video calls with limited network resources can also lead to an increase in call failure rate.
发明概述Summary of invention
本发明实施例提供一种语音和视频分流传输的视频通话方法和装置及服务器,用以解决在LTE网络资源不足时进行视频通话会导致通话质量不佳、呼叫失败率高的问题。The embodiments of the present invention provide a video call method, a device, and a server for voice and video offload transmission, which are used to solve the problem that a video call is caused when the LTE network resources are insufficient, resulting in poor call quality and high call failure rate.
本发明实施例提供一种语音和视频分流传输的视频通话方法,包括:The embodiment of the invention provides a video call method for voice and video offload transmission, including:
在用户终端进行视频通话时,根据所述用户终端当前连接的网络情况,判断所述用户终端是否符合分流传输条件;When the user terminal performs a video call, determining whether the user terminal meets the offload transmission condition according to the network condition currently connected by the user terminal;
当所述用户终端符合分流传输条件时,将所述用户终端的视频通话中的视频数据和语音数据分别通过WLAN和ETURAN(Evolved Universal Terrestrial Radio Access Network,演进通用陆地无线接入网)传输。When the user terminal meets the offload transmission condition, the video data and the voice data in the video call of the user terminal are respectively transmitted through the WLAN and ETURAN (Evolved Universal Terrestrial Radio Access Network).
在示例性实施方式中,所述判断用户终端是否符合分流传输条件的过程包括:In an exemplary embodiment, the process of determining whether the user terminal meets the offload transmission condition includes:
判断所述用户终端是否设置为采用分流方式进行视频通话;Determining whether the user terminal is configured to perform a video call by using a offloading manner;
判断所述用户终端是否连接有可用的WLAN和ETURAN。It is determined whether the user terminal is connected to an available WLAN and ETURAN.
在示例性实施方式中,所述视频通话方法还包括:设置视频通话的方式,所述视频通话的方式包括分流方式。In an exemplary embodiment, the video call method further includes: setting a manner of a video call, and the manner of the video call includes a split mode.
在示例性实施方式中,所述判断用户终端是否符合分流传输条件的过程包括:In an exemplary embodiment, the process of determining whether the user terminal meets the offload transmission condition includes:
判断所述用户终端连接的ETURAN的资源是否充足;Determining whether the resources of the ETURAN connected to the user terminal are sufficient;
判断所述用户终端是否连接有可用的WLAN。 Determining whether the user terminal is connected to an available WLAN.
在示例性实施方式中,所述判断所述用户终端连接的ETURAN的资源是否充足,包括:根据所述ETURAN的当前网络用户数量和资源剩余情况,判断所述ETURAN的资源是否充足。In an exemplary embodiment, determining whether the resource of the ETURAN connected by the user terminal is sufficient includes determining whether the resource of the ETURAN is sufficient according to the current network user quantity and resource remaining condition of the ETURAN.
在示例性实施方式中,所述判断用户终端是否连接有可用的WLAN包括:In an exemplary embodiment, determining whether the user terminal is connected to the available WLAN includes:
判断所述用户终端当前连接的WLAN是否在运营商服务的合法范围内。Determining whether the WLAN currently connected to the user terminal is within the legal range of the operator service.
在示例性实施方式中,所述视频通话中的视频数据通过WLAN传输,所述视频通话中的语音数据通过ETURAN传输。In an exemplary embodiment, video data in the video call is transmitted over a WLAN, and voice data in the video call is transmitted through ETURAN.
本发明实施例还提供一种语音和视频分流传输的视频通话装置,包括:The embodiment of the invention further provides a video communication device for voice and video offload transmission, comprising:
分流传输条件判断单元,配置为在用户终端进行视频通话时,根据所述用户终端当前连接的网络情况,判断所述用户终端是否符合分流传输条件;The offloading transmission condition determining unit is configured to determine, according to the network condition currently connected by the user terminal, whether the user terminal meets the offload transmission condition when the user terminal performs a video call;
数据传输单元,配置为当所述用户终端符合分流传输条件时,将所述用户终端的视频通话中的视频数据和语音数据分别通过WLAN和ETURAN传输。And a data transmission unit configured to transmit video data and voice data in the video call of the user terminal through the WLAN and the ETURAN, respectively, when the user terminal meets the offload transmission condition.
在示例性实施方式中,所述分流传输条件判断单元包括:In an exemplary embodiment, the offload transmission condition determining unit includes:
视频通话方式检测子单元,配置为判断所述用户终端是否设置为采用分流方式进行视频通话;a video call mode detecting subunit, configured to determine whether the user terminal is configured to perform a video call by using a offloading manner;
网络连接检测子单元,配置为判断所述用户终端是否连接有可用的WLAN和ETURAN。The network connection detecting subunit is configured to determine whether the user terminal is connected to the available WLAN and ETURAN.
在示例性实施方式中,所述视频通话装置还包括:In an exemplary embodiment, the video communication device further includes:
视频通话方式设置单元,与所述视频通话方式检测子单元连接,配置为设置视频通话的方式。The video call mode setting unit is connected to the video call mode detecting subunit and configured to set a video call mode.
在示例性实施方式中,所述分流传输条件判断单元包括:In an exemplary embodiment, the offload transmission condition determining unit includes:
资源检测子单元,配置为判断所述用户终端连接的ETURAN的资源是否充足;a resource detecting subunit configured to determine whether the resources of the ETURAN connected to the user terminal are sufficient;
WLAN连接检测子单元,配置为判断所述用户终端是否连接有可用的WLAN。The WLAN connection detecting subunit is configured to determine whether the user terminal is connected to an available WLAN.
在示例性实施方式中,所述数据传输单元包括: In an exemplary embodiment, the data transmission unit includes:
视频获取子单元,配置为获取所述用户终端的视频通话中的视频数据;a video acquisition subunit configured to acquire video data in a video call of the user terminal;
视频编解码子单元,与所述视频获取子单元连接,配置为对获取到的视频数据进行编解码;a video codec subunit, connected to the video acquisition subunit, configured to encode and decode the obtained video data;
视频传输子单元,与所述视频编解码子单元连接,配置为将编解码后的视频数据通过WLAN传输;a video transmission subunit, connected to the video codec subunit, configured to transmit the coded video data through a WLAN;
语音获取子单元,配置为获取所述用户终端的视频通话中的语音数据;a voice acquisition subunit configured to acquire voice data in a video call of the user terminal;
语音编解码子单元,与所述语音获取子单元连接,配置为对获取到的语音数据进行编解码;a voice codec subunit, connected to the voice acquisition subunit, configured to encode and decode the obtained voice data;
语音传输子单元,与所述语音编解码子单元连接,配置为将编解码后的语音数据通过ETURAN传输。The voice transmission subunit is connected to the voice codec subunit and configured to transmit the coded voice data through the ETURAN.
本发明实施例还提供一种提供语音和视频分流传输的服务器,包括:The embodiment of the invention further provides a server for providing voice and video offload transmission, including:
网络传输转换单元,配置为在与用户终端进行数据传输时,将在WLAN中传输的数据转换到ETURAN中进行传输,或者将在ETURAN中传输的数据转换到WLAN中进行传输。The network transmission conversion unit is configured to convert the data transmitted in the WLAN to the ETURAN for transmission during data transmission with the user terminal, or convert the data transmitted in the ETURAN to the WLAN for transmission.
本发明实施例还提供一种计算机可读存储介质,存储有计算机可执行指令,所述计算机可执行指令被处理器执行时实现上述的语音和视频分流传输的视频通话方法。The embodiment of the invention further provides a computer readable storage medium storing computer executable instructions, which are implemented by the processor to implement the video call method of the voice and video offload transmission described above.
本发明有益效果如下:The beneficial effects of the present invention are as follows:
本发明实施例通过将视频通话中的视频数据和语音数据分别通过WLAN和ETURAN分流传输的方式,在LTE网络资源不足的情况下减少了VOLET视频通话占用LTE网络的带宽,保证了视频通话的质量,提升了视频通话呼叫成功率。In the embodiment of the present invention, the video data and the voice data in the video call are separately transmitted through the WLAN and the ETURAN, and the bandwidth of the LTE network occupied by the VOLET video call is reduced in the case of insufficient LTE network resources, thereby ensuring the quality of the video call. , improved the success rate of video call calls.
附图概述BRIEF abstract
图1是本发明实施例2的一种语音和视频分流传输的视频通话方法的流程图;1 is a flowchart of a video call method for voice and video offload transmission according to Embodiment 2 of the present invention;
图2是本发明实施例3的一种语音和视频分流传输的视频通话方法的流 程图;2 is a flow chart of a video call method for voice and video offload transmission according to Embodiment 3 of the present invention; Cheng Tu
图3是本发明实施例4的一种语音和视频分流传输的视频通话方法的流程图;3 is a flowchart of a video call method for voice and video offload transmission according to Embodiment 4 of the present invention;
图4是本发明实施例5的一种语音和视频分流传输的视频通话装置的结构图;4 is a structural diagram of a video call device for voice and video offload transmission according to Embodiment 5 of the present invention;
图5是本发明实施例6的一种语音和视频分流传输的视频通话装置的结构图;5 is a structural diagram of a video call device for voice and video offload transmission according to Embodiment 6 of the present invention;
图6是本发明实施例7的一种音频、视频分流传输到服务器的示意图;6 is a schematic diagram of an audio and video offload transmission to a server according to Embodiment 7 of the present invention;
图7是本发明实施例8的一种主叫终端分流传输视频通话的发起流程图;FIG. 7 is a flowchart of a process for initiating a video call by a calling terminal according to Embodiment 8 of the present invention; FIG.
图8是本发明实施例9的一种被叫终端分流传输视频通话的接受流程图。FIG. 8 is a flow chart of receiving a video call by a called terminal according to Embodiment 9 of the present invention.
详述Detailed
为了解决在LTE网络资源不足时进行视频通话会导致通话质量不佳、呼叫失败率高的问题,本发明实施例提供了一种语音和视频分流传输的视频通话方法和装置及服务器。以下结合附图以及实施例,对本发明实施例进行进一步详细说明。应当理解,此处所描述的实施例仅仅用以解释本申请,并不限定本申请。In order to solve the problem that the video call in the LTE network is insufficient, the call quality is poor, and the call failure rate is high. The embodiment of the invention provides a video call method and device for voice and video offload transmission and a server. The embodiments of the present invention are further described in detail below with reference to the accompanying drawings and embodiments. It is to be understood that the embodiments described herein are merely illustrative of the application and are not limiting.
实施例1Example 1
本发明实施例的一种语音和视频分流传输的视频通话方法,首先在用户终端进行视频通话时,根据所述用户终端当前连接的网络情况,判断所述用户终端是否符合分流传输条件;然后当所述用户终端符合分流传输条件时,将所述用户终端的视频通话中的视频数据和语音数据分别通过WLAN和ETURAN传输。The video call method for voice and video offload transmission in the embodiment of the present invention first determines whether the user terminal meets the offload transmission condition according to the network condition currently connected by the user terminal when the user terminal performs a video call; When the user terminal meets the offload transmission condition, the video data and the voice data in the video call of the user terminal are transmitted through the WLAN and the ETURAN, respectively.
目前WLAN使用越来越广泛,尤其公共场合就有很多运营商提供的wifi热点,运营商提供的热点流量套餐资费也比移动流量要便宜,有的甚至免费。而对于如何在有限的带宽资源下保证视频通话的质量,本实施例利用公共场所的运营商布置的wifi热点,将视频信号承载在WLAN网络上,而语音信号则仍然承载在ETURAN网络上,通过VOLTE传输。这样既能减少VOLTE 视频通话占用的系统带宽,提升网络使用率,又充分利用LTE网络的质量保证完善的优点,保证视频通话过程中语音信息的准确清晰的传输,从而既保障了语音通话的质量,也能完成视频传输。At present, WLANs are used more and more widely. In particular, there are many wifi hotspots provided by operators in public places. The hotspot service packages provided by operators are also cheaper than mobile traffic, and some are even free. For how to guarantee the quality of the video call under the limited bandwidth resources, the embodiment uses the wifi hotspot arranged by the operator of the public place to carry the video signal on the WLAN network, and the voice signal is still carried on the ETURAN network. VOLTE transmission. This will reduce VOLTE The system bandwidth occupied by the video call improves the network usage rate, and fully utilizes the advantages of the quality assurance of the LTE network to ensure accurate and clear transmission of voice information during the video call, thereby ensuring the quality of the voice call and also completing the video. transmission.
实施例2Example 2
本发明实施例的一种语音和视频分流传输的视频通话方法如图1所示,包括以下步骤:A video call method for voice and video offload transmission according to an embodiment of the present invention is as shown in FIG. 1 , and includes the following steps:
步骤s101,设置视频通话的方式。本实施例中,将所述视频通话的方式设置为分流方式。In step s101, a method of setting a video call is set. In this embodiment, the manner of the video call is set to a split mode.
步骤s102,进入视频通话流程。In step s102, the video call process is entered.
步骤s103,判断用户终端是否设置为采用分流方式进行视频通话。如果是,则转步骤s104,否则进行正常VOLTE视频通话。In step s103, it is determined whether the user terminal is configured to perform a video call by using a split mode. If yes, go to step s104, otherwise perform a normal VOLTE video call.
步骤s104,判断所述用户终端是否连接有可用的WLAN和ETURAN。如果是,则转步骤s105,否则通话失败。In step s104, it is determined whether the user terminal is connected to the available WLAN and ETURAN. If yes, go to step s105, otherwise the call will fail.
步骤s105,将所述用户终端的视频通话中的视频数据和语音数据分别通过WLAN和ETURAN传输。本实施例中,所述视频通话中的视频数据通过WLAN传输,所述视频通话中的语音数据通过ETURAN传输。Step s105: The video data and the voice data in the video call of the user terminal are transmitted through the WLAN and the ETURAN, respectively. In this embodiment, the video data in the video call is transmitted through the WLAN, and the voice data in the video call is transmitted through the ETURAN.
采用本实施例的视频通话方式,当视频通话的方式设置为分流方式时,无论当前LTE网络资源是否充足,只要连接有可用的WLAN和ETURAN就以分流方式进行视频通话。With the video call mode of this embodiment, when the video call mode is set to the offload mode, regardless of whether the current LTE network resource is sufficient, the video call is performed in a offload manner as long as the available WLAN and ETURAN are connected.
实施例3Example 3
本发明实施例的一种语音和视频分流传输的视频通话方法如图2所示,包括以下步骤:A video call method for voice and video offload transmission according to an embodiment of the present invention is as shown in FIG. 2, and includes the following steps:
步骤s201,进入视频通话流程。In step s201, the video call process is entered.
步骤s202,判断用户终端连接的ETURAN的资源是否充足。如果是,则进行正常VOLTE视频通话,否则转步骤s203。本实施例中,根据所述ETURAN的当前网络用户数量和资源剩余情况,判断所述ETURAN的资源是否充足。 In step s202, it is determined whether the resources of the ETURAN connected to the user terminal are sufficient. If yes, a normal VOLTE video call is made, otherwise step s203 is performed. In this embodiment, it is determined whether the resources of the ETURAN are sufficient according to the current network user number and resource remaining condition of the ETURAN.
步骤s203,判断所述用户终端是否连接有可用的WLAN。如果是,则转步骤s204,否则通话失败。本实施例中,即使当前连接有WLAN,还要判断所述用户终端当前连接的WLAN是否在运营商服务的合法范围内。In step s203, it is determined whether the user terminal is connected to an available WLAN. If yes, go to step s204, otherwise the call will fail. In this embodiment, even if the WLAN is currently connected, it is determined whether the WLAN currently connected to the user terminal is within the legal range of the operator service.
步骤s204,将所述用户终端的视频通话中的视频数据和语音数据分别通过WLAN和ETURAN传输。本实施例中,所述视频通话中的视频数据通过WLAN传输,所述视频通话中的语音数据通过ETURAN传输。Step s204: The video data and the voice data in the video call of the user terminal are transmitted through the WLAN and the ETURAN, respectively. In this embodiment, the video data in the video call is transmitted through the WLAN, and the voice data in the video call is transmitted through the ETURAN.
采用本实施例的视频通话方式,只要LTE网络资源不足,且连接有可用的WLAN,就以分流方式进行视频通话。With the video call mode of the embodiment, the video call is performed in a shunt manner as long as the LTE network resources are insufficient and the available WLAN is connected.
实施例4Example 4
本发明实施例的一种语音和视频分流传输的视频通话方法如图3所示,包括以下步骤:A video call method for voice and video offload transmission according to an embodiment of the present invention is as shown in FIG. 3, and includes the following steps:
步骤s301,设置视频通话的方式。本实施例中,将所述视频通话的方式设置为分流方式。In step s301, a method of setting a video call is set. In this embodiment, the manner of the video call is set to a split mode.
步骤s302,进入视频通话流程。In step s302, the video call process is entered.
步骤s303,判断用户终端是否设置为采用分流方式进行视频通话。如果是,则转步骤s304,否则进行正常VOLTE视频通话。In step s303, it is determined whether the user terminal is configured to perform a video call by using the offloading mode. If yes, go to step s304, otherwise perform a normal VOLTE video call.
步骤s304,判断用户终端连接的ETURAN的资源是否充足。如果是,则进行正常VOLTE视频通话,否则转步骤s305。本实施例中,根据所述ETURAN的当前网络用户数量和资源剩余情况,判断所述ETURAN的资源是否充足。In step s304, it is determined whether the resources of the ETURAN connected to the user terminal are sufficient. If yes, a normal VOLTE video call is made, otherwise step s305 is performed. In this embodiment, it is determined whether the resources of the ETURAN are sufficient according to the current network user number and resource remaining condition of the ETURAN.
步骤s305,判断所述用户终端是否连接有可用的WLAN。如果是,则转步骤s306,否则通话失败。本实施例中,即使当前连接有WLAN,还要判断所述用户终端当前连接的WLAN是否在运营商服务的合法范围内。In step s305, it is determined whether the user terminal is connected to an available WLAN. If yes, go to step s306, otherwise the call will fail. In this embodiment, even if the WLAN is currently connected, it is determined whether the WLAN currently connected to the user terminal is within the legal range of the operator service.
步骤s306,将所述用户终端的视频通话中的视频数据和语音数据分别通过WLAN和ETURAN传输。本实施例中,所述视频通话中的视频数据通过WLAN传输,所述视频通话中的语音数据通过ETURAN传输。Step s306, the video data and the voice data in the video call of the user terminal are transmitted through the WLAN and the ETURAN, respectively. In this embodiment, the video data in the video call is transmitted through the WLAN, and the voice data in the video call is transmitted through the ETURAN.
采用本实施例的视频通话方式,当视频通话的方式设置为分流方式时,只有LTE网络资源不足,且连接有可用的WLAN时,才以分流方式进行视 频通话。其中,步骤s303、步骤s304和步骤s305的三个判断过程的顺序可以互相调整。In the video call mode of this embodiment, when the video call mode is set to the offload mode, only when the LTE network resources are insufficient, and the available WLAN is connected, the traffic is viewed in a split manner. Frequency call. The order of the three determination processes of step s303, step s304, and step s305 can be adjusted to each other.
实施例5Example 5
本发明实施例的一种语音和视频分流传输的视频通话装置如图4所示,包括视频通话方式设置单元41、分流传输条件判断单元42和数据传输单元43,其中,分流传输条件判断单元42分别与视频通话方式设置单元41和数据传输单元43连接。As shown in FIG. 4, a video call device for voice and video offload transmission according to an embodiment of the present invention includes a video call mode setting unit 41, a offload transmission condition determination unit 42, and a data transmission unit 43, wherein the offload transmission condition determination unit 42 It is connected to the video call mode setting unit 41 and the data transfer unit 43, respectively.
视频通话方式设置单元41配置为设置视频通话的方式;分流传输条件判断单元42配置为在用户终端进行视频通话时,根据所述用户终端当前连接的网络情况,判断所述用户终端是否符合分流传输条件;数据传输单元43配置为当所述用户终端符合分流传输条件时,将所述用户终端的视频通话中的视频数据和语音数据分别通过WLAN和ETURAN传输。The video call mode setting unit 41 is configured to set a video call mode; the offload transmission condition determining unit 42 is configured to determine, according to the network condition currently connected by the user terminal, whether the user terminal meets the offload transmission when the user terminal performs a video call. The data transmission unit 43 is configured to transmit the video data and the voice data in the video call of the user terminal through the WLAN and the ETURAN, respectively, when the user terminal meets the offload transmission condition.
所述分流传输条件判断单元42包括视频通话方式检测子单元421和网络连接检测子单元422,其中,视频通话方式设置单元41与所述视频通话方式检测子单元421连接。视频通话方式检测子单元421配置为判断所述用户终端是否设置为采用分流方式进行视频通话;网络连接检测子单元422配置为判断所述用户终端是否连接有可用的WLAN和ETURAN。The offload transmission condition determining unit 42 includes a video call mode detecting subunit 421 and a network connection detecting subunit 422, wherein the video call mode setting unit 41 is connected to the video call mode detecting subunit 421. The video call mode detecting sub-unit 421 is configured to determine whether the user terminal is configured to perform a video call by using a split mode; the network connection detecting sub-unit 422 is configured to determine whether the user terminal is connected to an available WLAN and ETURAN.
所述数据传输单元43包括视频获取子单元431、视频编解码子单元432、视频传输子单元433、语音获取子单元434、语音编解码子单元435和语音传输子单元436。其中,视频编解码子单元432分别与视频获取子单元431和视频传输子单元433连接,语音编解码子单元435分别与语音获取子单元434和语音传输子单元436连接。The data transmission unit 43 includes a video acquisition subunit 431, a video codec subunit 432, a video transmission subunit 433, a voice acquisition subunit 434, a speech codec subunit 435, and a voice transmission subunit 436. The video codec sub-unit 432 is connected to the video acquisition sub-unit 431 and the video transmission sub-unit 433, respectively, and the speech codec sub-unit 435 is connected to the speech acquisition sub-unit 434 and the voice transmission sub-unit 436, respectively.
视频获取子单元431配置为获取所述用户终端的视频通话中的视频数据;视频编解码子单元432配置为对获取到的视频数据进行编解码;视频传输子单元433配置为将编解码后的视频数据通过WLAN传输;语音获取子单元434配置为获取所述用户终端的视频通话中的语音数据;语音编解码子单元435配置为对获取到的语音数据进行编解码;语音传输子单元436配置为将编解码后的语音数据通过ETURAN传输。The video acquisition sub-unit 431 is configured to acquire video data in a video call of the user terminal; the video codec sub-unit 432 is configured to encode and decode the acquired video data; and the video transmission sub-unit 433 is configured to encode and decode the video data. The video data is transmitted through the WLAN; the voice acquisition sub-unit 434 is configured to acquire voice data in the video call of the user terminal; the voice codec sub-unit 435 is configured to encode and decode the acquired voice data; and the voice transmission sub-unit 436 is configured. In order to transmit the coded voice data through ETURAN.
实施例6 Example 6
本发明实施例的一种语音和视频分流传输的视频通话装置如图5所示,包括分流传输条件判断单元51和数据传输单元52,其中,分流传输条件判断单元51和数据传输单元52连接。分流传输条件判断单元51配置为在用户终端进行视频通话时,根据所述用户终端当前连接的网络情况,判断所述用户终端是否符合分流传输条件;数据传输单元52配置为当所述用户终端符合分流传输条件时,将所述用户终端的视频通话中的视频数据和语音数据分别通过WLAN和ETURAN传输。As shown in FIG. 5, a video call device for voice and video offload transmission according to an embodiment of the present invention includes a shunt transmission condition judging unit 51 and a data transmission unit 52, wherein the shunt transmission condition judging unit 51 and the data transmission unit 52 are connected. The offloading transmission condition determining unit 51 is configured to determine, according to the network condition currently connected by the user terminal, whether the user terminal meets the offload transmission condition when the user terminal performs a video call; the data transmission unit 52 is configured to be in compliance with the user terminal. When the transmission condition is offloaded, the video data and the voice data in the video call of the user terminal are transmitted through the WLAN and the ETURAN, respectively.
分流传输条件判断单元51包括资源检测子单元511和WLAN连接检测子单元512。资源检测子单元511配置为判断所述用户终端连接的ETURAN的资源是否充足;WLAN连接检测子单元512配置为判断所述用户终端是否连接有可用的WLAN。The shunt transmission condition judging unit 51 includes a resource detecting subunit 511 and a WLAN connection detecting subunit 512. The resource detection sub-unit 511 is configured to determine whether the resources of the ETURAN connected to the user terminal are sufficient; the WLAN connection detection sub-unit 512 is configured to determine whether the user terminal is connected to an available WLAN.
所述数据传输单元52包括视频获取子单元521、视频编解码子单元522、视频传输子单元523、语音获取子单元524、语音编解码子单元525和语音传输子单元526。其中,视频编解码子单元522分别与视频获取子单元521和视频传输子单元523连接,语音编解码子单元525分别与语音获取子单元524和语音传输子单元526连接。The data transmission unit 52 includes a video acquisition sub-unit 521, a video codec sub-unit 522, a video transmission sub-unit 523, a speech acquisition sub-unit 524, a speech codec sub-unit 525, and a voice transmission sub-unit 526. The video codec subunit 522 is connected to the video acquisition subunit 521 and the video transmission subunit 523, respectively, and the speech codec subunit 525 is connected to the voice acquisition subunit 524 and the voice transmission subunit 526, respectively.
视频获取子单元521配置为获取所述用户终端的视频通话中的视频数据;视频编解码子单元522配置为对获取到的视频数据进行编解码;视频传输子单元523配置为将编解码后的视频数据通过WLAN传输;语音获取子单元524配置为获取所述用户终端的视频通话中的语音数据;语音编解码子单元525配置为对获取到的语音数据进行编解码;语音传输子单元526配置为将编解码后的语音数据通过ETURAN传输。The video acquisition sub-unit 521 is configured to acquire video data in a video call of the user terminal; the video codec sub-unit 522 is configured to encode and decode the acquired video data; and the video transmission sub-unit 523 is configured to encode and decode the video data. The video data is transmitted through the WLAN; the voice acquisition sub-unit 524 is configured to acquire voice data in the video call of the user terminal; the voice codec sub-unit 525 is configured to encode and decode the acquired voice data; and the voice transmission sub-unit 526 is configured. In order to transmit the coded voice data through ETURAN.
实施例7Example 7
本发明实施例的一种提供语音和视频分流传输的服务器包括网络传输转换单元,配置为在与用户终端进行数据传输时,将在WLAN中传输的数据转换到ETURAN中进行传输,或者将在ETURAN中传输的数据转换到WLAN中进行传输。即服务器端必须有转换传输承载的能力,既可以将WLAN承载转换为EUTRAN,又可将EUTRAN承载转换为WLAN。本实施例中,音频、视频分流传输到服务器的示意图如图6所示,在视频通话内容中分离出视频 和音频,视频通过编解码后在WLAN或EUTRAN上传输到服务器,音频通过编解码后在EUTRAN上传输到服务器。其中,终端在视频通话过程中对于视频音频的采集本身就是有摄像头和话筒分开收集,传统的VOLTE视频通话也是分开传输的,但视频只能通过EUTRAN上传输到服务器。本实施例在传输视频信息上做了改进,增加了视频信息传输可以通过WLAN传输到服务器的结构,视频和音频信息最终汇总到服务器。A server for providing voice and video offload transmission according to an embodiment of the present invention includes a network transmission conversion unit configured to convert data transmitted in a WLAN to an ETURAN for transmission during data transmission with a user terminal, or to transmit in ETURAN The data transmitted in is converted to WLAN for transmission. That is, the server must have the ability to convert the transport bearer, which can convert the WLAN bearer into EUTRAN and convert the EUTRAN bearer into WLAN. In this embodiment, a schematic diagram of audio and video offload transmission to the server is shown in FIG. 6, and the video is separated in the video call content. And audio, the video is transmitted to the server on the WLAN or EUTRAN through codec, and the audio is transmitted to the server on the EUTRAN after being coded and decoded. Among them, the terminal collects video and audio separately during the video call, and the camera and the microphone are separately collected. The traditional VOLTE video call is also transmitted separately, but the video can only be transmitted to the server through the EUTRAN. This embodiment improves on the transmission of video information, increases the structure in which video information transmission can be transmitted to the server through WLAN, and the video and audio information are finally aggregated to the server.
实施例8Example 8
本发明实施例的一种主叫终端分流传输视频通话的发起流程如图7所示,包括以下步骤:As shown in FIG. 7 , a process for initiating a video call of a calling terminal to transmit a video call according to an embodiment of the present invention includes the following steps:
步骤s701,终端发起VOLTE视频通话。In step s701, the terminal initiates a VOLTE video call.
步骤s702,判断网络资源是否充足。如果是,则转步骤s705,否则转步骤s703。本实施例中,终端发起VOLTE视频通话之后,通过一系列测量和当前网络状况的信息获取来判断是否可以进行正常的承载,例如:当前网络带宽使用情况,资源分配情况,手机上报信息中,当前WLAN网络是否在运营商服务的合法范围,手机当前设置状态是否准许等。如果当前网络无法满足使用完全承载在EUTRAN上的VOLTE视频通话,则会下发给终端尝试进行视频分流方式的视频通话。In step s702, it is determined whether the network resource is sufficient. If yes, go to step s705, otherwise go to step s703. In this embodiment, after the terminal initiates a VOLTE video call, it determines whether a normal bearer can be performed through a series of measurements and information acquisition of the current network status, for example, current network bandwidth usage, resource allocation, and mobile phone reporting information, current Whether the WLAN network is within the legal scope of the carrier service, whether the current setting status of the mobile phone is permitted, and the like. If the current network cannot meet the VOLTE video call that is completely carried on the EUTRAN, the terminal will send a video call to the terminal to try the video offload mode.
步骤s703,判断是否满足进行分流传输的条件。如果是,则转步骤s704,否则转步骤s706。In step s703, it is judged whether or not the condition for performing the offload transmission is satisfied. If yes, go to step s704, otherwise go to step s706.
步骤s704,终端开始分流传输的视频通话。本实施例中,当终端和网络都判断当前环境可以进行语音和视频分流传输的视频通话,则分流传输的视频通话开始。In step s704, the terminal starts to offload the transmitted video call. In this embodiment, when both the terminal and the network determine that the current environment can perform video call for voice and video offload transmission, the video call of the offloaded transmission starts.
步骤s705,进行正常的承载在EUTRAN上的VOLTE视频通话。In step s705, a normal VOLTE video call carried on the EUTRAN is performed.
步骤s706,建立视频通话失败。本实施例中,当终端或者网络判断当前环境无法进行语音和视频分流传输的视频通话,则本次呼叫失败。In step s706, the video call fails to be established. In this embodiment, when the terminal or the network determines that the video call of the voice and video offload transmission cannot be performed in the current environment, the current call fails.
本实施例是主叫终端实现视频和音频分流功能的方法,现有的支持VOLTE和WLAN的终端在硬件上都可以满足本实施例所需要的要求。目前的上层控制协议也不需要进行大的改进,只是在建立承载的时候增加一种新 的承载方法,从而将原先的视频信号传输方式由经过EUTRAN改为通过WLAN方式传输到服务器;而音频信号传输方式不变,从而完成分流传输的功能。此承载方法可以由用户选择,或者网络判断条件后自动执行。可由当前网络用户数量、资源剩余情况、以及用户当前连接的wifi是否合法几个方面进行判断。当所有条件达到要求,则启动分流传输方式的VOLTE视频通话。This embodiment is a method for the calling terminal to implement the video and audio offloading function. The existing terminals supporting the VOLTE and the WLAN can meet the requirements required by the embodiment in hardware. The current upper layer control protocol does not need to be greatly improved, but a new one is added when the bearer is built. The bearer method is adopted, so that the original video signal transmission mode is changed from EUTRAN to WLAN to the server; and the audio signal transmission mode is unchanged, thereby completing the function of the offload transmission. This bearer method can be selected by the user or automatically executed after the network judges the condition. It can be judged by the number of current network users, the remaining resources, and whether the wifi currently connected by the user is legal. When all the conditions are met, the VOLTE video call of the offload transmission mode is started.
实施例9Example 9
本发明实施例的一种被叫终端分流传输视频通话的接受流程如图8所示,包括以下步骤:The receiving process of the called terminal for offloading the video call in the embodiment of the present invention is as shown in FIG. 8 and includes the following steps:
步骤s801,终端接收视频通话申请。In step s801, the terminal receives a video call application.
步骤s802,判断网络资源是否充足。如果是,则转步骤s805,否则转步骤s803。本实施例中,终端接收视频通话申请之后,通过一系列测量和当前网络状况的信息获取来判断是否可以进行正常的承载,例如:当前网络带宽使用情况,资源分配情况,手机上报信息中,当前WLAN网络是否在运营商服务的合法范围,手机当前设置状态是否准许等。如果当前网络无法满足使用完全承载在EUTRAN上的VOLTE视频通话,则会下发给终端尝试进行视频分流方式的接收视频通话。In step s802, it is determined whether the network resource is sufficient. If yes, go to step s805, otherwise go to step s803. In this embodiment, after receiving the video call request, the terminal determines whether the normal bearer can be performed through a series of measurements and information acquisition of the current network status, for example, current network bandwidth usage, resource allocation, and mobile phone reporting information. Whether the WLAN network is within the legal scope of the carrier service, whether the current setting status of the mobile phone is permitted, and the like. If the current network cannot meet the VOLTE video call that is completely carried on the EUTRAN, it will be sent to the terminal to try to receive video calls in the video offload mode.
步骤s803,判断是否满足进行分流传输的条件。如果是,则转步骤s804,否则转步骤s806。In step s803, it is judged whether or not the condition for performing the offload transmission is satisfied. If yes, go to step s804, otherwise go to step s806.
步骤s804,终端开始分流传输的视频通话。本实施例中,当终端和网络都判断当前环境可以进行语音和视频分流传输的视频通话,则分流传输的视频通话开始。In step s804, the terminal starts to offload the transmitted video call. In this embodiment, when both the terminal and the network determine that the current environment can perform video call for voice and video offload transmission, the video call of the offloaded transmission starts.
步骤s805,进行正常的承载在EUTRAN上的VOLTE视频通话。In step s805, a normal VOLTE video call carried on the EUTRAN is performed.
步骤s806,接收视频通话失败。本实施例中,当终端或者网络判断当前环境无法进行语音和视频分流传输的视频通话,则本次接收视频通话失败。In step s806, receiving the video call fails. In this embodiment, when the terminal or the network determines that the video call of the voice and video offload transmission cannot be performed in the current environment, the video call fails to be received this time.
本实施例是被叫终端实现视频和音频分流功能的方法,被叫终端判断当前网络状况如果网络良好,或者没有条件实现分流传输,则通知网络将接受方承载改为正常EUTRAN方式;如果可以实现分流传输,则服务器端将配 置传输方式为分流传输。此承载方法可以由用户选择,或者网络判断后自动执行。In this embodiment, the called terminal implements a video and audio offload function, and the called terminal determines the current network status. If the network is good, or the condition is not implemented, the network is notified to change the receiver bearer to the normal EUTRAN mode; Split transmission, the server will match The transmission mode is split transmission. This bearer method can be selected by the user or automatically executed after the network judges.
本发明实施例通过将视频通话中的视频数据和语音数据分别通过WLAN和ETURAN分流传输的方式,在LTE网络资源不足的情况下减少了VOLET视频通话占用LTE网络的带宽,保证了视频通话的质量,提升了视频通话呼叫成功率。In the embodiment of the present invention, the video data and the voice data in the video call are separately transmitted through the WLAN and the ETURAN, and the bandwidth of the LTE network occupied by the VOLET video call is reduced in the case of insufficient LTE network resources, thereby ensuring the quality of the video call. , improved the success rate of video call calls.
此外,本发明实施例还提供一种计算机可读存储介质,存储有计算机可执行指令,所述计算机可执行指令被处理器执行时实现上述的语音和视频分流传输的视频通话方法。In addition, an embodiment of the present invention further provides a computer readable storage medium storing computer executable instructions, the computer executable instructions being implemented by a processor to implement the video call method of the voice and video offload transmission.
本领域普通技术人员可以理解,上文中所公开方法中的全部或某些步骤、系统、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中,在以上描述中提及的功能模块/单元之间的划分不一定对应于物理单元的划分;例如,一个物理组件可以具有多个功能,或者一个功能或步骤可以由若干物理组件合作执行。某些组件或所有组件可以被实施为由处理器,如数字信号处理器或微处理器执行的软件,或者被实施为硬件,或者被实施为集成电路,如专用集成电路。这样的软件可以分布在计算机可读介质上,计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的,术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外,本领域普通技术人员公知的是,通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据,并且可包括任何信息递送介质。Those of ordinary skill in the art will appreciate that all or some of the steps, systems, and functional blocks/units of the methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical units; for example, one physical component may have multiple functions, or one function or step may be composed of several physical The components work together. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on a computer readable medium, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and nonvolatile, implemented in any method or technology for storing information, such as computer readable instructions, data structures, program modules or other data. Sex, removable and non-removable media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridge, magnetic tape, magnetic disk storage or other magnetic storage device, or may Any other medium used to store the desired information and that can be accessed by the computer. Moreover, it is well known to those skilled in the art that communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and can include any information delivery media. .
尽管为示例目的,已经公开了本申请的示例性实施例,本领域的技术人员将意识到各种改进、增加和取代也是可能的,因此,本申请的范围应当不限于上述实施例。 While the exemplary embodiments of the present application have been disclosed for illustrative purposes, those skilled in the art will recognize that various modifications, additions and substitutions are possible. Therefore, the scope of the present application should not be limited to the embodiments described above.
工业实用性Industrial applicability
本申请实施例提供一种语音和视频分流传输的视频通话方法和装置及服务器,通过将视频通话中的视频数据和语音数据分别通过WLAN和ETURAN分流传输的方式,在LTE网络资源不足的情况下减少了VOLET视频通话占用LTE网络的带宽,保证了视频通话的质量,提升了视频通话呼叫成功率。 The embodiment of the present invention provides a video call method and device for voice and video offload transmission, and a server, which is configured to transmit video data and voice data in a video call separately through WLAN and ETURAN, in case of insufficient LTE network resources. The VOLET video call reduces the bandwidth of the LTE network, ensures the quality of the video call, and improves the success rate of the video call.

Claims (13)

  1. 一种语音和视频分流传输的视频通话方法,包括:A video call method for voice and video offload transmission includes:
    在用户终端进行视频通话时,根据所述用户终端当前连接的网络情况,判断所述用户终端是否符合分流传输条件;When the user terminal performs a video call, determining whether the user terminal meets the offload transmission condition according to the network condition currently connected by the user terminal;
    当所述用户终端符合分流传输条件时,将所述用户终端的视频通话中的视频数据和语音数据分别通过无线局域网WLAN和演进通用陆地无线接入网ETURAN传输。When the user terminal meets the offload transmission condition, the video data and the voice data in the video call of the user terminal are respectively transmitted through the wireless local area network WLAN and the evolved universal terrestrial radio access network ETURAN.
  2. 如权利要求1所述的语音和视频分流传输的视频通话方法,其中,所述判断用户终端是否符合分流传输条件的过程包括:The video call method for voice and video offload transmission according to claim 1, wherein the process of determining whether the user terminal meets the offload transmission condition comprises:
    判断所述用户终端是否设置为采用分流方式进行视频通话;Determining whether the user terminal is configured to perform a video call by using a offloading manner;
    判断所述用户终端是否连接有可用的WLAN和ETURAN。It is determined whether the user terminal is connected to an available WLAN and ETURAN.
  3. 如权利要求2所述的语音和视频分流传输的视频通话方法,所述视频通话方法还包括:设置视频通话的方式,其中,所述视频通话的方式包括分流方式。The video call method for voice and video offload transmission according to claim 2, wherein the video call method further comprises: setting a video call mode, wherein the video call mode comprises a split mode.
  4. 如权利要求1所述的语音和视频分流传输的视频通话方法,其中,所述判断用户终端是否符合分流传输条件的过程包括:The video call method for voice and video offload transmission according to claim 1, wherein the process of determining whether the user terminal meets the offload transmission condition comprises:
    判断所述用户终端连接的ETURAN的资源是否充足;Determining whether the resources of the ETURAN connected to the user terminal are sufficient;
    判断所述用户终端是否连接有可用的WLAN。Determining whether the user terminal is connected to an available WLAN.
  5. 如权利要求4所述的语音和视频分流传输的视频通话方法,其中,所述判断所述用户终端连接的ETURAN的资源是否充足,包括:The video call method for voice and video offload transmission according to claim 4, wherein the determining whether the resource of the ETURAN connected to the user terminal is sufficient includes:
    根据所述ETURAN的当前网络用户数量和资源剩余情况,判断所述ETURAN的资源是否充足。Whether the resources of the ETURAN are sufficient according to the current network user number and resource remaining condition of the ETURAN.
  6. 如权利要求4所述的语音和视频分流传输的视频通话方法,其中,所述判断用户终端是否连接有可用的WLAN包括:The video call method for voice and video offload transmission according to claim 4, wherein the determining whether the user terminal is connected to the available WLAN comprises:
    判断所述用户终端当前连接的WLAN是否在运营商服务的合法范围内。Determining whether the WLAN currently connected to the user terminal is within the legal range of the operator service.
  7. 如权利要求1至6任一项所述的语音和视频分流传输的视频通话方法,其中,所述视频通话中的视频数据通过WLAN传输,所述视频通话中的 语音数据通过ETURAN传输。The video call method for voice and video offload transmission according to any one of claims 1 to 6, wherein the video data in the video call is transmitted through a WLAN, in the video call Voice data is transmitted via ETURAN.
  8. 一种语音和视频分流传输的视频通话装置,包括:A video communication device for voice and video offload transmission, comprising:
    分流传输条件判断单元,配置为在用户终端进行视频通话时,根据所述用户终端当前连接的网络情况,判断所述用户终端是否符合分流传输条件;The offloading transmission condition determining unit is configured to determine, according to the network condition currently connected by the user terminal, whether the user terminal meets the offload transmission condition when the user terminal performs a video call;
    数据传输单元,配置为当所述用户终端符合分流传输条件时,将所述用户终端的视频通话中的视频数据和语音数据分别通过无线局域网WLAN和演进通用陆地无线接入网ETURAN传输。And a data transmission unit configured to transmit the video data and the voice data in the video call of the user terminal through the wireless local area network WLAN and the evolved universal terrestrial radio access network ETURAN, respectively, when the user terminal meets the offload transmission condition.
  9. 如权利要求8所述的语音和视频分流传输的视频通话装置,其中,所述分流传输条件判断单元包括:The video communication device for voice and video offload transmission according to claim 8, wherein the offload transmission condition determination unit comprises:
    视频通话方式检测子单元,配置为判断所述用户终端是否设置为采用分流方式进行视频通话;a video call mode detecting subunit, configured to determine whether the user terminal is configured to perform a video call by using a offloading manner;
    网络连接检测子单元,配置为判断所述用户终端是否连接有可用的WLAN和ETURAN。The network connection detecting subunit is configured to determine whether the user terminal is connected to the available WLAN and ETURAN.
  10. 如权利要求9所述的语音和视频分流传输的视频通话装置,所述视频通话装置还包括:The video communication device for voice and video offload transmission according to claim 9, wherein the video communication device further comprises:
    视频通话方式设置单元,与所述视频通话方式检测子单元连接,配置为设置视频通话的方式。The video call mode setting unit is connected to the video call mode detecting subunit and configured to set a video call mode.
  11. 如权利要求8所述的语音和视频分流传输的视频通话装置,其中,所述分流传输条件判断单元包括:The video communication device for voice and video offload transmission according to claim 8, wherein the offload transmission condition determination unit comprises:
    资源检测子单元,配置为判断所述用户终端连接的ETURAN的资源是否充足;a resource detecting subunit configured to determine whether the resources of the ETURAN connected to the user terminal are sufficient;
    WLAN连接检测子单元,配置为判断所述用户终端是否连接有可用的WLAN。The WLAN connection detecting subunit is configured to determine whether the user terminal is connected to an available WLAN.
  12. 如权利要求8至11任一项所述的语音和视频分流传输的视频通话装置,其中,所述数据传输单元包括:The video communication device for voice and video offload transmission according to any one of claims 8 to 11, wherein the data transmission unit comprises:
    视频获取子单元,配置为获取所述用户终端的视频通话中的视频数据;a video acquisition subunit configured to acquire video data in a video call of the user terminal;
    视频编解码子单元,与所述视频获取子单元连接,配置为对获取到的视 频数据进行编解码;a video codec subunit, connected to the video acquisition subunit, configured to obtain the view Frequency data is encoded and decoded;
    视频传输子单元,与所述视频编解码子单元连接,配置为将编解码后的视频数据通过WLAN传输;a video transmission subunit, connected to the video codec subunit, configured to transmit the coded video data through a WLAN;
    语音获取子单元,配置为获取所述用户终端的视频通话中的语音数据;a voice acquisition subunit configured to acquire voice data in a video call of the user terminal;
    语音编解码子单元,与所述语音获取子单元连接,配置为对获取到的语音数据进行编解码;a voice codec subunit, connected to the voice acquisition subunit, configured to encode and decode the obtained voice data;
    语音传输子单元,与所述语音编解码子单元连接,配置为将编解码后的语音数据通过ETURAN传输。The voice transmission subunit is connected to the voice codec subunit and configured to transmit the coded voice data through the ETURAN.
  13. 一种提供语音和视频分流传输的服务器,包括:A server that provides voice and video offload transmission, including:
    网络传输转换单元,配置为在与用户终端进行数据传输时,将在无线局域网WLAN中传输的数据转换到演进通用陆地无线接入网ETURAN中进行传输,或者将在ETURAN中传输的数据转换到WLAN中进行传输。 a network transmission conversion unit configured to convert data transmitted in the wireless local area network WLAN to an Evolved Universal Terrestrial Radio Access Network (ETURAN) for transmission during data transmission with the user terminal, or to convert data transmitted in the ETURAN to the WLAN Transfer in.
PCT/CN2017/072975 2016-09-26 2017-02-06 Audio and video data offloading transmission method and device for video call, and server WO2018053987A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610850632.6 2016-09-26
CN201610850632.6A CN107872733A (en) 2016-09-26 2016-09-26 The video call method and device and server of voice and video shunting transmission

Publications (1)

Publication Number Publication Date
WO2018053987A1 true WO2018053987A1 (en) 2018-03-29

Family

ID=61690086

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/072975 WO2018053987A1 (en) 2016-09-26 2017-02-06 Audio and video data offloading transmission method and device for video call, and server

Country Status (2)

Country Link
CN (1) CN107872733A (en)
WO (1) WO2018053987A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112399128A (en) * 2020-11-16 2021-02-23 明磊 Video communication system and method based on big data

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115002920B (en) * 2022-08-01 2022-11-04 易联科技(深圳)有限公司 Mobile terminal signal enhancement method and device, computer equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103202013A (en) * 2010-08-05 2013-07-10 岩星社团美国有限公司 Web based access to video content associated with voicemail
CN104010156A (en) * 2013-02-22 2014-08-27 广达电脑股份有限公司 Video conference establishing method
CN104066121A (en) * 2013-03-22 2014-09-24 华为终端有限公司 Stream dividing method, device and system of wireless local area network
CN104967810A (en) * 2015-06-30 2015-10-07 努比亚技术有限公司 Call mode conversion method and terminal device
WO2016037642A1 (en) * 2014-09-09 2016-03-17 Telefonaktiebolaget L M Ericsson (Publ) Handover from 3gpp to untrusted non-3gpp access based on measured communication path characteristics
CN105898794A (en) * 2016-04-08 2016-08-24 努比亚技术有限公司 Device and method of transmitting data

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110222523A1 (en) * 2010-03-12 2011-09-15 Mediatek Inc Method of multi-radio interworking in heterogeneous wireless communication networks
CN102215530A (en) * 2011-05-27 2011-10-12 上海华为技术有限公司 Data flow transmission method and related equipment and system
CN103563355B (en) * 2011-06-10 2017-11-14 汤姆逊许可公司 Video-telephone system
CN103581604A (en) * 2012-08-01 2014-02-12 希姆通信息技术(上海)有限公司 Video call device and method
WO2014112826A1 (en) * 2013-01-20 2014-07-24 Lg Electronics Inc. Method and terminal for determining handover for traffic offloaded onto wlan
WO2015126160A1 (en) * 2014-02-20 2015-08-27 Samsung Electronics Co., Ltd. Video telephony service quality enhancement method and apparatus
CN103841584A (en) * 2014-02-27 2014-06-04 汉柏科技有限公司 Data transmission method and device
CN105451097B (en) * 2014-09-24 2018-09-11 中国电信股份有限公司 Video playing control method and device, mobile terminal

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103202013A (en) * 2010-08-05 2013-07-10 岩星社团美国有限公司 Web based access to video content associated with voicemail
CN104010156A (en) * 2013-02-22 2014-08-27 广达电脑股份有限公司 Video conference establishing method
CN104066121A (en) * 2013-03-22 2014-09-24 华为终端有限公司 Stream dividing method, device and system of wireless local area network
WO2016037642A1 (en) * 2014-09-09 2016-03-17 Telefonaktiebolaget L M Ericsson (Publ) Handover from 3gpp to untrusted non-3gpp access based on measured communication path characteristics
CN104967810A (en) * 2015-06-30 2015-10-07 努比亚技术有限公司 Call mode conversion method and terminal device
CN105898794A (en) * 2016-04-08 2016-08-24 努比亚技术有限公司 Device and method of transmitting data

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112399128A (en) * 2020-11-16 2021-02-23 明磊 Video communication system and method based on big data

Also Published As

Publication number Publication date
CN107872733A (en) 2018-04-03

Similar Documents

Publication Publication Date Title
US11497076B2 (en) Service processing method and service processing apparatus
KR101446028B1 (en) Method and device for handing over video call from packet switched domain to circuit switched domain
US8804661B2 (en) Method of handling call in handover in wireless communication system and wireless communication device using the same
US9635531B2 (en) Method and system for transmitting media preference information with respect to emergency call in mobile communication system
CN106301679B (en) Method and device for adjusting service rate
WO2017147959A1 (en) Service carrying method, communication terminal, control element s-cscf and system
KR102093485B1 (en) Apparatus and method for providing service access control in packet data communication system
US10206146B2 (en) Techniques for handout of an active session from a first network to a second network
TWI697247B (en) Device and method of handling a connection in a wireless communication system
WO2014127649A1 (en) Method for controlling service, mobile management entity and mobile switching centre
WO2021227683A1 (en) Radio connection reconstruction method and apparatus, terminal, and storage medium
CN110881193A (en) Measurement method, terminal and network equipment for voice call-back
WO2018053987A1 (en) Audio and video data offloading transmission method and device for video call, and server
EP4027694A1 (en) Method and device for playing video media
CN114828105A (en) Method and device for controlling service quality
JP2023547080A (en) Connection establishment method, device, communication equipment and storage medium
US8982840B2 (en) Handover
CN115834549B (en) Call switching method, device, electronic equipment and computer readable medium
CN115280802A (en) Multicast communication method and communication device
US10575343B2 (en) Communication method and apparatus
KR102160998B1 (en) Apparatus and method for providing service access control in packet data communication system
CN110915291B (en) Voice session establishing method, device, equipment and storage medium
KR102199271B1 (en) Method and apparatus for processing call
KR101577739B1 (en) Method and apparatus for controlling user equipment for additional service
KR102121970B1 (en) Method and apparatus for processing call

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17852067

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17852067

Country of ref document: EP

Kind code of ref document: A1