WO2017071309A1

WO2017071309A1 - Video call system, device and method

Info

Publication number: WO2017071309A1
Application number: PCT/CN2016/090337
Authority: WO
Inventors: 车晓东; 谭焕清; 姚再英; 何坚
Original assignee: 努比亚技术有限公司
Priority date: 2015-10-28
Filing date: 2016-07-18
Publication date: 2017-05-04
Also published as: CN105516635B; CN105516635A

Abstract

Disclosed are a video call system, device and method. The method comprises: connecting a first LTE network, and establishing a first communication channel; establishing a video call connection with an opposite end via the first LTE network, and transmitting call data via the first communication channel; connecting a second LTE network, and establishing a second communication channel in a video call process when a pre-set condition is met; and transmitting the call data via the first communication channel and the second communication channel. The beneficial effects of implementing the present invention are enlarging the network bandwidth, improving the data transmission rate, and improving the video call quality by starting using two 4G networks in a video call process for simultaneously transmitting call data. Even if a signal in the first 4G network is relatively weak, the second 4G network can also be used jointly for guaranteeing the video call quality, thereby improving the flexibility of a video call and the intelligentized level of a mobile terminal, and improving the video call experience of a user.

Description

Video call system, device and method

Technical field

The present invention relates to the field of communications technologies, and more particularly to a video calling system, apparatus and method.

Background technique

With the rapid development of communication technology, mobile communication networks have evolved from second-generation (2G) networks to third-generation (3G) networks to current fourth-generation (4G) networks, and the corresponding data transmission rates are increasing. Fast, starting from the 3G network, you can already support video calls.

In the current 4G network, the Long Term Evolution (LTE) network has been widely used, and it is the fastest mobile communication network with the current network speed. The mobile terminal can use the LTE network for IMS-based voice service (VOLTE, Voice Over). LTE) video call. VOLTE is an IP data transmission technology that enables data and voice services to be unified under the same network. In the existing VOLTE video call, both parties of the session process the image through the camera function of the mobile terminal and the IP Multimedia Subsystem (IMS, IP Multimedia Subsystem) protocol stack, so that the other party can clearly see the picture.

On the other hand, multimode terminals (terminals with two subscriber identity modules, such as dual-card dual-link terminals) have become more widely used while increasing network speed and frequency band utilization.

However, existing multimode terminals can only implement one of the subscriber identity modules using 4G (eg, LTE) networks and their data services, while the other identity module can only use 3G/2G services. Therefore, when using VOLTE video calls, only one LTE network can be used for video calls.

Since the voice and image are to be transmitted simultaneously during the video call, the signal strength of the LTE network needs to meet certain requirements. If the LTE network signal is poor, the call quality is difficult to guarantee, and it is prone to break or video jam.

Therefore, the reliability and stability of the existing mobile terminal video call are poor, and the call quality is not high.

Summary of the invention

The main purpose of embodiments of the present invention is to provide a video call system, apparatus, and method, which are directed to improving video call quality of a mobile terminal.

The technical solution adopted by the present invention to solve the technical problem thereof is:

The first aspect provides a video calling method, which is applied to a mobile terminal, and includes:

Connecting the first LTE network to establish a first communication channel;

Establishing a video call connection with the peer end by using the first LTE network, and transmitting call data by using the first communication channel;

During the video call, when the preset condition is met, the second LTE network is connected to establish a second communication channel;

The call data is transmitted through the first communication channel and the second communication channel.

In an embodiment, the method further includes:

During the video call, when it is detected that there is a reliable second LTE network signal, and it is detected that the first LTE network signal is weak, the first setting is detected, or the first user instruction is received, it is determined that the preset condition is met.

In an embodiment, the transmitting the call data by using the first communication channel and the second communication channel includes:

And distributing, according to a signal strength of the first LTE network and the second LTE network, the call data stream between the first communication channel and the second communication channel to pass the first communication The channel and the second communication channel transmit the call data.

In an embodiment, the step of distributing the call data stream between the first communication channel and the second communication channel is further included:

Obtaining a destination address from a packet data packet of a call data stream of the first communication channel, and Copying the destination address to a packet data packet of a call data stream of the second communication channel.

In an embodiment, the method further includes:

Receiving, according to the ratio, call data sent by the opposite end by using the first communication channel and the second communication channel, respectively;

The call data received through the first communication channel and the second communication channel is synthesized and output.

In an embodiment, the mobile terminal comprises:

a first processing chip, including an application service module and a first protocol stack;

a second processing chip, including a second protocol stack communicatively coupled to the first processing chip;

a first user identification card connected to the first processing chip;

a first radio frequency, connected to the first processing chip;

a second user identification card connected to the second processing chip;

a second radio frequency, connected to the second processing chip;

The application service module is configured to receive an operation instruction of a user, and the control signal is transmitted in the first LTE network via the first protocol stack and the first radio frequency;

The application service module is further configured to receive an operation instruction of the user, and the control signal is transmitted in the second LTE network via the second protocol stack and the second radio frequency;

The operation instruction includes information for performing a video call by using the first user identification card and/or the second user identification card.

The second aspect provides a video calling device, which is applied to a mobile terminal, and includes:

a first communication module, configured to connect to the first LTE network, and establish a first communication channel;

a video call module, configured to establish a video call connection with the opposite end by using the first LTE network, and transmit call data by using the first communication channel;

The second communication module is configured to determine whether the preset condition is met during the video call; when the preset condition is met, connecting the second LTE network to establish a second communication channel;

The video call module is further configured to: after the second communication module establishes the second communication channel, transmit the call data through the first communication channel and the second communication channel.

In one embodiment, the second communication module includes a determination unit and a channel establishment unit, wherein:

The determining unit is configured to: when it is detected that there is a reliable second LTE network signal, and the second LTE network signal is detected to be weak, the first setting is detected, or the first user instruction is received, determining that the preset condition is met ;

The channel establishing unit is configured to connect to the second LTE network and establish a second communication channel when the determining unit determines that the preset condition is met.

In an embodiment, the video call module is further configured to:

After the second communication channel is established, the first communication channel and the second communication channel are distributed proportionally according to signal strengths of the first LTE network and the second LTE network. Call data stream.

In an embodiment, the video call module further includes an address obtaining module, and the address obtaining module is configured to:

Obtaining a destination address from a packet data packet of the call data stream of the first communication channel, and copying the destination address in a packet data packet of a call data stream of the second communication channel.

In one embodiment, the first communication channel is an IMS channel and the second communication channel is an IMS channel.

In a third aspect, a video calling system includes a first mobile terminal and a second mobile terminal, wherein the first mobile terminal and the second mobile terminal are in communication connection, wherein:

The first mobile terminal is configured to establish a video call connection with the second mobile terminal, establish a first communication channel and a second communication channel by using the first LTE network and the second LTE network, by using the first communication channel and Transmitting, by the second communication channel, call data;

The second mobile terminal is configured to establish a video call connection with the first mobile terminal, and establish a first communication channel or/and a second communication channel by using the first LTE network or/and the second LTE network, by using the A communication channel or/and the second communication channel transmits call data.

In one embodiment, the first communication channel is an IMS channel, and the second communication channel For the IMS channel.

In an embodiment, the first mobile terminal is further configured to:

And distributing, according to a signal strength of the first LTE network and the second LTE network, a call data flow between the first communication channel and the second communication channel to pass the first communication channel and The second communication channel transmits call data.

A fourth aspect provides a video communication device, which is applied to a relay server, and includes:

a receiving module configured to receive call data;

a parsing module configured to parse a channel type of a destination address in the call data;

a processing module, configured to determine, according to the channel type, whether to perform data conversion on the call data and forward the call data through a corresponding communication channel;

The communication channel includes a first communication channel established through the first LTE network and a second communication channel established through the second LTE network.

In one embodiment, the communication channel further includes a third communication channel established over a wireless local area network.

In one embodiment, the parsing module is further configured to parse the amount of data of the call data received through the first communication channel and the second communication channel;

The processing module is further configured to determine a transmission ratio according to the amount of data received by the first communication channel and the second communication channel, and forward the corresponding call data to the first communication channel and the second communication channel according to the determined transmission ratio .

A fifth aspect provides a video calling method, which is applied to a transit server, and includes:

Receiving call data;

Parsing a channel type of the destination address in the call data;

Determining, according to the channel type, whether to perform data conversion on the call data and forwarding the call data through a corresponding communication channel;

The communication channel includes a communication channel including a first communication channel established through the first LTE network and a second communication channel established through the second LTE network.

In one embodiment, the communication channel further includes a third communication channel established through a wireless local area network;

The first communication channel is an IMS channel, the second communication channel is an IMS channel, the third communication channel is an internet channel, the IMS channel transmits IMS type call data, and the internet channel transmits an internet type call. Data, the channel type includes an IMS channel and an internet channel, and when the type of the call data is inconsistent with the channel type of the destination address of the call data, data conversion is performed on the call data.

A sixth aspect provides a video calling method, which is applied to a mobile terminal, and includes:

Connecting the first 4G network to establish a first communication channel;

Establishing a video call connection with the opposite end by using the first 4G network, and transmitting call data through the first communication channel;

During the video call, when the preset condition is met, the second 4G network is connected to establish a second communication channel;

The video call system, apparatus and method for implementing the embodiments of the present invention have the following beneficial effects: by enabling two 4G networks during a video call and transmitting call data at the same time, the network bandwidth is expanded, the data transmission rate is improved, and the video is improved. conversation quality. Even if the first 4G network signal is weak, the second 4G network can be jointly used to ensure video call quality, the flexibility of the video call and the intelligent level of the mobile terminal are improved, and the video call experience of the user is improved.

DRAWINGS

The present invention will be further described below in conjunction with the accompanying drawings and embodiments, in which:

1 is a schematic diagram of an optional hardware structure of a mobile terminal embodying various embodiments of the present invention;

2 is a schematic diagram of a network architecture of a mobile communication system where a mobile terminal is located according to an embodiment of the present invention;

3 is a flowchart of a first embodiment of a video call method according to the present invention;

4 is a schematic diagram of a data structure of a data packet according to an embodiment of the present invention;

FIG. 5 is a flowchart of a second embodiment of a video call method according to the present invention; FIG.

6 is a schematic diagram of interaction of each unit module in a mobile terminal during a video call according to an embodiment of the present invention;

FIG. 7 is a schematic block diagram of an embodiment of a video communication device according to the present invention; FIG.

8 is a block diagram of a second communication module of FIG. 7;

9 is a schematic block diagram of an embodiment of a video call system according to the present invention;

FIG. 10 is a schematic diagram of interaction between two mobile terminals in establishing a video call connection according to an embodiment of the present invention;

11 is a schematic diagram of interaction between entities in a first embodiment of the video call system of the present invention during a video call;

12 is a schematic diagram of interaction between entities in a second embodiment of the video call system of the present invention during a video call;

FIG. 13 is a schematic diagram of interaction of each subject in a video call process according to a third example of the video call system of the present invention; FIG.

FIG. 14 is a schematic block diagram of an embodiment of a video communication device applied to a relay server according to the present invention.

detailed description

In order to solve the technical problem that the reliability and stability of the video call of the mobile terminal are poor and the call quality is not high, the embodiment of the invention provides a video call system, device and method, and simultaneously transmits video by providing two LTE channels. The call data of the call has achieved the technical effect of expanding the network bandwidth, increasing the data transmission rate, and improving the quality of the video call.

The general idea of the above technical problem is to connect the first mobile communication network, establish a first communication channel, connect the second mobile communication network, and establish a second communication channel; The call data is transmitted through the first communication channel and the second communication channel. In an embodiment of the invention, the first mobile communication network and the second mobile communication network are both LTE networks.

For a better understanding of the technical features, objects and effects of the present invention, the embodiments of the present invention are described in detail with reference to the accompanying drawings.

The mobile terminal of the embodiment of the present invention supports dual LTE communication, and the principle thereof will be described in detail below with reference to FIGS.

FIG. 1 is an schematic structural diagram of a mobile terminal according to a first embodiment of the present invention. Referring to FIG. 1, a mobile terminal according to an embodiment of the present invention includes: a first processing chip 200, a second processing chip 300, a first radio frequency 205, a second radio frequency 305, a first user identification card 206, and a second user identification card 306. The codec 204, the first logic switch 401, the second logic switch 402, the camera 600, and the microphone 500. The first processing chip 200 includes an application processing module 202, a digital signal processing chip 203, and a first protocol stack 201. The second processing chip includes a second protocol stack 301.

It should be understood that the digital signal processing chip 203 can also be implemented by a chip that is independent of the first processing chip 200.

The first processing chip 200 and the second processing chip 300 are connected through a serial port (USB) and a GPIO/SDIO port to implement definition and transmission of control signals between the two processing chips, for example, performing sleep of two processing chips. Wake-up, synchronization control, control of the chip startup sequence when switching on and off, etc.

Through the serial port (USB), the application processing module 202 and the second protocol stack 301 perform control signal and data transmission.

The two protocol stacks (the first protocol stack 201 and the second protocol stack 301) in the implementation of the present invention are all driven and configured and controlled by the application processing module 202.

The user identification card (the first user identification card 206 and the second user identification card 306) is used for connection and information exchange with the user equipment, and provides correlations required for mobile communication services (CS voice service, PS data service, and PS voice service). Data, and store user information, short messages, and executions in it Line authentication algorithm and generation of encryption keys.

When the user identification card interacts with the user equipment, the signal for detecting the presence or absence of the user identification card is generated only at the instant of power-on. When the user does not detect the presence of the user identification card, the user will be prompted to insert the user identification card. After the user equipment is powered on, the user equipment and the subscriber identity card communicate once every 28 seconds to complete some fixed communication checks (eg, whether the subscriber identity card is in place, etc.).

The first user identification card 206 and the second user identification card 306 can manage different users associated with different or the same technical standards. In a specific, non-limiting example, the technical standards may be 2G communication technologies (eg, GSM, GPRS, EDGE), 3G communication technologies (eg, WCDMA, TDS-CDMA), 4G communication technologies (eg, LTE, TD-LTE) , or any other mobile communication technology (eg, 4G, 4.5G, etc.).

The radio access technologies involved in the first radio frequency 205 and the second radio frequency 305 may include LTE, GSM, GPRS, CDMA, EDGE, WLAN, CDMA-2000, TD-SCDMA, WCDMA, WIFI, and the like.

In the embodiment of the present invention, the technical standards managed by the first user identification card 206 and the second user identification card 306 are all LTE standards, and the radio access technologies involved in the first radio frequency 205 and the second radio frequency 305 are LTE. Therefore, the user equipment of the embodiment of the present invention supports dual LTE.

The internal framework of the application processing module 202 includes an application layer, a framework layer, and the like, and can handle complex logical operations and task assignments. In one embodiment, the application processing module 202 refers to the Android operating system, as well as various apks based on the Android operating system.

In an embodiment of the present invention, the application processing module 202 provides an interaction interface for the user, and transmits an operation instruction input by the user (for example, an operation instruction input by the user through the user interface regarding starting a video call) to the first protocol stack 201 or The second protocol stack 301.

The first protocol stack 201 and the second protocol stack 301 include various network protocol stacks that interact with the network, for example, protocol codes specified in communication standards such as LTE/WCDMA/GSM/TDSCDMA/1X/CDMA/EVDO. These standard protocols are for user equipment to interact with the carrier network (for example, through data traffic, via VOLTE video calls, or through CS circuit domains). Calling, etc.) must be followed.

Camera 600 includes suitable hardware, logic, circuitry, and/or code for acquiring image signals.

Microphone 500 includes suitable hardware, logic, circuitry, and/or code for acquiring voice signals or outputting sound signals. In addition, the mobile terminal of the embodiment of the present invention further includes a display screen (not shown in FIG. 1) for displaying image information.

Codec 204 includes appropriate hardware, logic, circuitry, and/or code for A/D and D/A conversion.

The digital signal processing chip 203 includes appropriate hardware, logic, circuitry, and/or code for audio signal processing, such as echo suppression, noise suppression, etc. during audio processing, and for image signal processing. .

The first radio frequency 205 is used to transmit signals to the base station network (eNodeB) and to receive signals transmitted by the base station network.

The second radio frequency 305 is used to transmit signals to the base station network (eNodeB) and to receive signals transmitted by the base station network. The first logic switch 401 is respectively connected to the first processing chip 200 and the first user identification card 206 for enabling the first user identification card 206 and the first protocol under the control of the first control instruction output by the first processing chip 200. The stack 201 or the second protocol stack 301 is connected.

The second logic switch 402 is connected to the first processing chip 200 and the second user identification card 306 respectively for enabling the second user identification card 306 and the first protocol under the control of the second control instruction output by the first processing chip 200. The stack 201 or the second protocol stack 301 is connected.

In one embodiment, the first processing chip 200 implements control of the first logic switch 401 and the second logic switch 402 by outputting a high level. For example, when outputting a high level, the first logic switch 401 is turned on, so that the first subscriber identity card 206 is connected to the first protocol stack 201; and when the low level is output, the first subscriber identity card 206 is connected to the second protocol stack 301. . Or when the output level is high, the second logic switch 401 is turned on to connect the second subscriber identity card 306 with the first protocol stack 201; and when the low level is output, the second subscriber identity card 306 is connected to the second protocol stack 301.

In an embodiment of the present invention, if the first subscriber identity card 206 is connected to the first protocol stack 201, the first subscriber identity card 206 may reside in the PS of the first mobile communication network through the first protocol stack 201 (Packet). Switching, packet switching) domain and CS (Circuit Switching) domain. Thus, the first subscriber identity card 206 can perform CS voice and PS data services over the first mobile communication network.

Similarly, if the second subscriber identity card 306 is connected to the first protocol stack 201, the second subscriber identity card 306 can reside in the PS domain and the CS domain of the first mobile communication network through the first protocol stack 201. Thus, the second subscriber identity card 306 can perform CS voice and PS data traffic over the first mobile communication network.

If the first subscriber identity card 206 establishes a connection with the second protocol stack 301, the first subscriber identity card 206 can reside in the PS domain of the second mobile communication network via the second protocol stack 301. Thus, the first subscriber identity card 206 can perform PS data services over the second mobile communication network.

Similarly, if the second subscriber identity card 306 establishes a connection with the second protocol stack 301, the second subscriber identity card 306 can reside in the PS domain of the second mobile communication network through the second protocol stack 301. Thus, the second subscriber identity card 306 can perform PS data services over the second mobile communication network.

The first mobile communication network and the second mobile communication network may be different networks of different operators, or may be different or the same network of the same operator. In one embodiment of the invention, both the first mobile communication network and the second mobile communication network are 4G networks (e.g., LTE networks).

2 is a schematic diagram of a network architecture of a mobile communication system where a mobile terminal is located according to an embodiment of the present invention. The network architecture includes: the mobile terminal 100, the E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) (not labeled in the figure), and the Evolved Packet Core (EPC) (not labeled in the figure) , Home Subscriber Server (HSS) 107, network (eg, Internet) (not labeled in the figure), and circuit switched system (not labeled in the figure). The E-UTRAN includes an evolved Node B (eNodeB) 101 and other eNodeBs 102.

The eNodeB 101 is connected to the EPC through the S1 interface. The EPC includes a Mobility Management Entity (EEM) 104, other Mobility Management Entities 106, a Serving Gateway 103, and a Packet Data Network (PDN). Gateway 105. The mobility management entity 104 is a control node that handles signaling between the user equipment 100 and the EPC. The mobility management entity 104 provides bearer and connection management. All user IP packets are passed through the Serving Gateway 103, which itself is connected to the PDN Gateway 105. The PDN Gateway 105 provides UE IP address allocation as well as other functions. The PDN Gateway 105 is connected to a network, such as the Internet.

The circuit switched system includes an Interaction Solution Module (IWS) 108, a Mobile Switching Center (MSC) 109, a base station 110, and a mobile station 111. In one aspect, the circuit switched system can communicate with the EPS through the IWS and the MME.

It should be understood that the specific implementation principles and details of the dual LTE mobile terminal (shown in FIG. 1) of the first embodiment may refer to the invention as "user equipment, wireless communication method, network node, and access terminal", and the application number is 201510641418.5. The invention patent application does not repeat the principles and details herein. In addition, the specific implementation principle and details of the dual LTE mobile terminal may also refer to the invention patent application entitled "User Equipment, Wireless Communication Method and Terminal", Application No. 201510675596.X, and the invention name "User Equipment, Wireless Communication Method" , terminal and network node", the invention patent application with the application number 201510671407.1.

Based on the hardware structure of the mobile terminal shown in FIG. 1 above, various embodiments of the video call method of the present invention are proposed.

As shown in FIG. 3, a first embodiment of a video call method according to the present invention is provided. The method is applied to the mobile terminal 100. In the embodiment of the present invention, a video call (VOLTE) is performed through dual LTE, and the first protocol stack 201 is used. Both the second protocol stack 301 and the second protocol stack 301 support PS data service transmission. Therefore, no matter whether the user performs a video call through the first subscriber identity card 206 or the second subscriber identity card 306, there is no need to perform a handover connection through a logical switch. Therefore, in the video calling method of the embodiment of the present invention, the first processing chip 200 outputs a control signal such that the first user identification card 206 is connected to the first protocol stack 201, and the second user identification card 306 and the second protocol stack 301 are connected. connection.

If the user initiates a video call through the first subscriber identity card 206, the method includes the following steps:

S11. Connect to the first mobile communication network to establish a first communication channel.

In the embodiment of the present invention, the first mobile communication network refers to a 4G communication network based on a subscriber identity card. Among them, 4G networks such as LTE. The type of the first communication channel is preferably an IMS channel, although other types of channels can be established as needed.

S12. Establish a video call connection with the peer end through the first mobile communication network, and transmit the call data through the first communication channel. During the video call, it is determined whether the preset condition is met, and when the preset condition is met, step S13 is performed.

Specifically, when the user performs video call dialing, the first protocol stack 201 and the first radio frequency 205 are sent to the opposite end to send a video call request to establish a video call connection with the peer end.

After the video call connection is established, the sound signal and the image signal are respectively collected by the microphone 500 and the camera 600, processed by the codec 204, and then transmitted to the digital signal processing chip (ADSP) 203 for processing to form the call data in the data packet format; The processing module 202 (APP processor) allocates the call data to the first protocol stack, and after the first protocol stack 201 performs the processing such as the packet header, the first radio frequency 205 is sent out, and the first radio frequency 205 is received. The call data returned by the terminal. The call data includes audio data and video data. The received call data is processed by the first protocol stack 201, the digital signal processing chip 203, and the codec 204, and then the sound signal is output through the microphone 500, and the image signal is displayed through the display screen.

Wherein, when establishing a video call connection, the mobile terminals of both parties of the call are assigned an IP address. Relatively speaking, the IP address of the local end is the source address, the IP address of the opposite end is the destination address, and the data packet of the call data (header) Contains source and destination addresses.

During the video call, you can determine whether the preset conditions are met by the following methods:

In an embodiment, when a reliable second mobile communication network signal is detected (eg, the signal strength is greater than a threshold), then it is determined that the preset condition is met.

In an embodiment, when a reliable second mobile communication network signal is detected (eg, the signal strength is greater than a threshold) and the first mobile communication network signal is weak (eg, the signal strength is less than a threshold), then it is determined that the preset condition is met. Or, when it is detected that the first mobile communication network signal is weak, and there is a When the mobile communication network signal is used, it is determined that the preset condition is satisfied.

In an embodiment, when a reliable second mobile communication network signal is detected (eg, the signal strength is greater than a threshold) and the first setting is detected, then it is determined that the preset condition is met. Wherein, the first setting, that is, the setting option, has opened the function of simultaneously performing video call by using the first mobile communication network and the second mobile communication network, and the function may be in an on state or a closed state by default.

In an embodiment, when a reliable second mobile communication network signal is detected (eg, the signal strength is greater than a threshold) and the first user command is detected, then it is determined that the preset condition is met. The first user instruction is a preset instruction for triggering the video call function of the second mobile communication network, and the user may issue the first user instruction by touching the screen, issuing a volley gesture, issuing a voice, pressing a button, and the like.

In an embodiment, when a reliable second mobile communication network signal is detected (eg, the signal strength is greater than a threshold), the user is asked whether to enable the video call function of the second mobile communication network, and when the user selects to enable, the determination is satisfied. Preset conditions.

S13. Connect to the second mobile communication network to establish a second communication channel.

In one embodiment of the invention, the second mobile communication network is a 4G network, such as LTE. The type of the second communication channel may be an IMS channel. In an embodiment of the invention, the first mobile communication network and the second mobile communication network may be communication networks provided by the same operator or different operators.

S14. Transmitting call data through the first communication channel and the second communication channel.

Specifically, the mobile terminal detects signal strengths of the first mobile communication network and the second mobile communication network, and distributes the call data stream between the first communication channel and the second communication channel according to the detected signal strength.

Specifically: when the first mobile communication network is stronger than the signal of the second mobile communication network, a larger proportion of the call data stream is allocated in the first communication channel; when the first mobile communication network is weaker than the signal of the second mobile communication network At the time, a smaller proportion of the call data stream is allocated in the first communication channel; when the signal strengths of the first mobile communication network and the second mobile communication network are equal, the first pass is The call data stream is evenly distributed between the letter channel and the second communication channel. The call data stream includes a video data stream and an audio data stream transmitted during a video call. Wherein, when the communication channel is an IMS channel, the call data transmitted by the communication channel is IMS type call data.

For example, there are five situations in which the call data stream can be assigned:

(1) When the signal of the first mobile communication network is strong (for example, the intensity is greater than -80 dbm), and the signal of the first mobile communication network is also strong (for example, the intensity is greater than -80 dbm), 50% is allocated to each of the first communication channel and the second communication channel. Call data stream;

(2) When the first mobile communication network signal is weak (such as between -140dbm and -120dbm), the first mobile communication network signal is also weak (such as the intensity between -140dbm and -120dbm), A communication channel and a second communication channel each allocate 50% of the call data stream;

(3) When the signal of the first mobile communication network is strong (if the intensity is greater than -80 dbm) and the signal of the second mobile communication network is weak (such as between -140 dbm and -120 dbm), 95% of the first communication channel is allocated. a call data stream, which allocates 5% of the call data stream to the second communication channel;

(4) When the first mobile communication network signal is weak (such as between -140dbm and -120dbm) and the second mobile communication network is strong (such as the intensity is greater than -80dbm), allocate 5% to the first communication channel. a call data stream, which allocates 95% of the call data stream to the second communication channel;

(5) When the signal strength of the first mobile communication network is between -80 dbm and -120 dbm, and the signal strength of the second mobile communication network is also between -80 dbm and -120 dbm, then:

If the signal strength of the first mobile communication network is between -80 dbm and -90 dbm, assigning 80% of the call data stream to the first communication channel and 20% of the call data stream to the second communication channel;

If the signal strength of the first mobile communication network is between -90 dbm and -100 dbm, assigning 60% of the call data stream to the first communication channel and 40% of the call data stream to the second communication channel;

If the signal strength of the first mobile communication network is between -100 dbm and -110 dbm, assigning 40% of the call data stream to the first communication channel and 60% of the call data stream to the second communication channel;

If the signal strength of the first mobile communication network is between -110 dbm and -120 dbm, 20% of the call data stream is allocated to the first communication channel, and 80% of the call data stream is allocated to the second communication channel.

It should be understood that in the embodiment of the present invention, the signal strength may be obtained from a cell message. In addition, one or more of a signal to noise ratio (SNR), a reference signal received power (RSRR), a bandwidth, a packet loss rate, and the like in the cell message may be used to replace the signal strength to determine the first mobile communication network. And the network quality of the second mobile communication network to guide the distribution of the call data stream. A preamble packet (for example, a ping packet) that does not carry any user data may be separately sent by the first mobile communication network and the second mobile communication network, and the returned response packet is respectively received, and the first mobile communication is determined by calculating a time difference. The network quality of the network and the second mobile communication network to guide the distribution of the call data stream.

When the mobile terminal connects to the first mobile communication network, it is assigned an IP address as the source address. When the mobile terminal allocates the data stream to the first and second communication channels, the destination address is obtained from the packet data packet of the call data stream of the first communication channel, and the destination address is copied to the packet of the call data stream of the second communication channel. In the packet, the source address in the packet is unchanged. After receiving the call data stream, the first communication channel and the second communication channel send the respective call data streams through the radio frequency, and receive the call data returned by the opposite end.

The data structure of the packet data packet in the first communication channel and the second communication channel is as shown in FIG. 4, and includes a source address, a destination address, and a Packet Data Unit (PDU).

Specifically, the application processing module 202 distributes the voice and image signals collected by the microphone 500 and the camera 600, and the call data processed by the codec 204 and the digital signal processing chip 203 to the first communication channel according to the foregoing allocation manner. The second communication channel performs transmission. The call data transmitted through the second communication channel is first transmitted to the second processing chip 300 through the first processing chip 200 (for example, transmitted through the USB data transmission interface), and then transmitted through the second radio frequency 305.

Further, the call data received via the second communication channel (the second radio frequency 305) is transmitted to the first processing chip 200 through a data transmission interface (for example, a USB interface) of the second processing chip 300. The application processing module 202 in the first processing chip 200 invokes the encapsulated protocol to combine the separated call data received via the first communication channel and the second communication channel (eg, Add together). The synthesized data is processed by the digital signal processing chip and the codec in turn, and then the image information is displayed through a display screen (not shown in FIG. 1 above), and the sound signal is output through the microphone.

If the user initiates a video call through the second user identification card 306, the video call method in the embodiment of the present invention includes:

S11', connecting to the second mobile communication network, establishing a second communication channel.

S12', establishing a video call connection with the opposite end through the second mobile communication network, and transmitting the call data through the second communication channel. During the video call, it is judged whether the preset condition is satisfied, and when the preset condition is satisfied, step S13' is performed.

Specifically, when the user performs video call dialing, the second protocol stack 301 and the second radio frequency 305 are used to send a video call request to the opposite end to establish a video call connection with the opposite end.

After the video call connection is established, the sound signal and the image signal are respectively collected by the microphone 500 and the camera 600, processed by the codec 204, and then transmitted to the digital signal processing chip (ADSP) 203 for processing to form the call data in the data packet format; The processing module 202 (APP processor) allocates the call data to the second protocol stack, and after the second protocol stack 301 performs the processing of the packet header, the second radio frequency 305 is sent out, and the second radio frequency 305 is received. The call data returned by the terminal. The call data includes audio data and video data. The received call data is processed by the second protocol stack 301, the digital signal processing chip 203, and the codec 204, and then the sound signal is output through the microphone 500, and the image signal is displayed through the display screen.

S13', connecting the first mobile communication network, establishing a first communication channel.

S14', transmitting call data through the first communication channel and the second communication channel.

Specifically, the application processing module 202 distributes the voice and image signals collected by the microphone 500 and the camera 600, and the call data processed by the codec 204 and the digital signal processing chip 203 to the first communication channel according to the foregoing allocation manner. The second communication channel performs transmission. The call data transmitted through the second communication channel is first transmitted to the second processing chip 300 through the first processing chip 200 (for example, transmitted through the USB data transmission interface), and then transmitted via the second video 305.

Further, the call data received via the second communication channel (the second radio frequency 305) is transmitted to the first processing chip 200 through a data transmission interface (for example, a USB interface) of the second processing chip 300. The application processing module 202 in the first processing chip 200 invokes the encapsulated protocol to combine the separated call data received via the first communication channel and the second communication channel (eg, based on the received tag in the packet header) , in order, etc.). The synthesized data is processed by the digital signal processing chip and the codec in turn, and then the image information is displayed through a display screen (not shown in FIG. 1 above), and the sound signal is output through the microphone.

As shown in FIG. 5 and FIG. 6 , a second embodiment of the video call method applied to the mobile terminal is provided. In this embodiment, the first mobile communication network and the second mobile communication network are both LTE networks, and the method includes the following. step:

S21. Connect to the first LTE network, and establish a first communication channel.

As shown in FIG. 6, the established first communication channel is composed of an IMS protocol stack, an LTE protocol stack, and a radio frequency module. In this embodiment, the first communication channel is an IMS channel.

S22. Establish a VOLTE video call connection with the peer end through the first LTE network, and transmit the call data by using the first communication channel. During the video call, it is determined whether the preset condition is met, and when the preset condition is met, step S23 is performed.

Specifically, as shown in FIG. 6, when the user performs video call dialing, the mobile terminal establishes a VOLTE video call connection with the opposite end through the LTE network. After the video call connection is established, the mobile terminal collects sounds and images through the microphone and the camera, and is processed by the codec, and then transmitted to the digital signal processing chip (ADSP) to form the call data in the data packet format; the application processing module (APP processing) The call data is allocated to the first protocol stack (modem), and after the first protocol stack performs the processing of the packet header, the first radio frequency is sent out, and the call data returned by the opposite end is received by the first radio frequency. The call data includes audio data and video data.

Since LTE only has a PS domain, when a VOLTE video call is made, a packet data packet of a voice and an image is transmitted through the PS domain. When a video call connection is established, the mobile terminals of both parties of the call are assigned an IP address, relatively speaking, the local end The IP address is the source address, and the IP address of the peer is The destination address, the data packet of the call data contains the source address and the destination address. The call data includes audio data and video data.

The specific processing procedure of the VOLTE video call in the LTE network in the step S22 is the same as that in the prior art, and details are not described herein again.

In an embodiment, when a reliable second LTE network signal is detected (eg, the signal strength is greater than a threshold), then it is determined that the preset condition is met.

In an embodiment, when a reliable second LTE network signal is detected (eg, the signal strength is greater than a threshold), and the first LTE network signal is weak (eg, the signal strength is less than a threshold), then it is determined that the preset condition is met. Alternatively, when it is detected that the first LTE network signal is weak and there is a second LTE network signal, it is determined that the preset condition is met.

In an embodiment, when a reliable second LTE network signal is detected (eg, the signal strength is greater than a threshold) and the first setting is detected, then it is determined that the preset condition is met. The function of using the first LTE network and the second LTE network to perform a video call is enabled in the first setting, that is, the setting option, and the function may be in an on state or a closed state by default.

In an embodiment, when a reliable second LTE network signal is detected (eg, the signal strength is greater than a threshold), and the first user command is detected, it is determined that the preset condition is met. The first user instruction is a preset instruction for triggering the second LTE network video call function, and the user may issue the first user instruction by touching the screen, issuing a volley gesture, issuing a voice, pressing a button, and the like.

In an embodiment, when a reliable second LTE network signal is detected (eg, the signal strength is greater than a threshold), the user is asked whether to enable the video call function of the second LTE network, and when the user selects to enable, it is determined that the preset is met. condition.

S23. Connect to the second LTE network to establish a second communication channel.

When the mobile terminal connects to the second LTE network, it is also assigned an IP address as the source address. In this embodiment, the second communication channel is an IMS channel.

S24. Transmitting call data through the first communication channel and the second communication channel.

Specifically, as shown in FIG. 6, an interface function is added, and the interface function has a flag bit LL_FLAG, and the interface function is also responsible for coordinating how the call data stream is reasonably allocated to the first communication channel and the second communication channel. . If the mobile terminal determines the preset condition during the video call and detects that the second mobile communication network is connected, then set LL_FLAG to 1, and enable the LL_call option (ie, enable the second mobile communication network video call function). When LL_FLAG=1 is detected, the mobile terminal may ask the user whether to use the LL_call function; when the user chooses to use the LL_call function, the first LTE network and the second LTE network are used for video call; when the user chooses not to use the LL_call function, Continue to use LTE video calls. In some embodiments, when LL_FLAG=1 is detected, the LL_call function is used directly without asking the user.

After the LL_call function is enabled, the call data is assigned to the first communication channel and the second communication channel. When the data stream is allocated, the destination address is obtained from the packet data packet of the call data stream of the first communication channel, and the destination address is copied in the packet data packet of the call data stream of the second communication channel, and the source in the packet data packet The address remains the same. The call data allocated to the first communication channel is processed by the first IMS protocol stack and the first LTE protocol stack, and then sent by the first radio frequency; the call data allocated to the second communication channel is sent to the second IMS protocol stack. After being processed by the second LTE protocol stack, the packet is processed by the second radio frequency. At the same time, the first communication channel and the second communication channel receive the call data returned by the opposite end.

If, in the LTE+LTE video call, the mobile terminal detects that the preset condition is no longer met, for example, if the second LTE network connection is disconnected, the LL_FLAG is set to 0, and the mobile terminal re-switches to the single LTE video call mode, that is, only The call data is transmitted through the first communication channel.

The mobile terminal detects the signal strength of the first LTE network and the second LTE network when performing the allocation of the call data stream, and distributes the call data stream between the first communication channel and the second communication channel according to the signal strength. When the first LTE network is stronger than the signal of the second LTE network, a larger proportion of the call data stream is allocated in the first communication channel; when the first LTE network is weaker than the signal of the second LTE network, the first communication is in the first communication The channel allocates a smaller proportion of the call data stream; when the first LTE When the signal strength of the network and the second LTE network are equal, the call data stream is evenly distributed between the first communication channel and the second communication channel. The call data stream includes a video data stream and an audio data stream transmitted during a video call.

It should be understood that, in an embodiment, when the user initiates a video call, it is also determined whether the preset condition is met (whether the determination in step S22 satisfies the preset condition), and if so, the first mobile communication network is established. a communication channel, and establishing a second communication channel through the second mobile communication network; after the first communication channel and the second communication channel are established, the call data is transmitted according to step S24.

It should be understood that the specific implementation details of the foregoing first embodiment are also applicable to the embodiment, and details are not described herein again.

The video call method in the embodiment of the present invention expands the network bandwidth, improves the data transmission rate, and improves the video call quality by enabling two LTE networks during the video call and simultaneously transmitting the call data. Even if the first mobile communication network signal is weak, the second mobile communication network can be used in combination to ensure video call quality, the flexibility of the video call and the intelligent level of the mobile terminal are improved, and the video call experience of the user is improved.

The present invention further provides a video communication device applied to the aforementioned mobile terminal. An embodiment of the video communication device of the present invention is now based on the above-described mobile terminal hardware structure and communication system. As shown in FIG. 7, the apparatus includes a first communication module, a second communication module, and a video call module, wherein:

The first communication module 71 is configured to connect to the first mobile communication network to establish a first communication channel. The type of the first communication channel is preferably an IMS channel.

The video calling module 72 is configured to establish a video call connection with the opposite end through the first mobile communication network, and transmit the call data through the first communication channel.

The second communication module 73 is configured to determine whether the preset condition is met during the video call; when the preset condition is met, connect the second mobile communication network to establish a second communication channel. The type of the second communication channel may be an IMS channel.

Specifically, as shown in FIG. 8, the second communication module 73 includes:

The determining unit 731 is configured to determine whether the preset condition is met during the video call, and notify the channel establishing unit when the preset condition is met. In an embodiment, when reliable is detected The second mobile communication network signal, and detecting that the first mobile communication network signal is weak, detecting the first setting, or receiving the first user instruction, determines that the preset condition is met.

The channel establishing unit 732 is configured to connect the second mobile communication network to establish a second communication channel when the determining unit determines that the preset condition is met.

The video call module 72 is further configured to transmit call data through the first communication channel and the second communication channel after the second communication channel is established.

Specifically, after the second communication channel is established, the channel establishing unit allocates the call data stream between the first communication channel and the second communication channel according to the signal strength of the first mobile communication network and the second mobile communication network. When the first mobile communication network is stronger than the signal of the second mobile communication network, a larger proportion of the call data stream is allocated in the first communication channel; when the first mobile communication network is weaker than the signal of the second mobile communication network, Allocating a smaller proportion of the call data stream in the first communication channel; when the signal strengths of the first mobile communication network and the second mobile communication network are equal, equally distributing the call data stream between the first communication channel and the second communication channel .

When the video call module allocates the data stream to the first and second communication channels, the destination address is obtained from the packet data packet of the call data stream of the first communication channel, and the destination address is copied to the call data stream of the second communication channel. In a packet packet.

In an embodiment, the first mobile communication network is an LTE network, and the first communication module establishes a first communication channel through the LTE network, where the first communication channel is configured by the first IMS protocol stack, the first LTE protocol stack, and the first radio frequency. The second mobile communication network is an LTE network, and the second communication module is formed by a second communication channel established by the LTE network, where the second communication channel is composed of a second IMS protocol stack, a second LTE protocol stack, and a second radio frequency.

The video call device and the video call method are provided in the same embodiment. The specific implementation process is described in the method embodiment, and the technical features in the device embodiment are applicable in the device embodiment, and details are not described herein.

Therefore, the video communication device of the present invention expands the network bandwidth and improves the data transmission rate by enabling two mobile communication networks during the video call and simultaneously transmitting the call data. Improve the quality of video calls. Even if the first mobile communication network signal is weak, the second mobile communication network can be used in combination to ensure video call quality, the flexibility of the video call and the intelligent level of the mobile terminal are improved, and the video call experience of the user is improved.

The present invention also provides a video calling system. As shown in FIG. 9, the video calling system includes a first mobile terminal 91, a relay server 92, and a second mobile terminal 93. The relay server 93 is connected to the first mobile terminal 91 and the first Between two mobile terminals 92, wherein:

The first mobile terminal 91 is configured to establish a video call connection with the second mobile terminal, establish a first communication channel and a second communication channel by using the first mobile communication network and the second mobile communication network, by using the first communication channel and the second communication The channel transmits call data.

a second mobile terminal 93: configured to establish a video call connection with the first mobile terminal, establish a first communication channel or/and a second communication channel through the first mobile network or/and the second mobile communication network, through the first communication channel or / and the second communication channel transmits call data. In addition, the second mobile terminal as the opposite end is further configured to establish a third communication channel by using the WLAN network, and transmit the call data by using at least one of the first communication channel, the second communication channel, and the third communication channel.

As shown in FIG. 10, a specific process for establishing an example of a video call connection between a first mobile terminal and a second mobile terminal: first, the first mobile terminal detects a local IP address (such as an IP address including an IMS gateway configuration), and 2. The mobile terminal sends an IP address and a video call request; then, the second mobile terminal detects the local IP address (eg, including the IP address configured by the IMS gateway), and sends an IP address and a reply request to the second mobile terminal; finally, the first move The terminal and the second mobile terminal respectively acquire the IP address of the other party and establish a video call connection.

The relay server 92 is configured to receive the call data, analyze the channel type of the destination address in the call data, determine whether to perform data conversion on the call data according to the channel type, and forward the call data through the corresponding communication channel.

The type of the first communication channel is preferably an IMS channel, and the type of the second communication channel is an IMS channel, and the IMS channel transmits the call data of the IMS type. The type of the third communication channel is preferably an Internet channel, and transmits call data of an internet type.

Correspondingly, the present invention also provides a video calling method, including the following steps:

S101. The first mobile terminal establishes a video call connection with the second mobile terminal.

S102. The first mobile terminal establishes a first communication channel and a second communication channel by using the first mobile communication network network and the second mobile communication network, and transmitting call data by using the first communication channel and the second communication channel; A mobile communication network or/and a second mobile communication network establishes a first communication channel or/and a second communication channel, and transmits call data through the first communication channel or/and the second communication channel.

The method further includes: the second mobile terminal establishes a third communication channel by using the WLAN network, and the second mobile terminal transmits the call data by using at least one of the first communication channel, the second communication channel, and the third communication channel; the relay server receives the first mobile The call data sent by the terminal or the second mobile terminal, parsing the channel type of the destination address in the call data, determining whether to perform data conversion on the call data according to the channel type, and forwarding the call to the second mobile terminal or the first mobile terminal through the corresponding communication channel. data.

Preferably, the first communication channel is an IMS channel and the second communication channel is an IMS channel. The IMS channel transmits IMS type call data. The type of the third communication channel is preferably an Internet channel, and transmits call data of an internet type. The channel type of the destination address includes the IMS channel. In an embodiment, the second mobile terminal may also perform a video call through a WLAN network (for example, a WIFI network), and the channel type of the destination address further includes an Internet channel. When the type of the call data does not match the channel type of the destination address of the call data, the relay server performs data conversion on the call data.

The following is a description of the process of making a video call by the video communication system of the present invention by taking the first mobile communication network as the LTE network and the second mobile communication network as the LTE network as an example:

Example one

As shown in FIG. 11, the first mobile terminal establishes an IMS channel through the first LTE network and the second LTE network, and the second mobile terminal also establishes an IMS channel through the first LTE network and the second LTE network, respectively. The transit server receives the call transmitted by the IMS channel of the first mobile terminal In the case of data, the channel type of the destination address in the call data is parsed as an IMS type, and the call data is forwarded to the second mobile terminal through the IMS channel of the second mobile terminal. Conversely, the manner in which the relay server receives the call data of the second mobile terminal is also the same.

Since the call data is transmitted through two channels, after the first mobile terminal (and the second mobile terminal) receives the call data through different channels, the application processing module calls the packaged protocol to merge the separated data blocks. Just together. After the synthesized data block is processed by the digital signal processing chip and the codec in turn, the screen is displayed through a display screen (not shown in FIG. 1 above), and the sound is output through the microphone.

It should be understood that, in this embodiment, the call data is transmitted to the second mobile terminal after being allocated according to the foregoing allocation manner by the first channel and the second channel, and is also sent according to the call data sent by the second mobile terminal. The time of distribution is accepted. For example, when transmitting, the first channel and the second channel respectively allocate 50% of the call data stream, and then receive 50% of the call data streams through the first channel and the second channel respectively. Specifically, the transfer ratio may be controlled by the transit server, or the first mobile terminal may set the receive ratio by itself.

Example two

As shown in FIG. 12, the first mobile terminal establishes two IMS channels through the first LTE network and the second LTE network, and the second mobile terminal establishes an IMS channel through the LTE network.

When the transit server receives the call data transmitted by the two IMS channels of the first mobile terminal, the channel type of the destination address in the call data is IMS type, and the call data is forwarded to the second through the IMS channel of the second mobile terminal. Mobile terminal.

When the transit server receives the call data transmitted by the IMS channel of the second mobile terminal, the channel type of the destination address in the call data is IMS type, and the call data is forwarded to the corresponding IMS channel of the first mobile terminal according to the destination address. The first mobile terminal. Since the call data is transmitted through two channels, after the first mobile terminal receives the call data through different channels, the application processing module calls the packaged protocol to put the separated data blocks together. After the synthesized data block is processed by the digital signal processing chip and the codec, The screen is displayed through a display screen (not shown in FIG. 1 above), and the sound is output through a microphone.

It should be understood that, in this embodiment, the call data is allocated to the second mobile terminal after being allocated by the first channel and the second channel according to the foregoing allocation manner, and when the first mobile terminal receives the call data sent by the second mobile terminal, It will also be received according to the distribution method (allocation ratio) at the time of transmission. Specifically, the transfer ratio may be controlled by the transit server, or the first mobile terminal may set the receive ratio by itself.

Example three

As shown in FIG. 13, the first mobile terminal establishes two IMS channels through the first LTE network and the second LTE network, and the second mobile terminal establishes an internet channel through the WIFI network.

In this embodiment, the channel type includes an IMS channel and an internet channel. When the type of the call data is different from the channel type of the destination address of the call data, the transit server performs data conversion on the call data, and converts the type of the call data to its purpose. The channel type of the address is the same.

When the transit server receives the call data transmitted by the IMS channel of the first mobile terminal, the channel type of the destination address in the call data is parsed into an internet type, the call data is converted into the internet type call data, and the call data is passed. The internet channel of the second mobile terminal is forwarded to the second mobile terminal.

When the transit server receives the call data transmitted by the internet channel of the second mobile terminal, the channel type of the destination address in the call data is parsed; when the channel type is the IMS type, the call data is converted into the IMS type call data. And forwarding the call data to the first mobile terminal through the IMS channel of the first mobile terminal.

After the first mobile terminal receives the call data through different channels, the application processing module calls the packaged protocol to combine the separated data blocks. After the synthesized data block is processed by the digital signal processing chip and the codec in turn, the screen is displayed through a display screen (not shown in FIG. 1 above), and the sound is output through the microphone.

It should be understood that, in this embodiment, the call data is allocated to the second mobile terminal after being allocated by the first channel and the second channel according to the foregoing allocation manner, and is received by the second mobile terminal. When the call data is received, it will also be received according to the distribution method at the time of transmission. Specifically, the transfer ratio may be controlled by the transit server, or the first mobile terminal may set the receive ratio by itself.

In addition, the second mobile terminal may also establish an IMS channel through the first LTE network, establish an IMS channel through the second LTE network, and establish an internet channel through the WIFI network, thereby selecting at least one of the three channels to perform call data transmission. The specific transmission process will not be described here.

In the video calling system and method of the present invention, the first mobile terminal and the second mobile terminal may enable the first mobile communication network and the second mobile communication network during the video call, and simultaneously transmit the call data, and the transit server according to the destination address in the call data. The channel type performs data conversion and selects the corresponding communication channel to forward the call data, expands the network bandwidth, improves the data transmission rate, and improves the video call quality. Even if the mobile network signal is weak, the wireless LAN can be used in combination to ensure the quality of the video call, the flexibility of the video call and the intelligent level of the mobile terminal are improved, and the video call experience of the user is improved.

The present invention also provides a video communication device applied to the foregoing relay server. As shown in FIG. 14, the video communication device includes the following unit modules:

The receiving module 141 is configured to receive call data.

Parsing module 142: configured to resolve the channel type of the destination address in the call data.

The processing module 143 is configured to determine, according to the channel type, whether to perform data conversion on the call data and forward the call data through the corresponding communication channel. The communication channel includes a first communication channel established through the first mobile communication network and a second communication channel established through the second mobile communication network. In some embodiments, the communication channel further includes a third communication channel established over the wireless local area network.

Preferably, the first communication channel is an IMS channel, the second communication channel is an IMS channel, and the third communication channel is an Internet channel. The IMS channel transmits IMS type call data, and the internet channel transmits internet type call data. The channel type includes an IMS channel and an internet channel. When the type of the call data is different from the channel type of the destination address of the call data, the processing module performs data conversion on the call data, and converts the type of the call data into a channel with the destination address. The types are consistent. For example, when the call data is IMS type call data, and the destination address channel type is internet type, the processing module converts the call data into internet type call data; when the call data is internet type call data, and When the channel type of the destination address is IMS type, the processing module converts the call data into the call data of the IMS type.

The processing module determines whether to perform data conversion on the call data and forwards the call data through the corresponding communication channel according to the channel type. For details, refer to the foregoing examples 1 to 4 and FIGS. 11 to 13 , and details are not described herein again.

In one embodiment, since the first mobile terminal will transmit the call data through the first communication channel and the second communication channel according to the allocated ratio, the parsing module in the relay server is configured to parse through the first communication channel and the second communication The amount of data of the call data received by the channel. The processing module determines the transmission ratio according to the amount of data received through the first communication channel and the second communication channel, and forwards the corresponding call data to the first communication channel and the second communication channel according to the determined transmission ratio. For example, 80% of the call data sent through the first communication channel and 20% of the call data sent through the second communication channel are analyzed, and then passed through the first communication channel according to the ratio of 80% and 20% respectively. The second communication channel forwards the call data to the first mobile terminal. Thus, the first mobile terminal receives the call data from the second mobile terminal forwarded by the relay server in such a manner that 80% of the call data is received through the first communication channel and 20% of the call data is received through the second communication channel.

It should be understood that in some embodiments, the relay server does not perform such an assignment, but instead forwards the received call data directly. When receiving the call data forwarded by the relay server, the first mobile terminal receives the call data through the first communication channel and the second communication channel according to a preset ratio (which may be the same distribution ratio as when the call data is sent).

Correspondingly, the present invention also provides a video calling method applied to the foregoing relay server, the method comprising the following steps:

S201. Receive call data.

S202. Analyze a channel type of a destination address in the call data.

S203. Determine, according to the channel type, whether to perform data conversion on the call data and forward the call data through the corresponding communication channel.

The communication channel is established by the first communication channel established by the first mobile communication network and the second communication channel established by the second mobile communication network. In some embodiments, the communication channel further includes a third communication channel established over the wireless local area network.

Preferably, the first communication channel is an IMS channel, the second communication channel is an IMS channel, and the third communication channel is an Internet channel. The IMS channel transmits IMS type call data, and the internet channel transmits internet type call data. The channel type includes an IMS channel and an internet channel. When the type of the call data is different from the channel type of the destination address of the call data, the processing module performs data conversion on the call data, and converts the type of the call data to the channel type of the destination address. . For example, when the call data is IMS type call data, and the destination address channel type is internet type, the processing module converts the call data into internet type call data; when the call data is internet type call data, and When the channel type of the destination address is IMS type, the processing module converts the call data into the call data of the IMS type.

For the process of determining whether to perform data conversion on the call data and forwarding the call data through the corresponding communication channel according to the channel type, refer to the foregoing example 1 to example 4 and FIGS. 11-13, which are not described herein again.

The video call device and method applied to the relay server can perform data conversion according to the channel type of the destination address in the call data and select the corresponding communication channel to forward the call data, so that the first mobile terminal and the second mobile terminal can be in the video call. The first mobile communication network and the second mobile communication network are enabled in the process, and the call data is transmitted at the same time, the network bandwidth is expanded, the data transmission rate is improved, and the video call quality is improved. Even if the mobile network signal is weak, the wireless LAN can be used in combination to ensure the quality of the video call, the flexibility of the video call and the intelligent level of the mobile terminal are improved, and the video call experience of the user is improved.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or The device includes not only those elements, but also other elements not explicitly listed, or elements that are inherent to such processes, methods, articles or devices. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, The optical disc includes instructions for causing a mobile terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to perform the methods described in various embodiments of the present invention.

The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the present invention and the drawings are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

The embodiments of the present invention have been described above with reference to the drawings, but the present invention is not limited to the specific embodiments described above, and the specific embodiments described above are merely illustrative and not restrictive, and those skilled in the art In the light of the present invention, many forms may be made without departing from the spirit and scope of the invention as claimed.

Industrial applicability

The technical solution of the embodiment of the present invention expands the network bandwidth, improves the data transmission rate, and improves the video by enabling two 4G networks during the video call and simultaneously transmitting the call data. conversation quality. Even if the first 4G network signal is weak, the second 4G network can be jointly used to ensure video call quality, the flexibility of the video call and the intelligent level of the mobile terminal are improved, and the video call experience of the user is improved.

Claims

A video calling method is applied to a mobile terminal, including:

Connecting the first long term evolution LTE network to establish a first communication channel;

Establishing a video call connection with the peer end by using the first LTE network, and transmitting call data by using the first communication channel;

During the video call, when the preset condition is met, the second LTE network is connected to establish a second communication channel;

The call data is transmitted through the first communication channel and the second communication channel.
The video calling method according to claim 1, wherein the method further comprises:

During the video call, when it is detected that there is a reliable second LTE network signal, and it is detected that the first LTE network signal is weak, the first setting is detected, or the first user instruction is received, it is determined that the preset condition is met.
The video call method according to claim 1, wherein said transmitting said call data through said first communication channel and said second communication channel comprises:

And distributing, according to a signal strength of the first LTE network and the second LTE network, the call data stream between the first communication channel and the second communication channel to pass the first communication The channel and the second communication channel transmit the call data.
The video calling method according to claim 3, wherein the step of distributing the call data stream between the first communication channel and the second communication channel in proportion to the method further comprises:

Obtaining a destination address from a packet data packet of the call data stream of the first communication channel, and copying the destination address in a packet data packet of a call data stream of the second communication channel.
The video calling method according to claim 3, wherein the method further comprises:

Receiving, according to the ratio, call data sent by the opposite end by using the first communication channel and the second communication channel, respectively;

The call data received through the first communication channel and the second communication channel is synthesized and output.
The video calling method according to any one of claims 1 to 5, wherein the mobile terminal comprises:

a first processing chip, including an application service module and a first protocol stack;

a second processing chip, including a second protocol stack communicatively coupled to the first processing chip;

a first user identification card connected to the first processing chip;

a first radio frequency, connected to the first processing chip;

a second user identification card connected to the second processing chip;

a second radio frequency, connected to the second processing chip;

The application service module is configured to receive an operation instruction of a user, and the control signal is transmitted in the first LTE network via the first protocol stack and the first radio frequency;

The application service module is further configured to receive an operation instruction of the user, and the control signal is transmitted in the second LTE network via the second protocol stack and the second radio frequency;

The operation instruction includes information for performing a video call by using the first user identification card and/or the second user identification card.
A video calling device is applied to a mobile terminal, including:

a first communication module, configured to connect to the first LTE network, and establish a first communication channel;

a video call module, configured to establish a video call connection with the opposite end by using the first LTE network, and transmit call data by using the first communication channel;

The second communication module is configured to determine whether the preset condition is met during the video call; when the preset condition is met, connecting the second LTE network to establish a second communication channel;

The video call module is further configured to: after the second communication module establishes the second communication channel, transmit the call data through the first communication channel and the second communication channel.
The video communication device according to claim 7, wherein said second communication module comprises a judging unit and a channel establishing unit, wherein:

The determining unit is configured to detect that a reliable second LTE network signal is detected and detected When the second LTE network signal is weak, the first setting is detected, or the first user instruction is received, determining that the preset condition is met;

The channel establishing unit is configured to connect to the second LTE network and establish a second communication channel when the determining unit determines that the preset condition is met.
The video call device of claim 7, wherein the video call module is further configured to:

After the second communication channel is established, the first communication channel and the second communication channel are distributed proportionally according to signal strengths of the first LTE network and the second LTE network. Call data stream.
The video call device of claim 7, wherein the video call module further comprises an address obtaining module, and the address obtaining module is configured to:

Obtaining a destination address from a packet data packet of the call data stream of the first communication channel, and copying the destination address in a packet data packet of a call data stream of the second communication channel.
The video communication device according to any one of claims 7 to 10, wherein the first communication channel is an IP Multimedia Subsystem IMS channel, and the second communication channel is an IMS channel.
A video calling system includes a first mobile terminal and a second mobile terminal, wherein the first mobile terminal and the second mobile terminal are in communication connection, wherein:

The first mobile terminal is configured to establish a video call connection with the second mobile terminal, establish a first communication channel and a second communication channel by using the first LTE network and the second LTE network, by using the first communication channel and Transmitting, by the second communication channel, call data;

The second mobile terminal is configured to establish a video call connection with the first mobile terminal, and establish a first communication channel or/and a second communication channel by using the first LTE network or/and the second LTE network, by using the A communication channel or/and the second communication channel transmits call data.
The video calling system of claim 12 wherein said first communication channel is an IMS channel and said second communication channel is an IMS channel.
The video calling system of claim 12, wherein said first mobile terminal Also configured as:

And distributing, according to a signal strength of the first LTE network and the second LTE network, a call data flow between the first communication channel and the second communication channel to pass the first communication channel and The second communication channel transmits call data.
A video calling device, applied to a relay server, includes:

a receiving module configured to receive call data;

a parsing module configured to parse a channel type of a destination address in the call data;

a processing module, configured to determine, according to the channel type, whether to perform data conversion on the call data and forward the call data through a corresponding communication channel;

The communication channel includes a first communication channel established through the first LTE network and a second communication channel established through the second LTE network.
The video communication device of claim 15 wherein said communication channel further comprises a third communication channel established over a wireless local area network.
The video communication device of claim 15, wherein the parsing module is further configured to parse the amount of data of the call data received through the first communication channel and the second communication channel;

The processing module is further configured to determine a transmission ratio according to the amount of data received by the first communication channel and the second communication channel, and forward the corresponding call data to the first communication channel and the second communication channel according to the determined transmission ratio .
A video calling method applied to a transit server includes:

Receiving call data;

Parsing a channel type of the destination address in the call data;

Determining, according to the channel type, whether to perform data conversion on the call data and forwarding the call data through a corresponding communication channel;

The communication channel includes a communication channel including a first communication channel established through the first LTE network and a second communication channel established through the second LTE network.
The video calling method according to claim 18, wherein said communication channel is further included Including a third communication channel established through a wireless local area network;

The first communication channel is an IMS channel, the second communication channel is an IMS channel, the third communication channel is an internet channel, the IMS channel transmits IMS type call data, and the internet channel transmits an internet type call. Data, the channel type includes an IMS channel and an internet channel, and when the type of the call data is inconsistent with the channel type of the destination address of the call data, data conversion is performed on the call data.
A video calling method is applied to a mobile terminal, including:

Connecting the first 4G network to establish a first communication channel;

Establishing a video call connection with the opposite end by using the first 4G network, and transmitting call data through the first communication channel;

During the video call, when the preset condition is met, the second 4G network is connected to establish a second communication channel;

The call data is transmitted through the first communication channel and the second communication channel.