WO2017071310A1

WO2017071310A1 - Video call system, device, and method

Info

Publication number: WO2017071310A1
Application number: PCT/CN2016/090338
Authority: WO
Inventors: 谭焕清; 车晓东
Original assignee: 努比亚技术有限公司
Priority date: 2015-10-28
Filing date: 2016-07-18
Publication date: 2017-05-04
Also published as: CN105227892A

Abstract

Disclosed in the present invention are a system, a device, and a method for video calls. The system comprises: a first mobile terminal, used for establishing a video call connection with a second mobile terminal, establishing a first communication channel and a second communication channel by means of a mobile communication network and a wireless network, and transmitting call data by means of the first communication channel and the second communication channel; the second mobile terminal, used for establishing a first communication channel or/and a second communication channel by means of the mobile communication network or/and the wireless network, and transmitting the call data by means of the first communication channel or/and the second communication channel; a transit server, used for receiving the call data, parsing from the call data the channel type of the destination address, determining, according to the channel type, whether to perform data conversion of the call data and forwarding the call data by means of the corresponding communication channel. The mobile communication network and the wireless network are used at the same time to transmit the call data during the video call, extending the network bandwidth, and improving the data transmission rate and the video call quality.

Description

Video call system, device and method

Technical field

The present invention relates to the field of communications technologies, and in particular, to a video call system, apparatus, and method.

Background technique

With the rapid development of communication technology, mobile communication networks have evolved from second-generation (2G) networks to third-generation (3G) networks to current fourth-generation (4G) networks, and the corresponding data transmission rates are increasing. Fast, starting from the 3G network, you can already support video calls.

In the current 4G network, Long Term Evolution (LTE) network has been widely used, and it is currently the fastest network communication network. Mobile terminals can use LTE networks for LTE-based voice services (VOLTE, Voice over). LTE) video call. VOLTE is an IP data transmission technology that enables data and voice services to be unified under the same network. In the existing VOLTE video call, both parties of the session process the image through the camera function of the mobile terminal and the IP Multimedia Subsystem (IMS, IP Multimedia Subsystem) protocol stack, so that the other party can clearly see the picture.

However, the current VOLTE video call can only be used in the area covered by the LTE network; since the voice and image are transmitted simultaneously during the video call, the signal strength of the LTE network needs to meet certain requirements. If the LTE network signal in the area is poor, the call quality is difficult to guarantee, and it is prone to break or video jam. Generally, in the case where the call quality is deteriorated or disconnected, the LTE network itself cannot be improved any more, and one or both parties of the call can only move to an area with a good LTE signal.

Therefore, the reliability and stability of the existing mobile terminal video call are poor, and the call quality is not high.

Summary of the invention

The main purpose of embodiments of the present invention is to provide a video call system, apparatus, and method, which are directed to improving video call quality of a mobile terminal.

To achieve the above objective, an embodiment of the present invention provides a video calling system, including a first mobile terminal, a transit server, and a second mobile terminal, where the relay server is connected to the first mobile terminal and the second mobile terminal. Between, where:

The first mobile terminal is configured to establish a video call connection with the second mobile terminal, establish a first communication channel and a second communication channel by using the mobile communication network and the wireless network, by using the first communication channel and the first Two communication channels transmit call data;

The second mobile terminal is configured to establish a video call connection with the first mobile terminal, establish a first communication channel or/and a second communication channel through the mobile communication network or/and the wireless network, and pass the first communication channel Or / and the second communication channel transmits call data;

The transit server is configured to receive the call data, parse a channel type of the destination address in the call data, determine, according to the channel type, whether to perform data conversion on the call data and forward the call through a corresponding communication channel. data.

The first communication channel is an IMS channel, the second communication channel is an IMS channel or an internet channel, the IMS channel transmits IMS type call data, and the internet channel transmits internet type call data, the channel The type includes an IMS channel and an internet channel. When the type of the call data is inconsistent with the channel type of the destination address of the call data, the transit server performs data conversion on the call data.

The embodiment of the invention further provides a video communication device, which is applied to a relay server, and includes:

a receiving module configured to receive call data;

a parsing module configured to parse a channel type of a destination address in the call data;

a processing module, configured to determine, according to the channel type, whether to perform data conversion on the call data and forward the call data through a corresponding communication channel;

The communication channel includes a first communication channel established through a mobile communication network and a second communication channel established through a wireless network.

The first communication channel is an IMS channel, the second communication channel is an IMS channel or an internet channel, the IMS channel transmits IMS type call data, and the internet channel transmits internet type call data, the channel The type includes an IMS channel and an internet channel. When the type of the call data is inconsistent with the channel type of the destination address of the call data, the processing module performs data conversion on the call data.

The embodiment of the invention further provides a video communication device, which is applied to a mobile terminal, and includes:

a first communication module configured to connect to the mobile communication network to establish a first communication channel;

a video call module, configured to establish a video call connection with the opposite end by using the mobile communication network, and transmit call data through the first communication channel;

The second communication module is configured to determine whether the preset condition is met during the video call; when the preset condition is met, connect the wireless network to establish a second communication channel;

The video call module is further configured to: after the second communication module establishes the second communication channel, transmit the call data through the first communication channel and the second communication channel.

The second communication module includes a determining unit and a channel establishing unit channel establishing unit, where:

The determining unit is configured to determine that a preset condition is met when detecting that a reliable wireless network signal is detected, and detecting that the mobile communication network signal is weak, detecting the first setting, or receiving the first user instruction;

The channel establishing unit channel establishing unit is configured to connect to the wireless network and establish a second communication channel when the determining unit determines that the preset condition is met.

The video call module is further configured to:

After the second communication channel is established, according to the signal strength of the mobile communication network and the wireless network, proportionally distributed between the first communication channel and the second communication channel The call data stream.

The video call module further includes an address obtaining module, where the address obtaining module is configured to:

Obtaining a destination address from a packet data packet of the call data stream of the first communication channel, and copying the destination address in a packet data packet of a call data stream of the second communication channel.

The mobile communication network is an LTE network, and the wireless network is a WLAN network.

The first communication channel is an IMS channel, and the second communication channel is an IMS channel or an internet channel.

The embodiment of the invention simultaneously provides a video calling method, including:

Establishing, by the first mobile terminal, a video call connection with the second mobile terminal;

The first mobile terminal establishes a first communication channel and a second communication channel through a mobile communication network and a wireless network, and transmits call data through the first communication channel and the second communication channel; the second mobile terminal moves by Establishing a first communication channel or/and a second communication channel by the communication network or/and the wireless network, and transmitting the call data through the first communication channel or/and the second communication channel;

The relay server receives the call data sent by the first mobile terminal or the second mobile terminal, parses the channel type of the destination address in the call data, and determines whether to perform data conversion and pass the call data according to the channel type. The corresponding communication channel forwards the call data to the second mobile terminal or the first mobile terminal.

The embodiment of the invention further provides a video call method, which is applied to a transit server, and includes:

Receiving call data;

Parsing a channel type of the destination address in the call data;

Determining, according to the channel type, whether to perform data conversion on the call data and forwarding the call data through a corresponding communication channel;

The first communication channel is an IMS channel, the second communication channel is an IMS channel or an internet channel, the IMS channel transmits IMS type call data, and the internet channel transmits internet type call data, the channel The type includes an IMS channel and an internet channel, and when the type of the call data does not match the channel type of the destination address of the call data, data conversion is performed on the call data.

The embodiment of the invention further provides a video calling method, which is applied to a mobile terminal, and includes:

Connecting a mobile communication network to establish a first communication channel;

Establishing a video call connection with the opposite end through the mobile communication network, and transmitting call data through the first communication channel;

During the video call, when the preset condition is met, the wireless network is connected to establish a second communication channel;

The call data is transmitted through the first communication channel and the second communication channel.

The method further includes:

During the video call, when it is detected that there is a reliable wireless network signal, and it is detected that the mobile communication network signal is weak, the first setting is detected, or the first user command is received, it is determined that the preset condition is satisfied.

The transmitting the call data by using the first communication channel and the second communication channel includes:

According to the signal strength of the mobile communication network and the wireless network, proportionally The call data stream is allocated between a communication channel and the second communication channel to transmit the call data through the first communication channel and the second communication channel.

The step of distributing the call data stream between the first communication channel and the second communication channel in proportion to the step further includes:

A video call system, apparatus and method according to an embodiment of the present invention expands network bandwidth and improves data transmission by enabling a wireless wifi network during a video call and simultaneously transmitting a call data using a mobile communication network and a wireless wifi network. Rate, which improves the quality of video calls. Even if the mobile communication network signal is weak, the wireless network can be used in combination to ensure the quality of the video call, the flexibility of the video call and the intelligent level of the terminal are improved, and the video call experience of the user is improved.

DRAWINGS

1 is a schematic structural diagram of hardware of an optional mobile terminal embodying various embodiments of the present invention;

2 is a schematic diagram of a wireless communication system of the mobile terminal shown in FIG. 1;

3 is a flowchart of a first embodiment of a video call method according to the present invention;

4 is a schematic diagram of a data structure of a data packet according to an embodiment of the present invention;

FIG. 5 is a flowchart of a second embodiment of a video call method according to the present invention; FIG.

6 is a schematic diagram of interaction of each unit module in a terminal during a video call according to an embodiment of the present invention;

FIG. 7 is a schematic block diagram of an embodiment of a video communication device according to the present invention; FIG.

8 is a block diagram of a second communication module of FIG. 7;

9 is a schematic block diagram of an embodiment of a video call system according to the present invention;

FIG. 10 is an interaction diagram of two mobile terminals in establishing a video call connection according to an embodiment of the present invention; intention;

11 is a schematic diagram of interaction between entities in a first embodiment of the video call system of the present invention during a video call;

12 is a schematic diagram of interaction between entities in a second embodiment of the video call system of the present invention during a video call;

FIG. 13 is a schematic diagram of interaction of each subject in a video call process according to a third example of the video call system of the present invention; FIG.

14 is a schematic diagram of interaction between entities in a fourth embodiment of the video call system of the present invention during a video call;

FIG. 15 is a schematic block diagram of an embodiment of a video communication device applied to a relay server according to the present invention.

The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.

detailed description

It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A mobile terminal embodying various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, the use of suffixes such as "module", "component" or "unit" for indicating an element is merely an explanation for facilitating the present invention, and does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.

The mobile terminal can be implemented in various forms. For example, the terminal described in the present invention may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device, etc. Mobile terminals and fixed terminals such as digital TVs, desktop computers, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, those skilled in the art will appreciate that in addition to being specifically used for mobile purposes In addition to the elements, the configuration according to an embodiment of the present invention can also be applied to a fixed type of terminal.

1 is a schematic diagram showing the hardware structure of an optional mobile terminal embodying various embodiments of the present invention.

The mobile terminal 100 may include a wireless communication unit 110, an A/V (Audio/Video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190. and many more. Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.

Wireless communication unit 110 typically includes one or more components that permit radio communication between mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.

The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel can include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to the terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Moreover, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of Digital Multimedia Broadcasting (DMB) Electronic Program Guide (EPG), Digital Video Broadcasting Handheld (DVB-H) Electronic Service Guide (ESG), and the like. . The broadcast receiving module 111 can receive a signal broadcast by using various types of broadcast systems. In particular, the broadcast receiving module 111 can use forward link media (MediaFLO) by using, for example, multimedia broadcast-terrestrial (DMB-T), digital multimedia broadcast-satellite (DMB-S), digital video broadcast-handheld (DVB-H) The digital broadcasting system of the ^@ ) data broadcasting system, the terrestrial digital broadcasting integrated service (ISDB-T), and the like receives digital broadcasting. The broadcast receiving module 111 can be constructed as various broadcast systems suitable for providing broadcast signals as well as the above-described digital broadcast system. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).

The mobile communication module 112 transmits the radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received in accordance with text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module can be internally or externally coupled to the terminal. The wireless Internet access technologies involved in the module may include WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (Worldwide Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. .

The short range communication module 114 is a module for supporting short range communication. Some examples of short-range communication technology include Bluetooth ^TM, a radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, etc. ^TM.

The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of a location information module is GPS (Global Positioning System). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information to accurately calculate three-dimensional current position information based on longitude, latitude, and altitude. Currently, the method for calculating position and time information uses three satellites and corrects the calculated position and time information errors by using another satellite. Further, the GPS module 115 is capable of calculating speed information by continuously calculating current position information in real time.

The A/V input unit 120 is for receiving an audio or video signal. The A/V input unit 120 may include a camera 121 and a microphone 1220 that processes image data of still pictures or video obtained by the image capturing device in a video capturing mode or an image capturing mode. The processed image frame can be displayed on the display module 151. The image frame processed by the camera 121 can be stored In the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, two or more cameras 1210 may be provided according to the configuration of the mobile terminal. The microphone 122 can receive sound (audio data) via a microphone in an operation mode of a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound as audio data. The processed audio (voice) data can be converted to a format output that can be transmitted to the mobile communication base station via the mobile communication module 112 in the case of a telephone call mode. The microphone 122 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated during the process of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal. The user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc. In particular, when the touch panel is superimposed on the display module 151 in the form of a layer, a touch screen can be formed.

The sensing unit 140 detects the current state of the mobile terminal 100 (eg, the open or closed state of the mobile terminal 100), the location of the mobile terminal 100, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 100, and the mobile terminal. The orientation of 100, the acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide type mobile phone, the sensing unit 140 can sense whether the slide type phone is turned on or off. In addition, the sensing unit 140 can detect whether the power supply unit 190 provides power or whether the interface unit 170 is coupled to an external device. Sensing unit 140 may include proximity sensor 1410 which will be described below in connection with a touch screen.

The interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more. The identification module may be storing various information for verifying that the user uses the mobile terminal 100 and A User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identification Module (USIM), and the like can be included. In addition, the device having the identification module (hereinafter referred to as "identification device") may take the form of a smart card, and thus the identification device may be connected to the mobile terminal 100 via a port or other connection device. The interface unit 170 can be configured to receive input from an external device (eg, data information, power, etc.) and transmit the received input to one or more components within the mobile terminal 100 or can be used at the mobile terminal and external device Transfer data between.

In addition, when the mobile terminal 100 is connected to the external base, the interface unit 170 may function as a path through which power is supplied from the base to the mobile terminal 100 or may be used as a transmission of various command signals allowing input from the base to the mobile terminal 100 The path to the terminal. Various command signals or power input from the base can be used as signals for identifying whether the mobile terminal is accurately mounted on the base. Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display module 151, an audio output module 152, an alarm module 153, and the like.

The display module 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display module 151 can display a user interface (UI) or graphical user interface (GUI) associated with a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 100 is in a video call mode or an image capture mode, the display module 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.

Meanwhile, when the display module 151 and the touch panel are superposed on each other in the form of layers to form a touch screen, the display module 151 can function as an input device and an output device. The display module 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like. Root According to a particular desired implementation, the mobile terminal 100 may include two or more display modules (or other display devices), for example, the mobile terminal may include an external display module (not shown) and an internal display module (not shown) . The touch screen can be used to detect touch input pressure as well as touch input position and touch input area.

The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 when the mobile terminal is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, and the like. The audio signal is output as sound. Moreover, the audio output module 152 can provide audio output (eg, call signal reception sound, message reception sound, etc.) associated with a particular function performed by the mobile terminal 100. The audio output module 152 can include a speaker, a buzzer, and the like.

The alert module 153 can provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alert module 153 can provide an output in a different manner to notify of the occurrence of an event. For example, the alarm module 153 can provide an output in the form of vibrations that, when receiving a call, message, or some other incoming communication, can provide a haptic output (ie, vibration) to notify the user of it. By providing such a tactile output, the user is able to recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm module 153 can also provide an output of the notification event occurrence via the display module 151 or the audio output module 152.

The memory 160 may store a software program or the like for processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, etc.) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), random access Memory (RAM), static random access memory (SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. Wait. Moreover, the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like. Additionally, the controller 180 can include a multimedia module 1810 for reproducing (or playing back) multimedia data, which can be constructed within the controller 180 or can be configured to be separate from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate the various components and components.

The various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof. For hardware implementations, the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle. For software implementations, implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation. The software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by controller 180.

So far, the mobile terminal has been described in terms of its function. Hereinafter, for the sake of brevity, a slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, the present invention can be applied to any type of Mobile terminal, and is not limited to a slide type mobile terminal.

The mobile terminal 100 as shown in FIG. 1 may be configured to operate using a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.

A communication system in which a mobile terminal according to the present invention can be operated will now be described with reference to FIG.

Such communication systems may use different air interfaces and/or physical layers. For example, air interfaces used by communication systems include, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)). ), Global System for Mobile Communications (GSM), etc. As a non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.

Referring to FIG. 2, a CDMA wireless communication system can include a plurality of mobile terminals 100, a plurality of base stations (BS) 270, a base station controller (BSC) 275, and a mobile switching center (MSC) 280. The MSC 280 is configured to interface with a public switched telephone network (PSTN) 290. The MSC 280 is also configured to interface with a BSC 275 that can be coupled to the base station 270 via a backhaul line. The backhaul line can be constructed in accordance with any of a number of well known interfaces including, for example, E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. It will be appreciated that the system as shown in FIG. 2 may include multiple BSC 2750s.

Each BS 270 can serve one or more partitions (or regions), each of which is covered by a multi-directional antenna or an antenna directed to a particular direction radially away from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS 270 can be configured to support multiple frequency allocations, and each frequency allocation has a particular frequency spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of partitioning and frequency allocation can be referred to as a CDMA channel. BS 270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" can be used to generally refer to a single BSC 275 and at least one BS 270. A base station can also be referred to as a "cell station." Alternatively, each partition of a particular BS 270 may be referred to as a plurality of cellular stations.

As shown in FIG. 2, a broadcast transmitter (BT) 295 transmits a broadcast signal to operations within the system. Mobile terminal 100. A broadcast receiving module 111 as shown in FIG. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In Figure 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 helps locate at least one of the plurality of mobile terminals 100.

In Figure 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information can be obtained using any number of satellites. The GPS module 115 as shown in Figure 1 is typically configured to cooperate with the satellite 300 to obtain desired positioning information. Instead of GPS tracking technology or in addition to GPS tracking technology, other techniques that can track the location of the mobile terminal can be used. Additionally, at least one GPS satellite 300 can selectively or additionally process satellite DMB transmissions.

As a typical operation of a wireless communication system, BS 270 receives reverse link signals from various mobile terminals 100. Mobile terminal 100 typically participates in calls, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within a particular BS 270. The obtained data is forwarded to the relevant BSC 275. The BSC provides call resource allocation and coordinated mobility management functions including a soft handoff procedure between the BSs 270. The BSC 275 also routes the received data to the MSC 280, which provides additional routing services for interfacing with the PSTN 290. Similarly, PSTN 290 interfaces with MSC 280, which forms an interface with BSC 275, and BSC 275 controls BS 270 accordingly to transmit forward link signals to mobile terminal 100.

Based on the above-described mobile terminal hardware structure and communication system, various embodiments of the video call method of the present invention are proposed.

As shown in FIG. 3, a first embodiment of a video call method according to the present invention is proposed. The method is applied to a mobile terminal, and includes the following steps:

S11. Connect to a mobile communication network to establish a first communication channel.

In the embodiment of the present invention, the mobile communication network refers to a communication network based on a SIM card, and the mobile communication network capable of supporting video calls at present includes a 3G network and a 4G network. Among them, 3G networks such as CDMA2000, WCDMA, TD-SCDMA, WiMAX, etc., 4G networks such as LTE. The type of the first communication channel is preferably an IMS channel, and of course other types can be established as needed. aisle.

S12. Establish a video call connection with the peer end through the mobile communication network, and transmit the call data through the first communication channel. During the video call, it is determined whether the preset condition is met, and when the preset condition is met, step S13 is performed.

Specifically, when the user performs video call dialing, the terminal establishes a video call connection with the peer end through the mobile communication network. After the video call connection is established, the terminal captures the sound and image through the microphone and the camera, and the APP processor transmits the sound and image to the ADSP module for processing, and simultaneously controls the ADSP module. The sound and image processed by the ADSP module become the call data in the data packet format, and then the call data is allocated to the first communication channel, and the first communication channel performs processing such as adding a packet header, compressing and encoding, and then passing through the first communication channel. The radio frequency is sent out, and the call data returned by the opposite end is received through the first communication channel.

In the case of establishing a video call connection, the terminals of both parties of the call are assigned an IP address. Relatively speaking, the IP address of the local end is the source address, the IP address of the peer end is the destination address, and the data packet of the call data includes the source address. And destination address. The call data includes audio data and video data.

During the video call, you can determine whether the preset conditions are met by the following methods:

In an embodiment, when a reliable wireless network signal is detected (eg, the signal strength is greater than a threshold), then it is determined that the preset condition is met.

In an embodiment, when a reliable wireless network signal is detected (eg, the signal strength is greater than a threshold) and the mobile communication network signal is weak (eg, the signal strength is less than a threshold), then it is determined that the preset condition is met. Alternatively, when it is detected that the mobile communication network signal is weak and there is a wireless network signal, it is determined that the preset condition is satisfied.

In an embodiment, when a reliable wireless network signal is detected (eg, the signal strength is greater than a threshold) and the first setting is detected, then it is determined that the preset condition is met. The wireless network video call function is enabled in the first setting, that is, the setting option, and the function can be turned on or off by default.

In an embodiment, when a reliable wireless network signal is detected (eg, the signal strength is greater than a threshold) and the first user command is detected, then it is determined that the preset condition is met. The first user instruction is a preset instruction for triggering the wireless network video call function, and the user can issue the first user instruction by touching the screen, issuing a volley gesture, issuing a voice, pressing a button, and the like.

In an embodiment, when a reliable wireless network signal is detected (eg, the signal strength is greater than a threshold), the user is asked whether to enable the wireless network video call function, and when the user selects to enable, it is determined that the preset condition is met.

S13. Connect to a wireless network to establish a second communication channel.

In the embodiment of the present invention, the wireless network refers to a network of a wireless network card based on the terminal, such as an existing WLAN (Wireless Local Area Networks) network, and most typically a WIFI (Wireless Fidelity) network. The type of the second communication channel may be an IMS channel or an internet channel.

S14. Transmitting call data through the first communication channel and the second communication channel.

Specifically, the terminal detects the signal strength of the mobile communication network and the wireless network, and distributes the call data stream between the first communication channel and the second communication channel according to the signal strength of the mobile communication network and the wireless network. When the mobile communication network is stronger than the signal of the wireless network, a larger proportion of the call data stream is allocated in the first communication channel; when the mobile communication network is weaker than the signal of the wireless network, a smaller proportion is allocated in the first communication channel. The call data stream; when the signal strengths of the mobile communication network and the wireless network are equal, the call data stream is evenly distributed between the first communication channel and the second communication channel. The call data stream includes a video data stream and an audio data stream transmitted during a video call. When the communication channel is an IMS channel, the call data transmitted by the IMS channel is IMS type call data; when the communication channel is an internet channel, the call data transmitted by the call channel is internet type call data.

For example, there are five situations in which the call data stream can be assigned:

(1) When the signal of the mobile communication network is strong (such as the intensity is greater than -80dbm), the wireless network signal is strong (such as When the intensity is greater than -70dbm), 50% of the call data stream is allocated to each of the first communication channel and the second communication channel;

(2) When the mobile communication network signal is weak (such as between -140dbm and -120dbm) and the wireless network signal is weak (such as the intensity is less than -90dbm), allocate 50% to each of the first communication channel and the second communication channel. Call data stream;

(3) When the signal of the mobile communication network is strong (such as the intensity is greater than -80dbm) and the wireless network signal is weak (such as the intensity is less than -90dbm), 95% of the call data stream is allocated to the first communication channel, and 5 is allocated to the second communication channel. % of the call data stream;

(4) When the mobile communication network signal is weak (such as the intensity between -140dbm and -120dbm), and the wireless network signal is strong (such as the intensity is greater than -70dbm), allocate 5% of the call data stream to the first communication channel, The second communication channel allocates 95% of the call data stream;

(5) When the signal strength of the mobile communication network is between -80dbm and -120dbm, the signal strength of the wireless network is no longer considered. At this time:

If the signal strength of the mobile communication network is between -80 dbm and -90 dbm, assigning 80% of the call data stream to the first communication channel and 20% of the call data stream to the second communication channel;

If the signal strength of the mobile communication network is between -90 dbm and -100 dbm, assigning 60% of the call data stream to the first communication channel and 40% of the call data stream to the second communication channel;

If the signal strength of the mobile communication network is between -100 dbm and -110 dbm, assigning 40% of the call data stream to the first communication channel and 60% of the call data stream to the second communication channel;

If the signal strength of the mobile communication network is between -110 dbm and -120 dbm, 20% of the call data stream is allocated to the first communication channel, and 80% of the call data stream is allocated to the second communication channel.

When the terminal is connected to the wireless network, it will also be assigned an IP address as the source address. When the terminal allocates the data stream to the first and second communication channels, the destination address is obtained from the packet data packet of the call data stream of the first communication channel, and the destination address is copied to the packet data of the call data stream of the second communication channel. In the packet, the source address in the packet is unchanged. First communication channel and After receiving the call data stream, the second communication channel sends the respective call data stream through the radio frequency, and receives the call data returned by the opposite end.

The data structure of the packet data packet in the first communication channel and the second communication channel is as shown in FIG. 4, and includes a source address, a destination address, and a Packet Data Unit (PDU).

As shown in FIG. 5 and FIG. 6 , a second embodiment of the video call method applied to the mobile terminal of the present invention is provided. In this embodiment, the mobile communication network is an LTE network, and the wireless network is a WLAN network. The method includes the following steps. :

S21. Connect to an LTE network to establish a first communication channel.

As shown in FIG. 6, the established first communication channel is composed of an IMS protocol stack, an LTE protocol stack, and a radio frequency module. In this embodiment, the first communication channel is an IMS channel.

S22. Establish a VOLTE video call connection with the peer end through the LTE network, and transmit the call data through the first communication channel. During the video call, it is determined whether the preset condition is met, and when the preset condition is met, step S23 is performed.

Specifically, as shown in FIG. 6, when the user performs video call dialing, the terminal establishes a VOLTE video call connection with the peer end through the LTE network. After the video call connection is established, the terminal captures the sound and image through the microphone and the camera, and the APP processor transmits the sound and image to the ADSP module for processing, and simultaneously controls the ADSP module. The sound and image processed by the ADSP module become the call data in the data packet format, and then the call data is allocated to the first communication channel, and the IMS protocol stack and the LTE protocol stack of the first communication channel are processed by adding a packet header, compression coding, and the like. Then, it is sent out through the radio frequency module in the first communication channel, and the call data returned by the opposite end is received through the first communication channel. In this embodiment, the first communication channel transmits IM type call data.

Since LTE only has a PS domain, when a VOLTE video call is made, a packet data packet of a voice and an image is transmitted through the PS domain. When a video call connection is established, both terminals of the call are assigned an IP address, and the IP of the local end is relatively The address is the source address, the IP address of the peer end is the destination address, and the data packet of the call data includes the source address and the destination address. Call data including audio Data and video data.

The specific processing procedure of the VOLTE video call in the LTE network in the step S22 is the same as that in the prior art, and details are not described herein again.

In an embodiment, when a reliable WLAN network signal is detected (eg, the signal strength is greater than a threshold), then it is determined that the preset condition is met.

In an embodiment, when a reliable WLAN network signal is detected (eg, the signal strength is greater than a threshold) and the LTE network signal is weak (eg, the signal strength is less than a threshold), then it is determined that the preset condition is met. Or, when it is detected that the LTE network signal is weak and there is a WLAN network signal, it is determined that the preset condition is met.

In an embodiment, when a reliable WLAN network signal is detected (eg, the signal strength is greater than a threshold) and the first setting is detected, then it is determined that the preset condition is met. Among them, the WLAN network video call function is enabled in the first setting, that is, the setting option, and the function can be turned on or off by default.

In an embodiment, when a reliable WLAN network signal is detected (eg, the signal strength is greater than a threshold) and a first user command is detected, then it is determined that the preset condition is met. The first user instruction is a preset instruction for triggering the WLAN network video call function, and the user may issue the first user instruction by touching the screen, issuing a volley gesture, issuing a voice, pressing a button, and the like.

In an embodiment, when a reliable WLAN network signal is detected (eg, the signal strength is greater than a threshold), the user is asked whether to enable the WLAN network video call function, and when the user selects to enable, it is determined that the preset condition is met.

S23. Connect to the WLAN network to establish a second communication channel.

As shown in FIG. 6, the established second communication channel is composed of an IP processing module, a WLAN protocol stack, and a radio frequency module. When the terminal is connected to the wireless network, it will also be assigned an IP address as the source address. In this embodiment, the second communication channel is an IMS channel or an internet channel.

S24. Transmitting call data through the first communication channel and the second communication channel.

Specifically, as shown in FIG. 6, an interface function may be added between the WLAN module and the IMS protocol stack of the terminal, and the interface function has a flag bit WLAN_FLAG, and the interface function is also responsible for coordinating transmission by the ADSP module. How the call data stream is reasonably allocated to the first communication channel and the second communication channel. If the terminal determines the preset condition during the video call and the WLAN module internally detects that the WLAN network is connected, set WLAN_FLAG to 1, and enable the WLAN_call option (ie, enable the WLAN network video call function). When WLAN_FLAG=1 is detected, the terminal may ask the user whether to use the WLAN_call function; when the user chooses to use the WLAN_call function, the LTE network and the WLAN network are used for video call at the same time; when the user chooses not to use the WLAN_call function, the LTE video call continues to be used. . In some embodiments, when WLAN_FLAG=1 is detected, the WLAN_call function is used directly without asking the user.

After the WLAN_call function is enabled, the call data is assigned to the first communication channel and the second communication channel. When the terminal allocates the data stream to the LTE and the second communication channel, the destination address is obtained from the packet data packet of the call data stream of the first communication channel, and the destination address is copied to the packet data packet of the call data stream of the second communication channel. Medium, while the source address in the packet is unchanged. The call data allocated to the first communication channel is processed by the IMS protocol stack and the LTE protocol stack, and then sent out by the radio frequency module; the call data allocated to the second communication channel is packetized by the IP processing module and the WLAN protocol stack. After the packet is processed, it is sent out through the RF module. At the same time, the first communication channel and the second communication channel receive the call data returned by the opposite end.

If the terminal detects that the WLAN network connection is disconnected, the WLAN_FLAG is set to 0, and the terminal re-switches to the LTE video call mode, that is, only the WLAN/LTE video call is detected. The call data is transmitted through the first communication channel.

The terminal detects signals of the LTE network and the WLAN network when the call data stream is allocated. Intensity, according to the signal strength of the LTE network and the WLAN network, the call data stream is allocated proportionally between the first communication channel and the second communication channel. When the LTE network is stronger than the signal of the WLAN network, a larger proportion of the call data stream is allocated in the first communication channel; when the LTE network is weaker than the signal of the WLAN network, a smaller proportion of the call data is allocated in the first communication channel. Flow; when the signal strengths of the LTE network and the WLAN network are equal, the call data stream is evenly distributed between the first communication channel and the second communication channel. The call data stream includes a video data stream and an audio data stream transmitted during a video call.

(1) When the LTE network signal is strong (such as rsrp ≥ -80dbm) and the WLAN network signal is strong (such as rss ≥ -70dbm), 50% of the call data stream is allocated to each of the first communication channel and the second communication channel;

(2) When the LTE network signal is weak (such as -140dbm<rsrp<-120dbm) and the WLAN network signal is weak (such as rssi<-90dbm), allocate 50% of the call data stream to each of the first communication channel and the second communication channel. ;

(3) When the LTE network signal is strong (such as rsrp≥-80dbm) and the WLAN network signal is weak (such as rssi<-90dbm), 95% of the call data stream is allocated to the first communication channel, and 5% is allocated to the second communication channel. Call data stream;

(4) When the LTE network signal is weak (such as -140dbm<rsrp<-120dbm) and the WLAN network signal is strong (such as rssi≥-70dbm), allocate 5% of the call data stream to the first communication channel to the second communication channel. Allocating 95% of the call data stream;

(5) When the signal strength of the LTE network is between -80dbm and -120dbm, the signal strength of the WLAN network is between -70dbm and -90dbm, at this time:

If the LTE network signal strength is: -80dbm<rsrp≤-90dbm, allocate 80% of the call data stream to the first communication channel, and allocate 20% of the call data stream to the second communication channel;

If the LTE network signal strength is: -90dbm<rsrp≤-100dbm, allocate 60% of the call data stream to the first communication channel, and allocate 40% of the call data stream to the second communication channel;

If the LTE network signal strength is: -100dbm<rsrp≤-110dbm, allocate 40% of the call data stream to the first communication channel, and allocate 60% of the call data stream to the second communication channel;

If the LTE network signal strength is: -110dbm<rsrp≤-120dbm, 20% of the call data stream is allocated to the first communication channel, and 80% of the call data stream is allocated to the second communication channel.

Therefore, the video calling method of the present invention expands the network bandwidth, improves the data transmission rate, and improves the video call quality by enabling the wireless network during the video call and simultaneously transmitting the call data using the mobile communication network and the wireless network. Even if the mobile communication network signal is weak, the wireless network can be used in combination to ensure the quality of the video call, the flexibility of the video call and the intelligent level of the terminal are improved, and the video call experience of the user is improved.

The present invention further provides a video communication device applied to the aforementioned mobile terminal. An embodiment of the video communication device of the present invention is now based on the above-described mobile terminal hardware structure and communication system. As shown in FIG. 7, the apparatus includes a first communication module, a second communication module, and a video call module, wherein:

The first communication module 71 is configured to connect to the mobile communication network to establish a first communication channel. The type of the first communication channel is preferably an IMS channel.

The video calling module 72 is configured to establish a video call connection with the opposite end through the mobile communication network, and transmit the call data through the first communication channel.

The second communication module 73 is configured to determine whether the preset condition is met during the video call; when the preset condition is met, connect the wireless network to establish a second communication channel. The type of the second communication channel may be an IMS channel or an internet channel.

Specifically, as shown in FIG. 8, the second communication module 73 includes:

The determining unit 731 is configured to determine whether the preset condition is met during the video call, and notify the channel establishing unit channel establishing unit when the preset condition is met. In an embodiment, when it is detected that there is a reliable wireless network signal, and it is detected that the mobile communication network signal is weak, the first setting is detected, or the first user instruction is received, it is determined that the preset condition is satisfied.

The channel establishing unit 732 is configured to connect to the wireless network and establish a second communication channel when the determining unit determines that the preset condition is met.

The video call module 72 is further configured to transmit call data through the first communication channel and the second communication channel after the second communication channel is established.

Specifically, after the second communication channel is established, the channel establishment unit channel establishing unit allocates the call data stream between the first communication channel and the second communication channel in proportion according to the signal strength of the mobile communication network and the wireless network. When the mobile communication network is stronger than the signal of the wireless network, a larger proportion of the call data stream is allocated in the first communication channel; when the mobile communication network is weaker than the signal of the wireless network, a smaller proportion is allocated in the first communication channel. The call data stream; when the signal strengths of the mobile communication network and the wireless network are equal, the call data stream is evenly distributed between the first communication channel and the second communication channel.

When the video call module allocates the data stream to the first and second communication channels, the destination address is obtained from the packet data packet of the call data stream of the first communication channel, and the destination address is copied to the call data stream of the second communication channel. In a packet packet.

In an embodiment, the mobile communication network is an LTE network, and the first communication module is established by the LTE network, and the first communication channel is composed of an IMS protocol stack, an LTE protocol stack, and a radio frequency module; the wireless network is a WLAN network. a second communication channel established by the second communication module through the WLAN network, where the second communication channel is composed of an IP processing module, a WLAN protocol stack, and a radio frequency module.

The video call device and the video call method are provided in the same embodiment. The specific implementation process is described in the method embodiment, and the technical features in the device embodiment are applicable in the device embodiment, and details are not described herein.

Therefore, the video calling device of the present invention expands the network bandwidth, improves the data transmission rate, and improves the video call quality by enabling the wireless network during the video call and simultaneously transmitting the call data using the mobile communication network and the wireless network. Even if the mobile communication network signal is weak, It is also possible to jointly use the wireless network to ensure the quality of the video call, improve the flexibility of the video call and the intelligent level of the terminal, and improve the video call experience of the user.

The present invention also provides a video calling system. As shown in FIG. 9, the video calling system includes a first mobile terminal 91, a relay server 92, and a second mobile terminal 93. The relay server 93 is connected to the first mobile terminal 91 and the first Between two mobile terminals 92, wherein:

The first mobile terminal 91 is configured to establish a video call connection with the second mobile terminal, establish a first communication channel and a second communication channel through the mobile communication network and the wireless network, and transmit the call data through the first communication channel and the second communication channel.

a second mobile terminal 93: configured to establish a video call connection with the first mobile terminal, establish a first communication channel or/and a second communication channel through the mobile communication network or/and the wireless network, through the first communication channel or/and the second The communication channel transmits call data.

As shown in FIG. 10, a specific process for establishing an example of a video call connection between a first mobile terminal and a second mobile terminal: First, the first mobile terminal detects a local IP address (eg, an IP address configured by two different gateways including IMS and internet) And sending an IP address and a video call request to the second mobile terminal; then, the second mobile terminal detects the local IP address (such as an IP address including two different gateway configurations of IMS and internet), and sends the IP to the second mobile terminal. Address and reply request; Finally, the first mobile terminal and the second mobile terminal respectively obtain the IP address of the other party to establish a video call connection.

The relay server 92 is configured to receive the call data, analyze the channel type of the destination address in the call data, determine whether to perform data conversion on the call data according to the channel type, and forward the call data through the corresponding communication channel.

The type of the first communication channel is preferably an IMS channel, and the type of the second communication channel is an IMS channel or an internet channel. The IMS channel transmits IMS type call data, and the internet channel transmits internet type call data. The channel type includes an IMS channel and an internet channel. When the type of the call data is different from the channel type of the destination address of the call data, the transit service is used. The device performs data conversion on the call data, and converts the type of the call data to match the channel type of the destination address.

Correspondingly, the present invention also provides a video calling method, including the following steps:

S101. The first mobile terminal establishes a video call connection with the second mobile terminal.

S102. The first mobile terminal establishes a first communication channel and a second communication channel by using a mobile communication network and a wireless network, and transmits call data through the first communication channel and the second communication channel; and the second mobile terminal uses a mobile communication network or/and wireless The network establishes a first communication channel or/and a second communication channel, and transmits call data through the first communication channel or/and the second communication channel.

S103. The transit server receives the call data sent by the first mobile terminal or the second mobile terminal, parses the channel type of the destination address in the call data, determines whether to perform data conversion on the call data according to the channel type, and moves to the second mobile through the corresponding communication channel. The terminal or the first mobile terminal forwards the call data.

Preferably, the first communication channel is an IMS channel, and the second communication channel is an IMS channel or an internet channel, wherein the IMS channel transmits IMS type call data, and the internet channel transmits internet type call data. The channel type of the destination address includes the IMS channel and the internet channel. When the type of the call data is different from the channel type of the destination address of the call data, the transit server performs data conversion on the call data.

The following is a description of the process of making a video call by the video communication system of the present invention by taking the mobile communication network as the LTE network and the wireless network as the WIFI network as an example:

Example one

As shown in FIG. 11, the first mobile terminal establishes an IMS channel and an internet channel respectively through the LTE network and the WIFI network, and the second mobile terminal also establishes an IMS channel and an internet channel through the LTE network and the WIFI network, respectively. When the transit server receives the call data transmitted by the IMS channel of the first mobile terminal, the channel type of the destination address in the call data is IMS type, and the call data is forwarded to the second mobile terminal through the IMS channel of the second mobile terminal; Transfer service When receiving the call data transmitted by the internet channel of the first mobile terminal, the channel type of the destination address in the call data is analyzed as an internet type, and the call data is forwarded to the second mobile terminal through the internet channel of the second mobile terminal. Conversely, the manner in which the relay server receives the call data of the second mobile terminal is also the same.

Example two

As shown in FIG. 12, the first mobile terminal establishes an IMS channel through the LTE network and the WIFI network, respectively, and the second mobile terminal establishes an IMS channel through the LTE network.

When the transit server receives the call data transmitted by the two IMS channels of the first mobile terminal, the channel type of the destination address in the call data is IMS type, and the call data is forwarded to the second through the IMS channel of the second mobile terminal. Mobile terminal.

When the transit server receives the call data transmitted by the IMS channel of the second mobile terminal, the channel type of the destination address in the call data is IMS type, and the call data is forwarded to the corresponding IMS channel of the first mobile terminal according to the destination address. The first mobile terminal.

Example three

As shown in FIG. 13, the first mobile terminal establishes an IMS channel and an internet channel respectively through the LTE network and the WIFI network, and the second mobile terminal establishes an internet channel through the WIFI network.

When the transit server receives the call data transmitted by the IMS channel of the first mobile terminal, the channel type of the destination address in the call data is parsed into an internet type, the call data is converted into the internet type call data, and the call data is passed. The internet channel of the second mobile terminal is forwarded to the second mobile terminal; when the relay server receives the call data transmitted by the internet channel of the first mobile terminal, the channel type of the destination address in the call data is parsed to be the internet type, and the second type is passed. The internet channel of the mobile terminal is forwarded to the second mobile terminal.

When the transit server receives the call data transmitted by the internet channel of the second mobile terminal, the channel type of the destination address in the call data is parsed; when the channel type is the IMS type, the call data is converted into the IMS type call data. And pass the call data through the first move The IMS channel of the terminal is forwarded to the first mobile terminal; when the channel type is the internet type, it is forwarded to the first mobile terminal through the internet channel of the first mobile terminal.

Example four

As shown in FIG. 14, the first mobile terminal establishes an IMS channel and an internet channel respectively through the LTE network and the WIFI network, and the second mobile terminal establishes an IMS channel through the LTE network.

When the transit server receives the call data transmitted by the IMS channel of the first mobile terminal, the channel type of the destination address in the call data is IMS type, and the call data is forwarded to the second mobile terminal through the IMS channel of the second mobile terminal. When the relay server receives the call data transmitted by the internet channel of the first mobile terminal, the channel type of the destination address in the call data is parsed into an IMS type, and the call data is converted into the IMS type call data, and the second mobile The IMS channel of the terminal is forwarded to the second mobile terminal.

When the transit server receives the call data transmitted by the IMS channel of the second mobile terminal, the channel type of the destination address in the call data is parsed; when the channel type is the IMS type, the call data is passed through the IMS channel of the first mobile terminal. Forwarding to the first mobile terminal; when the channel type is the internet type, converting the call data to the internet type call data, and forwarding the call data to the first mobile terminal through the internet channel of the first mobile terminal.

In the video calling system and method of the present invention, the first mobile terminal and the second mobile terminal can enable the wireless network during the video call, and simultaneously transmit the call data using the mobile communication network and the wireless network, and the transit server can channel according to the destination address in the call data. The type performs data conversion and selects the corresponding communication channel to forward the call data, expands the network bandwidth, improves the data transmission rate, and improves the video call quality. Even if the mobile communication network signal is weak, the wireless network can be used in combination to ensure the quality of the video call, the flexibility of the video call and the intelligent level of the terminal are improved, and the video call experience of the user is improved.

The present invention also provides a video communication device applied to the foregoing relay server. As shown in FIG. 15, the video communication device includes the following unit modules:

The receiving module 151 is configured to receive call data.

Parsing module 152: configured to resolve the channel type of the destination address in the call data.

The processing module 153 is configured to determine, according to the channel type, whether to perform data conversion on the call data and forward the call data through the corresponding communication channel. The communication channel includes a first communication channel established through the mobile communication network and a second communication channel established through the wireless network.

Preferably, the first communication channel is an IMS channel, and the second communication channel is an IMS channel or an internet channel, wherein the IMS channel transmits IMS type call data, and the internet channel transmits internet type call data. The channel type includes an IMS channel and an internet channel. When the type of the call data is different from the channel type of the destination address of the call data, the processing module performs data conversion on the call data, and converts the type of the call data to the channel type of the destination address. . For example, when the call data is IMS type call data, and the destination address channel type is internet type, the processing module converts the call data into internet type call data; when the call data is internet type call data, and When the channel type of the destination address is IMS type, the processing module converts the call data into the call data of the IMS type.

The processing module determines whether to perform data conversion on the call data and forwards the call data through the corresponding communication channel according to the channel type. For details, refer to the foregoing examples 1 to 4 and FIGS. 11 to 14, which are not described herein again.

Correspondingly, the present invention also provides a video calling method applied to the foregoing relay server, the method comprising the following steps:

S201. Receive call data.

S202. Analyze a channel type of a destination address in the call data.

S203. Determine, according to the channel type, whether to perform data conversion on the call data and forward the call data through the corresponding communication channel.

The communication channel includes a first communication channel established through the mobile communication network and a second communication channel established through the wireless network.

Preferably, the first communication channel is an IMS channel, and the second communication channel is an IMS channel or an internet channel, wherein the IMS channel transmits IMS type call data, and the internet channel transmits internet type call data. The channel type includes an IMS channel and an internet channel. When the type of the call data is different from the channel type of the destination address of the call data, the call data is converted, and the type of the call data is converted to the channel type of the destination address. For example, when the call data is IMS type call data, and the channel type of the destination address is internet type, the call data is converted into the internet type call data; when the call data is the internet type call data, and the destination address thereof When the channel type is IMS type, the call data is converted into IMS type call data.

For the process of determining whether to perform data conversion on the call data and forwarding the call data through the corresponding communication channel according to the channel type, refer to the foregoing examples 1 to 4 and FIGS. 11 to 14 , and details are not described herein again.

The video call device and method applied to the relay server can perform data conversion according to the channel type of the destination address in the call data and select the corresponding communication channel to forward the call data, so that the first mobile terminal and the second mobile terminal can be in the video call. In the process, the wireless network is enabled, and the mobile communication network and the wireless network are used to transmit the call data, thereby expanding the network bandwidth, increasing the data transmission rate, and improving the quality of the video call. Even if the mobile communication network signal is weak, the wireless network can be used in combination to ensure the quality of the video call, the flexibility of the video call and the intelligent level of the terminal are improved, and the video call experience of the user is improved.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, The optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the methods described in various embodiments of the present invention.

The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the present invention and the drawings are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Industrial applicability

The technical solution of the embodiment of the present invention expands the network bandwidth, improves the data transmission rate, and improves the video call quality by enabling the wireless wifi network during the video call and simultaneously transmitting the call data using the mobile communication network and the wireless wifi network. Even if the mobile communication network signal is weak, the wireless network can be used in combination to ensure the quality of the video call, the flexibility of the video call and the intelligent level of the terminal are improved, and the video call experience of the user is improved.

Claims

A video calling system includes a first mobile terminal, a relay server and a second mobile terminal, wherein the relay server is connected between the first mobile terminal and the second mobile terminal, wherein:

The first mobile terminal is configured to establish a video call connection with the second mobile terminal, establish a first communication channel and a second communication channel by using the mobile communication network and the wireless network, by using the first communication channel and the first Two communication channels transmit call data;

The second mobile terminal is configured to establish a video call connection with the first mobile terminal, establish a first communication channel or/and a second communication channel through the mobile communication network or/and the wireless network, and pass the first communication channel Or / and the second communication channel transmits call data;

The transit server is configured to receive the call data, parse a channel type of the destination address in the call data, determine, according to the channel type, whether to perform data conversion on the call data and forward the call through a corresponding communication channel. data.
The video calling system according to claim 1, wherein said first communication channel is an IP Multimedia Subsystem IMS channel, said second communication channel is an IMS channel or an Internet internet channel, and said IMS channel transmits an IMS type call Data, the internet channel transmits the call data of the internet type, and the channel type includes an IMS channel and an internet channel. When the type of the call data is different from the channel type of the destination address of the call data, the transit server pair The call data is converted into data.
A video calling device, applied to a relay server, includes:

a receiving module configured to receive call data;

a parsing module configured to parse a channel type of a destination address in the call data;

a processing module, configured to determine, according to the channel type, whether to perform data conversion on the call data and forward the call data through a corresponding communication channel;

Wherein the communication channel comprises a first communication channel and a communication established through a mobile communication network The second communication channel established by the wireless network.
The video communication device according to claim 3, wherein the first communication channel is an IMS channel, the second communication channel is an IMS channel or an internet channel, and the IMS channel transmits IMS type call data, the internet The channel transmits the call data of the internet type, and the channel type includes an IMS channel and an internet channel. When the type of the call data is different from the channel type of the destination address of the call data, the processing module performs the call data. Data conversion.
A video calling device is applied to a mobile terminal, including:

a first communication module configured to connect to the mobile communication network to establish a first communication channel;

a video call module, configured to establish a video call connection with the opposite end by using the mobile communication network, and transmit call data through the first communication channel;

The second communication module is configured to determine whether the preset condition is met during the video call; when the preset condition is met, connect the wireless network to establish a second communication channel;

The video call module is further configured to: after the second communication module establishes the second communication channel, transmit the call data through the first communication channel and the second communication channel.
The video communication device according to claim 5, wherein said second communication module comprises a judging unit and a channel establishing unit channel establishing unit, wherein:

The determining unit is configured to determine that a preset condition is met when detecting that a reliable wireless network signal is detected, and detecting that the mobile communication network signal is weak, detecting the first setting, or receiving the first user instruction;

The channel establishing unit channel establishing unit is configured to connect to the wireless network and establish a second communication channel when the determining unit determines that the preset condition is met.
The video call device of claim 5, wherein the video call module is further configured to:

After the second communication channel is established, according to the mobile communication network and the wireless network The signal strength of the network, proportionally distributing the call data stream between the first communication channel and the second communication channel.
The video call device of claim 5, wherein the video call module further comprises an address obtaining module, and the address obtaining module is configured to:

Obtaining a destination address from a packet data packet of the call data stream of the first communication channel, and copying the destination address in a packet data packet of a call data stream of the second communication channel.
The video communication device according to any one of claims 5-8, wherein the mobile communication network is an LTE network, and the wireless network is a WLAN network.
The video communication device according to any one of claims 5-8, wherein the first communication channel is an IMS channel, and the second communication channel is an IMS channel or an internet channel.
A video calling method, including:

Establishing, by the first mobile terminal, a video call connection with the second mobile terminal;

The first mobile terminal establishes a first communication channel and a second communication channel through a mobile communication network and a wireless network, and transmits call data through the first communication channel and the second communication channel; the second mobile terminal moves by Establishing a first communication channel or/and a second communication channel by the communication network or/and the wireless network, and transmitting the call data through the first communication channel or/and the second communication channel;

The relay server receives the call data sent by the first mobile terminal or the second mobile terminal, parses the channel type of the destination address in the call data, and determines whether to perform data conversion and pass the call data according to the channel type. The corresponding communication channel forwards the call data to the second mobile terminal or the first mobile terminal.
The video calling method according to claim 11, wherein the first communication channel is an IMS channel, the second communication channel is an IMS channel or an internet channel, and the IMS channel transmits IMS type call data, the internet The channel transmits the call data of the internet type, and the channel type includes an IMS channel and an internet channel, when the type of the call data is When the channel type of the destination address of the call data is inconsistent, the transit server performs data conversion on the call data.
A video calling method applied to a transit server includes:

Receiving call data;

Parsing a channel type of the destination address in the call data;

Determining, according to the channel type, whether to perform data conversion on the call data and forwarding the call data through a corresponding communication channel;

The communication channel includes a first communication channel established through a mobile communication network and a second communication channel established through a wireless network.
The video calling method according to claim 13, wherein the first communication channel is an IMS channel, the second communication channel is an IMS channel or an internet channel, and the IMS channel transmits IMS type call data, the internet The channel transmits the call data of the internet type, and the channel type includes an IMS channel and an internet channel. When the type of the call data is different from the channel type of the destination address of the call data, data conversion is performed on the call data.
A video calling method is applied to a mobile terminal, including:

Connecting a mobile communication network to establish a first communication channel;

Establishing a video call connection with the opposite end through the mobile communication network, and transmitting call data through the first communication channel;

During the video call, when the preset condition is met, the wireless network is connected to establish a second communication channel;

The call data is transmitted through the first communication channel and the second communication channel.
The video calling method according to claim 15, wherein the method further comprises:

During a video call, when a reliable wireless network signal is detected and the mobile communication network signal is detected to be weak, the first setting is detected, or the first user command is received, the determination is full. Presupposed conditions.
The video call method according to claim 15, wherein said transmitting said call data through said first communication channel and said second communication channel comprises:

Distributing the call data stream between the first communication channel and the second communication channel in proportion to a signal strength of the mobile communication network and the wireless network to pass the first communication channel and The second communication channel transmits the call data.
The video calling method according to claim 15, wherein said step of distributing said call data stream between said first communication channel and said second communication channel in proportion comprises:

Obtaining a destination address from a packet data packet of the call data stream of the first communication channel, and copying the destination address in a packet data packet of a call data stream of the second communication channel.
The video call method according to any one of claims 15 to 18, wherein the mobile communication network is a long term evolution LTE network, and the wireless network is a wireless local area network (WLAN).
The video calling method according to any one of claims 15 to 18, wherein the first communication channel is an IMS channel, and the second communication channel is an IMS channel or an internet channel.