KR101316482B1 - Mobile Device and Method for Videotelephony - Google Patents

Abstract

A mobile terminal for a video call and a video call method thereof are provided. When a video call request is input, the resource pooling unit of the mobile terminal for the video call determines a multi-path to be used for the video call based on the state of a plurality of networks available in the mobile terminal, and the communication unit determines the determined multi-path. The pass may be used to transmit audio data and video data required for a video call.

Description

Mobile device for video call and video call method thereof {Mobile Device and Method for Videotelephony}

The present invention relates to a mobile terminal for a video call and a video call method thereof, and more particularly, to a mobile terminal for a video call and a video call method thereof that can provide a video call service using a multipath.

There is an increasing number of available IP-based toll-free applications. Recently, Google and Apple have also provided IP-based video call services such as Google Talk and Facetime.

Meanwhile, the mobile terminal can use various wireless networks such as a cellular network such as 3G, a wireless LAN such as WiFi, and WiBro, but uses one network to provide a real voice call service or a video call service. That is, although the conventional network has an interface for various networks, it provides a VoIP (Voice over Internet Protocol) service that implements a voice call through packet data based on an IP network using one network. This provides VoIP services without making the most of the available network bandwidth.

In addition, when a handover occurs while providing a VoIP service using one network path, there is a problem in that a call is reconnected or a long time delay occurs while searching for a new network path. In addition, the multipath technology provided by the transport layer of the OSI 7 layer is used based on the Transmission Control Protocol (TCP), but is not applied to a service such as VoIP using the User Datagram Protocol (UDP).

According to an exemplary embodiment of the present invention, there is provided a mobile terminal for a video call and a video call method thereof capable of controlling the use of various network paths and the amount of data used for each network path.

According to another exemplary embodiment of the inventive concept, a mobile terminal for a video call may, when a request for the video call is input, multi-use for the video call based on a state of a plurality of networks available in the mobile terminal. A resource pooling unit to determine a path (Multi-Path); And a communicator configured to transmit audio data and video data necessary for the video call using the determined multipath.

The resource pooling unit may include: a network state collecting unit collecting and outputting information representing the states of the plurality of networks; If the bandwidth of the plurality of networks is greater than or equal to a predetermined reference value by analyzing the collected information and the network quality is within a stable criterion, the multipath or the at least one network among the plurality of networks is set. A multipath determination unit determining a single pass; And a data distribution unit for adaptively distributing the audio data and the image data according to the determined multipath.

The image processing unit for down-adjusting the quality of the image data at the request of the multipath determination unit; The multipath determination unit, if the network quality of the plurality of networks belong to an unstable criterion, Some bands of at least two networks having a high priority among networks are determined as a path for redundant transmission of the voice data, and the remaining bands of the at least two networks having the highest priority are used for downgrading the video data of which the quality is down-regulated. You can decide which path to send.

The resource pooling unit may include: a network state collecting unit collecting and outputting information representing the states of the plurality of networks; A multipath determination unit configured to analyze the collected information to determine a state of the plurality of networks, and determine, according to a result of the identification, multi-paths having higher priority among the plurality of networks to use in the video call; And a data distribution unit for adaptively distributing the audio data and the image data according to the determined multipath.

The multipath determining unit may determine a portion of a network having the highest priority among the plurality of networks as a path to transmit the voice data, and the remaining band of the network having the highest priority and the next higher priority network. At least one of the above may be determined as a path for transmitting the image data.

The multipath determination unit determines a network having the highest priority among the plurality of networks as a path for transmitting the entire voice data and a part of the video data, and considering the bandwidth of the network having the highest priority, As a result, at least one of the networks having high priority may be determined as a path to transmit the remaining part of the image data.

And a video processor configured to downgrade the quality of the video data, wherein the multipath determination unit analyzes the collected information to determine that the bandwidths of all of the plurality of networks are less than a predetermined reference value. Some bands of the network having the highest priority are determined as a path to transmit the voice data, and at least one of the remaining band of the network having the highest priority and the next higher priority network is down-regulated. It can be determined as a path to transmit image data.

The image processor may adjust the quality of the image data by adjusting at least one of a group of pictures (GOP), a compression ratio, and a frame rate of the image data.

Meanwhile, according to another exemplary embodiment of the inventive concept, a video call method of a mobile terminal for a video call is based on a state of a plurality of networks available in the mobile terminal when a request for the video call is input. Determining a multi-path for use in the video call; And transmitting the image data and the audio data by using the determined multipath.

The determining of the multipath may include determining higher priority networks among the plurality of networks as a multipath to use for the video call.

The determining of the multipath may include determining some bands of a network having the highest priority among the plurality of networks as a path for transmitting the voice data, remaining bands of the network having the highest priority, and next priority. At least one of the higher networks may be determined as a path to transmit the image data.

The determining of the multipath may include determining a network having the highest priority among the plurality of networks as a path for transmitting the entire voice data and a part of the image data, and considering the bandwidth of the network having the highest priority. Next, a network having a higher priority may be determined as a path to transmit the remaining part of the image data.

The determining of the multipath may include: multiplying at least one network of which a user preference path is set among the plurality of networks if the bandwidth of the plurality of networks is equal to or greater than a predetermined reference value and the network quality is within a stable standard. Determining a pass or a single pass; may include.

The determining of the multipath may include: if the network quality of the plurality of networks belongs to an unstable criterion, a path of overlapping transmission of the voice data through some bands of at least two networks having a higher priority among the plurality of networks. Determining to; Down adjusting the quality of the image data; And determining at least one of a remaining band of the at least two networks having the highest priority and a next higher priority network among the plurality of networks as a path to transmit the downscaled image data. Can be.

The determining of the multipath may include determining a portion of a band of a network having the highest priority among the plurality of networks as a path to transmit the voice data when the bandwidth of all the plurality of networks is less than a predetermined reference value. Making; Down adjusting the quality of the image data; And determining at least one of a remaining band of the highest priority network and a next higher priority network among the plurality of networks as a path to transmit the downscaled image data.

According to one or more exemplary embodiments of the present inventive concept, a mobile terminal provides a video call service using an increased network bandwidth when using a multipath, compared to using a single pass alone, whereby a bit of video data is used during a video call. Increasing the rate can provide a better quality video call service.

In addition, according to one or more exemplary embodiments of the present invention, when a user moves a network network during a call and a handover occurs, when a multipath is being used, another path may be used even if a signal is shorted. It is possible to continuously transmit and receive data necessary for video calls, thereby preventing a call drop and reducing voice interruption time.

In addition, according to one or more exemplary embodiments of the present invention, when using multipath, when the packet loss is increased due to instability of the network, or when the connection is lost, the audio data having a higher importance than the video data is multiplied. By simultaneously transmitting duplicated paths, the packet loss rate can be reduced.

1 is a block diagram illustrating a mobile terminal for a video call according to an exemplary embodiment of the inventive concept;
2 is a block diagram illustrating a resource pooling unit according to an exemplary embodiment of the inventive concept;
3 is a flowchart illustrating a video call method of a mobile terminal for a video call according to an exemplary embodiment of the present invention;
4 is a flowchart for describing operation S340 of FIG. 3 in detail.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features, and advantages of the present invention will become more readily apparent from the following description of preferred embodiments with reference to the accompanying drawings. However, the present invention is not limited to the embodiments described herein but may be embodied in other forms. Rather, the embodiments disclosed herein are provided so that the disclosure can be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

In this specification, when an element is referred to as being on another element, it may be directly formed on another element, or a third element may be interposed therebetween.

Where the terms first, second, etc. are used herein to describe components, these components should not be limited by such terms. These terms have only been used to distinguish one component from another. The embodiments described and exemplified herein also include their complementary embodiments.

Also, when it is mentioned that the first element (or component) is operated or executed on the second element (or component) ON, the first element (or component) It should be understood that it is operated or executed in an operating or running environment or is operated or executed through direct or indirect interaction with a second element (or component).

It is to be understood that when an element, component, apparatus, or system is referred to as comprising a program or a component made up of software, it is not explicitly stated that the element, component, (E.g., memory, CPU, etc.) or other programs or software (e.g., drivers necessary to drive an operating system or hardware, etc.)

It is also to be understood that the elements (or components) may be implemented in software, hardware, or any form of software and hardware, unless the context clearly dictates otherwise.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. The terms "comprises" and / or "comprising" used in the specification do not exclude the presence or addition of one or more other elements.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. In describing the specific embodiments below, various specific details are written to more specifically explain and help understand the inventive concept. However, a person skilled in the art that can understand the inventive concept can recognize that it can be used without these various specific details. In some cases, it is mentioned in advance that parts of the invention which are commonly known in the description of the inventive concept and which are not highly related to the invention are not described in order to prevent confusion for no reason.

1 is a block diagram illustrating a mobile terminal 100 for a video call according to an exemplary embodiment of the inventive concept.

The mobile terminal 100 exemplarily illustrated in FIG. 1 may provide not only IP (Internet Protocol) based voice call but also video call service in a mobile environment, and may be a terminal such as a smartphone or a tablet PC.

Referring to FIG. 1, the mobile terminal 100 may include a user input unit 110, a communication unit 120, an image processing unit 130, a resource pooling unit 140, and a controller 150. .

The user input unit 110 provides an interface between the user and the mobile terminal 100 and may be implemented as a touch panel, a plurality of operation buttons, and the like. The user may request a video call by manipulating the user input unit 110.

The communication unit 120 may include first to third network interfaces (IF) 121, 122, and 123 that support a plurality of network communication schemes. The plurality of network communication methods (or a plurality of network types) may be all network communication methods such as 3G, WiFi, and Wibro, and the first to third network interfaces 121, 122, and 123 may have images according to the corresponding communication methods. Send and receive data related to calls, voice calls, or Internet services. Although three network interfaces 121, 122, and 123 are illustrated in FIG. 1 for convenience of description, the number is not limited thereto.

In particular, the communication unit 120 may transmit voice data and video data necessary for a video call to a receiving terminal using a single pass or a multi-path determined by the resource pooling unit 140. Multipath means at least two of the first to third network interfaces 121, 122, and 123, or first to third devices connected to the first to third network interfaces 121, 122, and 123. Means a network path including networks. Transferring data using multipath can be achieved by using at least two network interfaces (eg, 121, 122) and different networks (eg, 3G) connected to at least two network interfaces 121, 122. Means transmitting data to the receiving side using WiFi).

The image processor 130 may process image data obtained through a camera (not shown) in a video call format in a form that can be transmitted to a receiving terminal. For example, the image processor 130 may adjust a group of pictures (GOP), a frame rate, a compression rate, or a quality factor of the image data in consideration of the bandwidth of the network to be used for the video call. When video data for a video call is input, the video processor 130 may adjust the quality of the video data by using a Voice over Internet Protocol (VoIP) application.

When a request for a video call is input through the user input unit 110, the resource pooling unit 140 may determine a multipath to use for the video call based on the states of the first to third networks available in the mobile terminal 100. have. That is, the resource pooling unit 140 considers the states of the first to third networks connected to the first to third network interfaces 121, 122, and 123, and thus, the first to third network interfaces 121 and 122. , 123) may determine a multipath to be used for a video call. Specific operations or functions of the resource pooling unit 140 will be described in detail with reference to FIG. 2.

2 is a block diagram illustrating a resource pooling unit 140 according to an exemplary embodiment of the inventive concept.

The resource pooling unit 140 illustrated in FIG. 2 may include a network state collecting unit 141, a multipath determination unit 143, and a data distribution unit 145.

The network state collecting unit 141 collects information on the states of the first to third networks connected to the first to third network interfaces 121, 122, and 123, and uses the collected information to determine the multipath determination unit 143. ) Can be printed. The network state collecting unit 141 may collect information from each packet received by the first to third network interfaces 121, 122, and 123 through the first to third networks. The network state collecting unit 141 may collect information representing the states of the first to third networks based on the network usage status with the end-to-end or infrastructure.

The information collected by the network state collecting unit 141 includes information for obtaining connection stability, packet loss rate, network bandwidth, etc. of the first to third networks, and information on a network currently available for a video call in the mobile terminal 100. Information (ie, types of first to third networks). For example, even if the communication unit 120 provides a communication service through 10 different network interfaces, the communication unit 120 may provide a communication service using fewer than 10 network interfaces depending on the connection state of the network. Therefore, the network state collecting unit 141 may transfer the information of the currently available network to the multipath determining unit 143.

The multipath determination unit 143 may analyze the received information to determine the states of the first to third networks, and determine a single pass or multipath to be used for a video call based on the result of the determination.

As a first example, the multipath determination unit 143 analyzes the information collected by the network state collecting unit 141, the bandwidth of the first to third networks is greater than or equal to a predetermined reference value, the first to third If the quality of the networks falls within a stable criterion, one or more of the first to third networks may be determined as a single pass or a multipath to use for a video call. Alternatively, the multipath determination unit 143 analyzes the information collected by the network state collecting unit 141, and as a result, the bandwidth of the first to third networks is greater than or equal to a predetermined reference value, If the quality is within a stable criterion, the first to third networks may be prioritized in order of user preference, and at least one network corresponding to the high priority may be determined as a single pass or a multipath to use for a video call. .

'Quality of the network' can be determined from the network's connection stability and packet loss rate, which is a well-known technique, and thus a detailed description thereof will be omitted. 'User Preferred Pass' is a path corresponding to a network previously set by the user, and the user can use the network as a first priority in a video call through a UI (User Interface) screen provided by the mobile terminal 100, and a second The network to be used as a priority can be set in advance.

Accordingly, the multipath determination unit 143 may preferentially determine at least one network that is set as a user preference path among currently available networks as a path for transmitting audio data and video data. For example, if the interface corresponding to the currently available networks are the first to third network interfaces 121, 122, 123, and the user preference pass of the first priority is the first network interface 121, The path determination unit 143 may determine the path to use the first network interface 121 for a video call.

If the bandwidth of the first network interface 121 is sufficient, the multipath determination unit 143 may determine the first network interface 121 as a single pass for transmitting both audio data and video data. On the other hand, when the bandwidth of the first network interface 121 is not sufficient and both audio and video data cannot be transmitted through the first network interface 121, the multipath determination unit 143 may determine the first network interface ( 121 may be determined as a path for transmitting audio data first, and the first network interface 121 and a second network interface 122 which is a user preference path having a second priority may be determined as a path for transmitting image data. That is, the multipath determination unit 143 determines a part of the band of the first network corresponding to the first network interface 121 as a path for transmitting voice data, and transmits the remaining band of the first network and the second network to the image data. It can be decided by a pass. If the second network corresponding to the second network interface 122 also does not have enough bandwidth to transmit image data, the multipath determination unit 143 multipaths the third network (corresponding to the third network interface 123). Can be added as

In a second example, the multipath determining unit 143 may have a bandwidth of the first to third networks greater than or equal to a predetermined reference value, and the quality of the first to third networks may be a stable criterion, but among the first to third networks. If there is no network set as the user preference path, the multipath determination unit 143 gives priority to the first to third networks in the order of high network quality, and displays at least one network corresponding to the high priority. You can choose the pass you want to use for the call.

For example, when the first to third networks have high stability in order, the multipath determination unit 143 may select the first network interface 121 corresponding to the first network having the highest stability to transmit voice data and video data. The path to transfer can be determined first. If the bandwidth of the first network interface 121 is not sufficient and both audio data and video data cannot be transmitted through the first network interface 121, the multipath determining unit 143 may determine the first network interface ( 121 may be determined as a path for transmitting audio data first, and a band remaining after transmitting audio data to the first network interface 121 and a second network interface 122 having high stability may be determined as a path for transmitting image data. have. In this case, the multipath determination unit 143 may add the third network as a multipath path when the bandwidth of the remaining band of the first network and the bandwidth of the second network are insufficient to transmit image data.

As a third example, if the network quality of the first to third networks falls within an unstable criterion, the multipath determination unit 143 may request the VoIP application layer to downgrade the quality of the image data.

The VoIP application layer corresponds to the image processor 130. The multipath determination unit 143 may request the quality of down adjustment while transmitting the state of the network to the VoIP application layer. The VoIP application layer may adjust the quality of the video data down based on the state of the network. For example, the VoIP application layer can reduce the quality by increasing the compression rate of video data or lowering the frame rate.

When the video data whose quality is down-regulated is inputted from the VoIP application layer, the multipath determination unit 143 transmits the redundant transmission of the voice data to some bands of at least two networks having the highest priority among the first to third networks. The remaining bandwidth of the at least two networks having a high priority and the at least one network having the next highest priority may be determined as a path to transmit downlinked image data. The reason why the voice data is redundantly transmitted through networks having high priority is that in the video call, the voice data is more important than the video data. 'Duplicate transmission' means transmitting the same voice data through different networks.

As a fourth example, the multipath determining unit 143 may determine the multipaths to be used for the video call among networks having the highest priority among the first to third networks according to the determined result. The multipath determination unit 143 may determine a path to transmit the image data in consideration of the bandwidth of the network determined to transmit the voice data. The priority of the first to third networks may be set by the user, or automatically set to have a higher priority as the frequency used by the user is high, or automatically set to have a high priority as the quality and bandwidth are excellent.

In detail, the multipath determination unit 143 determines the first network having the highest priority among the first to third networks as a path to transmit voice data, and considers the bandwidth of the first network and then, At least one high ranking network (eg, at least one of the second network and the third network) may be determined as a path for transmitting image data.

Alternatively, the multipath determination unit 143 determines a network having the highest priority among the first to third networks as a path for transmitting the entire voice data and a part of the image data, and considering the bandwidth of the first network, In addition, at least one network having a high priority may be determined as a path for transmitting the remaining part of the image data. That is, the multipath determination unit 143 may transmit voice data to some bands of the first network, and determine the remaining bands of the first network and at least one network having the next highest priority as a path to transmit the video data. have.

Alternatively, if the bandwidth of all of the first to third networks is less than a predetermined reference value, that is, if the bandwidth is insufficient for use in a video call, the multipath determination unit 143 may analyze the collected information. First, some bands among the networks having the highest priority among the third networks are determined as a pass for transmitting voice data, and downlinked at least one of the remaining bands of the network with the highest priority and the networks with the next highest priority. It can be determined as a path to transmit image data. To this end, the multipath determination unit 143 may request the VoIP application layer to adjust the quality of the image data downward as in the third example.

When the single pass or the multipath is determined by the multipath determination unit 143, the data distribution unit 145 adapts the audio data input through the microphone and the image data acquired through the camera according to the determined singlepath or multipath. It can be distributed and output to UDP (User Datagram Protocol) transport layer. The UDP transport layer corresponds to the communication unit 120.

For example, when the first network interface 121 is determined as a single pass, the data distribution unit 145 may output both to the first network interface 121 without distributing voice data and image data.

In addition, when the first and second network interfaces 121 and 122 are determined as a multipath, and the first network interface 121 has a higher priority, the data distributor 145 may determine that the voice data is the first. The image data may be distributed to the network interface 121 and output to the second network interface 122.

In addition, when the first and second network interfaces 121 and 122 are determined as multipaths, and the first network interface 121 has a higher priority, the data distributor 145 may perform the entire voice data and the image. A part of the data may be distributed to the first network interface 121 and output, and the rest of the image data may be output to the second network interface 122.

The controller 150 controls the overall operation of the mobile terminal 100 described above, and may include at least one processor and a memory (not shown) for loading a program. For example, when a request for a video call is input from a user, the controller 150 determines a network resource, that is, a network currently available, and uses a single pass or multipath to use for the video call based on the identified network state. The resource pooling unit 140 may be controlled to determine.

3 is a flowchart illustrating a video call method of a mobile terminal for a video call according to an exemplary embodiment of the inventive concept.

The mobile terminal performing the video call method illustrated in FIG. 3 may be a processor of the mobile terminal 100 or the mobile terminal 100 described with reference to FIG. 1.

Referring to FIG. 3, when the mobile terminal receives a video call request from the user (S310), the mobile terminal may collect information on the states of the first to third networks connected to the mobile terminal (S320). In the following description, the first to third networks may respectively correspond to the first to third network paths or may have the same meaning.

The mobile terminal may determine the states of the first to third networks by analyzing the collected information (S330). In operation S330, the mobile terminal may determine bandwidth, packet loss rate, and connection stability of each of the first to third networks.

The mobile terminal may determine a single pass or a multipath to use for a video call among the first to third networks based on the identified network state (S340). Operation S340 will be described in detail with reference to FIG. 4.

When the single pass is determined (S350-Y), the mobile terminal may transmit audio data and video data through the network determined as the single pass among the first to third networks (S360).

On the other hand, when the multipath is determined (S350-N), the mobile terminal may adaptively distribute and transmit the voice data and the image data according to the states of the networks corresponding to the multipath (S370). In operation S370, the mobile terminal may transmit the entire audio data and a part of the image data in one pass of the multipath, and transmit the remaining image data in the remaining paths (which may be one or two or more).

4 is a flowchart for describing operation S340 of FIG. 3 in detail.

Referring to FIG. 4, the mobile terminal can identify currently available networks from the network state identified in step S330 (S405). Hereinafter, although the first to third networks are described as examples of usable networks identified in step S405, the number is not limited thereto as an example.

If the bandwidth of the first to third networks is sufficient (S410-Y), the mobile terminal may determine whether the quality of the first to third networks is stable to provide a video call service (S415). In operation S410, the mobile terminal may determine that the bandwidth is sufficient if the bandwidth of each of the first to third networks is greater than or equal to a reference value for a predetermined video call among the network conditions determined in operation S330.

If the quality of the first to third networks are all stable (S415-Y), the mobile terminal may check whether the first to third networks have a user preference pass set in advance by the user (SS420).

If there are user preference passes in the first to third networks (S420-Y), the mobile terminal may give priority to the first to third networks in order of high user preferences (S425). The user preference path may be set for each network type in the order that the user prefers in advance, or automatically set by the mobile terminal. For example, the mobile terminal may set WiFi, which is freely available to the user, as a network having the highest user preference, and give the highest priority to a network corresponding to WiFi (eg, the first network).

The mobile terminal may determine at least one network corresponding to the highest priority among the first to third networks assigned the priority in step S425 as a single pass or a multipath (S430). In step S430, the mobile terminal transmits the voice data and the video data using the highest priority network (that is, the network having the highest user preference), or the voice data and the partial video data as the highest priority network. Then, it may decide to transmit the remaining image data to the next higher priority network.

On the other hand, if there are no user preference passes in the first to third networks (S420-N), the mobile terminal may give priority to the first to third networks in the order of stable network quality (S435).

The mobile terminal may determine at least one network corresponding to a high priority among the first to third networks assigned the priority in step S435 as a single pass or a multipath for a video call (S440). In step S440, the mobile terminal transmits the voice data and the video data using the highest priority network (that is, the network with the most stable network quality), or the voice data and the part with the highest priority network. The video data and the next higher priority network may be determined to transmit the remaining video data.

On the other hand, if the bandwidth of all of the first to third networks as a result of the determination in step S410 (S445), the mobile terminal corresponds to the first priority (that is, the highest priority) of the first to third networks The network (eg, the first network) may be determined as a path for transmitting voice data (S450).

Since the bandwidth of all the networks is insufficient, the mobile terminal can adjust the quality of the image data (S455). In step S455, the mobile terminal may adjust the quality by adjusting the compression rate, packet rate, and the like of the image data.

The mobile terminal may determine an out of band band occupied by voice data among the first network and a network (for example, a second network) corresponding to the second priority as a path for transmitting down-adjusted image data. There is (S460). As a result, the first network and the second network may be determined as multipaths for a video call in steps S450 and S460.

In operation S450, the voice data may not require much band for data transmission. Therefore, in step S460, if there is a band remaining after transmitting the voice data through the first network, the mobile terminal may determine the remaining band and the second network of the first network as a path to transmit the image data. If the bandwidth is insufficient to transmit the video data over the second network, the mobile terminal may add a third network corresponding to the third priority as a multipath for transmitting the video data.

If the quality of all of the first to third networks is not stable (S415-N), the mobile terminal determines networks corresponding to the first and second priorities among the first to third networks. It may be determined as a multipath for redundant transmission of voice data (S465). In operation S465, the mobile terminal may duplicately transmit the voice data in order to minimize the loss rate of more important voice data since all of the first to third networks are unstable.

Since the same voice data is redundantly transmitted through at least two networks in step S465, a case where there is insufficient bandwidth to transmit image data may occur. In order to prepare for this, or when there is not enough bandwidth to actually transmit the video data, the mobile terminal can adjust the quality of the video data down (S455).

In operation S460, the mobile terminal may determine the remaining bands of the first network and the second network determined in operation S465 as multipaths for transmitting image data whose quality is down-regulated in operation S455. In operation S460, when the bandwidth of the remaining band of the first network and the bandwidth of the remaining band of the second network are insufficient to transmit the video data, the mobile terminal may include the remaining band of the first network, the remaining band of the second network, and the first bandwidth. Of course, the three networks can be determined as a multipath for transmitting image data.

In FIG. 4, in step S460 performed after step S465, the remaining band of the first network, the remaining band of the second network, and, if insufficient, transmit image data using the third network, and step S460 performed after step S450. In the aspect of transmitting image data using the remaining band of the first network and the second network is slightly different.

According to the above-described conceptual embodiment of the present invention, since the mobile terminal can use various types of networks, in an IP-based application or service requiring real-time capability such as VoIP, image data is transmitted and received through a plurality of available networks. The quality of the video call service can be improved and the delay time can be reduced in the handover situation.

In addition, the exemplary embodiments of the inventive concept described above may be applied to a field using UDP in a mobile environment by using resource pooling for managing network resources. The field of using UDP in a mobile environment is various, for example, mobile VoIP one-to-one call, mobile VoIP multi-party call or video conferencing, video streaming service, Internet broadcasting or mobile online game using a mobile terminal.

While the present invention has been described with reference to the particular embodiments and drawings, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. This is possible. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

100: mobile terminal 110: user input unit
120: communication unit 130: image processing unit
140: resource pooling unit 141: network state collection unit
143: Multipath determination unit 145: Data distribution unit
150:

Claims (15)

In a mobile terminal for a video call,
A resource pooling unit configured to determine a multi-path to be used for the video call based on a state of a plurality of networks available in the mobile terminal when the video call request is input;
A communication unit which transmits audio data and video data necessary for the video call using the determined multipath; And
It includes; Image processing unit;
The resource pooling unit,
A network state collecting unit for collecting and outputting information indicating the state of the plurality of networks, to analyze the collected information to determine the state of the plurality of networks, according to the result of the identification of the high priority among the plurality of networks A multipath determination unit for determining at least two or more networks as a multipath for use in the video call, and a data distribution unit for adaptively distributing the audio data and the video data according to the determined multipath;
When the network quality of the plurality of networks falls within an unstable criterion, the multipath determining unit determines some bands of at least two networks having high priority among the plurality of networks as redundant transmission paths of the voice data. Determining a remaining band of at least two networks having high priority as a path to transmit the down-adjusted image data,
The image processing unit, the mobile terminal for a video call, characterized in that to adjust the quality of the video data down, when the request of the multi-path determination unit. The method of claim 1,
The multipath determination unit analyzes the collected information, and when the bandwidth of the plurality of networks is greater than or equal to a predetermined reference value and the network quality is within a stable criterion, at least one user preference path among the plurality of networks is set. A mobile terminal for a video call, characterized in that for determining the network as the multipath or single pass. delete delete The method of claim 1,
The multipath determination unit,
Determining some bands among the networks having the highest priority among the plurality of networks as a path to transmit the voice data, and at least one of the networks having the highest priority next to the network having the highest priority, and And the remaining band of the highest network is determined as a path to transmit the video data. The method of claim 1,
The multipath determination unit,
The network having the highest priority among the plurality of networks is determined as a path for transmitting the entire voice data and a part of the video data, and considering the bandwidth of the network having the highest priority, the next higher priority network. The mobile terminal for a video call, characterized in that for determining at least one of the path to transmit the remaining part of the video data. The method of claim 1,
The multipath determination unit,
If the bandwidth of all the plurality of networks is analyzed by analyzing the collected information, first, some bands among the networks having the highest priority among the plurality of networks are determined as a pass to transmit the voice data, And determining at least one of the networks having the highest priority next to the network having the highest priority, and the remaining band of the network having the highest priority as a path to transmit the down-regulated video data. Mobile terminal for. 8. The method according to claim 6 or 7,
Wherein the image processing unit comprises:
And adjusting the quality of the video data by adjusting at least one of a group of pictures (GOP), a compression ratio, and a frame rate of the video data. In the video call method of a mobile terminal for a video call,
When a request for the video call is input, determining a multi-path to use for the video call based on a state of a plurality of networks available in the mobile terminal; And
And transmitting the image data and the audio data using the determined multipath.
The determining of the multipath may include:
If the network quality of the plurality of networks falls within an unstable criterion, determining some bands of at least two networks having high priority among the plurality of networks as redundant transmission paths of the voice data; Downgrading quality; And determining at least one of the higher priority networks and the remaining band of the at least two networks having the highest priority as a path to transmit the downscaled image data. And a video call method. 10. The method of claim 9,
The determining of the multipath may include:
And determining at least two or more priorities among the plurality of networks as multipaths to be used for the video call. The method of claim 10,
The determining of the multipath may include:
Determining some bands among the networks having the highest priority among the plurality of networks as a path to transmit the voice data, and at least one of the networks having the highest priority next to the network having the highest priority, and And determining the remaining band of the highest network as a path to transmit the video data. The method of claim 10,
The determining of the multipath may include:
The network having the highest priority among the plurality of networks is determined as a path for transmitting the entire voice data and a part of the video data, and considering the bandwidth of the network with the highest priority, the next highest network is selected. And determining the remaining part of the image data as a transmission path. 10. The method of claim 9,
The determining of the multipath may include:
If the bandwidth of the plurality of networks is greater than or equal to a predetermined reference value and the network quality is within a stable criterion, determining at least one of the plurality of networks in which a user preference path is set as the multipath or single pass; The video call method further comprises. delete 10. The method of claim 9,
The determining of the multipath may include:
If a bandwidth of all of the plurality of networks is less than a predetermined reference value, first determining a portion of a band of a network having the highest priority among the plurality of networks as a path to transmit the voice data;
Down adjusting the quality of the image data; And
Determining at least one of the highest priority networks next to the highest priority network and the remaining band of the highest priority network as a path to transmit the downlinked image data among the plurality of networks; Video call method comprising a.

Images