KR101462222B1 - Image currency connection method between different kind terminal that video format differs - Google Patents

Abstract

Disclosed in the present invention is a video call connecting method between different kinds of terminals having different video formats. The present invention: basically applies a horizontal mode if a SIP signaling does not have a key value of parameter information (sprop-parameter-sets); periodically transmits an I-Frame packet to an RTP packet through time setting while storing resolution information and a horizontal mode or a vertical mode by decoding the key value if the key value exists, and thereby determines the resolution information and the horizontal mode or the vertical mode in preparation for a loss which is caused when PPS information does not come into the RTP packet or is lost; is able to form a video call connection between different kinds of terminals having different video formats without passing through an MRF server and changing resolution which is not supported by terminals through the determination result; and especially enables users having different kinds of terminals having different video formats to enjoy a video call with optimum video call resolution without using separate equipment, while easily performing an image recovery even in the case of a packet loss and an image distortion.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video call connection method,

The present invention relates to a SoIP (Service Over IP) terminal which is a commercialized video phone based on an ALL IP network having a different video format from a terminal such as an LTE smartphone and a VoLTE smart phone (Hereinafter referred to as " second terminal ") attempts to make a video call with each other, the call success rate of the video call can be increased.

In general, when a first terminal such as an LTE smartphone or a VoLTE smart phone connected to a commercial backbone and a second terminal, which is a commercialized video phone based on an ALL IP network connected to a private network, The call success rate of the video call was very low.

The second terminal, which is a commercialized video phone, is capable of supporting a horizontal mode of a maximum resolution of 720P / VGA / CIF / QCIF framerate (30/15/8 fps) and does not support a vertical mode. The second terminal determines the resolution using only the profile-level-id in the Session Description Protocol (SDP).

That is, the second terminal, which is a commercialized video phone, sets the resolution only in the profile-level-ID of the Session Initiation Protocol (SIP) The resolution setting of the landscape mode and the portrait mode can not be performed during a video call.

On the other hand, the first terminal supports both the landscape mode and the portrait mode but does not support the VGA resolution and supports the QVGA resolution corresponding to half of the VGA resolution.

Accordingly, when the first and second terminals attempt to make a video call with each other, the first terminal can not support the resolution of the second terminal, so that the video call can not be performed.

Also, since the second terminal, which is a commercialized video phone, receives the RTP (Real Time Protocol) of the actual media data and sets the report resolution, it takes a long time to decode / encode the RTP .

On the other hand, the first terminal does not display video using RTP media data, i.e., SPS (Sequence Parameter Set) / PPS (Picture Parameter Set) information in RTP, since the second terminal does not send frame sizes and sprop-parameter-sets to the frame size and the sprop-parameter-sets, The video communication with the second terminal is not performed well.

Accordingly, in order for the first and second terminals having different video formats to make video calls with each other, the media data (Media (Media)) such as Media No. 10-0655554 (MRF) server that relays the data to the media server. However, in this case, there is a disadvantage in that the board for mixing with time for covering the media data is expensive, and a lot of encoding and decoding circuits There is a problem in that maintenance cost for video call is increased.

That is, as shown in FIG. 1, when a first terminal is connected to a commercial backbone network and a second terminal is connected to a private network, a video call connection is established through the MRF server 1 The session control unit 2 (P-CSCF / SBC / AS) requests the codec information to the MRF server 1 (A1), and receives a video call to the second terminal which is the receiver side while receiving the requested codec information And transmits the requesting signal (A2)

Then, the signaling engine module 3 of the receiver side transmits a response signal of the video codec information that can be talked to the session control unit 2 through the SIP message. (A3)

At this time, the session control unit 2 confirms the video callable information with the calling and receiving information (e.g., the terminal number, the calling party / the receiving unit, etc.) of the first terminal and the second terminal, Change the state to SDP that can be called and save the state (A4)

Next, the session control unit 2 transmits a resolution message to the signal engine module 4 on the caller side of the first terminal by changing the response message to enable the video call (A5). Thus, the MRF server 1 transmits the resolution information And decodes the video codec information received from the signal engine module 3 according to the resolution of the second terminal A6.

Next, the MRF server 1 receiving the image codec information from the sender side's thread engine module 4 performs encoding / decoding according to the resolution of the first terminal, thereby performing a video call of the first and second terminals (A7)

Here, the session information according to the video call connection of the first and second terminals is maintained by the SIP: UPDATE message through the session control unit 2. (A8)

However, in the case of the MRF server, since the resolution to be supported is forcibly mixed, the resolution format is not optimized and the image displayed on the screen of the terminal tends to be slightly cut or reduced. The quality would have been bad.

On the other hand, in the case of the second terminal, which is a commercialized video phone, most of the terminals are used in a fixed position such as home and work rather than having mobility, so that the probability of packet loss is higher than that of the first terminal having mobility , Loss of SPS or PPS information often occurs in the LTE environment in the case of the first terminal and when the second terminal receives the SPS or PPS information lost in the first terminal, The user can not make a video call with the first terminal while the call with the first terminal is terminated or the screen is blacked out.

That is, if the first and second terminals having different video formats can not receive the SPS or PPS information for updating the I-frame, the call can not be ended.

In other words, the biggest problem of the first terminal is that it does not send the PPS information. Therefore, the second terminal displaying the image with only the SPS / PPS information of the RTP can not determine the resolution according to the video call, , There is a disadvantage that the possibility of loss of SPS / PPS information of RTP after the disconnection of SIP is considerably high.

In the case of the first terminal, the SPS / PPS information is sent only once and then not transmitted continuously. Therefore, there is a problem that the video communication can not be performed with the second terminal displaying the video only with SPS / PPS information of RTP.

As a countermeasure against the occurrence of video packet loss in the related art, media control messages should be defined in the RFC standard to implement the RTCP (Real Time Control Protocol) of the inband and the SIP: INFO of the outband However, in order for the first and second terminals having different video formats to transmit the media control message and perform image restoration, the MS and all the terminals must have the same conditions. In this case, each communication company (KT / SKT / LG) has not been feasible since the current media control message is not applied to the backbone network.

Accordingly, the second terminal, which is a commercially available video phone before the first terminal is released, can directly make a video call without passing through the first terminal and the MRF server, and also can change the resolution not supported by the terminal Accordingly, the present invention is intended to satisfy such a demand.

The present invention basically applies the landscape mode if there is no key value of the parameter information (sprop-parameter-sets) in the SIP signaling, and if the key value is present, decodes the key value to store the resolution information and the horizontal mode or vertical mode, The resolution information, the horizontal mode and / or the portrait mode are determined in case that the PPS information is not inputted into the RTP packet or the loss due to the loss is lost, thereby changing the resolution not supported by the terminal without passing through the MRF server The present invention is directed to a video call connection method for a heterogeneous terminal having a video format in which a video call connection between heterogeneous terminals having different video formats can be performed.

In view of the difficulty of media recovery through media control, the present invention is configured to periodically transmit I-frame packets with RTP packets through time setting, thereby facilitating image recovery in packet loss and image distortion The video format of the present invention provides a video call connection method in a heterogeneous terminal.

A video call connection method for a heterogeneous terminal having different video formats according to the present invention for achieving the above object is a method for connecting a first terminal connected to a commercial backbone network and a second terminal connected to a private network, Determining whether a key size of the frame size and parameter information in the Session Description Protocol (SDP) is present in SIP signaling; If the frame size and parameter information in the Session Description Protocol (SDP) do not exist in the SIP signaling, a resolution is set by applying a default landscape mode. In SIP signaling, a frame size in the Session Description Protocol (SDP) And setting a resolution of encoding and decoding using the key value of the parameter information, if the key value is present; .

In addition, in the video call connection method for the heterogeneous terminal in which the video format of the present invention is different, the resolution setting of the horizontal mode application and the determination of the SPS / PPS information of the RTP packet within a predetermined time ; And if the SPS / PPS information of the RTP packet is present within a predetermined time from the step, the resolution is processed and stored in the media engine module so as to share the video call, Failing the video call with media error if there is no / PPS information; As shown in FIG.

In the video call connection method for a heterogeneous terminal in which the video format according to the present invention is different, when the first and second terminals are connected to a video call and the refreshing eye frame is periodically retransmitted at a set time, the SPS / PPS Continuing the video call by retransmitting the information; As shown in FIG.

In addition, the video call connection method for a heterogeneous terminal in which the video format according to the present invention is different includes a case where the frame size and parameter information in the Session Description Protocol (SDP) are included together in the session initiation protocol (SIP) signaling, Setting a resolution by preferentially storing only information in a media engine module; And setting the resolution of the horizontal mode by default if there is no frame size and parameter information in the session description protocol (SDP) in the session initiation protocol (SIP) signaling, and setting the horizontal mode, the vertical mode and the resolution Storing in a media engine module in a shareable manner; As shown in FIG.

In addition, the video call connection method for a heterogeneous terminal in which the video format of the present invention is different includes a method of connecting a SPS (Session Initiation Protocol) of an RTP packet within a predetermined time period with a frame size and parameter information in a Session Description Protocol (SDP) Starting the decoder if information is present; Connecting a video call through a PPS process when there is PPS information of an RTP packet in a session initiation protocol (SIP) signaling with frame size and parameter information in a session description protocol (SDP); And failing to process the video call with a media error if the resolution information PPS processed from the step is different from the resolution information stored in the media engine module in a shareable manner; As shown in FIG.

In a video call connection method in a heterogeneous terminal having a different video format according to the present invention, if the frame rate and the bandwidth size of the set resolution are larger than the maximum value or the minimum value of the resolution set in the terminal, ; As shown in FIG.

As described above, according to the present invention, if there is no key value of the parameter information (sprop-parameter-sets) in the SIP signaling, the horizontal mode is basically applied and if the key value exists, the key value is decoded to store the resolution information and the horizontal mode or vertical mode Meanwhile, it is configured to periodically transmit I-frame packets as RTP packets through time setting. Thus, resolution information stored in preparation for loss due to loss or loss of PPS information through RTP packets, So that a video call connection can be made between disparate terminals having different video formats without changing the resolutions that the terminal does not support without passing through the MRF server. In particular, in the case of packet loss and image distortion, So that different types of video formats having different video formats Having end users who will be expected to effect so that you can enjoy video calls with optimum resolution video calls without using additional equipment.

1 is a flowchart of a video call connection of a heterogeneous terminal having different video formats via a conventional MRF server.
2 is a block diagram of a video call connection of a heterogeneous terminal having different video formats according to an embodiment of the present invention.
3 is a flowchart of a video call connection of a heterogeneous terminal having different video formats without passing through an MRF server according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

FIG. 2 is a block diagram for connecting a video call of a heterogeneous terminal having different video formats according to an embodiment of the present invention. FIG. 3 is a block diagram of a heterogeneous terminal having different video formats FIG. 2 is a flowchart illustrating a video call connection method according to the present invention.

2 and 3, an embodiment of the present invention provides a video call connection between a first terminal 100 connected to a commercial backbone network having different video formats and a second terminal 200 connected to a private network The first terminal 100 has a profile-level-id, a frame size (framesize), and a parameter in a Session Description Protocol (SDP) in Session Initiation Protocol (SIP) signaling. The second terminal 200 can set the resolution to the key value of the sprop-parameter-sets and the second terminal 200 can set the profile-level (ID) level in the Session Description Protocol (SDP) -id), a video communication is made by setting the resolution only by level, and a commercial image based on the All IP network which does not include the key values of the frame size (framesize) and the parameter information (sprop-parameter-sets) Hereinafter, video call connection between the first and second terminals 100 and 200, which are heterogeneous terminals, will be described in detail.

2 and 3, when the first terminal 100 connected to the commercial backbone network and the second terminal 200 connected to the private network are connected by video call, the session of the originating signal engine module 11 (Framesize) and parameter information (sprop-parameter-sets) in the session description protocol (SDP) in the initiation protocol (SIP) signaling.

3, when the first terminal 100 connected to the commercial backbone network is attached (A11) to the session control unit 13 as shown in FIG. 3 (A11), the session control unit 13 transmits the signaling engine module 11 ) Determines whether there is a key value of frame size (Framesize) and parameter information (sprop-parameter-sets) in the session description protocol (SDP) in the signaling of the session initiation protocol (SIP) And transmits the video call request signal A12 to the signal engine module 16 on the receiving side to which the second terminal 200 is connected.

If it is determined that there is no key value of frame size (Framesize) and / or parameter information (sprop-parameter-sets) in the Session Description Protocol (SDP) in the SIP signaling as a result of the determination by the session controller 13, The signal engine module 16 and the media engine module 15 set the resolution by applying the landscape mode to the second terminal 200 as a default.

However, if it is determined that there is a key value of frame size (Framesize) and / or parameter information (sprop-parameter-sets) in the Session Description Protocol (SDP) in the SIP signaling as a result of the determination by the session controller 13, The module 16 and the media engine module 15 set the encoding and decoding resolution for the second terminal 200 through the key value.

That is, the media engine module 15 on the receiving side preferentially stores the frame size and key values of the parameter information (sprop-parameter-sets) so that resolution information capable of negotiating can be sharedly stored And transmits a response signal for a video call to the signaling engine module 11 on the calling side through the session control unit 13 according to the resolution to be shared and stored.

Here, in SIP signaling, even if the frame size (Framesize) and the parameter information (sprop-parameter-sets) in the Session Description Protocol (SDP) come in together or there is no frame size (Framesize) (12) and (15) preferentially store only the parameter information (sprop-parameter-sets) to set the resolution (A13) (A15).

If the frame size (Framesize) and the parameter information (sprop-parameter-sets) in the Session Description Protocol (SDP) are not all included in the SIP signaling, the signaling engine module 16 transmits, to the second terminal 200, If there is only the frame size (Framesize), it is possible to set the horizontal mode, the vertical mode, and the resolution, and to share them with the media engine module 12 (15) (A13) (A15)

In the next step, when the resolution setting of the horizontal mode application and the resolution of the encoding and decoding are set by the key value, the presence / absence of the SPS / PPS information of the RTP packet is determined within a predetermined time (A16)

In the next step, if the SPS / PPS information of the RTP packet is present within a predetermined time, the resolution is processed and stored in the media engine module 12 (15) ), And if there is no SPS / PPS information of the RTP packet, the video call fails due to a media error.

That is, when there is a frame size (Framesize) and parameter information (sprop-parameter-sets) in the SDP in the SIP signaling, the first and second terminals 100 and 200 on the calling and receiving sides transmit the RTP packet The encoder and the decoder are started when the SPS information is present.

When the PPS information of the RTP packet is present in the SIP signaling with the frame size (Framesize) and the parameter information (sprop-parameter-sets) in the SDP, the PTP processing of the RTP packet causes the calling side and the receiving side 1 and 2 terminals 100 and 200 are connected to each other.

If the resolution information of the RTP packet is different from the resolution information stored in the media engine module 12 or 15 in a shareable manner, the video call fails due to a media error.

If the framerate and bandwidth of the set resolution are greater than or equal to the maximum value Max of the resolution set in the first and second terminals 100 and 200 The video call fails even if it is small.

In the next step, when the first and second terminals 100 and 200 retransmit the I-frame information for Refresh at the time of the video call connection, the SPS / PPS of the RTP packet (A17). [0158] (A18) In order to continue the video call connection of the first and second terminals 100 and 200,

In this case, at the time of periodically retransmitting the refreshing eye frame information according to the set time, a new resolution can be set through the notification when the SPS / PPS information of the RTP packet is retransmitted. In this case, If the SPS / PPS information of the RTP packet is not retransmitted, the receiving side uses the resolution information stored in the media engine module 12 on the receiving side as it is because the screen distortion may occur. ), The black screen or the screen distortion may occur. In this case, the video call connection is stopped.

As described above, a video call connection method in a heterogeneous terminal having a different video format according to an embodiment of the present invention will be described in more detail with reference to FIGS. 2 and 3 attached hereto.

First, when requesting a video call from the first terminal 100 on the calling side to the second terminal 200 on the receiving side (A11), the signaling engine module 11 on the calling side transmits a request signal of the video call to the session controller The session control unit 13 transmits a video call request signal to the signal engine module 16 on the receiving side without going through the MRF server 14 (A12).

At this time, the system engine module 11, which is the call module of the calling party, processes the frame size (frame size) and the parameter information (sprop-parameter-sets) in the Session Description Protocol (SDP) in the SIP signaling, The media engine module 15 and the signal engine module 16 which are modules receive and store the parameter information (sprop-parameter-sets) and share a negotiable image codec, and store the refreshing eye frame I- Frame) information to determine the reception time for the SPS / PPS information of the RTP packet (A13).

Next, when the signal engine module 16 of the receiving side transmits a response signal including the codec information of a resolution capable of video communication to the session control unit 13, the session control unit 13 transmits the response signal including the signal of the calling side And transmits it to the engine module 11 (A14).

Next, the system engine module 11, which is the call module of the calling party, calculates the frame size (Framesize) in the session description protocol (SDP) and the parameter information (SDP) in the SIP signaling process transmitted to the signal engine module 16, (A15), the spool-parameter sets are stored in the media engine module 12, which is the calling module of the calling party, and the spool-parameter sets are stored in the calling terminal first terminal 100 having different video formats, (A16), a video call connection can be made by encoding and decoding through the SPS / PPS information of the RTP packet.

At this time, since the retransmission time of the I-frame information for refresh is set and the reception time for the SPS / PPS information of the RTP packet is determined at the set retransmission time, The terminal 100 or 200 can continuously maintain the connection state of the video call from the SPS / PPS information of the RTP packet retransmitted for the set time for the retransmission (A17) (A18).

That is, according to the embodiment of the present invention, the SPS / PPS information of the RTP packet is transmitted from the first terminal 100, which is the calling party, according to the resolution information shared and stored in the media engine module 12 (15) PPS information of the RTP packet is not received from the second terminal 200. In this case, if the SPS / PPS information of the RTP packet is not received from the second terminal 200, The video call connection with the first terminal 100 is performed through resolution processing of encoding / decoding SPS / PPS information of the RTP packet using the resolution information stored in the media engine module 15.

Although the description of the video call connection method in the heterogeneous terminal according to the video format of the present invention has been described above with reference to the accompanying drawings, it is to be understood that the present invention is not limited thereto.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit and scope of the invention as defined by the appended claims. It is to be understood that such changes and modifications are within the scope of the claims.

11; Originating signal engine module
12; Outbound Media Engine Module
13; The session controller
15; Receiving media engine module
16; Receiving signal engine module

Claims (6)

(SDP) frame size and parameter information in session initiation protocol (SIP) signaling of the signaling engine module when a first terminal connected to a commercial backbone network and a second terminal connected to a private network are connected to each other ;
If the frame size and the key value of the parameter information in the Session Description Protocol (SDP) do not exist in the SIP signaling, the resolution is set by applying the default landscape mode, and the frame size and parameters in the Session Description Protocol (SDP) Setting a resolution of encoding and decoding using the key value of the information, if the key value of the information is present; Wherein the video call connection method is performed in a different video terminal format. The method according to claim 1,
Determining a resolution setting for the horizontal mode application and determining whether the SPS information and the PPS information of the RTP packet are present within a predetermined time when the encoding and decoding resolution is set using the key value; And
If the SPS information and the PPS information of the RTP packet are present within a predetermined time, the resolution is processed and stored in the media engine module so as to share the resolution, so that the video calls of the first and second terminals are connected and the SPS information of the RTP packet and the PPS information Failing the video call with a media error; The method of claim 1, further comprising the steps of: 3. The method of claim 2, further comprising: retransmitting the SPS information and the PPS information of the RTP packet every time the first and second terminals periodically retransmit the refreshing eye frame at a predetermined time, step; The method of claim 1, further comprising the steps of: (SDP) frame size and parameter information in session initiation protocol (SIP) signaling of the signaling engine module when a first terminal connected to a commercial backbone network and a second terminal connected to a private network are connected to each other ;
Setting a resolution by preferentially storing only the parameter information in the media engine module even if the frame size and the parameter information in the Session Description Protocol (SDP) are included in the Session Initiation Protocol (SIP) signaling or the frame size is not included; And
If there is no frame size and parameter information in the session description protocol (SDP) in Session Initiation Protocol (SIP) signaling, the resolution of the horizontal mode is set by default. If the frame size is only the size, Shareably storing the data in a module; The method of claim 1, further comprising the steps of: 3. The method according to claim 1 or 2,
Initiating a decoder if SPS information of an RTP packet is present within a predetermined time with the frame size and parameter information in the Session Initiation Protocol (SIP) signaling in the Session Description Protocol (SDP);
Connecting a video call through a PPS process when there is PPS information of an RTP packet in a state where frame size and parameter information in a session description protocol (SDP) are present in the session initiation protocol (SIP) signaling; And
Failing the video call with a media error if the resolution information to be PPS-processed from the step is different from the resolution information stored in the media engine module in a shareable manner; The method of claim 1, further comprising the steps of: 3. The method according to claim 1 or 2,
Failing the video call if the frame rate and the bandwidth size of the set resolution are greater than or less than the maximum value of the resolution set in the terminal; The method of claim 1, further comprising the steps of:

Images