KR20080072357A - Method for multipoint video telepony in mobile terminal - Google Patents

Abstract

A multipoint video telephony method in a mobile terminal is provided to enable a user to express the feeling of the user only to a specific another part or to use a whispering function by transmitting different images to counterparts in multipoint video telephony. A mobile terminal, which executes multipoint video telephony with the first terminal and the second terminal, comprises an image input part(110), a storage part(120), a control part(130), and a radio transceiver part(140). The image input part inputs real-time images. The storage part stores substitute images. The control part transmits the real-time images and the substitute images to the first and second terminals at the same time. At this moment, the control part transmits the first control command to the first terminal so that the real-time images can be displayed. Also the control part transmits the second control command to the second terminal so that the substitute images can be displayed. The radio transceiver part transmits the real-time and substitute images and the control commands according to the control of the control part.

Description

Method for Multipoint Video Telepony in Mobile Terminal}

1 is a view showing a method for transmitting a substitute image in a video call according to the present invention.

2 is a diagram illustrating a method of transmitting and receiving an image in a multi-party video call according to the present invention.

3 is a block diagram showing a schematic internal configuration of a mobile communication terminal according to an embodiment of the present invention.

4 is a flowchart illustrating a multi-party video call method according to an embodiment of the present invention.

5 is a diagram illustrating a method for transmitting and receiving an image in a multi-party video call according to an embodiment of the present invention.

6 illustrates a multi-party video call system according to an embodiment of the present invention.

7 is a diagram illustrating a screen implementing a whisper function in a multi-party video call according to an embodiment of the present invention.

FIG. 8 is a diagram illustrating a screen implementing emotion expression using a character in a multi-party video call according to an embodiment of the present invention. FIG.

The present invention relates to a multi-party video call method using the mobile communication terminal, in particular.

Recently, as the demand for Internet access increases, users' demand for a new wireless Internet supporting mobility using mobile communication devices is increasing. Accordingly, a wireless Internet service using a mobile communication terminal is provided by a communication method such as CDMA 1x EV-DO, WCDMA, and the like, and the demand thereof is also increasing.

In general, the third generation mobile communication service is classified into IMT-2000. Since the second generation of providing voice and short message (SMS) mobile communication services, mobile service providers are now moving to third generation technology capable of providing high-speed data services. Third-generation mobile communication technologies can provide new types of data services using higher bandwidths (1.9 GHz and above) than second generation (1.8 GHz and below), while consumers are not limited by time and place. Make the service available.

One of the features of the IMT-2000 is that it can provide a wireless multimedia service capable of high-speed data and video services by breaking away from the existing voice-oriented service. Accordingly, advanced functions such as a color display, a large memory, a digital camera, a wireless Internet platform, a multiplex sound, an MP3 function, and a VOD function are being adopted in the mobile communication terminal. In other words, the development of mobile communication service technology and the demands of consumers are accelerating the multimediaization of mobile communication terminals. Seamless video call is possible with CDMA 2000 EV-DO or CDMA 2000 EV-DV.

In addition to the video input in real time, the video call may transmit a substitute video such as a still image or a video stored in the terminal, and may perform a video conference using a multi-party call.

1 is a diagram illustrating a method of transmitting a substitute image in a video call according to the present invention.

According to FIG. 1, a first terminal displays an image A input in real time through a camera, a substitute image A 'stored in a storage unit, and an image B received from a second terminal which is a video call counterpart on a screen. The substitute image A 'includes a video, a still image, and an animation.

The first terminal uses the real time image A to transmit a substitute image A 'to the second terminal during a video call with the second terminal. Then, the first terminal inputs a signal instructing to transmit the A 'image while transmitting the A image.

The images are transmitted in the form of packet data, and are loaded with the A 'image data packet and transmitted to the second terminal. In this case, the data packet includes a control command for displaying the A 'image data packet, which is a substitute image, among the data packets transmitted from the first terminal.

The data packet transmitted from the first terminal is received by the second terminal through a 3G network, and the second terminal analyzes the received data packet and displays the screen on the screen of the terminal according to a control command included in the data packet. A 'is displayed.

2 is a diagram illustrating a method for transmitting and receiving an image in a multi-party video call according to the present invention.

According to Fig. 2, the first terminal, the second terminal, and the third terminal make a multi-party video call. The multi-party video call is controlled by a multipoint call control unit (hereinafter referred to as "MCU") of a 3G network to select video and audio. The multi-party video call can simultaneously communicate with a plurality of terminals using a channel having the same bandwidth (64 Kbps) as a conventional 1: 1 video call.

The first terminal transmits a real-time video A to the 3G network. Then, the MCU located in the 3G network transmits the A video to the second terminal and the third terminal in the video call.

Meanwhile, the real time image B of the second terminal is also transmitted to the first terminal and the third terminal through the MCU of the 3G network, and the real time image C of the third terminal is also transmitted through the MCU of the 3G network in the same manner. It is transmitted to the terminal and the second terminal.

However, the mobile communication terminal according to the related art has a disadvantage in that only the same image provided from each of the call partners is provided even during the multi-party video call.

SUMMARY OF THE INVENTION An object of the present invention is to provide a method for transmitting different images for each video call counterpart using a limited frequency region in a multi-party video call of a mobile communication terminal.

One feature of a mobile communication terminal according to the present invention for achieving the above object is, the image input unit for inputting a real-time image, the storage unit for storing the replacement image, simultaneously transmitting the real-time image and the replacement image to other terminals And transmitting a control command for controlling the display of the real-time image to the first terminal of the other terminals, and transmitting a control command for controlling the replacement image to be displayed to the second terminal of the other terminals. And a wireless transmitter for transmitting the images and the control commands according to the controlling unit.

In addition, one feature of a multi-party video call method of a mobile communication terminal according to the present invention for achieving the above object is the step of inputting a real-time video and a substitute video, a control command to display the real-time video on the first terminal and And generating a control command to display the substitute image on the second terminal and simultaneously transmitting the images and the control commands to other terminals.

More preferably, the substitute image includes a moving image, a still image, and an animation.

More preferably, a combination of the images is controlled by using a frame sequence of the real time image and the substitute image.

More preferably, the images are compressed and transmitted in the H.245 protocol.

More preferably, the images and the control commands are transmitted via a 3G mobile communication network.

Hereinafter, with reference to the accompanying drawings illustrating the configuration and operation of the embodiment of the present invention, the configuration and operation of the present invention shown in the drawings and described by it will be described by at least one embodiment, By the technical spirit of the present invention described above and its core configuration and operation is not limited.

3 is a block diagram illustrating a schematic internal configuration of a mobile communication terminal according to an embodiment of the present invention, and FIG. 4 is a flowchart illustrating a multi-party video call method according to an embodiment of the present invention.

According to FIG. 3, the mobile communication terminal includes an image input unit 110, a storage unit 120, a controller 130, and a wireless transmitter 140.

First, the mobile communication terminal performs a multi-party video call with other terminals using a real-time image input through the image input unit 110 [S210]. At this time, the data for the video call is made through a 3G network, a multi-party video call control device (MCU) located in the 3G network controls the video and audio transmission for the multi-party video call.

If a video call is to be transmitted to each of the video call counterparts using the real-time input image, the controller 130 may store the storage unit 120 of the terminal in addition to the real-time image input through the video input unit 110. Combining the images to simultaneously transmit the replacement image stored in the [S220, S230].

The real time image and the substitute image are transmitted in the form of a data packet, and the two image data are combined to simultaneously transmit the two images. In general, the image transmission encodes and transmits a frame sequence constituting the image. If the simultaneous transmission of the real time image and the substitute image is performed, the frames of the real time image and the substitute image are transmitted. Frame sequences are constructed by combining them in the desired order and frequency.

The combined frame sequence includes image configuration information for recognizing a video call counterpart to which each frame should be transmitted. The video configuration information uses H.245's User Input Indication transmission method that supports the interaction of user-defined symbols in 3G-324M, and exists in the form of a synchronized flag in each of the combined frame sequences. The User Input Indication transmission method uses a User Input Indication field defined in the H.245 standard which is in charge of 3G-324M video call protocol call control, and enables real-time interaction between terminals. Representative functions of the user input indication transmission method include DTMF (Dual Tone Multi Frequency) and video chat, which transmits keypad input of a terminal.

For example, the video configuration information is information that is transmitted together when simultaneously transmitting the real-time image and the substitute image to other terminals, a control command for controlling to display the real-time image to the first terminal of the other terminals; The second terminal of the other terminals is information including a control command for controlling the replacement image to be displayed. The information is synchronized for each corresponding frame to identify a video call counterpart to receive the images and the control commands.

Thereafter, the controller 130 encodes and compresses the combined image using the H.245 protocol, and then transmits the combined image through the wireless transmitter 140 [S240, S250].

5 is a diagram illustrating a method of transmitting and receiving an image in a multi-party video call according to an embodiment of the present invention.

According to FIG. 5, in addition to the image B received from the second terminal and the image C received from the third terminal during the multi-party video call, the first terminal includes the real-time image A and the first terminal input in real time to the first terminal. The substitute image A 'stored in the storage unit is displayed on the screen.

The first terminal transmits a real time image A to the second terminal, and simultaneously transmits a substitute image A 'to the third terminal. Then, the first terminal combines the A image and the A 'image and transmits them to the 3G communication network.

In this case, the image combination is to combine the frame sequence constituting the images to be combined in a desired order and frequency. In this case, the combined frame sequence includes image configuration information for recognizing a video call counterpart to be transmitted for each frame. The video configuration information uses the H.245 user input indication transmission scheme, and exists in the form of a flag synchronized to each of the combined frame sequences.

The combined image is transmitted to a multi-party video call control device (MCU) located in the 3G communication network in the form of a data packet. The MCU receiving the data separates the combined image and analyzes image composition information of the separated images. As a result of analyzing the video configuration information, a control command to display on the second terminal is synchronized to a frame corresponding to the real-time video A, and a control command to display on a third terminal is synchronized to a frame corresponding to the substitute image A '. It is. Then, the MCU transmits the real time image A to the second terminal and the substitute image A 'to the third terminal according to the analysis result.

6 is a diagram illustrating a multi-party video call system according to an embodiment of the present invention.

According to FIG. 6, the first terminal combines real-time video A and substitute video A 'to transmit to the MCU that controls the multi-party video call located in the 3G network.

In this case, the combination of the real time image and the substitute image is achieved by generating a frame sequence combining the frames constituting the two images in a desired order and frequency. Each of the combined frames includes additional information about the video call partner who will receive the frame. The video frame and the additional information use H.245's User Input Indication transmission scheme that supports user-defined symbol interaction in 3G-324M.

The MCU receiving the combined video analyzes video call partner information included in each frame, and transmits the real-time video A to the second terminal and transmits the replacement video to the third terminal according to the analysis result.

Therefore, the first terminal transmits different images to the second terminal and the third terminal, respectively, thereby expressing emotions, whispering functions, and caraden functions using a multi-party call. There is an advantage that can be implemented.

7 is a diagram illustrating a screen implementing a whisper function in a multi-party video call according to an embodiment of the present invention.

According to FIG. 7, the first terminal is in a multi-party video call with the second terminal and the third terminal using the real-time video A. FIG. At this time, the first terminal is to transmit the image taken in the zoo only to the third terminal.

Then, the first terminal executes a "whisper" function menu with respect to the third terminal, selects a zoo photographed image A 'stored in a storage unit of the first terminal, and combines with the real-time video for a multi-party video call. Transfer to the control unit (MCU).

In this case, the A image displayed on the screen of the first terminal is a real-time image input to the first terminal, the A 'image is a zoo photographing image stored in the storage of the first terminal, the B image is the second terminal The image received from the C image, the image received from the third terminal.

The MCU, having received the combined image, transmits the real-time image A to the second terminal and the zoo photographed image A 'to the third terminal according to the selection of the "whisp" function set in the first terminal. .

Therefore, the first terminal can transmit the story that was in the zoo only to the third terminal by using the "whisper" function.

8 is a diagram illustrating a screen on which an emotion expression using a character is implemented in a multi-party video call according to an embodiment of the present invention.

According to FIG. 8, the first terminal is in a multi-party video call using the real-time image A with the second terminal and the third terminal. At this time, the first terminal intends to deliver an emotional expression of "angry" only to the third terminal.

Then, the first terminal executes an "emotion expression" function menu with respect to the third terminal during the video call, and loads an animation character stored in the storage unit of the first terminal. Subsequently, when anger, "anger," which is an emotion to be expressed in the animation character, is selected, the character is changed to an angry expression. The character image A 'expressing the emotion is combined with the real-time image A being transmitted to the video call counterpart and transmitted to the multi-party video call controller (MCU). The terminal user arbitrarily selects an animation character to be used for the emotion and the emotion expression to be expressed.

In this case, the A image displayed on the screen of the first terminal is a real time image input to the first terminal, the A 'image is a character image expressing the emotion of the first terminal, and the B image is received from the second terminal. And the C image is an image received from the third terminal.

The MCU receiving the combined image transmits a real-time image A to the second terminal and a character image A to which the emotion is expressed in the third terminal according to the selection of the "emotional expression" function set in the first terminal. Send '.

Therefore, the first terminal can deliver a character carrying its emotion only to the third terminal by using the "expression of emotion" function.

Those skilled in the art will appreciate that various changes and modifications can be made without departing from the spirit of the present invention. Therefore, the technical scope of the present invention should not be limited to the contents described in the embodiments, but should be defined by the claims.

As described above, the present invention transmits a different image to each video call counterpart, so that only the video call counterpart can express emotions or use a whisper function.

Claims (10)

An image input unit which inputs a real time image; A storage unit for storing the replacement image; Simultaneously transmit the real-time image and the substitute image to other terminals, and control to transmit a control command for controlling the display of the real-time image to the first terminal of the other terminals, the second terminal of the other terminals The control unit for controlling to transmit a control command for controlling to display the replacement image; And And a wireless transmitter for transmitting the images and the control commands according to the control. The method of claim 1, The substitute image is a mobile communication terminal comprising a video, a still image, and animation. The method of claim 1, And the controller controls to transmit the combined images using a frame sequence of the real time image and the substitute image. The method of claim 1, The control unit controls to transmit the compressed video to the H.245 protocol. The method of claim 1, And the wireless transmitter transmits the images and the control commands through a 3G mobile communication network. Inputting a real time image and a substitute image; Generating a control command for displaying the real time image on the first terminal and a control command for displaying the substitute image on the second terminal; And And simultaneously transmitting the images and the control commands to other terminals. The method of claim 6, The substitute video includes a video, a still image, and animation. The method of claim 6, And using the frame sequence of the real time video and the substitute video to control the combined video and transmit the combined video. The method of claim 6, And the images are compressed and transmitted in the H.245 protocol. The method of claim 6, And the transmitting step transmits the images and the control commands via a 3G mobile communication network.

Images