KR100574858B1 - Apparatus and Method for transmitting additional data in image-phone - Google Patents

Abstract

The present invention provides a method for transmitting additional information to the counterpart terminal to be informed to a counterpart during a video phone call using a videophone terminal equipped with a photographing means. It is determined whether an additional information selection command to be given is received, and when the additional information selection command is received from the user, the additional information corresponding to the input information and the additional information selection command is synthesized, and the synthesized image is encoded. By transmitting to the counterpart terminal, the additional information is transmitted from the video telephone terminal, the desired additional information can be transmitted to the counterpart without consultation with a third-party terminal operator.

Video phone terminal, additional information, recording, encoder

Description

Apparatus and Method for transmitting additional data in image-phone}             

1 is a block diagram schematically showing the configuration of a general video telephone system.

2 is a block diagram schematically illustrating a configuration of an encoder for transmitting additional information to a counterpart terminal in a videophone terminal according to an exemplary embodiment of the present invention.

3 is a flowchart illustrating a method for transmitting additional information in a video telephone terminal according to an embodiment of the present invention.

4A is a screen illustrating an input image according to an exemplary embodiment of the present invention.

4B is a screen illustrating additional information according to an exemplary embodiment of the present invention.

4C is a screen showing an image obtained by combining the screens of FIGS. 4A and 4B.

<Explanation of symbols for the main parts of the drawings>

100, 110: terminal 101. 111: input unit

102, 112: decoder 103, 113: protocol stack

104, 114: modem 105, 115: decoder

106, 116: output unit 200: input image receiving unit

210: controller 220: image synthesizer

230: video encoding unit

The present invention relates to a method and apparatus for transmitting additional information in a video telephone terminal for sending additional information to be informed to the other party during a video telephone call.

Recently, video telephone terminals capable of making a call with the other party while transmitting a video depicted using the mounted camera have been exploded.

In other words, in the past, video telephony using a wired network (PSTN / ISDN / IP network) was rarely used in a limited range. However, with the introduction of IMT-2000, mobile video telephony using 3G wireless networks will be widely used in the near future. will be.

This videophone is mainly a videophone using a packet switched network using H.323, and a videophone using a circuit switched network using H.324 or 3G-324M.

In addition, a video call using 3G-324M is currently being developed.

A video telephone system for performing a video call with a counterpart using the video telephone terminal will be described with reference to FIG. 1.

1 is a block diagram schematically showing the configuration of a general video telephone system.

Referring to FIG. 1, in a video telephone system, both terminals 100 and 110 exchange video streams through an IMT-2000 network such as a packet (EVDO) or a circuit (WCDMA) during a video call. H.245 protocol will be used. Here, the H.245 protocol transmits and receives control messages to play a role of mediating between terminals and performance, and these control messages include capability exchange, opening and closing of logical channels, mode preference request, flow control, and general commands. And instructions. In addition, the control messages may be configured for master / slave determination, capability exchange for performance between both terminals, logical channel signaling and bidirectional logical channel signaling, closed logical channel signaling mode request, and delay for It can be used to support decisions and the like.

In addition, the H.245 protocol is responsible for negotiation (negotiation) and quality of service (QoS) control for compatibility between terminals. These QoS control types have functions such as frame / bit rate control, video size control, and fast update request.

In the video telephone system as described above, when the user makes a phone call with the other party, the other party video having the appearance of the other party is compressed and transmitted by the other party, and the user terminal receives the compressed other party video as the original other party video. Restore it and display it on the output of the user terminal. Of course, the user's appearance is also processed in the same manner as described above and displayed on the counterpart terminal.

For example, a case in which the first terminal 100 communicates with the second terminal 110 will be described.

When the first terminal 100 receives the video / audio through the input unit 101, the input unit 101 transmits the video / audio to the encoder 102. The input unit 101 refers to a camera for acquiring an image, a microphone for acquiring audio, and the like.

Then, the encoder 102 compresses the video / audio and transmits it to the second terminal 110 through the protocol stack 103 and the modem 104. Here, the encoder 102 includes an audio encoder 102a and a video encoder 102b. The video encoder 102b compresses an image and the audio encoder 102a compresses a voice.

The second terminal 110 receives the video / audio transmitted from the first terminal 100 through the modem 114 and the protocol stack 113 and decodes the decoder 115.

The decoder 115 includes a video decoder 115b and an audio decoder 115a. The video decoder 115b decodes the encoded image, and the audio decoder 115a decodes the encoded voice.

The decoded video / audio is output through the output unit 116. The output unit 116 refers to a speaker and a display unit, and audio is output through the speaker and an image is output through the display unit.

The video telephone system described above is provided with a universal function of talking directly while watching the other party's appearance, but in addition to these functions, a camcorder function and a user that can record a video and play it when necessary when not in a call Various services that provide convenience for general users, such as a function of transmitting a video file recorded and stored by the MMS (Multimedia Messaging Service) to the counterpart, are being developed one after another.

On the other hand, the desire to store the appearance of the other party in a video call in real time is increasing. For example, the user needs to store the other party's face in real time during a video call when the other party's face is difficult to remember.

In general, the following methods exist for storing the counterpart image.

First, when a counterpart video is received and displayed through decoding, there is a method of storing the decoded video as it is.

Secondly, when the counterpart video is decoded and displayed, there is a method of recoding and storing the decoded video using H.263 and MPEG-4.

Third, there is a still image compression storage method for compressing and storing the decoded video using a still image encoder such as JPEG when the counterpart video is decoded and displayed.

As described above, the video phone must encode and send its own audio / video signal while decoding the audio / video signal sent from the other party. Among them, if there is a need to deliver additional information other than additional video / audio, for example, when the other party records the video / audio being sent to his or her handset, You must inform the fact that it is being recorded. Some countries may require it legally, and some may require it as a mandatory feature.

However, in the video telephone system as described above, a method of transmitting additional information should be sent using a control signal such as H.245. Since the two sets of video telephones always work together, the information can be arbitrarily determined by either terminal. There is a problem that the other party can not receive this information properly.

In addition, when additional information is transmitted to the counterpart using a control signal such as H.245, in order to transmit various types of information that have not yet been standardized, some information is transmitted using various signals with various operators and terminal manufacturers. There is a problem in that there is a need for consultation about whether to receive the product, and there is no way for each manufacturer to implement its own function.

Accordingly, an object of the present invention for solving the above problems is a method and apparatus for transmitting additional information in a video telephone terminal capable of delivering simple additional information to the other party through modification of the encoder side without newly defined matters in the video telephone system. To provide.

Another object of the present invention is to provide a method and an apparatus for transmitting additional information in a video telephone terminal which enables the counterpart terminal to easily recognize additional information sent by the terminal.

According to a preferred embodiment of the present invention for achieving the above object, in the method for transmitting the additional information to the counterpart terminal to inform the other party during the video call using the videophone terminal provided with the photographing means, the photographing When an image is input through the means, it is determined whether or not an additional information selection command is received from the user to inform the other party, and when the additional information selection command is received from the user, it corresponds to the input image and the additional information selection command. There is provided a method for transmitting additional information in a video telephone terminal comprising synthesizing additional information, and encoding the synthesized video to be transmitted to the counterpart terminal.

If the additional information selection command is not received from the user, the method further includes encoding the input video and transmitting the encoded video to the counterpart terminal.

The additional information indicates that the video / audio transmitted from the counterpart terminal is being recorded.

The photographing means includes a camera and a camcorder attached to the video telephone terminal.

The synthesizing of the additional information corresponding to the input information and the additional information selection command refers to generating the additional information image corresponding to the additional information selection command and synthesizing the generated additional information image and the input image.

The counterpart terminal decodes the synthesized video and displays the video and additional information.

According to another aspect of the present invention, an apparatus for transmitting additional information to be informed to a counterpart terminal during a video phone call by using a video telephone terminal having an input unit, a decoder, and an output unit, wherein the input image is transmitted through the input unit. And receiving an encoder for determining whether the additional information selection command is received from the user and synthesizing and encoding the input image and the additional information corresponding to the additional information selection command according to the result. An additional information transmission apparatus is provided at a terminal.

The encoder may include an input image receiver configured to receive an input image input through the input unit, a controller configured to determine whether an additional information selection command is received from a user, and generate an additional information image, the additional information image transmitted from the controller, and the An image synthesizer for synthesizing an input image, and a video encoder for encoding the image synthesized by the image synthesizer.

The input unit includes a photographing means and a microphone.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 is a block diagram schematically illustrating a configuration of an encoder for transmitting additional information to a counterpart terminal in a videophone terminal according to an exemplary embodiment of the present invention.

Although the video telephone terminal of the present invention has the same configuration as shown in Fig. 1, the encoder will be described because the configuration of the encoder for encoding additional information together with the input video is different.

Referring to FIG. 2, the encoder includes an input image receiver 200, a controller 210, an image synthesizer 220, and a video encoder 230.

The input image receiving unit 200 receives an input image transmitted from the photographing means. The photographing means refers to a camera or a camcorder attached to the mobile communication terminal.

The controller 210 determines whether the additional information selection command is received from the user and generates the additional information image. That is, when the additional information selection command is received from the user, the controller 210 determines that the user wants to transmit additional information to the counterpart terminal, generates the corresponding additional information image, and transmits the additional information image to the image synthesizer 220.

Here, the additional information refers to information that should be informed to the other party, such as a recording command that means that the video / audio transmitted from the other party is being recorded during the video phone call. The user selects an additional information selection command using a predetermined shortcut key and a menu.

When the additional information image is received from the control unit 210, the image synthesizing unit 220 synthesizes the input image transmitted from the input image receiving unit 200 and the additional information image.

The video encoder 230 encodes an image synthesized by the image synthesizer 220.

Hereinafter, the operation of the video telephone terminal including the encoder configured as described above will be described with reference to FIG. 1.

When the video telephone terminal receives the video / audio through the input unit, the input unit transmits the video / audio to the encoder. The input unit refers to a camera for acquiring an image, a microphone for acquiring audio, and the like.

The encoder determines whether an additional information selection command has been received from the user in encoding the transmitted video / audio.

As a result of the determination, when an additional information selection command is received from the user, the image synthesizing unit 220 synthesizes the additional information with the input image, and encodes the synthesized image by the video encoding unit 230.

The encoder then transmits the composite video / audio to a counterpart terminal via a protocol stack and a modem. Here, the encoder includes a video encoder and an audio encoder, where the video encoder compresses the image and the audio encoder compresses the voice.

The counterpart terminal receives the video / audio transmitted from the videophone terminal through a modem and a protocol stack and decodes the decoder. The decoder includes a video decoder and an audio decoder, where the video decoder decodes the encoded image, and the audio decoder decodes the encoded voice.

The decoded video / audio is output through the output unit. The output unit refers to a speaker and a display unit, and audio is output through the speaker and an image is output through the display unit. An image transmitted from the user and additional information are output to the image output to the display unit.

3 is a flowchart illustrating a method for transmitting additional information in a video telephone terminal according to an exemplary embodiment of the present invention, FIG. 4A is a screen illustrating an input image according to an exemplary embodiment of the present invention, and FIG. 4B is an embodiment of the present invention. 4C is a screen illustrating an image obtained by synthesizing the screens of FIGS. 4A and 4B according to an exemplary embodiment.

Referring to FIG. 3, when an image is input through the photographing means (S300), the video telephone terminal determines whether an additional information selection command is received from the user (S302). That is, the video telephone terminal determines whether it is necessary to transmit additional information in transmitting the input video to the counterpart terminal. Here, the additional information is information indicating that the video / audio transmitted from the counterpart is being recorded.

As a result of the determination of step 302, when the additional information selection command is received from the user, the video telephone terminal synthesizes the input video and the corresponding additional information (S304) and encodes the synthesized video (S306).

For example, it is assumed that the image input through the photographing means is FIG. 4A, and the additional information selection command received from the user is a recording command indicating that the audio / video sent from the counterpart terminal is being recorded as shown in FIG. 4B. Let's do it.

Since the video telephone terminal receives a recording command from the user, the video telephone terminal synthesizes the input video of 4a and the recorded video of FIG. 4b as shown in FIG. 4c.

Then, the input image and the additional information are output to the counterpart terminal as shown in FIG. 4C.

After performing step 306, the video telephone terminal transmits the synthesized video to the counterpart terminal (S308).

In this case, the counterpart terminal is a terminal capable of decoding the transmitted image and recognizing the additional information transmitted by the user.

Then, since the additional information is used and recognized by the other party, a process such as consultation with another terminal and IOT is not required for additional information delivery.

Accordingly, the counterpart terminal sees the synthesized video on the screen decoded and output by the video decoder, and the user recognizes the additional information by viewing the synthesized video from the output video.

If it is determined in step 302 that the additional information selection command is not received from the user, the video telephone terminal encodes the input video and transmits it to the counterpart terminal (S310).

The method of transmitting additional information according to another aspect of the present invention is not limited to the synthesis of an image, and may also transmit additional information through voice by modifying an audio encoder.

For example, when an additional information selection command is received from a user, the audio encoder synthesizes the additional information and a voice and transmits the additional information to a counterpart terminal. Then, the counterpart terminal may output additional information before the voice is output, or additional information may be output in the middle of outputting the voice.

As described above, according to the present invention, when the additional information is transmitted from the video telephone terminal, the additional information transmission method and apparatus in the video telephone terminal capable of transmitting the desired additional information to the other party without consultation with the third-party terminal operator Can provide.

Claims (9)

In the method for transmitting the additional information to the counterpart terminal to notify the other party during a video phone call using the videophone terminal equipped with a photographing means, Determining whether an additional information selection command to notify the other party is received from the user when an image is input through the photographing means; Synthesizing additional information corresponding to the input image and the additional information selection command when the additional information selection command is received from the user; and Encoding the synthesized video and transmitting the encoded video to the counterpart terminal; The additional information transmission method in a video telephone terminal comprising a. The method of claim 1, And if the additional information selection command is not received from the user, encoding the input video and transmitting the encoded video to the counterpart terminal. The method of claim 1, And the additional information indicates that the video / audio transmitted from the counterpart terminal is being recorded. The method of claim 1, And the photographing means comprises a camera and a camcorder attached to the video telephone terminal. The method of claim 1, Synthesizing the input image and the additional information corresponding to the additional information selection command may include generating an additional information image corresponding to the additional information selection command; And synthesizing the generated additional information image and the input image. The method of claim 1, And the counterpart terminal decodes the synthesized video to display a corresponding video and additional information. An apparatus for transmitting additional information to a counterpart terminal during a videophone call using a videophone terminal having an input unit, a decoder, and an output unit, When the input image is received through the input unit, it is determined whether the additional information selection command is received from the user, and an encoder for synthesizing and encoding the input image and the additional information corresponding to the additional information selection command according to the result. Apparatus for transmitting additional information in a video telephone terminal comprising a. The method of claim 7, wherein The encoder may include an input image receiver configured to receive an input image input through the input unit; A controller configured to determine whether an additional information selection command is received from a user and generate an additional information image; An image synthesizer configured to synthesize the additional information image transmitted from the controller and the input image; And a video encoding unit for encoding the image synthesized by the image synthesizing unit. The method of claim 7, wherein And the input unit comprises a photographing means and a microphone.

Images