KR20080074442A - The system for portrait telephone and method the same - Google Patents

Abstract

A video telephone system and a method thereof are provided to apply a stored or received object to a transceived image to send the image to a receiving terminal, thereby offering intimacy between calling/called parties during a video call as decorating video data. In the server, an object storage(210) stores the object received from a contents provider(300) in a DB(240). An index provider(220) provides a list including an index of the stored object to the terminal. An object provider(230) transmits the object corresponding to the index received from the terminal to the terminal. The server receives an item from the contents provider which generates the item, and stores the received item in the object DB.

Description

Video phone system and method {THE SYSTEM FOR PORTRAIT TELEPHONE AND METHOD THE SAME}

1 is a view showing the structure of a typical 3G-324M.

2 is a system configuration diagram for a video call according to a preferred embodiment of the present invention.

3 is a flowchart showing a method of operating a video telephone system according to a preferred embodiment of the present invention.

4 is a block diagram showing an apparatus of a mobile communication terminal for providing a video telephone service in a video telephone system according to a preferred embodiment of the present invention.

5 is a block diagram showing an apparatus of a server for providing a video telephone service in a video telephone system according to a preferred embodiment of the present invention.

6 is an exemplary view showing a display screen of a transmitting and receiving terminal during a video call according to a preferred embodiment of the present invention.

7 is a flowchart illustrating a video telephone method of a mobile communication terminal in a video telephone system according to a preferred embodiment of the present invention.

<Explanation of symbols for the main parts of the drawings>

10 microphone 12 audio encoder

17: integrated unit 22: video encoder

24: control unit 26: RF transmitter

100: transmitting terminal 108: server

116: receiving terminal 118: network

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to video telephony technology, and more particularly, to a video telephony system and method for making a video call by inserting an object capable of embellishing the face of itself and the other party.

Generally, 3G-324M is used for video telephony in WCDMA (Wideband Code Division Multiple Access) network, and it is possible to transmit / receive voice, video, data, etc. in general telephone network by using mobile communication terminal (hereinafter referred to as terminal). Based on H.324 used in the case, it is defined to be suitable for mobile communication environment.

1 is a diagram showing the structure of a general 3G-324M.

As shown in Fig. 1, the structure of a general 3G-324M includes a video codec for transmitting and receiving video information, an audio codec for transmitting and receiving voice information, and a function related to connection and control of a video telephony protocol, respectively. It is composed of Call Control in charge and Data Protocol which provides the function to transmit data during video call. In addition, Control Channel Segmentation and Reassembly (CCSRL) is a segmentation and reassembly (SAR) implementation of the control frame specified in ITU-T Recommendation H.324 / Annex C, which provides a stable H.245 message exchange role. . The maximum size of the NSRP instruction responsible for wrapping the CCSRL segment is 2048 Octets.

However, the conventional video telephony method is a telephone method for the purpose of concealing information of the sender by simply using a substitute image during video telephony or a general telephony method that does not decorate an image on a user's face. The application to call was not provided to the user.

Accordingly, an aspect of the present invention is to provide a video telephone system and method for making a video call by inserting an object capable of decorating a face of a person and a counterpart in a video call.

The present invention also provides a video communication mobile communication terminal and a video telephony method in which an object downloaded from a server is applied to an image transmitted and received during video telephony.

The video telephone system of the present invention for achieving the above object, the object storage unit for storing the object received from the content provider in the database, the index providing unit for providing the terminal with a list including the index of the object stored in the database And an object providing unit which transmits an object corresponding to the index received from the terminal to the terminal. A transmitting terminal for transmitting the image data to which the object is applied by applying the object downloaded from the server to an image transmitted / received during a video call; And a receiving terminal that receives and reproduces image data to which the object is applied.

The video telephony method of the present invention for achieving the above object comprises the steps of selecting an object to be applied to the image to be transmitted and received during video telephony; If the selected object is stored in the transmitting terminal, applying the selected object to the image transmitted and received; Transmitting image data to which the received object is applied to a receiving terminal; The receiving terminal receives and reproduces the image data.

According to an aspect of the present invention, there is provided a video communication mobile communication terminal comprising: a display unit for displaying objects to be applied to an image to be transmitted and received; An integration unit for applying the selected object to an image when a predetermined object is selected among the displayed objects; And a control unit for controlling transmission of the image data to which the above-selected object is applied to the receiving terminal.

The video telephony method of the mobile communication terminal of the present invention for achieving the above object comprises the steps of selecting a menu for applying the object to the image transmitted and received during the video call; If a menu is selected, displaying object index lists; Checking whether an object corresponding to the list selected by the user from among the displayed lists is stored in the terminal; If it is stored in the terminal, extracting features of the image transmitted and received; And applying the object corresponding to the selected list to the image transmitted and received using the extracted feature and transmitting the same to the receiving terminal.

Preferably, the above feature is characterized in that the contour of the image is extracted through the contrast of the eyes, nose and mouth of the image being transmitted and received.

Preferably, the object index is displayed on the right side of the display unit in the form of an icon.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. First of all, in adding reference numerals to the components of each drawing, it should be noted that the same reference numerals are used as much as possible even if displayed on different drawings. In addition, in describing the present invention, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

2 is a system configuration diagram for a video call according to a preferred embodiment of the present invention.

As shown in Fig. 2, a system for video telephony according to a preferred embodiment of the present invention includes a transmitting and receiving terminal 100, 116 equipped with a module for video telephony service, and a plurality of video telephony services. And a base station (102, 114) for routing video information transmitted to and received from a transmitting and receiving terminal and information for providing a video telephone service to the terminal, and a base station. RNCs 104 and 112 which act as radios of the domain to which the domain belongs, and which perform management functions for interfaces between different networks, provide circuit switching services to mobile communication subscribers in connection with fixed networks, When an object insertion request is generated at the request of the user, the MSCs 106 and 110 leading the object from the server 108 are used for video telephony. Is requested or configured to include a server 108 with a plurality of objects are stored is provided to the user.

In addition, the wireless communication switch has subscriber terminal information, subscription information, location information, authentication function, etc., controls the signaling network protocol along with MSC and VLR (not shown) nodes, and completes an incoming call. And an HLR 110 that performs a transaction with the VLR to update subscriber information.

3 is a flowchart illustrating a method of operating a video telephone system according to a preferred embodiment of the present invention.

Hereinafter, a method of operating a video telephone system according to a preferred embodiment of the present invention will be described in detail with reference to FIGS. 2 and 3 as follows.

In a state where a video call is made between the transmitting and receiving terminals 100 and 116, the user of the transmitting terminal 100 selects an object to be worn on his or her face through a predetermined menu (S100). When the object is selected, the terminal checks whether the selected object is an object that is previously stored in the terminal or an object that is not stored. If the object is already stored in the terminal, the terminal performs the integration process of the integration unit provided in the terminal. Apply the selected object to the face through (S102, S108).

If, as a result of the check, there is only an index of the object to be applied to the terminal, and if there is no real object, the selected object is requested from the user by sending an index to the server 108, and the requested object is received from the server 108. The object received through the integration unit is applied to the face of the user or the counterpart (S102-S108). In this way, the image data to which the object is applied is transmitted to the receiving terminal through equipment such as a base station, an RNC, and an MSC provided in a network providing a video telephone service (S110). The receiving terminal displays image data received from the transmitting terminal (S112).

In the above embodiment, the transmitting terminal applies the object to the image and transmits the image to the receiving terminal as an example. However, the receiving terminal may include an integrated unit such as the transmitting terminal to transmit image data to which the object is applied.

4 is a block diagram showing an apparatus of a mobile communication terminal that provides a video telephone service in a video telephone system according to a preferred embodiment of the present invention.

As shown in FIG. 4, the apparatus of the mobile communication terminal that provides a video telephone service in a video telephone system according to a preferred embodiment of the present invention includes a microphone 10 for acquiring a voice from a user during a video telephone call, and an acquired voice. The audio encoder 12 encoding the, the image capturing unit 14 for capturing the image, the input unit 38 for receiving the selection of the object to be applied to the image captured above, and the selected object is already stored in the terminal An integrated unit 17 for applying the pre-stored object to the image and integrating the object received from the server into the image to generate the image data, if not already stored in the terminal; and a video encoder for encoding the generated image data. 22) and an apparatus for synchronizing the audio output from the audio encoder 12 with the image output from the video encoder 22, and further comprising the present invention. A control unit 24 for controlling a series of operations of the camera, an RF transmitter 26 for transmitting the encoded image data and voice through an antenna (not shown), and image data received during a video call from the network 118. An RF decoder 28 for receiving, an audio decoder 34 for decoding the voice file received through the RF receiver 28 under the control of the control unit 24, an output unit 36 for outputting the decoded voice, It also includes a video decoder 30 for decoding the image data received through the RF receiver 28 under the control of the control unit 24, and a display unit 32 for displaying the decoded image.

5 is a block diagram showing an apparatus of a server for providing a video telephone service in a video telephone system according to a preferred embodiment of the present invention.

The server 200 stores the object to provide the object to the terminal and transmits the object requested by the terminal to the terminal. The server 200 stores the object received from the content provider 300 in the database 240, the object storage 210, and a list including the indexes of the objects stored in the database 240 to the terminal 400. The index providing unit 220 and the object providing unit 230 for transmitting the object corresponding to the index received from the terminal 400 to the terminal 400.

The server 200 receives an item from the content provider 300 that creates the item and stores the received item in the object database 240. Items include sunglasses, wigs, clothes, and accessories. The server 200 creates a list of objects stored in the object database 240.

When the object database 240 is updated, the server 200 provides a list of updated objects to the terminal. The server 200 receives an index for the object selected from the list from the terminal 400 and transmits an object corresponding to the index to the terminal 400.

When the server 200 receives the index of the object from the terminal 400, the server 200 searches for an object corresponding to the index from the object database 240 and transmits the searched object to the terminal 400. The object database 240 stores items received from the content provider 300.

6 is an exemplary view showing a display screen of a transmitting and receiving terminal during a video call according to a preferred embodiment of the present invention.

As shown in FIG. 6, the display screen transmitted / received during a video call according to the preferred embodiment of the present invention displays a counterpart image, its own image, and an object list to be applied to the image transmitted / received. The object list may change a display position through a predetermined menu, and periodically connects to a server and periodically updates a plurality of received objects in the list. If an object to be applied to an image is selected from these lists, it is displayed as shown due to the operation of the integrating unit provided in the terminal.

Hereinafter, referring to FIGS. 4 and 6, operations of a transmitting and receiving terminal during a video call according to an exemplary embodiment of the present invention will be described.

When a user makes a video call using a terminal equipped with a video call function, the microphone 10 and the photographing unit 14 such as a camera provided in the terminal acquire a voice and an image spoken by the user. The voice obtained through the microphone 10 is transmitted to the counterpart terminal through the RF transmitter 26 under the control of the controller 24 through an encoding process through the audio encoder 12. Also, the image acquired through the photographing unit 14 integrates the object selected through the input unit 38 in the integrating unit 17.

In order to apply the selected or received object to the face, the integrated unit equipped with the integrated module first extracts the shape of the face, and uses eye, nose and mouth using information such as color and contrast in the extracted face shape region. Determining and integrating the candidate area of the back, or considering the elliptical face of the average person, the brightness is analyzed in the elliptical, and the location of the eyes, nose and mouth are integrated according to the analyzed contrast. As described above, in order to apply an object to an image moving in real time, the device provided in the terminal continuously performs the process in real time as the user moves during the call.

Also, the integrating unit 17 transmits to the video encoder 22 when the image data in which the selected or received object is integrated is generated. The video encoder 22 encodes the integrated picture under the control of the control unit 24 and transmits the integrated picture to the RF transmitter 26, and the RF transmitter 26 transmits the encoded picture through an antenna (not shown). To transmit.

7 is a flowchart illustrating a video telephony method of a mobile communication terminal in a video telephony system according to a preferred embodiment of the present invention.

Hereinafter, an operation method of a mobile communication terminal providing a video telephone service in a video telephone system according to a preferred embodiment of the present invention will be described in detail with reference to FIG. 4.

When the user selects a video call mode and wants to decorate the user's face using images of small masks, earrings, glasses, etc., the user selects an object to be decorated (S200, S202, S204). Then, the terminal uses the photographing means such as a camera to obtain information for applying the object in the shape of the face of the user who is in the video call (that is, the position of the eyes, nose, mouth through the contrast or the position of the eyes, nose, and mouth). To extract (S206).

When the information for applying the object is extracted, the selected object is applied to the image using the extracted information, or if the selected information is not stored in the terminal, the server requests the server to apply the received object to the image ( S208). When the selected object is matched with the image as described above, the matched image data is transmitted to the receiving side (S210).

If, during the video call, the user's face moves, the terminal returns to step S106 to extract information indicative of the user's face in real time (S112, S106).

If the user wants to apply another image as a decoration while in a video call, the user returns to the process of selecting an image to be decorated (S104) and selects the corresponding image (S114, S104).

As described above, when the user's face moves and / or to decorate another object during the video call, the processes S104 to S114 are repeatedly performed. When the user finishes the video call, the terminal terminates the video call mode.

Although the present invention has been described in more detail with reference to examples, the present invention is not necessarily limited to these examples, and various modifications can be made without departing from the spirit of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

As described above, according to the present invention, by applying the object to be applied during the video call to the other party or the user's face during the video call, it provides more intimacy among the telephones during the call, and can decorate the image data. have.

Claims (20)

An object storage unit for storing the object received from the content provider in the database, an index provider for providing a list containing the index of the object stored in the database to the terminal, and an object for transmitting the object corresponding to the index received from the terminal A server including a providing unit; A transmitting terminal for transmitting the image data to which the object is applied by applying the object downloaded from the server to an image transmitted / received during a video call; A receiving terminal that receives and reproduces image data to which the object is applied; Video telephone system is configured to include. The method of claim 1, And if the object to be applied is not stored in the terminal, the transmitting terminal periodically connects to the server and updates the object. The method of claim 2, And when the object to be applied is selected, extracts a feature of the image to be transmitted and received, applies it to the selected object, and transmits the same to the receiving terminal. The method of claim 3, The transmitting terminal displays an index list of objects, and if the object corresponding to the index selected by the user is not stored among the displayed index lists, requests the selected index from the server, and sends the selected index to the selected index from the server. And a corresponding object is applied to the image to be transmitted and received. The transmitting terminal selects an object to be applied to the image transmitted and received during the video call; If the selected object is stored in a transmitting terminal, applying the selected object to the image to be transmitted and received at the transmitting terminal; Transmitting image data to which the received object is applied by the transmitting terminal to a receiving terminal; Receiving and playing the image data by the receiving terminal; Video telephony method comprising a. The method of claim 5, wherein the application process, Requesting a server if the selected object is not stored in the transmitting terminal; Receiving the requested object from the server; Applying the received object to the transmitted and received image; Video telephony method comprising a. The method of claim 6, And the requesting step includes updating the object by periodically connecting to the server. A display unit which displays objects to be applied to an image to be transmitted and received; An integrating unit applying the selected object to the image when a predetermined object is selected among the displayed objects; A control unit which transmits and controls the image data to which the selected object is applied; Mobile communication terminal for a video phone comprising a. The method of claim 8, And the display unit displays an index list of objects to be applied. The method of claim 9, The integrated unit extracts a feature through a geometric structure such as eyes, nose and mouth of the image to be transmitted and received, and applies the selected object through the extracted feature. The method of claim 10, And the feature is extracted through the contrast of the transmitted and received image. The method according to claim 10 or 11, wherein And the controller periodically connects to the server where the object is stored and updates the objects. The method of claim 12, And if the selected object is not stored in the terminal, accessing the server providing the object and updating the object. The method of claim 13, The controller extracts features in real time even when the user's face moves during a video call. Selecting a menu for applying an object to an image transmitted / received during a video call; If the menu is selected, displaying object index lists; Checking whether an object corresponding to a list selected by the user from among the displayed lists is stored in the terminal; If it is stored in the terminal, extracting features of the transmitted and received image; Applying an object corresponding to the selected list to the image to be transmitted and received using the extracted feature and transmitting the object to a receiving terminal; Video telephony method of a mobile communication terminal comprising a. The method of claim 15, And if the check result is not stored in the terminal, requesting and receiving the selected object from a server storing the selected object. The method of claim 16, And the receiving step comprises a step of periodically connecting to the server to receive and update objects. The method of claim 17, The extracting method is a video telephone method of a mobile communication terminal, characterized in that the feature is extracted through the geometry of the eye, nose, mouth, etc. of the image being transmitted and received. The method of claim 18, The extracting method is a video telephone method of a mobile communication terminal, characterized in that the extraction in real time even if the user's face moves during the video call. An object storage unit for storing the object received from the content provider in a database; An index provider for providing a terminal with a list including an index of an object stored in a database; And And an object provider for transmitting an object corresponding to the index received from the terminal to the terminal.

Images