KR20040108065A - Apparatus for Providing Video Phone using Multimedia Contents Synthesis and Method Thereof - Google Patents

Abstract

PURPOSE: An apparatus and a method for providing video communications using multimedia contents synthesis are provided to synthesize motion picture data with image data of a user and multimedia contents which are transmitted from a contents supply server at a real time or stored in a terminal of the user and transmit the synthesized motion picture data to a terminal of another user. CONSTITUTION: Image data are inputted to an input unit(110) through a camera. A control unit(120) controls a synthesis unit(140) according to a predetermined matter stored by a user, wherein the synthesis unit synthesizes motion picture data with image data of the user and multimedia contents. A storage unit(130) stores the synthesized motion picture data. A transmission unit(150) transmits the synthesized motion picture data to a terminal of another user.

Description

Apparatus for Providing Video Phone using Multimedia Contents Synthesis and Method Thereof}

The present invention relates to an apparatus for providing a video call using the synthesis of multimedia contents, and a method thereof and a computer-readable recording medium recording a program for realizing the method. The present invention relates to an apparatus for providing a video call using the synthesis of multimedia contents for transmission, and to a computer readable recording medium having recorded thereon a program for realizing the method.

Nowadays, the remarkable development of the information and telecommunications industry is enabling the realization of things that used to be possible in the imagination.

In particular, the rapid development of the Internet is changing our real life. More than traditional phones such as Integrated Service Digital Network (ISDN), Asymmetric Digital Subscriber Line (ADSL), Very High-data Rate Digital Subscriber Line (VDSL) and Cable Modem Fast and efficient communication is now available in every home.

On the other hand, in recent years, mobile communication terminals are now developing into multimedia devices that can provide not only voice calls but also various additional services such as electronic organizer functions, game functions, and schedule management functions. As the (International Mobile Telecommunication) 2000 service becomes visible, provision of a video call service, which has not been realized in the conventional IS-95A / B, is becoming a reality.

A video call service is a telephone service that allows you to make a call while viewing and seeing the other person's face by simultaneously transmitting and receiving video and audio. It has the advantage of talking face to face.

As the provision of such a video call service is realized, an extension that simultaneously transmits / receives multimedia content transmitted in real time from a content provider server or previously stored in a terminal in addition to the video and audio data of a call counterpart during video call transmission / reception There is a demand for a multimedia content service.

The present invention is proposed in order to meet the above-described requirements, by synthesizing multimedia content such as images, videos and texts stored in the terminal or transmitted in real time from the content provider server to the user's video data, An object of the present invention is to provide an apparatus for providing a video call using the synthesis of multimedia contents for transmission to a terminal.

In addition, the present invention is a video call using a multimedia content synthesis for transmitting the multimedia content, such as images, videos and text stored in the terminal or transmitted in real time from the content provider server in advance to the user's video data Another purpose is to provide a providing method.

In addition, the present invention provides a program for realizing a function for synthesizing multimedia content such as image, video and text stored in the terminal or transmitted in real time from the content provider server to the user's image data and transmitting it to the terminal of the other party. It is another object to provide a computer readable recording medium having recorded thereon.

1 is a structural diagram of an apparatus for providing a video call using the synthesis of multimedia contents according to the present invention;

2A to 2C are exemplary views for briefly explaining a method of synthesizing image data and multimedia content according to the present invention;

3 is a flowchart illustrating a method of selecting a setting item in a terminal for the present invention;

4 is a flowchart illustrating a video call providing method using the synthesis of multimedia contents.

* Explanation of symbols for the main parts of the drawings

110: image input unit 120: control unit

130: storage unit 140: synthesis unit

150: transmitter

According to an aspect of the present invention, there is provided a video call providing apparatus using a multimedia content synthesis of a terminal capable of making a video call through a wired / wireless network, comprising: input means for receiving image data through a camera; Control means for controlling the synthesizing means by invoking the setting matters set and stored by the user in advance; The synthesizing means for synthesizing the video data and the multimedia content under control of the control means; Storage means for storing the multimedia content and the moving picture data synthesized by the synthesizing means; And transmitting means for transmitting the moving picture data to the counterpart terminal.

In addition, the present invention provides a video call providing method using the synthesis of multimedia content of a terminal capable of making a video call via a wired / wireless network, comprising: a first step of receiving image data through a camera; A second step of calling up the setting items previously set and stored by the user; A third step of synthesizing the image data and the multimedia content according to the setting details and storing the synthesized moving image data; And a fourth step of transmitting the moving picture data to the counterpart terminal.

In addition, the present invention provides a device having a microprocessor to provide a video call providing method using the synthesis of multimedia content of a terminal capable of making a video call via a wired / wireless network, a first function for receiving image data through a camera; A second function of recalling settings stored in advance by a user; A third function of synthesizing the image data and the multimedia content according to the setting details and storing the synthesized moving image data; And a computer readable recording medium having recorded thereon a program for realizing a fourth function of transmitting the moving picture data to a counterpart terminal.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. First of all, in adding reference numerals to the components of each drawing, it should be noted that the same components have the same number as much as possible even if displayed on different drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a structural diagram of an apparatus for providing a video call using the synthesis of multimedia contents according to the present invention.

A terminal to which the present invention is applied is a concept in which a camera and a microphone may be internally / externally provided to provide a video call, and include a terminal that may be connected to a wired / wireless network. For example, it may be a personal computer (PC), a cellular phone, a personal digital assistant (PDA), or the like.

As shown in FIG. 1, the apparatus for providing a video call of the present invention includes a video input unit 110, a controller 120, a storage unit 130, a synthesizer 140, and a transmitter 150.

The video input unit 110 is installed inside the terminal to provide a video call of the present invention, or is responsible for receiving image data through a camera installed outside.

The control unit 120 is responsible for the function of controlling the synthesis unit 140 by calling the settings for the synthesis of the multimedia content previously set by the user.

The user may select multimedia contents to be synthesized through a display unit (not shown) in advance for a video call provided by the present invention, and may preset settings such as a synthesis scheme and a location at which the multimedia contents are displayed.

The synthesis method and the method of selecting the setting items will be described later.

To this end, the terminal to which the present invention is applied should provide a size that can sufficiently display the corresponding multimedia content, and should be provided with the display unit capable of displaying the corresponding color when the color is included in the moving image data.

The storage unit 130 is responsible for storing a multimedia content.

The multimedia content refers to a moving picture, a still picture, a text, and the like. The moving picture and the still picture may be downloaded by a user using a wired / wireless network or stored in advance by a terminal. It may be to download from a contents provider (CP) in real time at a time point. Meanwhile, the text may be directly input by the user at the time of selecting the setting item.

In addition, the storage unit 130 may store a moving image synthesized by the synthesis unit 140.

The synthesizing unit 140 is responsible for synthesizing the image data received by the image input unit 110 and the multimedia content stored in the storage unit 130 according to the setting items of the control unit.

The synthesis of the multimedia content and the image data of the synthesis unit 140 may be performed in units of frames of the image information received by the image input unit 110, and transparent pixels in the image to be synthesized according to the synthesis method. ) And replace the pixel information with the same position based on the coordinates to synthesize the pixel information other than the transparent pixel (substitution method), or perform the average operation (average operation method) of the pixels of the two data. Can be.

2A to 2C are exemplary views for briefly explaining a method of synthesizing image data and multimedia content according to the present invention.

FIG. 2A is for explaining moving image data input by the image input unit 110, FIG. 2B is for showing multimedia contents stored by the terminal, and FIG. 2C is a diagram showing the synthesis of the data of FIGS. 2A and 2B. This is for representing moving picture data.

According to an exemplary embodiment of the present invention, the video data of FIG. 2A may be synthesized with the multimedia content of FIG. 2B according to a predetermined setting and may be configured in the form of moving picture data as shown in FIG. 2C. It may be encoded and transmitted to the terminal of the counterpart.

The substitution method is to generate the composite image information by substituting the pixel information of the multimedia content with the pixel information of the multimedia content on the coordinates to which the multimedia content is synthesized in the two images of the multimedia content and the image data.

On the other hand, the average operation method, in the two images of the multimedia content and the image data, the pixels on the same coordinates are selected and red, green, blue of the pixels (hereinafter, referred to simply as 'RGB') The composite image information is generated by calculating the RGB values for the pixels of the corresponding coordinates by summing each of the color values for and dividing by two.

In this case, multiplying the R.G.B information of the pixel by the weight constant may adjust the degree of transparency in the composite image information.

The weight constant has a real value greater than or equal to 0 and greater than or equal to 2, and is multiplied by the RGB value of the corresponding pixel of the multimedia content, and the remaining value of the pixel of the corresponding frame of the image data is obtained by subtracting the weight constant from the integer 2. Multiply each RGB value to perform an average operation.

In this case, the closer the weight constant is to 0, the greater the degree of transparency of the multimedia content becomes, and the closer the weight constant is to 2, the clearer the appearance becomes.

The weight constant may be adjusted by adjusting transparency when the user sets the synthesis method.

When the data is synthesized by the substitution method, the synthesized content is clearly displayed on the resultant moving image data. When the data is synthesized by the average operation method, the multimedia content may be expressed in a translucent state.

On the other hand, the transparent color specified in the synthetic multimedia content data in both the substitution method and the average operation synthesis method are excluded from the calculation.

The data to be synthesized is a multimedia content, i.e., a still image, a moving picture, or a character. When the data type is a video, the data is inputted by each frame and repeatedly synthesized by synchronizing each frame. It can be synthesized to each frame of the input image data. Character data can also be synthesized in the same manner.

The transmitter 150 of FIG. 1 is responsible for transmitting the video data synthesized by the synthesizer 140 to the counterpart terminal, and may include an antenna and a radio frequency (RF) transceiver.

Hereinafter, a method of selecting a setting item in a terminal for application of the present invention will be described in detail with reference to FIG. 3.

3 is a flowchart illustrating a method of selecting a setting item in a terminal for the present invention.

As shown in the figure, in a state where the terminal is in a reception or non-reception state, the terminal displays the image data input through the image input unit 110 on a display unit, and the user displays it. Check (S301). Thereafter, a list of stored multimedia contents is displayed to select multimedia contents to be synthesized (S303).

When the multimedia content to be synthesized is selected, the content is synthesized with the image data and displayed on the display unit. The user determines a location and a synthesis method (average calculation method or a substitution method) where the multimedia content is to be synthesized by operating a data input unit (not shown). It may be (S305).

Finally, after the user determines other necessary setting items (S307), and stores them (S309).

The setting items are stored in the storage unit 130, and moving image data may be synthesized with reference to the actual call.

The setting items may include synthesizing, a file name of a multimedia content to be synthesized (which may be a physical memory address or a remote file address of data), horizontal and vertical pixel coordinates of the display unit to which data is to be synthesized, and a synthesis method (substitution synthesis, averaging). Arithmetic synthesis), transparency weighting constants (if averaged), the terminal identifier (number, IP, ID, etc.) of the other party to which the synthesis is applied, and other synthesis effects (synthesis duration, fade out effect, motion) Effects and the like).

The user may store a plurality of sets of the set items. In other words, it is possible to adopt several modes and set different settings for each mode differently.

At this time, the setting information can be selected when the identifier information of the stored counterpart terminal is corrected or when the terminal identifier information is newly stored, and different setting items can be applied according to the terminal identifier of the called party.

Other settings can be saved in other compositing effects to set the duration of compositing, or to create existing video compositing effects such as fade out effects, effects that constantly change the location where the multimedia content is synthesized on the screen. And image correction and processing techniques.

4 is a flowchart illustrating a video call providing method using multimedia content synthesis.

As shown in the figure, the video call providing method of the present invention receives the image data through a camera mounted on the inside of the terminal or installed outside to provide the video call of the present invention (S401).

Thereafter, the user calls a setting item for synthesizing the multimedia content previously selected and stored (S403), synthesizes the image data and the multimedia content according to the setting item, generates a moving image data, and stores the same (S405). .

Thereafter, the moving image data is transmitted to the opposite terminal (S407).

The method of the present invention as described above may be implemented as a program and stored in a computer-readable recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.).

The present invention described above is not limited to the above-described embodiments and the accompanying drawings, and various substitutions, modifications, and changes are possible in the art without departing from the technical spirit of the present invention. It will be clear to those of ordinary knowledge.

As described above, the present invention enables the user to send a cute icon, avatar, or a favorite celebrity, animation hero, or the like character to the other party, instead of simply sending the user's video, thereby making a video call utilizing the personality of the user. It is effective to provide.

In addition, the present invention has the effect that it is possible to replace the secondary screen, such as the answering screen, the connection screen, and the like during the video call with multimedia content.

In addition, when the user selects the frame-shaped content occupies only the edge of the video signal of the camera, it is possible to bring the effect of talking while looking at the other party in the frame or mirror.

Furthermore, the present invention has an effect of ensuring the privacy of the user by synthesizing the background image into multimedia content when it is not desired to transmit the background image which is not reluctant to be transmitted in the video call.

Claims (7)

An apparatus for providing a video call using the synthesis of multimedia contents of a terminal capable of making a video call through a wired / wireless network, Input means for receiving image data through a camera; Control means for controlling the synthesizing means by invoking the setting matters set and stored by the user in advance; The synthesizing means for synthesizing the video data and the multimedia content under control of the control means; Storage means for storing the multimedia content and the moving picture data synthesized by the synthesizing means; And Transmitting means for transmitting the moving picture data to a counterpart terminal Apparatus for providing a video call using multimedia content synthesis, including. The method of claim 1, The multimedia content, User downloaded via wired or wireless network Apparatus for providing a video call using multimedia content synthesis, characterized in that. The method of claim 1, The above setting matters, Whether or not to synthesize, the multimedia content to be synthesized, pixel coordinates, a synthesis method, a counterpart terminal identifier, and other synthesis effects Apparatus for providing a video call using multimedia content synthesis, characterized in that it comprises a. The method of claim 3, wherein The synthesis method, One of substitution method and average operation method Apparatus for providing a video call using multimedia content synthesis, characterized in that. The method according to claim 3 or 4, In the case where the synthesis method is the average operation method, The setting item further includes a weight constant. Apparatus for providing a video call using multimedia content synthesis, characterized in that. In the video call providing method using the synthesis of multimedia content of the terminal capable of making a video call over a wired / wireless network, A first step of receiving image data through a camera; A second step of calling up the setting items previously set and stored by the user; A third step of synthesizing the image data and the multimedia content according to the setting details and storing the synthesized moving image data; And A fourth step of transmitting the moving picture data to a counterpart terminal; Video call providing method using a multimedia content synthesis comprising a. In order to provide a video call providing method using the synthesis of multimedia content of a terminal capable of a video call over a wired / wireless network, A first function of receiving image data through a camera; A second function of recalling settings stored in advance by a user; A third function of synthesizing the image data and the multimedia content according to the setting details and storing the synthesized moving image data; And A fourth function of transmitting the moving picture data to a counterpart terminal A computer-readable recording medium having recorded thereon a program for realizing this.