KR100892433B1 - System and Method for relaying motion pictures using mobile communication device - Google Patents

Abstract

Disclosed are a video relay system using a mobile communication terminal and a method thereof. The present invention encodes an image taken by a built-in camera or a pre-stored image with a built-in codec, receives an interactive element added to the encoded image, the real-time transcoding server through the wireless network to the encoded image and the interactive element Mobile communication terminal for transmitting to; Decode the encoded image, generate an action script for the interactive element, perform encoding to convert the decoded image into flash video that is a streaming video, and transmit the flash video and the action script to a flash streaming server A real time transcoding server; A flash streaming server connected to a client computer over the Internet and transmitting the flash video and the action script to the client computer in a streaming manner; And a client computer for playing the flash video according to the action script. According to the present invention, by using a flash player already installed in a mobile communication terminal or a client computer, it is possible to reduce the hassle of having to install a separate device or program in a terminal owned by the user in order to receive a video service, Even if you add a new interactive element to your system, you don't need to update plug-ins, active axes, upgraded video players, etc., and you can broadcast live video between your mobile device and your client computer anytime, anywhere. In addition, advertisements, texts, etc. can be added in real time to maintain the real-time of UCC.

Description

Image relay system and method using mobile communication terminal {System and Method for relaying motion pictures using mobile communication device}

1 is a block diagram of a video relay system using a mobile communication terminal according to an embodiment of the present invention.

2 is a block diagram of a video relay system using a mobile communication terminal according to another embodiment of the present invention.

3 is a flowchart illustrating a video relay method using a mobile communication terminal according to another embodiment of the present invention.

4 is a flowchart illustrating a video relay method using a mobile communication terminal according to another embodiment of the present invention.

The present invention relates to real-time video relay, and more particularly, to a video relay system and a method using a mobile communication terminal.

In the conventional video streaming service method, whenever a new interactive element is added, it is cumbersome to update the plug-in, ActiveX, versioned video player, etc. on the client side. When adding an advertisement, a character, etc., there is a problem in that the decoding and encoding process is lengthened, thereby losing the real-time of video transmission.

Therefore, the first technical problem to be achieved by the present invention is to reduce the hassle of having to install a separate device or program in the terminal owned by the user in order to provide a video service, the special effects, advertising, text, etc. in the video The present invention provides a video relay system using a mobile communication terminal that can be added in real time.

A second technical problem to be achieved by the present invention is to provide a video relay method using a mobile communication terminal applied to a video relay system using a mobile communication terminal.

In order to achieve the first technical problem, the present invention encodes an image taken by a built-in camera or a pre-stored image with a built-in codec, receives an interactive element added to the encoded image, and receives the encoded image and the interactive element. A mobile communication terminal for transmitting to a real-time transcoding server through a wireless network; Decode the encoded image, generate an action script for the interactive element, perform encoding to convert the decoded image into flash video that is a streaming video, and transmit the flash video and the action script to a flash streaming server A real time transcoding server; A flash streaming server connected to a client computer over the Internet and transmitting the flash video and the action script to the client computer in a streaming manner; And a client computer for playing the flash video according to the action script.

In order to achieve the second technical problem, the present invention includes the steps of encoding a video taken by a camera or a pre-stored video in a mobile communication terminal with a built-in codec, and receiving an interactive element added to the encoded video; Transmitting, by the mobile communication terminal, the encoded image and the interactive element to a real-time transcoding server through a wireless network; Decoding the encoded image at the real-time transcoding server, generating an action script for the interactive element, and performing encoding to convert the decoded image into flash video which is a streaming video; Transmitting the flash video and the action script from the real-time transcoding server to a client computer connected to the Internet via a flash streaming server; And playing the flash video according to the action script at the client computer.

Flash movies are based on vector graphics and are Adobe's data formats that support user interaction. Compared to bitmap-based animation, it is widely used by general users with animations, internet cards, advertisements, and games on the Internet due to its advantages of providing much cleaner and more user interaction.

FLV stands for FLash Viedo file and is a video file that can be used in Flash. Flash video (FLV) is a file format that is smaller than other video files but has very good quality. In addition, Flash-based video services do not require a separate player installation. FLV files are more secure than WMV, AVI, ASF and other formats, and can realize high quality with a small capacity.

Hereinafter, with reference to the drawings will be described a preferred embodiment of the present invention. However, embodiments of the present invention illustrated below may be modified in many different forms, and the scope of the present invention is not limited to the embodiments described below.

1 is a block diagram of a video relay system using a mobile communication terminal according to an embodiment of the present invention.

The mobile communication terminal 110 encodes an image photographed by a built-in camera or a pre-stored image by a built-in codec, and receives an interactive element added to the encoded image. For example, the interactive element may include at least one of a special effect, a character, or a button object added to the encoded image.

The mobile communication terminal 110 includes a small camera for a communication terminal, a memory in which a video recorded by the camera is stored, and a video receiving program, a WAP Ｂrouser, and a flash video player. Say. For example, in the case of a mobile communication terminal, as a wireless communication device that guarantees portability and mobility, a personal communication system (PCS), a global system for mobile communications (GSM), a personal digital cellular (PDC), It includes all kinds of handheld based wireless communication devices such as a personal handyphone system (PHS), a personal digital assistant (PDA), an international mobile telecommunication (IMT) -2000 terminal, and a smart phone. In particular, most mobile communication terminals currently sold are basically equipped with a flash video player that runs a small camera and a mobile game of more than 1 million pixels due to integration between electronic products.

The mobile terminal 110 transmits the encoded image and the interactive element to the real-time transcoding server 130 through a wireless network.

The mobile terminal controller 120 is connected to the mobile communication terminal through a wireless network, and transmits the encoded image and the interactive element to the real-time transcoding server 130. For example, the mobile terminal controller 120 may use any one of WCDMA, EV-DO, HSDPA, EV-DV, or WiBro, and may be connected to the mobile communication terminal through a base station.

Preferably, the video relay system using a mobile communication terminal according to an embodiment of the present invention may include a cache manager and a load balancer 125, the cache manager and the load balancer 125 is a mobile terminal controller 120 Manage your traffic. In addition, the cache manager and load balancer 125 may be used as a means of reading an image from the database unit 170 or recording an image in the database unit 170.

The real-time transcoding server 130 decodes the encoded video (photographed video) encoded by the mobile communication terminal 110. This decoding is performed in the decoder 131 provided separately, which is necessary for preparing to convert the image encoded by various built-in codecs used in the mobile communication terminal 110 into flash video.

The real-time transcoding server 130 generates an action script for the interactive element and performs encoding for converting the decoded image into a flash video which is a streaming video. In this case, the process of converting the flash video is performed by the live encoding unit 132.

The real-time transcoding server 130 is a server that converts and stores a flash video, which is a streaming video in a vector format. When the user's video is received, the real-time transcoding server 130 compresses and processes the received video and the audio. You can use FLASH ACTION SCRIPT and languages such as PHP, ASP, COLD FUSION. Compression can be compressed with the extension FLV, which can be played on a Flash video player.

As a method for converting a compressed video or video to a flash video based on a bitmap, a commercially available conversion program such as Flash, Riva FLV Encoder, Sorenson Media, or On2 Flix may be used.

FLASH ACTION SCRIPT is a scripting language used within Flash. The commands that control the various visual and auditory elements in Flash are called actions, and the code that combines the actions make up the ActionScript. It is used to create multimedia contents including animation production and interaction. It interprets and plays ActionScript with Flash player. The model was produced by the European Computer Manufacturers' Association (ECMA-262). The syntax, conventions and features are introduced in Flash 5, and there is also an editing function.

The generation of the action script may be implemented by applying a script routine prepared in advance according to the nature of the interactive element (eg, addition of a special effect, addition of a character, or addition of a button object).

ActionScript can execute movie clips using object methods, including object-oriented programming languages. In ActionScript, a method is a function attached to an object. In other words, if you create a function on an object, that function is called a method. In ActionScript, attributes are the characteristics of an object. For example, _visible is a property that hides or shows a movie clip. In ActionScript, an event is an action that occurs when a movie is played. ActionScript is an event-based language. Therefore, when you put an action on a button, this code waits for execution until an event occurs on the button. Clip events combined with movie clips also allow you to use not only traditional mouse events, but also more specialized events, such as movie clips being loaded and data transferred from the outside. This allows you to wait for the sound to load completely before running the music. In ActionScript, functions are reusable blocks of code that can pass variables and return values. The advantage of functions is that they do a lot of work at once. You can create and initialize several objects that look different but are identical internally. Functions allow us to create our own methods that match our objects. In ActionScript, a variable is a space that contains some variable value. Variables can contain strings, integers, or booleans.

By using the action script, an operation such as adding a special effect (for example, screen rotation, screen movement, sound size adjustment, background sound insertion, screen border addition, etc.) or inserting characters to the video can be performed. In other words, it becomes possible for a user to insert interactive elements in a video in real time.

Real-time transcoding server 130 transmits flash video and action scripts to flash streaming server 140.

The flash streaming server 140 is connected to the client computer 160 through the Internet, and transmits the flash video and the action script to the client computer 160 in a streaming manner.

For connection of the flash streaming server 140 and the client computer 160, the Internet-end control unit 145, the web server and the load balancer 150 may be used as shown in FIG.

The Internet-side control unit 145 has a communication interface to deliver flash video and action scripts to the web server and the load balancer 150. The web server and load balancer 150 provide an interface to the client computer 160 and manage traffic for flash video requests from the client computer 160.

The client computer 160 is a computer connected to the Internet and installed with a flash player. Client computer 160 plays the flash video according to the action script. Client computer 160 includes a notebook, UMPC, PDA, desktop PC, and the like.

When the real time video recorded by the camera of the mobile communication terminal 110 is played on the client computer 160, a flash video player is required on the client computer 160. A computer equipped with a Windows operating system is generally installed with a flash video player. It is.

Wireless network applied to the present invention includes a base station (not shown) connected to the mobile communication terminal 110 and a means for converting data transmitted and received between the base station and the wired network to suit the wireless environment, for example, including a swap gateway Is done. At the present time, WCDMA (Wide Code Division Multiple Access) or EV-DO (Evolution Data Only), which is a third generation communication method having a communication speed of up to 2Mbps, is used. In the future, high-speed downlink packet access (HSDPA), evolution data and video (EV-DV), or wireless broadband Internet (WiBro), which are 3.5-generation communication methods, will be available.

In the present invention, the client computer 160 and the Internet-side control unit 145 may be connected by a wired or wireless network, the wired network is achieved by the Internet (intranet) or intranet (net) generally used, the wireless network is 802.11a / b / g or WiBro.

Preferably, if the client computer 160 is a button object added to the encoded image of the interactive element, when the button object is clicked during the playback of the flash video, the client computer 160 transmits the click-related information of the button object through the wireless network. 110 may be configured to transmit. Here, the click related information of the button object includes information about when the button object was clicked, at what position on the screen, how many times it was clicked, and the like.

In this case, the mobile communication terminal 110 may be configured to display click related information on the terminal screen or to perform an action according to the click related information. For example, the action according to the click related information is to provide another image back to the client computer 160 according to the time when the button object is clicked. By doing in this way, it becomes possible not only to relay a video in real time but also to perform more interactive operation.

2 is a block diagram of a video relay system using a mobile communication terminal according to another embodiment of the present invention.

The client computer 260 transmits an image captured by the camera 265 or an image previously stored in the client computer 260 to the flash streaming server 240 through the Internet. The client computer 260 also sends interactive elements added by the user in this process to the flash streaming server 240 via the Internet. The client computer 260 may be connected to the camera 265 for real-time image shooting through USB, IEEE1394, or the like to capture the image in real time. The image transmitted from the client computer 260 to the flash streaming server 240 includes not only an image photographed by the camera 265, but also an advertisement image and other content previously stored in the client computer 260.

If the live encoding client 269 is not embedded in the client computer 260, the ActionScript and flash video generation is performed by the live encoding unit 232 of the real-time transcoding server 230.

On the other hand, when the live encoding client 269 is embedded in the client computer 260, the ActionScript and flash video generation is performed in the live encoding client 269. In this case, the client computer 260 generates an action script for the interactive element added by the user, and the live encoding client 269 converts the video captured by the camera 265 or the pre-stored video into a flash video which is a streaming video. Perform the encoding to convert.

The web server and load balancer 250 provide an interface to the client computer 260 and manage traffic for the flash of the client computer 260.

The flash streaming server 240 is connected to the client computer 260 by the Internet, and transmits the captured image and the interactive element to the real-time transcoding server 240.

If the live encoding client 269 is not built into the client computer 260, the real-time transcoding server 240 decodes the image received from the client computer 260, generates an action script for the interactive element, and decodes it. It performs encoding to convert the converted video into flash video, which is a streaming video. Here, decoding is performed in a decoder 231 separately provided, which is necessary to prepare for converting an image encoded by various codecs used in various client computers 260 into flash video.

Meanwhile, the real-time transcoding server 240 may be configured to process the flash video into a size or format that can be reproduced in the mobile communication terminal 210. To this end, the real-time transcoding server 240 may perform a re-encoding process.

The real-time transcoding server 240 transmits the flash video and the action script to the mobile communication terminal through the wireless network.

The mobile terminal controller 220 receives the flash video and the action script from the real-time transcoding server 240 and transmits it to the mobile communication terminal 210 through the wireless network.

Preferably, the video relay system using a mobile communication terminal according to another embodiment of the present invention may include a cache manager and a load balancer 225, the cache manager and the load balancer 225 is a mobile terminal controller 220 Manage your traffic. In addition, the cache manager and the load balancer 225 may be used as a means for performing a network load minimization command, reading an image from the database unit 270, or recording an image in the database unit 170.

The mobile communication terminal 210 has a built-in flash player that can read the action script, and plays the flash video according to the action script.

3 is a flowchart illustrating a video relay method using a mobile communication terminal according to another embodiment of the present invention.

First, an image captured by a built-in camera or a pre-stored image is encoded by a built-in codec in a mobile communication terminal, and an interactive element added to the encoded image is received (step 310). For example, the interactive element may include at least one of a special effect, a character, or a button object added to the encoded image.

Next, the mobile terminal transmits the encoded video and interactive elements to the real-time transcoding server through the wireless network (step 320). This process (step 320) may be performed through a base station connected with a mobile communication terminal, for example, using any one of WCDMA, EV-DO, HSDPA, EV-DV, or WiBro.

The real-time transcoding server decodes the encoded image, generates an action script for the interactive element, and performs encoding for converting the decoded image into flash video, which is a streaming video (step 330). The flash video and the action script may be stored in a database according to a user request of the mobile communication terminal.

Next, the real-time transcoding server transmits the flash video and the action script to the client computer connected to the Internet through the flash streaming server (S340).

Finally, the client computer plays the flash video according to the action script (step 350).

Preferably, in the video relaying method using a mobile communication terminal according to another embodiment of the present invention, when the interactive element is a button object added to an encoded image, when the button object is clicked while playing the flash video on the client computer, And transmitting the click related information of the button object to the mobile communication terminal through the wireless network. In this case, the mobile communication terminal may further activate the bidirectional communication by displaying the click related information on the terminal screen.

As shown in FIG. 3, when broadcasting from a mobile to the Internet, a voice of a mobile communication terminal user can be transmitted to a client computer on a video screen, and a character or the like is displayed on a video screen transmitted to the client computer. You can give a video special effect to.

4 is a flowchart illustrating a video relay method using a mobile communication terminal according to another embodiment of the present invention.

First, the client computer captures an image with a camera and receives an interactive element added to the captured image (step 410).

Next, when the live encoding client is not built in the client computer (step 420), the following process is performed. That is, the image captured by the client computer and the interactive element added by the user are transmitted to the real-time transcoding server through the flash streaming server through the Internet.

Thereafter, the image is captured by the real-time transcoding server, an action script for the interactive element is generated, and encoding is performed to convert the decoded image into a flash video, which is a streaming video (step 440).

On the other hand, if the live encoding client is not built in the client computer (step 420), the following process is performed. That is, the client computer generates an action script for an interactive element added by the user, and uses the live encoding client to encode an encoding for converting a video or pre-stored video recorded with a camera connected to the client computer into a streaming video, which is a streaming video. (Step 431). Thereafter, the client computer transmits the flash video and the action script to the real-time transcoding server through the flash streaming server through the Internet (step 432).

Preferably, if the flash video and the action script exists in the real-time transcoding server, the process of processing the flash video to a size that can be reproduced in the mobile communication terminal in the real-time transcoding server (step 450).

Next, the real-time transcoding server transmits the flash video and the action script to the mobile communication terminal through the wireless network (step 460).

Finally, the mobile terminal plays the flash video according to the action script (step 470).

As shown in FIG. 4, when broadcasting over the Internet, a client computer user's voice may be transmitted to a mobile communication terminal on a video screen, a text may be added to the video screen, or a video special effect may be applied to the video screen. Real-time advertisement can be sent to the communication terminal.

The invention can be implemented via software. When executed in software, the constituent means of the present invention become code segments for performing the necessary work. The program or code segments may be stored on a processor readable medium or transmitted by a computer data signal coupled with a carrier on a transmission medium or network.

Although the present invention has been described with reference to one embodiment shown in the drawings, this is merely exemplary and will be understood by those of ordinary skill in the art that various modifications and variations can be made therefrom. However, such modifications should be considered to be within the technical protection scope of the present invention. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

As described above, according to the present invention, by using a flash player already installed in a mobile communication terminal or a client computer, in order to provide a video service, a user has to install a separate device or program in a terminal owned by the user. When adding new interactive elements to a video, there is no need to update plug-ins, active axes, upgraded video players, etc. In addition, it is possible to add special effects, advertisements, and text to a video in real time, thereby maintaining the real-time of UCC.

Claims (12)

Encodes an image captured by a built-in camera or a pre-stored video with a built-in codec, receives an interactive element added to the encoded image, and transmits the encoded image and the interactive element to a real-time transcoding server through a wireless network. A mobile communication terminal; Decode the encoded image, generate an action script for the interactive element, perform encoding to convert the decoded image into flash video that is a streaming video, and transmit the flash video and the action script to a flash streaming server A real time transcoding server; A flash streaming server connected to a client computer over the Internet and transmitting the flash video and the action script to the client computer in a streaming manner; And And a client computer for playing the flash video according to the action script. The method of claim 1, The interactive element And a special effect, a character, or a button object added to the encoded image. The method of claim 1, A video relay system connected to the mobile communication terminal through a base station through a wireless network, and further comprising a mobile terminal control unit using any one of WCDMA, EV-DO, HSDPA, EV-DV, and WiBro communication methods. . The method of claim 1, The client computer When the interactive element is a button object added to the encoded image, when the button object is clicked during playback of the flash video, the click related information of the button object is transmitted to the mobile communication terminal through a wireless network. The mobile communication terminal The video relay system using a mobile communication terminal, characterized in that for displaying the click-related information on the terminal screen. A client computer for transmitting an image captured by a camera or a pre-stored image, and an interactive element added by a user to a flash streaming server through the Internet; A flash streaming server connected to the client computer via the Internet and transmitting an image and the interactive element received from the client computer to a real-time transcoding server; Decoding the image received from the flash streaming server, generating an action script for the interactive element, performing encoding to convert the decoded image into a flash video that is a streaming video, and wirelessly converting the flash video and the action script A real time transcoding server transmitting to the mobile communication terminal through a network; And And a mobile communication terminal having a flash player capable of reading an action script and reproducing the flash video according to the action script. Generate an action script for an interactive element added by a user, perform encoding using a live encoding client to convert an image captured by a camera connected to a client computer or a pre-stored image into a flash video, which is a streaming video, and the flash A client computer for transmitting the video and the action script to a flash streaming server via the Internet; A flash streaming server connected to the client computer via the Internet and transmitting the flash video and the action script to a real-time transcoding server; A real-time transcoding server for processing the flash video into a size reproducible in the mobile communication terminal, and transmitting the flash video and the action script to the mobile communication terminal through a wireless network; And And a mobile communication terminal having a flash player capable of reading an action script and reproducing the flash video according to the action script. Encoding, by a built-in codec, an image captured by a built-in camera or a pre-stored image by a mobile communication terminal, and receiving an interactive element added to the encoded image; Transmitting, by the mobile communication terminal, the encoded image and the interactive element to a real-time transcoding server through a wireless network; Decoding the encoded image at the real-time transcoding server, generating an action script for the interactive element, and performing encoding to convert the decoded image into flash video which is a streaming video; Transmitting the flash video and the action script from the real-time transcoding server to a client computer connected to the Internet via a flash streaming server; And Playing the flash video according to the action script at the client computer. The method of claim 7, wherein The interactive element And at least one of a special effect, a text, or a button object added to the encoded video. The method of claim 7, wherein The step of transmitting to the real-time transcoding server A video relay method using a mobile communication terminal using a communication method of any one of WCDMA, EV-DO, HSDPA, EV-DV or WiBro, and is performed through a base station connected to the mobile communication terminal. The method of claim 7, wherein When the interactive element is a button object added to the encoded image, when the button object is clicked during the playback of the flash video on the client computer, click related information of the button object is transmitted to the mobile communication terminal through a wireless network. Transmitting; And And displaying the click-related information on the terminal screen in the mobile communication terminal. In the method for relaying the image of the client computer to a mobile communication terminal with a built-in flash player, Transmitting images captured by a camera connected to the client computer or pre-stored images, and interactive elements added by a user from the client computer to a real-time transcoding server via a flash streaming server through the Internet; Decoding an image received from the client computer at the real-time transcoding server, generating an action script for the interactive element, and performing encoding to convert the decoded image into flash video, which is a streaming video; Transmitting, by the real-time transcoding server, the flash video and the action script to the mobile communication terminal through a wireless network; And And playing the flash video according to the action script in the mobile communication terminal. In the method for relaying the image of the client computer to a mobile communication terminal with a built-in flash player, The client computer uses the live encoding client to perform encoding for converting an image captured by a camera connected to the client computer or a pre-stored image into a flash video, which is a streaming video, and executing an action script for an interactive element added by the user. Generating; Transmitting, at the client computer, the flash video and the action script to a real-time transcoding server via a flash streaming server via the Internet; Processing the flash video to a size reproducible by the mobile communication terminal in the real-time transcoding server, and transmitting the flash video and the action script to the mobile communication terminal through a wireless network; And And playing the flash video according to the action script in the mobile communication terminal.

Images