KR20110137529A - System and method for providing moving picture - Google Patents

Abstract

PURPOSE: A system and a method for providing a video are provided to compensate a service quality even if handoff from a first communication network to a second communication network is completed during a video real time reproduction. CONSTITUTION: A second streaming server(300(b)) on a real time basis transmits characteristic information per video and frame which is requested from the frame of eth confirmed location. A mobile terminal(400) receives feature information of a video per frame and the video from the first streaming server. If with only a second communication is handed off during reproducing the received video, the mobile terminal transmits the feature information of the video frame which is stopped reproducing to a second streaming server.

Description

Video delivery system and method thereof {SYSTEM AND METHOD FOR PROVIDING MOVING PICTURE}

The present invention relates to a video providing system and a method thereof. In particular, when a mobile terminal, which is playing a video streamed from a streaming server through a first communication network, performs a handoff to a second communication network, a file is generated using the feature information of the video frame. The present invention relates to a video providing system and a method for guaranteeing a service quality by being able to take over without interruption.

Currently, 3G network uses UDP (User Diagram Protocol) based transmission method when streaming server streams video files, and Wi-Fi network uses TCP (Transmission Control Protocol) based transmission method.

Therefore, if a mobile terminal performs handoff to a Wi-Fi network while playing a video file streamed between heterogeneous networks, for example, a 3G network, a communication protocol may be different, and thus, the quality of service cannot be guaranteed due to a failure in receiving and playing a video.

This occurs in the case of handoff to 3G network during video streaming playback on Wi-Fi network.

The present invention proposes a video providing system and method for guaranteeing a quality of service even when handoff is performed from a first communication network to a second communication network during real time video playback.

In addition, the present invention proposes a video providing system and a method for allowing a video to be played immediately from the point where the playback is stopped even if the video is interrupted when handoff is performed from the first communication network to the second communication network during the real-time video playback.

According to an embodiment of the present invention, a video providing system according to an embodiment of the present invention extracts feature information for each frame of a video, and provides a video object recognition server that provides the extracted feature information for each frame together with the video, the video provided from the video object recognition server, and A first streaming server for real-time transmission of the frame-specific feature information of the video through the first communication network; and if there is a video transmission request including the feature information of the predetermined video frame, the position of the video frame corresponding to the feature information is checked and confirmed. A second streaming server for transmitting the requested video and the feature information for each frame in real time from the frame of the received position; and receiving the video and the feature information for each frame of the video from the first streaming server; When handing off to the network, The mobile terminal transmits the feature information to the second streaming server, and receives and reproduces the video and the frame-specific feature information of the video from the frame at which the playback is stopped from the second streaming server.

In addition, the video object recognition server according to an embodiment of the present invention includes a receiver for receiving a video from a multimedia video server, a feature information extractor for extracting feature information for each frame of the video, and for transmitting the video and frame feature information. And a control unit for controlling to provide the extracted frame-specific feature information to the streaming server together with the video.

In addition, the video providing method of the video object recognition server according to an embodiment of the present invention, the process of receiving a video from the multimedia video server, the process of extracting the feature information for each frame of the video, and the extracted feature information for each frame It includes the process of transmitting to the streaming server along with the video.

In addition, the streaming server according to an embodiment of the present invention includes a receiver for receiving at least one video and feature information for each frame of the video, a feature information checker for confirming the position of the video frame corresponding to the feature information of a predetermined frame; If there is a video transmission request including the feature information of the video frame from the mobile terminal, the position of the video frame corresponding to the feature information is confirmed through the feature information checking unit, and the requested video and frame-specific feature information from the frame of the checked position The server control unit for controlling to transmit to the mobile terminal, and a transmission unit for transmitting the video and the frame-specific feature information of the video under the control of the server control unit.

In addition, the video providing method of the streaming server according to an embodiment of the present invention, if there is a video transmission request from the mobile terminal to check whether there is feature information of a predetermined video frame in the request, and the request includes the feature information of the video frame And if there is a video, identifying a video frame position corresponding to the feature information in the requested video, and transmitting the requested video and feature information for each frame to the mobile terminal from the frame of the checked position.

In addition, the mobile terminal according to an embodiment of the present invention requests a video transmission, the transceiver for receiving the requested video and the feature information for each frame of the video, a memory for storing the received feature information for each frame, and the first If the reception and playback of the video are interrupted during the handoff to the second communication network during the playback of the video received through the communication network, the feature information of the stopped video frame is read from the memory, and the feature information of the video frame through the second communication network. It includes a control unit for controlling to receive the video and the frame-specific feature information from the frame of the playback stop position by requesting a video transmission including a.

In addition, the video providing method of a mobile terminal according to an embodiment of the present invention is a process of receiving the video and the frame-specific feature information of the video through a first communication network and storing the received frame-specific information, and the playback of the received video During the handoff to the second communication network, if the video reception and playback are interrupted, reading feature information of the stopped video frame from the memory; and transmitting a video including the read feature information through the second communication network. Requesting and receiving video and frame-specific feature information from the frame at the position at which the reproduction is stopped through the second communication network.

According to the present invention, the quality of service can be guaranteed even when the first communication network is handed off from the first communication network to the second communication network during the real-time playback of the video. It has an effect.

On the other hand, various other effects will be disclosed directly or implicitly in the detailed description of the embodiments of the present invention to be described later.

1 is a block diagram of a video providing system according to an embodiment of the present invention.
2 is a flowchart illustrating a video providing process of a video providing system according to an exemplary embodiment of the present invention.
3 is a block diagram of a video object recognition server according to an embodiment of the present invention.
4 is a flowchart illustrating an operation process of a video object recognition server according to an embodiment of the present invention.
5 is an exemplary view for explaining a process of extracting feature information of a video frame in a video object recognition server according to an embodiment of the present invention.
6 is a block diagram of a streaming server according to an embodiment of the present invention.
7 is a block diagram illustrating a mobile terminal according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Specific details described below are provided to aid the overall understanding of the present invention. In describing the present invention, detailed descriptions of related known functions or configurations will be omitted when it is determined that the gist of the present invention may be unnecessarily obscured.

1 is a block diagram of a video providing system according to an exemplary embodiment of the present invention.

The illustrated video providing system includes a multimedia video server 100, a video object recognition server 200, a first streaming server 300a, a second streaming server 300b, and a mobile terminal 400.

The multimedia video server 100 provides videos to the video object recognition server 200.

The video object recognition server 200 extracts feature information for each frame of a video provided from the multimedia video server 100, and extracts the extracted feature information for each frame together with the corresponding video from the first streaming server 300a and the second streaming. Provided to server 300b. At this time, the video object recognition server 200 extracts the feature information for each frame using the object analysis for each frame. Here, the feature information means a frame, that is, pattern information of a still image. Such feature information may be extracted in the form of a binary code value through each convex, corner, and edge of an image.

When the mobile terminal 400 requests a video transmission from the first streaming server 300a, the first streaming server 300a transmits the requested video among the videos provided from the video object recognition server 200 and feature information for each frame of the video to the first communication network (eg, 3G). Network) to the mobile terminal 400 in real time. When the first communication network is a 3G network, the first streaming server 300a provides a streaming service based on UDP (User Datagram Protocol).

When the second streaming server 300b receives a video transmission request including feature information of a predetermined video frame from the mobile terminal 400 through a second communication network (eg, a Wi-Fi network), the second streaming server 300b corresponds to the video frame corresponding to the feature information. Check the position of the and transmits the requested video and the feature information for each frame from the frame of the confirmed position to the mobile terminal 400 in real time through the second communication network. When the second communication network is a Wi-Fi network, the second streaming server 300b provides a streaming service based on Transmission Control Protocol (TCP), and is typically streamed through an access point (AP).

Here, transmitting the requested video from the frame of the checked position means transmitting the video having the frame of the checked position as a start frame.

In addition, the first streaming server 300a and the second streaming server 300b store the frame-specific feature information of the predetermined video provided from the video object recognition server 200 and transmit the requested video from the mobile terminal 400. Provides feature information of the frame to the mobile terminal 400 together.

The first communication network and the second communication network mean different communication networks. In FIG. 1, a 3G network and a Wi-Fi network are described as an example, but the present disclosure is not limited thereto.

The mobile terminal 400 receives a video and frame feature information of the video from the first streaming server 300a through a first communication network, and stores the received frame feature information separately. The mobile terminal 400 stores and executes the feature information in a progressive download form and deletes it after a predetermined time.

When the mobile terminal 400 stops receiving and playing a video due to a handoff to a second communication network during the playing of the received video, the mobile terminal 400 sends the video streaming request information including the characteristic information of the stopped video frame to the second streaming server ( 300b).

The mobile terminal 400 receives a moving picture having the start frame as a start frame and feature information for each frame of the moving picture from the second streaming server 300b, and subsequently reproduces the stopped moving picture.

Meanwhile, in the embodiment of the present invention, the streaming server is described as two, but may be implemented as one server, or the video object recognition server 200 may be implemented as a streaming server or the multimedia video server 100 and one server. have.

2 is a flowchart illustrating a video providing process of a video providing system according to an exemplary embodiment of the present invention.

1 and 2, the mobile terminal 400 accesses a first communication network (eg, 3G network) (S110).

The mobile terminal 400 requests the video transmission to the first streaming server 300a through the first communication network (S115).

The first streaming server 300a transmits the requested video and the feature information for each frame of the video to the mobile terminal 400 together (S120). At this time, the first streaming server 300a receives and stores at least one video and feature information for each frame of the video in advance through the video object recognition server 200 or whenever there is a request from the mobile terminal 400. The video object recognition server 200 may be provided with corresponding video and feature information for each frame.

The mobile terminal 400 sequentially plays the video received from the first streaming server 300a for each frame, and separately stores frame-specific feature information (S125).

The mobile terminal 400 performs handoff to a second communication network (for example, a Wi-Fi network) while playing a video (S130). E.g. When the mobile terminal 400 enters the Wi-Fi network, handoff is performed by receiving a beacon signal periodically transmitted from the access point.

When the mobile terminal 400 is handed off from the first communication network to the second communication network, the mobile terminal 400 stops receiving and playing the video (S135). This is because the video streaming service protocols of 3G and Wi-Fi networks are different.

The mobile terminal 400 transmits the characteristic information of the video frame, which has been stopped, to the second streaming server 300b (S140). That is, the mobile terminal 400 checks the feature information of the stopped video frame through the feature information for each frame stored in the step S125, and the video transmission request information including the checked feature information through the second communication network. It is transmitted to the streaming server 300b. For example, the mobile terminal 400 may transmit video transmission request information including feature information to the second streaming server 300b through RTS (Request To Send), which is a data transmission request signal in the Wi-Fi network.

If there is a video transmission request including feature information of a predetermined video frame from the mobile terminal 400, the second streaming server 300b checks the position of the video frame corresponding to the feature information in the requested video (S145).

The second streaming server 300b transmits the moving picture and the feature information for each frame to the mobile terminal 400 in real time through the second communication network (S150).

The mobile terminal 400 continuously plays back the video whose playback has been stopped from the corresponding frame (S155).

3 is a block diagram of a video object recognition server according to an embodiment of the present invention.

The illustrated video object recognition server includes a receiver 210, a transmitter 220, an object recognition server controller 230, and a feature information extractor 240.

1 and 3, the receiver 210 receives a video from the multimedia video server 100.

The transmitter 220 transmits the video and the feature information for each frame constituting the video to at least one of the first streaming server 300a and the second streaming server 300b.

The object recognition server control unit 230 controls the overall operation of the video object recognition server according to an embodiment of the present invention. Also, the object recognition server controller 230 transfers the feature information for each video frame extracted from the feature information extractor 240 to at least one server of the first streaming server 300a and the second streaming server 300b together with the corresponding video. Control to provide.

The feature information extractor 240 extracts feature information for each frame of the video received by the receiver 210.

The feature information extractor 240 acquires a still image from a video frame as shown in (a) of FIG. 5, and preprocessing as shown in (b) to easily extract essential information from the obtained still image. After that, feature information is extracted as shown in (c). At this time, the feature information extractor 240 preferably extracts feature information for each frame using a Gaussian algorithm, but may use other object recognition algorithms. Since the Gaussian algorithm is a known technique as an algorithm for quickly analyzing an image pattern, a detailed description thereof will be omitted.

Although not shown in FIG. 3, a separate database for storing at least one video and feature information for each frame extracted from the video in order to provide the video and feature information for each frame of the video whenever a streaming server requests it. It may further include.

4 is a flowchart illustrating an operation process of a video object recognition server according to an embodiment of the present invention.

3 and 4, the receiver 210 receives a video and transmits the video to the object recognition server controller 230 (S210).

The object recognition server controller 230 controls the feature information extractor 240 to extract feature information for each frame of the received video (S220). In this case, the feature information extractor 240 may extract feature information for each video frame by using an object recognition algorithm Gaussian (eg, a Gaussian algorithm).

The object recognition server controller 230 transmits the extracted frame-specific feature information together with the video through the transmitter 220 (S230).

6 is a block diagram of a streaming server according to an embodiment of the present invention.

The illustrated streaming server includes a transmitter 310, a receiver 320, a server controller 330, a storage 340, and a feature information checker 350.

1 and 6, the transmitter 310 transmits a corresponding video and feature information for each frame of the video to the mobile terminal 400 according to a video transmission request from the mobile terminal 400.

The receiver 320 receives at least one video and feature information for each frame of the video from the video object recognition server 200.

In addition, if there is a video transmission request from the mobile terminal 400, the receiver 320 transmits the request information to the server controller 330. The request information may include feature information of a specific video frame.

The server controller 330 controls the overall operation of the streaming server according to the embodiment of the present invention. In addition, when a video transmission request is received from the mobile terminal 400, the server controller 330 checks whether the request information includes characteristic information of a predetermined video frame.

If the request information includes the feature information of the predetermined video frame, the server controller 330 controls the feature information checking unit 350 to identify the position of the video frame corresponding to the feature information among the frames of the requested video. . The server controller 330 controls to transmit the requested video and the frame-specific feature information of the video to the mobile terminal 400 from the frame of the checked position.

If the video transmission request does not include feature information of a predetermined frame, the server controller 330 controls to transmit the requested video and feature information for each frame of the video to the mobile terminal 400.

The storage unit 340 stores at least one video received by the receiver 320 and feature information for each frame of the video.

The feature information checking unit 350 checks the position of the video frame corresponding to the feature information of the predetermined frame among the frames of the video and transmits it to the server controller 330.

7 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The illustrated mobile terminal includes a key input unit 410, a display unit 420, a controller 430, a transceiver 440, an audio processor 450, and a memory 460.

1 and 7, the key input unit 410 includes a character key, a numeric key, various function keys, and the like, and outputs a key input signal corresponding to a key input by a user to the controller 430.

The display unit 420 may be formed of a liquid crystal display (LCD) or the like, and displays various display data generated in the mobile terminal. In this case, when the LCD is implemented using a touch screen method, the display unit 420 may operate as an input unit.

The controller 430 controls the overall operation of the mobile terminal according to an embodiment of the present invention. In addition, the controller 430 stores the characteristic information of the stopped video frame when the video reception / playback is stopped when the video is received by the first streaming server 300a through the first communication network and is handed off to the second communication network. ).

The controller 430 generates video transmission request information including the read feature information, controls the transceiver 440 and transmits the information to the second streaming server 300b through the second communication network.

When the controller 430 receives the video having the start frame as the start frame and the feature information for each frame of the video from the second streaming server 300b, the controller 430 continuously outputs the stopped video from the stopped frame. The star feature information is stored in the memory 460.

Meanwhile, the controller 430 may delete the feature information stored in the memory 460 when the video frame corresponding to the feature information is completed. It can be deleted after 2 seconds).

The transceiver 440 transmits information for requesting video transmission under the control of the controller 430, and receives the requested video and feature information for each frame of the video.

The audio processor 450 outputs an audio signal received by the transceiver 440 or an audio signal generated inside the mobile terminal.

The memory 460 stores various kinds of information necessary for controlling the operation of the mobile terminal according to an embodiment of the present invention. In addition, the memory 460 stores the frame-specific feature information received with the video in the transceiver 440 according to an embodiment of the present invention.

Although embodiments of the present invention have been described above with reference to the accompanying drawings, those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features thereof. I can understand that.

Therefore, since the embodiments described above are provided to completely inform the scope of the invention to those skilled in the art, it should be understood that they are exemplary in all respects and not limited. The invention is only defined by the claims.

According to the present invention, even when a mobile terminal playing a video streamed through a first communication network is handed off to a second communication network different from the first communication network, the video being played can be continuously played without being interrupted. Can be widely used to improve the quality of streaming video services through mobile terminals.

100: multimedia video server 200: video object recognition server
300 (a): first streaming server 300 (b): second streaming server
400: mobile terminal 210, 320: receiver
220, 310: transmitter 230: object recognition server controller
240: feature information extraction unit 330: server control unit
340: storage unit 350: feature information confirmation unit
410: key input unit 420: display unit
430: control unit 440: transceiver
450: audio processor

Claims (15)

A video object recognition server for extracting feature information for each frame of a video and providing the extracted feature information for each frame together with the video;
A first streaming server for real-time transmission of video provided from the video object recognition server and feature information for each frame of the video through a first communication network;
A second streaming server that checks the position of the video frame corresponding to the feature information when the video transmission request including the feature information of the predetermined video frame is transmitted, and transmits the requested video and the feature information for each frame in real time from the frame of the checked position; Wow,
Receive video and frame feature information of the video from the first streaming server, and when the handoff to the second communication network during the playback of the received video, and transmits the feature information of the video frame stopped playback to the second streaming server, And a mobile terminal configured to receive and play the video and the frame-specific feature information of the video from the frame at the position where the playback is stopped from the second streaming server.
The method of claim 1, wherein the video object recognition server
The video providing system, characterized in that to extract the feature information for each frame of the video using a Gaussian (Gaussian) algorithm.
Receiving unit for receiving a video from the multimedia video server,
A feature information extraction unit for extracting feature information for each frame of the video;
A transmitting unit which transmits the moving picture and the feature information for each frame;
The video object recognition server including a control unit for controlling to provide the extracted feature information for each frame to the streaming server along with the video.
The method of claim 3, wherein the feature information extraction unit
Video object recognition server, characterized in that for extracting the feature information for each frame of the video using a Gaussian (Gaussian) algorithm.
Receiving a video from the multimedia video server,
Extracting feature information for each frame of the video;
The video providing method of the video object recognition server comprising the step of transmitting the extracted feature information for each frame to the streaming server.
The method of claim 5, wherein the extraction process
The video providing method of the video object recognition server, characterized in that for extracting the feature information for each frame of the video using a Gaussian (Gaussian) algorithm.
A receiver configured to receive at least one video and feature information for each frame of the video;
A feature information checking unit for checking a position of a video frame corresponding to feature information of a predetermined frame;
If there is a video transmission request including the feature information of the video frame from the mobile terminal, the position of the video frame corresponding to the feature information is confirmed through the feature information checking unit, and the requested video and frame-specific feature information from the frame of the checked position A server controller which controls to transmit the data to the mobile terminal;
And a transmitter for transmitting the video and the frame-specific feature information of the video under the control of the server controller.
The method of claim 7, wherein the server control unit
If the video transmission request does not include the feature information of a predetermined frame, the streaming server, characterized in that for controlling to transmit the requested video and the feature information for each frame of the video to the mobile terminal.
The method according to claim 7 or 8,
The streaming server further comprises a storage unit for storing the at least one video and feature information for each frame of the video.
If there is a video transmission request from the mobile terminal, checking whether the request includes characteristic information of a predetermined video frame;
Identifying a video frame position corresponding to the feature information in the requested video when the request includes the feature information of the video frame;
And transmitting the requested video and the frame-specific feature information to the mobile terminal from the frame of the identified location.
The method of claim 10,
If the request does not include the feature information of the video frame, the video providing method of the streaming server further comprising the step of transmitting the requested video and the frame-specific feature information of the video to the mobile terminal.
A transmission and reception unit for requesting a video transmission and receiving the requested video and feature information for each frame of the video;
A memory for storing the received frame-specific information;
If the reception and playback of the video are interrupted during the handoff to the second communication network during video playback received through the first communication network, the feature information of the stopped video frame is read from the memory, and the video frame is read through the second communication network. And a controller for requesting a video transmission including the feature information to receive the video and the frame-specific feature information from the frame at the position where playback is stopped.
The method of claim 12, wherein the control unit
And delete the feature information stored in the memory when a predetermined time elapses.
Receiving a video and frame feature information of the video through a first communication network and storing the received frame information;
Reading feature information of the paused video frame from the memory when the video reception and playback are interrupted when performing a handoff to a second communication network during the playback of the received video;
Requesting a video transmission including the read feature information through a second communication network;
And receiving video and frame-specific feature information from the frame at the position at which the reproduction is stopped through the second communication network.
The method of claim 14,
And deleting the stored feature information when a predetermined time elapses.

Images