KR101810556B1 - System and method for providing moving picture - Google Patents

Abstract

The present invention relates to a moving picture providing system and a method thereof. To this end, according to the present invention, when a mobile terminal that is playing a moving picture streamed from a streaming server through a first communication network performs a handoff to a second communication network, when a moving picture reception and playback is interrupted, The streaming server requests a video including feature information of the frame, and the streaming server accurately checks the position value of the video file in which the playback video is broken based on the feature information of the frame, And frame-by-frame feature information, so that the mobile terminal can perform a function of receiving a moving image file even when moving between heterogeneous networks, thereby ensuring quality of service of a moving image.

Description

SYSTEM AND METHOD FOR PROVIDING MOVING PICTURE [0002]

The present invention relates to a moving image providing system and method thereof, and more particularly, to a moving image providing system and method thereof, in which a moving picture streaming from a streaming server through a first communication network, The present invention relates to a video providing system and a video providing system capable of ensuring quality of service by allowing users to receive video without interruption.

In the current 3G network, a streaming server uses a UDP (User Diagram Protocol) based transmission method when streaming video files and a TCP (Transmission Control Protocol) based transmission method is used in a Wi-Fi network.

Therefore, if the mobile terminal performs a handoff to a Wi-Fi network during playback of a video file streamed in a heterogeneous network, for example, a 3G network, the communication network protocol is different.

This also occurs when handoff is performed to 3G network during video streaming playback in a Wi-Fi network.

The present invention proposes a video providing system and method for ensuring quality of service even when handing off from a first communication network to a second communication network during real time video playback.

Also, the present invention proposes a video providing system and method for enabling a video to be played immediately from a point of time when playback is stopped even if video playback is interrupted during a handoff from the first communication network to the second communication network during real time video playback.

The moving picture providing system according to an embodiment of the present invention includes a moving picture object recognition server for extracting characteristic information for each frame of a moving picture and providing the extracted characteristic information for each frame together with the moving picture, A first streaming server for transmitting frame-by-frame feature information of a moving image in real time through a first communication network; and a second streaming server for checking the position of a moving image frame corresponding to the feature information, A second streaming server for transmitting the requested video and frame-specific feature information from a frame at a predetermined position in real time; and a second streaming server for receiving the video and the frame-by-frame feature information from the first streaming server, When handed off to the network, And a mobile terminal for transmitting the feature information to the second streaming server and receiving and reproducing the feature information for each frame of the moving image and the moving image from the frame of the stopped position from the second streaming server.

According to another aspect of the present invention, there is provided a video object recognition server including a receiver for receiving moving pictures from a multimedia video server, a feature information extractor for extracting feature information for each frame of the video, And a control unit for controlling the streaming server to provide the extracted frame-by-frame feature information together with the moving image.

According to another aspect of the present invention, there is provided a moving picture providing method of a moving picture object recognition server, comprising the steps of: receiving a moving picture from a multimedia moving picture server; extracting characteristic information of each moving picture frame; To the streaming server together with the moving image.

A streaming server according to an embodiment of the present invention includes a receiver for receiving at least one moving picture and feature information for each frame of the moving picture, a feature information checking unit for checking a position of a moving picture frame corresponding to feature information of a predetermined frame, If there is a video transmission request including the feature information of the moving image frame from the mobile terminal, the position of the moving image frame corresponding to the feature information is confirmed through the feature information checking unit, And a transmitter for transmitting the moving image and the feature information for each frame of the moving image under the control of the server control unit.

The streaming server providing method of the streaming server according to the embodiment of the present invention includes the steps of checking whether there is feature information of a predetermined moving picture frame in the request when there is a moving picture transmission request from the mobile terminal, Determining a position of a moving image frame corresponding to the feature information in the requested moving image; and transmitting the requested moving image and feature information for each frame to the mobile terminal from the frame of the identified position.

The mobile terminal according to an embodiment of the present invention includes a transceiver for requesting a video transmission and receiving the requested video and feature information for each frame of the video, a memory for storing the feature information for each frame received, If motion picture reception and reproduction are interrupted during a handoff to a second communication network during a motion picture reproduction through a communication network, the motion picture decoding apparatus reads from the memory the feature information of the motion-stopped motion picture frame, And controls to receive feature information of a moving picture and a frame from a frame of a stopped position.

According to another aspect of the present invention, there is provided a moving image providing method for a mobile terminal, the method comprising the steps of: receiving moving image and characteristic information for each moving image frame through a first communication network and storing characteristic information for each received moving image; The method comprising the steps of: reading from the memory the feature information of the motion-stopped video frame when the motion picture reception and reproduction are interrupted during the handoff to the second communication network; And receiving the feature information of the moving picture and the frame from the frame of the playback stopped position through the second communication network.

According to the present invention, it is possible to guarantee the quality of service even if handing off from the first communication network to the second communication network during the real time reproduction of the moving picture, and even if the reproduction of the moving picture is interrupted due to the handoff between the heterogeneous communication networks, There is an effect.

Meanwhile, various other effects will be directly or implicitly disclosed in the detailed description according to the embodiment of the present invention to be described later.

1 is a configuration diagram of a moving image providing system according to an embodiment of the present invention;
2 is a flowchart illustrating a moving picture providing process of a moving picture providing system according to an embodiment of the present invention.
3 is a block diagram of a moving image object recognition server according to an embodiment of the present invention.
4 is a flowchart illustrating an operation process of a moving image object recognition server according to an exemplary embodiment of the present invention.
FIG. 5 is an exemplary diagram for explaining a process of extracting feature information of a moving image frame in a moving image object recognition server according to an embodiment of the present invention; FIG.
6 is a block diagram of a streaming server according to an embodiment of the present invention;
7 is a block diagram of a mobile terminal according to an embodiment of the present invention;

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The specific details set forth below are provided to aid in an overall understanding of the present invention. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

1 is a configuration diagram of a moving image providing system according to an embodiment of the present invention.

The moving picture providing system includes a multimedia moving picture server 100, a moving picture object recognition server 200, a first streaming server 300a, a second streaming server 300b, and a mobile terminal 400.

The multimedia moving picture server 100 provides moving pictures to the moving picture recognition server 200. [

The video object recognition server 200 extracts feature information for each frame of the moving image provided from the multimedia moving picture server 100 and transmits the extracted feature information for each frame to the first streaming server 300a and the second streaming And provides it to the server 300b. At this time, the moving picture object recognition server 200 extracts characteristic information for each frame using object-by-frame object analysis. Here, the feature information means a frame, i.e., pattern information of a still image. This feature information can be extracted as a binary code value through each convex, corner, and edge of the image.

The first streaming server 300a transmits the requested moving image among the moving images provided from the moving image recognition server 200 and the characteristic information of each moving image frame to the first communication network 300 Network to the mobile terminal 400 in real time. When the first communication network is a 3G network, the first streaming server 300a provides a streaming service based on UDP (User Datagram Protocol).

If the second streaming server 300b receives a video transmission request including the feature information of a predetermined video frame from the mobile terminal 400 through the second communication network (e.g., Wi-Fi network), the second streaming server 300b transmits the video frame corresponding to the feature information And transmits the requested moving picture and frame-specific feature information from the frame of the confirmed position to the mobile terminal 400 through the second communication network in real time. When the second communication network is a Wi-Fi network, the second streaming server 300b provides a streaming service based on a TCP (Transmission Control Protocol), and is usually streamed through an access point (AP).

The transmission of the requested moving image from the frame of the identified position here means transmitting the moving image having the frame of the confirmed position as the starting frame.

The first streaming server 300a and the second streaming server 300b store the feature information for each frame of the predetermined moving image provided from the moving image recognition server 200 and transmit the requested moving image To the mobile terminal 400, the feature information of the frame.

The first communication network and the second communication network refer to different communication networks. In FIG. 1, the 3G network and the Wi-Fi network are exemplified, but the present invention is not limited thereto.

The mobile terminal 400 receives the video and the frame-by-frame feature information from the first streaming server 300a through the first communication network, and separately stores the received frame-by-frame feature information. The mobile terminal 400 stores feature information in a progressive download form and executes the feature information, and deletes the feature information after a predetermined period of time.

If the mobile terminal 400 stops receiving and playing the moving picture due to the handoff to the second communication network during the playback of the moving picture, the mobile terminal 400 transmits the moving picture transmission request information including the feature information of the stopped moving picture frame to the second streaming server 300b.

The mobile terminal 400 receives the moving image having the frame of the stopped position from the second streaming server 300b as the start frame and the feature information of each moving image frame and continuously plays the stopped moving image.

In the embodiment of the present invention, although two streaming servers have been described, they may be implemented as one server, or the moving object recognition server 200 may be implemented as a streaming server or a multimedia video server 100 and one server have.

2 is a flowchart illustrating a moving picture providing process of a moving picture providing system according to an embodiment of the present invention.

Referring to FIGS. 1 and 2, a mobile terminal 400 accesses a first communication network (e.g., 3G network) (S110).

The mobile terminal 400 requests video transmission to the first streaming server 300a through the first communication network (S115).

The first streaming server 300a transmits the requested moving image and feature information for each frame of the moving image to the mobile terminal 400 (S120). At this time, the first streaming server 300a receives and stores at least one moving image and characteristic information for each frame of the moving image through the moving object recognition server 200, or when the request is received from the mobile terminal 400 And the feature information of the moving image and the frame may be provided from the moving image recognition server 200. [

The mobile terminal 400 sequentially reproduces moving pictures received from the first streaming server 300a for each frame, and separately stores the feature information for each frame (S125).

The mobile terminal 400 performs a handoff to a second communication network (e.g., Wi-Fi network) during video playback (S130). E.g. When the mobile terminal 400 enters the Wi-Fi network, it performs a handoff by receiving a beacon signal periodically transmitted from the access point.

When the mobile terminal 400 is handed off from the first communication network to the second communication network, the mobile terminal 400 stops the video reception and reproduction (S135). This is because the protocols of the video streaming service of the 3G network and the Wi-Fi network are different.

The mobile terminal 400 transmits the feature information of the motion-stopped video frame to the second streaming server 300b (S140). That is, the mobile terminal 400 confirms the feature information of the motion-stopped video frame through the feature information of each frame stored in step S125, and transmits the video transmission request information including the confirmed feature information to the second To the streaming server 300b. For example, the mobile terminal 400 may transmit the video transmission request information including the feature information to the second streaming server 300b through a request to send (RTS) request signal in the Wi-Fi network.

If there is a video transmission request including the feature information of the predetermined moving picture frame from the mobile terminal 400, the second streaming server 300b checks the location of the moving picture frame corresponding to the feature information in the requested moving picture (S145).

In operation S150, the second streaming server 300b transmits the video and frame-specific feature information having the identified frame as a start frame to the mobile terminal 400 through the second communication network in real time.

The mobile terminal 400 continuously reproduces the motion-stopped video from the corresponding frame (S155).

3 is a block diagram of a moving image object recognition server according to an embodiment of the present invention.

The video object recognition server includes a receiving unit 210, a transmitting unit 220, an object recognition server control unit 230, and a feature information extracting unit 240.

Referring to FIGS. 1 and 3, the receiving unit 210 receives moving pictures from the multimedia moving picture server 100.

The transmitting unit 220 transmits the moving image and the frame-specific characteristic information constituting the moving image to at least one of the first streaming server 300a and the second streaming server 300b.

The object recognition server control unit 230 controls the overall operation of the moving object recognition server according to the embodiment of the present invention. The object recognition server control unit 230 also transmits the feature information of each moving picture frame extracted by the feature information extraction unit 240 to at least one of the first streaming server 300a and the second streaming server 300b together with the corresponding moving image .

The feature information extracting unit 240 extracts feature information for each frame of the moving image received by the receiving unit 210. [

The feature information extracting unit 240 extracts a still image from a moving image frame as shown in FIG. 5A, and preprocessing the extracted feature information as shown in FIG. 5B so that essential information can be easily extracted from the obtained still image. Then, the feature information is extracted as shown in (c). At this time, the feature information extracting unit 240 extracts feature information for each frame using a Gaussian algorithm, but it is also possible to use other object recognition algorithms. Since the Gaussian algorithm is a well known technique for quickly analyzing an image pattern, a detailed description thereof will be omitted.

Although not shown in FIG. 3, each time a request is made from the streaming server, a separate database for storing at least one video and feature information for each frame extracted from the video is provided As shown in FIG.

4 is a flowchart illustrating an operation of a moving picture object recognition server according to an embodiment of the present invention.

3 and 4, the receiving unit 210 receives the moving image and transmits the moving image to the object recognition server control unit 230 (S210).

The object recognition server control unit 230 controls the feature information extraction unit 240 to extract feature information for each frame of the received moving image (S220). At this time, the feature information extracting unit 240 can extract feature information for each moving picture frame using an object recognition algorithm Gaussian (e.g., Gaussian algorithm) or the like.

The object recognition server control unit 230 transmits the extracted frame-by-frame feature information together with the moving image through the transmission unit 220 (S230).

6 is a block diagram of a streaming server according to an embodiment of the present invention.

The illustrated streaming server includes a transmitting unit 310, a receiving unit 320, a server controlling unit 330, a storing unit 340, and a feature information verifying unit 350.

Referring to FIGS. 1 and 6, the transmitter 310 transmits the video and the frame-by-frame feature information to the mobile terminal 400 according to a video transmission request of the mobile terminal 400.

The receiving unit 320 receives at least one moving image and characteristic information for each frame of the moving image from the moving image recognition server 200.

In addition, if there is a video transmission request from the mobile terminal 400, the reception unit 320 transmits the request information to the server control unit 330. The request information may include characteristic information of a specific moving picture frame.

The server control unit 330 controls the overall operation of the streaming server according to the embodiment of the present invention. In addition, if there is a video transmission request from the mobile terminal 400, the server control unit 330 checks whether the feature information of the predetermined moving picture frame is included in the request information.

If the request information includes the feature information of the predetermined moving image frame, the server control unit 330 controls the feature information identifying unit 350 to check the position of the moving image frame corresponding to the feature information among the frames of the requested moving image . The server control unit 330 controls the mobile terminal 400 to transmit the requested moving picture and the feature information of each moving picture frame to the mobile terminal 400 from the frame of the confirmed position.

If the feature information of the predetermined frame is not included in the video transmission request, the server control unit 330 controls the mobile terminal 400 to transmit the requested video and the feature information for each frame of the video.

The storage unit 340 stores the at least one moving image received by the receiving unit 320 and the feature information for each frame of the moving image.

The feature information confirming unit 350 confirms the position of the moving image frame corresponding to the feature information of the predetermined frame among the frames of the moving image, and transmits it to the server control unit 330.

7 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The illustrated mobile terminal includes a key input unit 410, a display unit 420, a control unit 430, a transceiver unit 440, an audio processing unit 450, and a memory 460.

1 and 7, the key input unit 410 includes a character key, a number key, and various function keys. The key input unit 410 outputs a key input signal corresponding to a key input by the user to the control unit 430.

The display unit 420 may be an LCD (Liquid Crystal Display) or the like, and displays various display data generated in the mobile terminal. In this case, when the LCD is implemented by a touch screen method, the display unit 420 may operate as an input unit.

The controller 430 controls the overall operation of the mobile terminal according to the embodiment of the present invention. In addition, when the motion picture reception / reproduction is stopped during the handoff to the second communication network during the motion picture reproduction received from the first streaming server 300a through the first communication network, the control unit 430 stores the feature information of the motion- ).

The control unit 430 generates moving image transmission request information including the read feature information and controls the transmitting and receiving unit 440 to transmit the moving image transmission request information to the second streaming server 300b through the second communication network.

The control unit 430 sequentially outputs the moving picture having the frame of the stopped position from the second streaming server 300b as the starting frame and the moving picture stopped when the characteristic information of each moving picture of the moving picture is received, The star feature information is stored in the memory 460.

The control unit 430 deletes the feature information stored in the memory 460 when the motion picture frame corresponding to the feature information is completely reproduced. However, when the motion picture frame is reproduced and a predetermined time (for example, 1- 2 seconds) is elapsed.

The transmission / reception unit 440 transmits information for requesting moving image transmission according to the control of the control unit 430, and receives the requested moving image and feature information for each frame of the moving image.

The audio processing unit 450 outputs an audio signal received in the transceiver 440 or an audio signal generated in the mobile terminal.

The memory 460 stores various kinds of information necessary for controlling the operation of the mobile terminal according to the embodiment of the present invention. In addition, the memory 460 stores the frame-specific feature information received with the moving image in the transceiver 440 according to the embodiment of the present invention.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand.

Therefore, it should be understood that the above-described embodiments are provided so that those skilled in the art can fully understand the scope of the present invention, and are therefore to be considered in all respects as illustrative and not restrictive, The invention is only defined by the claims.

Even if a mobile terminal playing a moving picture streamed through a first communication network handoffs to a second communication network different from the first communication network, a moving picture being played back can be continuously played without being disconnected, Can be widely used to improve the quality of the streaming video service through the mobile terminal.

100: Multimedia video server 200: Video object recognition server
300 (a): first streaming server 300 (b): second streaming server
400: mobile terminal 210, 320:
220, and 310, a transmitting unit 230, an object recognition server control unit
240: Feature information extraction unit 330:
340: storage unit 350: feature information verification unit
410: key input unit 420:
430: Control section 440: Transmitting /
450: Audio processor

Claims (15)

delete delete delete delete delete delete A receiver for receiving at least one moving picture and feature information for each frame of the moving picture;
A feature information identifying unit for identifying a position of a moving picture frame corresponding to feature information of a predetermined frame;
The mobile terminal performs a handoff from the first communication network to the second communication network, which is a heterogeneous communication network having a different transmission scheme from the first communication network, so that the reception and reproduction of the moving image received through the first communication network is interrupted, When the request for moving picture is received through the second communication network and the characteristic information of the stopped moving picture frame stored in the mobile terminal only for a predetermined time in association with the handoff is included in the request, A controller for checking the position of a moving picture frame corresponding to the feature information through the feature information checking unit and transmitting the requested moving picture and frame-specific feature information from the identified location to the mobile terminal through the second communication network, A control unit,
And a transmitter for transmitting the moving image and the characteristic information for each frame of the moving image under the control of the server control unit.
[8] has been abandoned due to the registration fee. The method of claim 7, wherein the server control unit
And controls the mobile terminal to transmit the requested moving image and feature information for each frame of the moving image to the mobile terminal if the feature information of the predetermined frame is not included in the moving image transmission request.
[Claim 9 is abandoned upon payment of registration fee.] 9. The method according to claim 7 or 8,
And a storage unit for storing the at least one moving image and feature information for each frame of the moving image.
The mobile terminal performs a handoff from the first communication network to the second communication network, which is a heterogeneous communication network having a different transmission scheme from the first communication network, so that the reception and reproduction of the moving image received through the first communication network is interrupted, The mobile communication terminal determines whether or not the characteristic information of the motion-stopped video frame stored in the mobile terminal for the predefined time in association with the handoff is included in the request Quot;
Identifying a video frame position corresponding to the feature information in the requested video if the request includes the feature information of the video frame;
And transmitting the requested video and frame-specific feature information from the identified location frame to the mobile terminal over the second communication network.
[Claim 11 is abandoned upon payment of the registration fee.] 11. The method of claim 10,
And transmitting the requested video and feature information for each frame of the video to the mobile terminal if the request does not include the feature information of the video frame.
A transmitting and receiving unit for requesting video transmission and receiving the requested moving image and feature information for each frame of the moving image,
A memory for storing the received feature information for each frame;
When receiving and playing back the moving picture is interrupted due to handoff from the first communication network to a second communication network which is a heterogeneous communication network having a different transmission scheme from that of the first communication network during moving picture playback through the first communication network, Reads the feature information of the motion-stopped video frame stored only for a predetermined time in association with the handoff from the memory, and transmits a video transmission request including the feature information of the video frame through the second communication network And controlling the mobile terminal to receive the feature information of the moving picture and the frame from the frame of the stopped position through the second communication network.
[13] has been abandoned due to the registration fee. 13. The apparatus of claim 12, wherein the control unit
And to delete the feature information stored in the memory when a preset time elapses.
Receiving feature information for each frame of the moving image and the moving image through the first communication network and storing the feature information for each frame;
When the reception and playback of the moving picture is interrupted by the handoff from the first communication network to the second communication network which is a heterogeneous communication network having a different transmission scheme from the first communication network during the reproduction of the moving picture, Reading feature information of a motion-stopped video frame stored only for a predetermined period of time from a memory,
Transmitting a moving image transmission request including the read feature information through the second communication network;
And receiving feature information for a moving picture and a frame from a frame at the playback stopped position through the second communication network through the second communication network.
[Claim 15 is abandoned upon payment of registration fee] 15. The method of claim 14,
And deleting the stored feature information when a preset time has elapsed.

Images