KR20090006424A - System and method for service of summarizing video - Google Patents

Abstract

A system for automatically generating a summary moving picture according to moving picture inquiry history and a method thereof are provided to summarize a moving picture efficiently in a user terminal by generating playback section information of contents from memory information for button use and automatically generating the moving picture summary based on the playback section information. A user terminal(100) plays original moving picture received through the network and transmits playback pattern information according to playback of the moving picture. A web server(200) operates and manages a service requested from the user terminal. A moving picture conversion server(300) generates a moving picture summary for the original moving picture based on the playback pattern information received from the user terminal. A database server(400) stores and manages the original moving picture received from a CP(Contents Provider) and the moving picture summary provided from the moving picture conversion server. A transfer server(500) extracts the moving picture from the database server according to a service type selected from the user terminal and transfers the extracted moving picture to the user terminal.

Description

Video summary service system and method thereof {SYSTEM AND METHOD FOR SERVICE OF SUMMARIZING VIDEO}

The present invention relates to a video summary service system and a method thereof, and more specifically, to generate playback section information of a content by utilizing memory information of a user using a button such as fast forward, rewind, and stop on a user terminal. The present invention relates to a video summary service system and a method for automatically generating a summary video through the same.

Due to the increasing weight of large multimedia databases and the development of communication and digital media processing technologies, numerous video videos have emerged, and efforts to promote user convenience and satisfaction through search services based on the abbreviated information of abbreviated video videos have been made. It is increasing.

However, to date, most video reduction has been achieved through the process of directly selecting the appropriate scene or image by human intervention.

Recently, with the development of various types of commerce related to moving picture video, the necessity of automatically analyzing a large amount of moving picture video is increasing, and accordingly, a lot of researches are being actively conducted to solve this problem.

There are video skimming, highlighting, and video summarization methods.

Highlights are shorthand, mainly for a specific event, to pick out only the interesting parts of the video. Video summaries are intended to extract meaningful content and structural information about moving images. The results of video summaries are typically represented by a sequence of key frames of the main still image (keyframes). Most researches on video abbreviation mainly aim to generate video summary information.

Video summaries represented by key frames not only provide an overview of the content of the entire video, but also act as scenes or shot entries containing the key frame. For this reason, video summarization can be regarded as selecting the optimal key frame or segment selection where the optimal key frame is located, and visually sharp features such as color and motion are important requirements for selecting the key frame. do.

On the other hand, video summaries can be divided into shot-based summaries and segment-based summaries according to their application range.

Shot-based summarization is a method of representing a relatively small amount of video, that is, a video clip as a small number of key frames, and segment-based summarization is a technique for summarizing entire long videos.

Due to the wide range of application of segment-based summarization technology, research on segment-based summarization has been actively conducted in recent years.

The method of summarizing the segmented video into segments includes a) a shot grouping method which analyzes the interrelationships between shots in a time window, grouping highly related shots into one story unit, and (b) a traditional clustering method. There is a way to select important clusters by analyzing the properties of clusters obtained from.

These methods can be further refined depending on which visual feature is used or which shot is chosen as the representative.

However, an important problem that these methods have in common is that they are too dependent on thresholds in determining representation. In other words, a representative threshold value is determined based on the specific threshold value. For example, the shots are selected as those whose importance is above the threshold or those whose importance is in the 10% ranking. Moreover, this threshold is determined experimentally. However, a problem caused by the video summarization algorithm becoming too dependent on experimental thresholds is that video summarization systems can be quite effective for some specific videos, but are difficult to apply to various genres of video.

In addition, this problem can be a fatal defect in applications that deal with various kinds of video information, and the task of setting the optimal threshold experimentally also incurs significant costs.

On the other hand, in selecting a key frame for a video summary, not only the visual features but also subjective judgment based on human judgment can be an important factor.

Indeed, if a person performs video reduction manually, this subjective judgment can be used to create a much more sympathetic video summary. Therefore, in order to generate an effective video summary, a study is needed to reflect this subjective judgment in the video reduction process.

The present invention was created to solve the problems inherent in the prior art as described above, an object of the present invention is to perform a video summary utilizing the video browsing history of the subjective judgment of the user in performing the video summary A user terminal for reproducing an original video provided through a wired / wireless communication network and transmitting reproduction pattern information according to the reproduction of the video; A web server for operating and managing a service requested from the user terminal through the wired / wireless communication network; A video conversion server generating a summary video of the original video based on the play pattern information transmitted from the user terminal; A database server configured to store and manage the original video provided from a content provider (CP) and the summary video provided from the conversion server; And a transmission server extracting the corresponding content from the database server and transmitting the corresponding content to the user terminal according to the service type selected from the user terminal.

a) extracting the original moving image from the database server and transmitting the original moving image to the user terminal according to a user request through the web server; b) playing, by a user terminal, an original video provided from the transmission server through a wired or wireless communication network, and transmitting reproduction pattern information according to the video playback; c) the video conversion server collecting and summing playback time information for each section of the original video based on the playback pattern information transmitted from the user terminal to determine a summary target section according to the size of the summed time information; And d) generating, by the video conversion server, the summary video through the combination of the summary target sections.

In accordance with an aspect of the present invention, a video summary service system is provided to achieve the above object: This system plays an original video provided through a wired / wireless communication network and transmits playback pattern information according to the video playback. A user terminal; A web server for operating and managing a service requested from the user terminal through the wired / wireless communication network; A video conversion server generating a summary video of the original video based on the play pattern information transmitted from the user terminal; A database server configured to store and manage the original video provided from a content provider (CP) and the summary video provided from the conversion server; And a transmission server extracting a corresponding video from the database server and transmitting the video to the user terminal according to the service type selected from the user terminal.

In the above configuration, the user terminal is characterized in that for transmitting the reproduction pattern information including fast forward, rewind, and pause according to the reproduction of the original video.

In the above configuration, the user terminal transmits the reproduction pattern information according to the reproduction in real time through a Real-Time Streaming Protocol (RTSP) when the original video is provided from the transmission server in a streaming manner. Characterized in that.

In the above configuration, the user terminal, when playing the original video provided by the download (Download) method from the transmission server, characterized in that to collect and transmit the playback pattern information according to the playback.

In the above configuration, the video conversion server collects and sums playback time information for each section of the original video based on playback pattern information transmitted for each user terminal to determine a summary target section according to the size of the summed time information. The summary video is generated through the combination of the summary target sections.

In the above configuration, the video conversion server, through the following formula

{However, if the user terminal plays a video for the corresponding period f _n , U (f _n , c) = 1 otherwise 0, u: individual user number, f _n : nth video playback section unit (the playback section is C: total number of plays for the same user u, C: total number of plays for the same user u} Collect play time information for each user terminal. Characterized in that.

In the above configuration, the video conversion server, through the following formula

{However, U is the total number of users who have played the video, P _u is a function of the sum of the video sections played by the user u as shown in the following equation.

Where N is the total number of f _n , P1 = total playback time (f _n ) / T ₁ (setting threshold), P ₂ = total playing time (f _n ) / T ₂ (setting threshold): above the set threshold Except when playing long (P ₂ , T ₂ ) or playing short (P ₁ , T ₁ )} The playing time information for each user terminal of the original video is added.

In the above configuration, the video conversion server, through the following formula

) 상기, W(f_n)을 크기의 순서로 재배치하며,(However, when F _K : W (f _n ) is arranged in the large order, the k th largest value, F _K = Histogram (W (f _n ), k): W (f _n ) is arranged in the large order. , the function that returns the k-th largest value, 1≤n≤N, 1≤k≤K,

) Relocates W (f _n ) in order of magnitude,

Satisfying the following formula:

(However, 1≤r≤K, R: converted value corresponding to the total duration of the summary video) is characterized in that r of F _K is set to the summary of the target interval.

In the above configuration, the video conversion server is configured to generate the summary video by encoding the summary target section.

In the above configuration, the video conversion server generates an information file having information on the summary target section and stores the information file in the database server.

In the above configuration, the video conversion server extracts a representative image of the original video based on the information on the summary target section, generates a separate file, and stores it in the database server.

According to another aspect of the present invention, there is provided a video conversion server: the server collects the play time information for each section of the original video based on the playback pattern information according to the original video playback transmitted from the user terminal through a wired or wireless communication network and The summarization period may be determined according to the sum of the summed time information, and the summary video may be generated by combining the summarization period.

In the above configuration, the video conversion server, through the following formula

{However, if the user terminal plays a video for the corresponding period f _n , U (f _n , c) = 1 otherwise 0, u: individual user number, f _n : nth video playback section unit (the playback section is C: total number of plays for the same user u, C: total number of plays for the same user u} Collect play time information for each user terminal. Characterized in that.

In the above configuration, the video conversion server, through the following formula

{However, U is the total number of users who have played the video, P _u is a function of the sum of the video sections played by the user u as shown in the following equation.

Where N is the total number of f _n , P1 = total playback time (f _n ) / T ₁ (setting threshold), P ₂ = total playing time (f _n ) / T ₂ (setting threshold): above the set threshold Except when playing long (P ₂ , T ₂ ) or playing short (P ₁ , T ₁ )} The playing time information for each user terminal of the original video is added.

In the above configuration, the video conversion server, through the following formula

) 상기, W(f_n)을 크기의 순서로 재배치하며,(However, when F _K : W (f _n ) is arranged in the large order, the k th largest value, F _K = Histogram (W (f _n ), k): W (f _n ) is arranged in the large order. , the function that returns the k-th largest value, 1≤n≤N, 1≤k≤K,

) Relocates W (f _n ) in order of magnitude,

Satisfying the following formula:

(However, 1≤r≤K, R: converted value corresponding to the total duration of the summary video) is characterized in that r of F _K is set to the summary of the target interval.

In the above configuration, the video conversion server is configured to generate the summary video by encoding the summary target section.

In the above configuration, the video conversion server is characterized by generating an information file having information on the summary target section.

In the above configuration, the video conversion server is characterized in that to extract a representative image of the original video based on the information on the summary target section to generate a separate file.

In the above configuration, the reproduction pattern information may include fast forward, rewind, and pause according to the reproduction of the original video.

According to another aspect of the present invention, there is provided a video summary service method comprising: a) extracting an original video from a database server and transmitting the original video to a user terminal according to a user request through a web server; b) playing, by a user terminal, an original video provided from the transmission server through a wired or wireless communication network, and transmitting reproduction pattern information according to the video playback; c) the video conversion server collecting and summing playback time information for each section of the original video based on the playback pattern information transmitted from the user terminal to determine a summary target section according to the size of the summed time information; And d) generating, by the video conversion server, the summary video through the combination of the summary target sections.

In the above configuration, step a) is characterized in that the transmission server transmits the original video to the user terminal through a transmission scheme including a streaming scheme and a download.

In the above configuration, step b) is characterized in that the user terminal transmits, in real time, the reproduction pattern information according to the reproduction when the original video is provided from the transmission server in a streaming manner.

In the above configuration, when the user terminal plays the original video provided by the download method from the transmission server, the user terminal collects and transmits playback pattern information according to the reproduction.

In the above configuration, the step b) is characterized in that the user terminal transmits the reproduction pattern information including fast forward, rewind, and pause according to the reproduction of the original video. do.

In the above configuration, the step c) is performed by the video conversion server through the following equation.

{However, if the user terminal plays a video for the corresponding period f _n , U (f _n , c) = 1 otherwise 0, u: individual user number, f _n : nth video playback section unit (the playback section is C: total number of plays for the same user u, C: total number of plays for the same user u} Collect play time information for each user terminal. Characterized in that.

In the above configuration, the step c) is performed by the video conversion server through the following equation.

{However, U is the total number of users who have played the video, P _u is a function of the sum of the video sections played by the user u as shown in the following equation.

Where N is the total number of f _n , P1 = total playback time (f _n ) / T ₁ (setting threshold), P ₂ = total playing time (f _n ) / T ₂ (setting threshold): above the set threshold Except when playing for a long time (P ₂ , T ₂ ) or playing a short time (P ₁ , T ₁ )} The play time information for each user terminal of the original video is added.

In the above configuration, the step c) is performed by the video conversion server through the following equation.

) 상기, W(f_n)을 크기의 순서로 재배치하며,(However, when F _K : W (f _n ) is arranged in the large order, the k th largest value, F _K = Histogram (W (f _n ), k): W (f _n ) is arranged in the large order. , the function that returns the k-th largest value, 1≤n≤N, 1≤k≤K,

) Relocates W (f _n ) in order of magnitude,

Satisfying the formula below,

(However, 1≤r≤K, R: converted value of the playing time of the summary video) is characterized in that r of F _K is set to the summary of the target interval.

In the above configuration, step d), the video conversion server is characterized in that for generating the summary video by encoding the summary target section.

In the above configuration, step d), the video conversion server, characterized in that for generating the information file containing the information on the summary target section and stored in the database server.

In the above configuration, step d), the video conversion server extracts the representative image of the original video based on the information on the summary target section to generate a separate file and store it in the database server It is done.

According to yet another aspect of the present invention, there is provided a video summary service method comprising the steps of: a) receiving playback pattern information according to original video playback transmitted from a user terminal through a wired or wireless communication network; b) collecting and summing play time information for each section of the original video based on the play pattern information transmitted from the user terminal; c) determining a summary target section according to the size of the summed time information; And d) generating, by the video conversion server, the summary video through the combination of the summary target sections.

In the above configuration, step a) may include receiving the playback pattern information including fast forward, rewind, and pause according to the reproduction of the original video from the user terminal. do.

In the above configuration, step b), the video conversion server, through the following formula

{However, if the user terminal plays a video for the corresponding period f _n , U (f _n , c) = 1 otherwise 0, u: individual user number, f _n : nth video playback section unit (the playback section is C: total number of plays for the same user u, C: total number of plays for the same user u} Collect play time information for each user terminal. Characterized in that.

In the above configuration, step b), the video conversion server, through the following formula

{However, U is the total number of users who have played the video, P _u is a function of the sum of the video sections played by the user u as shown in the following equation.

Where N is the total number of f _n , P1 = total playback time (f _n ) / T ₁ (set threshold), P ₂ = total playback time (f _n ) / T ₂ (set threshold), provided that the set threshold Except when playing longer (P ₂ , T ₂ ) or playing shorter (P ₁ , T ₁ ), the play time information for each user terminal of the original video is added.

In the above configuration, the step c) is performed by the video conversion server through the following equation.

) 상기, W(f_n)을 크기의 순서로 재배치하며,(However, when F _K : W (f _n ) is arranged in the large order, the k th largest value, F _K = Histogram (W (f _n ), k): W (f _n ) is arranged in the large order. , the function that returns the k-th largest value, 1≤n≤N, 1≤k≤K,

) Relocates W (f _n ) in order of magnitude,

Satisfying the formula below,

(However, 1≤r≤K, R: converted value of the playing time of the results: video) is characterized in that the set of r F _K to the target interval summary.

In the above configuration, step d), the video conversion server is characterized in that for generating the summary video by encoding the summary target section.

In the above configuration, step d) is characterized in that the video conversion server generates an information file including information on the summary target section.

In the above configuration, step d), the video conversion server, characterized in that for extracting a representative image of the original video based on the information on the summary target section to generate a separate file.

As can be seen above, the video summary service system and method according to an embodiment of the present invention, by performing a video summary utilizing the video viewing history of the user in performing the video summary, the user according to the video viewing history By subjecting the subjective judgment of to the video summary, it is possible to more efficiently user-centered video summary.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic block diagram of a video summary service system according to an exemplary embodiment of the present invention.

As shown in FIG. 1, the system includes: a user terminal 100 for requesting and playing a specific video through a wired or wireless communication network and transmitting a reading history to the video playback; A web server 200 connected to a wired / wireless communication network for operating and managing a service requested from the user terminal 100; A video conversion server 300 for receiving a reading history transmitted according to video playback from the user terminal 100 and generating a summary video based on this; A database server 400 for storing and managing a plurality of videos provided from a content provider (CP) and at the same time storing and managing a summary video for a specific video provided from the video conversion server 300; The transmission server 500 extracts specific content stored from the database server 400 according to the service type selected from the user terminal 100 and transmits the extracted content to the user terminal 100 through the wired / wireless communication network. ); Has a configuration that includes.

The user terminal 100 provides a specific video requested for service through the web server 200 from the transmission server 500 through various methods including a streaming method, a progressive download, and a general download method. Receive.

In addition, the user terminal 100 plays a video provided from the transmission server 500, and includes a reading history according to the playback, that is, fast forward, rewind, and pause. The reproduction pattern information is transmitted to the video conversion server 300 through a wired or wireless communication network.

More specifically, when the user terminal 100 plays a video provided from the transmission server 500 in a streaming manner, the playback pattern information according to the playback, that is, fast forward, rewind, and Each time a button such as Pause is pressed, the corresponding signal is transmitted to the image conversion server 300. More specifically, in the streaming method, the user terminal 100 transmits a random access signal to the transmission server 500 using a Real-Time Streaming Protocol (RTSP), and at this time, the image conversion server 300 is Based on the reproduction position information requested by the RTSP, the reproduction pattern information is extracted or the user terminal 100 collects the reproduction pattern information and transmits the reproduction pattern information in real time.

Meanwhile, when the user terminal 100 plays the downloaded video from the transmission server, the user terminal 100 collects the play pattern information generated when playing the video and transmits it to the image conversion server 300.

The video conversion server 300 collects and sums playback time information for each section of the original video based on playback pattern information transmitted for each user terminal 100 to determine a summary target section. That is, as shown in FIGS. 2 and 3, play time information for each section individually transmitted from the user terminal 100 is collected, and the use time information of all users is summed up based on this. FIG. 2 is a diagram showing numerical information of playback information for a video watched by five users, and FIG. 3 is a diagram showing playback information as shown in FIG.

In this case, when the user terminal 'u' plays a specific video, the video conversion server 300 determines play time information for each user terminal 100 through Equation 1 below.

[Equation 1]

{However, if the user terminal plays a video for the corresponding period f _n , U (f _n , c) = 1 otherwise 0, u: individual user number, f _n : nth video playback section unit (the playback section is Unit of time, number of frames and number of key frames), c: number of plays of the same user u, C: total number of plays of the same user u}

In addition, the video conversion server 300 sums up usage time information of all users through Equation 2 below.

[Formula 2]

(Where U is the total number of users who played the video)

In Equation 2, P _u may be expressed as a function of the sum of the video sections played by the user u as shown in Equation 3 below.

[Equation 3]

Where N can be defined as the total number of f _n , P1 = total playback time (f _n ) / T ₁ (set threshold), P ₂ = total playback time (f _n ) / T ₂ (set threshold) That is, except when playing longer than the set threshold (P ₂ , T ₂ ) or playing short (P ₁ , T ₁ )}

In addition, the video conversion server 300 determines a summary target section according to the size of the summed time information. That is, the video conversion server 300 through the following [Equation 4]

[Equation 4]

)(However, when F _K : W (f _n ) is arranged in the large order, the k th largest value, F _K = Histogram (W (f _n ), k): W (f _n ) is arranged in the large order. , the function that returns the k-th largest value, 1≤n≤N, 1≤k≤K,

)

Above, relocating the W (f _n) in the order of size, and is set to be the target region for the summation of r F _K satisfying the Formula 5 below.

[Equation 5]

(However, 1≤r≤K, R: converted value according to the playback time of the summary video. For example, when a unit of f _n is 2 seconds and a summary video summarized in 40 seconds is generated, R = 40, r = 20)

*. Here, all the variables used in [Formula 1] to [Formula 5] are integers.

In addition, the video conversion server 300 generates a summary video through the combination of the determined summary target sections. More specifically, the video conversion server 300 deletes unnecessary parts before and after sections using the scene change detection technology of the video for the summary target section, and performs consolidation on adjacent sections f _n to watch the user's smooth summary video. Make this possible.

Furthermore, the video conversion server 300 newly encodes the determined summary target section to generate a summary video and stores it in the database server 400.

Alternatively, the video conversion server 300 generates an information file including the information on the summary target section and stores the information file in the database server 400, thereby providing the summary video to the user terminal 100.

In addition, the video conversion server 300 extracts the representative image of the original video based on the information on the summary target section in order to provide a separately summarized image before playing the video on the web page or the screen of the user terminal 100 Create as a separate file, and store it in the database server 400.

Hereinafter, a video summary service method according to a preferred embodiment of the present invention will be described with reference to FIG. 2. 4 is a schematic flowchart illustrating a video summary service method according to an exemplary embodiment of the present invention.

First, in response to a user request through the web server 200, the transmission server 500 extracts an original video from the database server 400 and transmits the original video to the user terminal 100 (S110-S130). Preferably, the transmission server 500 extracts the original video from the database server 400 through a transmission method including a streaming method and a download, and the extracted original video to the user terminal 100. To be sent).

Thereafter, the user terminal 100 plays the original video provided from the transmission server 500 through a wired / wireless communication network and transmits reproduction pattern information according to the video playback (S140-S160). Preferably, when playing a video provided from a transmission server 500 in a streaming manner, playback pattern information according to the playback, that is, fast forward, rewind, pause, and the like. Each time the button is pressed, the signal is transmitted to the video conversion server 300. More specifically, in the streaming method, the user terminal 100 transmits a random access signal to the transmission server 500 by using a Real-Time Streaming Protocol (RTSP), and the image conversion server 300 at the RTSP Based on the requested playback position information, the playback pattern information is extracted. On the other hand, when playing the video downloaded from the transmission server, the user terminal 100 collects the playback pattern information generated during video playback and transmits it to the image conversion server 300.

Then, the video conversion server 300 collects and sums playback time information for each section of the original video based on the playback pattern information transmitted from the user terminal 100 (S170-S180). Preferably, when the user terminal 'u' plays a specific video, the video conversion server 300 determines the play time information for each user terminal 100 through [Equation 1] described above. In addition, the video conversion server 300 sums up the use time information of all the users through the above-mentioned [Equation 2].

Then, the video conversion server 300 determines the summary target section according to the size of the time information added through the steps 'S170-S180' (S190). Preferably, the video conversion server 300 rearranges the time information summed through the above Equation 4 according to the size, and sets the summary target section through the above Equation 5.

Next, the video conversion server 300 generates a summary video through the combination of the summary target section determined through the step 'S190' (S200). Preferably, the video conversion server 300 deletes unnecessary portions before and after the section for the summary target section by using a scene change detection technology of the video, and performs a merger of adjacent sections f _n to watch a user smooth summary video. Make this possible. Furthermore, the video conversion server 300 newly encodes the determined summary target section to generate a summary video and stores it in the database server 400. Alternatively, the video conversion server 300 generates an information file including the information on the summary target section and stores the information file in the database server 400, thereby providing the summary video to the user terminal 100. In addition, the video conversion server 300 extracts the representative image of the original video based on the information on the summary target section in order to provide a separately summarized image before playing the video on the web page or the screen of the user terminal 100 Create as a separate file, and store it in the database server 400.

For reference, the steps 'S180 to S200' may not be repeated if the user's playback pattern information on the video is collected by more than a predetermined value according to the operator's decision by the process of steps S110 to S170. Would be possible.

Although the present invention has been described in detail with reference to the preferred embodiments, the present invention is not limited to the above-described embodiments, and the present invention belongs to the present invention without departing from the gist of the present invention as claimed in the following claims. Anyone skilled in the art will have the technical idea of the present invention to the extent that various modifications or changes are possible.

By using the memory information of the user using the fast-forward, rewind, and stop buttons on the user's terminal, the playback section of the content is generated and the summary video is automatically generated, thereby subjecting the subjective judgment of the user to the video summary. By providing a user-oriented video summary service by importing, there is an advantage of increasing user participation and use of the corresponding service.

The following drawings, which are attached in this specification, illustrate preferred embodiments of the present invention, and together with the detailed description of the present invention, serve to further understand the technical spirit of the present invention. It should not be construed as limited to.

1 is a schematic configuration diagram of a video summary service system according to an exemplary embodiment of the present invention.

FIG. 2 is a diagram quantifying playback information of a video watched by a user according to an exemplary embodiment of the present invention. FIG.

3 is a diagram illustrating playback information of a video watched by a user according to an exemplary embodiment of the present invention.

4 is a flowchart illustrating a video summary service method according to an embodiment of the present invention.

* Description of the symbols for the main parts of the drawings *

100: user terminal

200: web server

300: video conversion server

400: database server

500: transport server

Claims (38)

A user terminal that plays an original video provided through a wired / wireless communication network and transmits playback pattern information according to the video playback; A web server for operating and managing a service requested from the user terminal through the wired / wireless communication network; A video conversion server generating a summary video of the original video based on the play pattern information transmitted from the user terminal; A database server configured to store and manage the original video provided from a contents provider (CP) and the summary video provided from the conversion server; And And a transmission server extracting the video from the database server and transmitting the video to the user terminal according to the service type selected from the user terminal. The method of claim 1, wherein the user terminal, The video summary service system of claim 1, wherein the playback pattern information including fast forward, rewind, and pause according to the original video playback is transmitted. The method of claim 1, wherein the user terminal, Video, characterized in that for transmitting the playback pattern information according to the playback in real time through the Real-Time Streaming Protocol (RTSP), when playing the original video provided by the streaming (streaming) method from the transmission server Summary service system. The method of claim 1, wherein the user terminal, When playing the original video provided by the download method from the transmission server, video summary service system, characterized in that for collecting and transmitting the playback pattern information according to the playback. The method of claim 1, wherein the video conversion server, Collecting and summing playback time information for each section of the original video based on the play pattern information transmitted for each user terminal to determine a summary target section according to the size of the summed time information, and through the combination of the summary target section Video summary service system, characterized in that for generating a summary video. The method of claim 5, wherein the video conversion server, Through the formula below

{However, if the user terminal plays a video for the corresponding period f _n , U (f _n , c) = 1 otherwise 0, u: individual user number, f _n : nth video playback section unit (the playback section is C: total number of plays for the same user u, C: total number of plays for the same user u} Collect play time information for each user terminal. Video summary service system, characterized in that. The method of claim 5, wherein the video conversion server, Through the formula below

{However, U is the total number of users who have played the video, P _u is a function of the sum of the video sections played by the user u as shown in the following equation.

Where N is the total number of f _n , P1 = total playback time (f _n ) / T ₁ (setting threshold), P ₂ = total playing time (f _n ) / T ₂ (setting threshold): above the set threshold Except when playing long (P ₂ , T ₂ ) or playing short (P ₁ , T ₁ )} Video summary service system, characterized in that the playing time information for each user terminal of the original video is added up. The method of claim 7, wherein the video conversion server, Through the formula below

(However, when F _K : W (f _n ) is arranged in the large order, the k th largest value, F _K = Histogram (W (f _n ), k): W (f _n ) is arranged in the large order. , the function that returns the k-th largest value, 1≤n≤N, 1≤k≤K,

) Wherein W (f _n ) is rearranged in order of size, Satisfying the following formula:

(However, 1≤r≤K, R: Summary converted value according to the duration of the video) r F _K of the video summary service system characterized in that the target set to the summary section. The method of claim 5, wherein the video conversion server, The video summary service system, wherein the summary video is generated by encoding the summary target section. The method of claim 5, wherein the video conversion server, Video summary service system, characterized in that for generating an information file having information on the summary target section and stored in the database server. The method of claim 5, wherein the video conversion server, The video summary service system of claim 1, wherein the representative image of the original video is extracted based on the information on the summary target section, and is generated as a separate file and stored in the database server. Collecting and summing playback time information for each section of the original video based on the playback pattern information according to the playback of the original video transmitted from the user terminal through a wired or wireless communication network to determine a summary target section according to the size of the summed time information, And a summary video is generated through a combination of summary target sections. The method of claim 12, wherein the video conversion server, Through the formula below

{However, if the user terminal plays a video for the corresponding period f _n , U (f _n , c) = 1 otherwise 0, u: individual user number, f _n : nth video playback section unit (the playback section is C: total number of plays for the same user u, C: total number of plays for the same user u} Collect play time information for each user terminal. Video conversion server, characterized in that. The method of claim 12, wherein the video conversion server, Through the formula below

{However, U is the total number of users who have played the video, P _u is a function of the sum of the video sections played by the user u as shown in the following equation.

Where N is the total number of f _n , P1 = total playback time (f _n ) / T ₁ (setting threshold), P ₂ = total playing time (f _n ) / T ₂ (setting threshold): above the set threshold Except when playing for a long time (P ₂ , T ₂ ) or playing a short time (P ₁ , T ₁ )} The video conversion server of claim ₁ , wherein play time information for each user terminal of the original video is added up. The method of claim 14, wherein the video conversion server, Through the formula below

(However, when F _K : W (f _n ) is arranged in the large order, the k th largest value, F _K = Histogram (W (f _n ), k): W (f _n ) is arranged in the large order. , the function that returns the k-th largest value, 1≤n≤N, 1≤k≤K,

) Wherein W (f _n ) is rearranged in order of size, Satisfying the following formula:

(However, 1≤r≤K, R: Summary set value corresponding to the duration of the video) r F _K of the video conversion server, it characterized in that the target set to the summary section. The method of claim 12, wherein the video conversion server, And a video encoding server generating the summary video by encoding the summary target section. The method of claim 12, wherein the video conversion server, And an information file having information on the summary target section. The method of claim 12, wherein the video conversion server, And a representative image of the original video is generated as a separate file based on the information on the summary target section. The method of claim 12, wherein the reproduction pattern information, And a fast forward, rewind, and pause according to the playback of the original video. In the video summary service method, a) extracting the original moving image from the database server and transmitting the original moving image to the user terminal according to a user request through the web server; b) playing, by a user terminal, an original video provided from the transmission server through a wired or wireless communication network, and transmitting reproduction pattern information according to the video playback; c) the video conversion server collecting and summing playback time information for each section of the original video based on the playback pattern information transmitted from the user terminal to determine a summary target section according to the size of the summed time information; And and d) generating, by the video conversion server, the summary video through the combination of the summary subject sections. The method of claim 20, wherein step a) And the transmission server transmits the original video to the user terminal through a transmission method including a streaming method and a download. 22. The method of claim 20 or 21, wherein b) comprises: When the user terminal plays the original video provided from the transmission server in a streaming manner, the playback pattern information according to the playback is transmitted in real time through RTSP (Real-Time Streaming Protocol) Video summary service method characterized in that. The method of claim 20 or 21, wherein the user terminal, When the user terminal plays the original video provided from the transmission server by the download method, the video summary service method of collecting and transmitting the playback pattern information according to the playback. The method of claim 20, wherein b), And the user terminal transmits the reproduction pattern information including fast forward, rewind, and pause according to the reproduction of the original moving image. The method of claim 20, wherein step c) Through the formula below

{However, if the user terminal plays a video for the corresponding period f _n , U (f _n , c) = 1 otherwise 0, u: individual user number, f _n : nth video playback section unit (the playback section is C: total number of plays for the same user u, C: total number of plays for the same user u} Collect play time information for each user terminal. Video summary service method, characterized in that. 26. The method of claim 20 or 25, wherein step c) comprises: Through the formula below

{However, U is the total number of users who have played the video, P _u is the function of the sum of the video segments played by the user u as shown in the following formula.

Where N is the total number of f _n , P1 = total playback time (f _n ) / T ₁ (setting threshold), P ₂ = total playing time (f _n ) / T ₂ (setting threshold): above the set threshold Except when playing long (P ₂ , T ₂ ) or playing short (P ₁ , T ₁ )} Video summary service method characterized in that the playing time information for each user terminal of the original video is added up. The method of claim 26, wherein step c) Through the formula below

(However, when F _K : W (f _n ) is arranged in the large order, the k th largest value, F _K = Histogram (W (f _n ), k): W (f _n ) is arranged in the large order. , the function that returns the k-th largest value, 1≤n≤N, 1≤k≤K,

) Wherein W (f _n ) is rearranged in order of size, Satisfying the following formula:

(However, 1≤r≤K, R: Summary converted value according to the duration of the video) r F _K of the video summary, characterized in that characterized in that a summary of the set target interval service method. The method of claim 20, wherein the d) step, And a video conversion server generates the summary video by encoding the summary target section. The method of claim 20, wherein the d) step, And the video conversion server generates an information file including information on the summary target section and stores the information file in the database server. The method of claim 20, wherein the d) step, The video converting server extracts a representative image of the original video based on the information on the summary target section, generates a separate file, and stores it in the database server. In the video summary service method, a) receiving reproduction pattern information according to reproduction of an original video transmitted from a user terminal through a wired or wireless communication network; b) collecting and summing play time information for each section of the original video based on the play pattern information transmitted from the user terminal; c) determining a summary target section according to the size of the summed time information; And and d) generating, by the video conversion server, the summary video through the combination of the summary subject sections. The method of claim 31, wherein step a) comprises: And the play pattern information including fast forward, rewind, and pause according to the reproduction of the original video from the user terminal. 32. The method of claim 31, wherein b) comprises: Through the formula below

{However, if the user terminal plays a video for the corresponding period f _n , U (f _n , c) = 1 otherwise 0, u: individual user number, f _n : nth video playback section unit (the playback section is C: total number of plays for the same user u, C: total number of plays for the same user u} Collect play time information for each user terminal. Video summary service method, characterized in that. 34. The method of claim 31 or 33, wherein b) comprises: Through the formula below

{However, U is the total number of users who have played the video, P _u is a function of the sum of the video sections played by the user u as shown in the following equation.

Where N is the total number of f _n , P1 = total playback time (f _n ) / T ₁ (setting threshold), P ₂ = total playing time (f _n ) / T ₂ (setting threshold): above the set threshold Except when playing long (P ₂ , T ₂ ) or playing short (P ₁ , T ₁ )} Video summary service method characterized in that the playing time information for each user terminal of the original video is added up. The method of claim 34, wherein step c) Through the formula below

(However, when F _K : W (f _n ) is arranged in the large order, the k th largest value, F _K = Histogram (W (f _n ), k): W (f _n ) is arranged in the large order. , the function that returns the k-th largest value, 1≤n≤N, 1≤k≤K,

) Wherein W (f _n ) is rearranged in order of size, Satisfying the following formula:

(However, 1≤r≤K, R: Summary converted value according to the duration of the video) r F _K of the video summary, characterized in that characterized in that a summary of the set target interval service method. The method of claim 31, wherein step d) And a video conversion server generates the summary video by encoding the summary target section. The method of claim 31, wherein step d) And the video conversion server generates an information file including information on the summary target section. The method of claim 31, wherein step d) The video converting server extracts a representative image of the original video based on the information on the summary target section, and generates a video summary service method.

Images