KR20150078747A - Method for displaying video summary data, computing device and computer-readable medium - Google Patents

Abstract

The present invention relates to a method for displaying video summary data, which comprises the steps of: playing a video at a normal speed; receiving an input for playing the video at a first speed faster than the normal speed; displaying first summary data based on the first speed while playing the video at the first speed; receiving an input for playing the video at a second speed faster than the first speed; and displaying second summary data based on the second speed while playing the video at the second speed.

Description

METHOD FOR DISPLAYING VIDEO SUMMARY DATA, COMPUTING DEVICE AND COMPUTER READABLE MEDIUM,

The present invention relates to a method for displaying moving picture summary information, a computing device, and a computer readable medium.

Conventionally, when viewing a moving picture, the moving picture function can be used to view a moving picture more quickly or to find a specific portion. At this time, the segment movement can be performed from the user interface through input of Fast Forward (FF) or REW (Rewind). At this time, the section movement can be performed in time units. Also, the segment movement may be performed through control of a track bar from the user interface.

In connection with the movement of moving picture contents, Korean Unexamined Patent Publication No. 2003-0024257 discloses a moving picture data execution method in a mobile communication terminal. However, when moving a section of a moving picture in units of time, it can be skipped regardless of the story line of the moving picture contents, so that the user can not grasp the flow of the contents. Therefore, there is a need for a method that enables the user to grasp the flow of the contents even if the section of the moving picture is moved.

The present invention provides a video summary information display method, a computing device, and a computer readable medium that can provide a summary information of a moving picture differently according to a playback speed, thereby assisting understanding of a moving picture viewed at a high speed. A summary of information of a moving picture, a moving picture summary information display method, a computing device, and a computer readable medium, which enable a user to skip a moving picture content by a content unit instead of a scene unit. In addition, the present invention provides a summary information display method, a computing device, and a computer readable medium for providing summary information about a section before and after a skip to a viewer to help understand the story line. In addition, the present invention provides a video summary information display method, a computing device, and a computer readable medium, which enable a viewer to select whether or not to execute a skip function to the next section while viewing summary information by providing summary information of a moving image. It is to be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

According to an aspect of the present invention, there is provided a method of reproducing a moving picture at a normal speed, receiving an input for reproducing a moving picture at a first speed higher than a normal speed, Displaying the first summary information according to the first speed while reproducing at a speed, receiving an input reproducing the moving image at a second speed higher than the first speed, and reproducing the moving image at the second speed, And displaying the second summary information according to the second summary information.

In another embodiment of the present invention, there is provided a method for reproducing a moving picture, comprising: receiving an input skipping to a second section, which is a next section of a first section during reproduction of a first section of a moving picture; And displaying the summary information on the display unit.

Yet another embodiment of the present invention includes a processing unit arranged to interface with a memory and a memory, wherein the processing unit is adapted to play back the video at a normal rate and to receive an input to reproduce the video at a first rate, Receives an input to reproduce a moving image at a first speed, displays first summary information according to a first speed, receives an input to reproduce the moving image at a second speed higher than the first speed, and reproduces the moving image at a second speed While displaying the second summary information according to the second rate.

Yet another embodiment of the present invention is directed to a computer-readable recording medium storing a computer-readable program for causing a computing device to execute a process of causing a computing device to reproduce a moving image at a normal speed, receive an input for reproducing the moving image at a first speed higher than a normal speed, Wherein the moving picture reproducing apparatus reproduces the moving picture at the second speed while displaying the first summary information according to the first speed while reproducing the moving picture at the first speed while reproducing the moving picture at the second speed while reproducing the moving picture at the second speed, And to display the second summary information according to the speed.

The above-described task solution is merely exemplary and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and the detailed description of the invention.

According to any one of the above-mentioned tasks, it is possible to provide an understanding of moving pictures to be viewed at a high speed by providing the moving picture summary information differently according to the playback speed. The present invention can provide a video summary information display method, a computing device, and a computer readable medium that can provide summary information of a moving picture so that moving picture content can be skipped in units of contents instead of a scene unit. Also, it is possible to provide a video summary information display method, a computing device, and a computer readable medium that provide summary information on a section before and after a skip to a viewer to help understand the story line. The present invention also provides a video summary information display method, a computing device, and a computer readable medium, which allow a viewer to select whether or not to execute a skip function to the next section while viewing summary information by providing summary information of a moving image.

1 is a configuration diagram of a moving picture summary information display system according to an embodiment of the present invention.
2 is a configuration diagram of a computing device according to an embodiment of the present invention.
3 is a view showing a predetermined section according to an embodiment of the present invention.
4 is a flowchart illustrating a method for determining priorities for a plurality of important sentences according to an embodiment of the present invention.
5A to 5C are views for explaining a process of generating summary information according to an embodiment of the present invention.
6A to 6C are views for explaining exposure time of summary information according to a playback speed according to an embodiment of the present invention.
FIG. 7 is a diagram illustrating summary information in a user terminal according to an exemplary embodiment of the present invention. Referring to FIG.
8 is a flowchart illustrating a method of displaying moving image summary information according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "including" an element, it is to be understood that the element may include other elements as well as other elements, And does not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof.

In this specification, the term " part " includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be implemented using two or more hardware, or two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by the terminal or the device may be performed in the server connected to the terminal or the device instead. Similarly, some of the operations or functions described as being performed by the server may also be performed on a terminal or device connected to the server.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram of a moving picture summary information display system 1 according to an embodiment of the present invention. Referring to FIG. 1, the moving picture summary information display system 1 may include a server 100 and a user terminal 200. The server 100 and the user terminal 200 shown in FIG. 1 illustratively show the components that can be controlled by the video summary information display system 1. In FIG. Each component of the moving picture summary information display system 1 of FIG. 1 is generally connected through a network. For example, as shown in FIG. 1, the user terminal 200 may be connected to the server 100 through a network.

An example of such a network is Wi-Fi, the Internet, a LAN (Local Area Network), a Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), 3G, 4G, LTE and the like.

The server 100 provides video content. At this time, the server 100 may provide various video contents such as a real-time channel or VOD (Video On Demands) to the user terminal 200 in a streaming or download manner.

The server 100 may divide a moving picture into a plurality of sections in units of contents and generate summary information for each divided section. In addition, the user terminal 200 can provide the generated summary information. Alternatively, in some embodiments, the user terminal 200 may itself generate summary information. In this case, the user terminal 200 does not need to receive the summary information from the server 100.

The server 100 or the user terminal 200 calculates the appearance frequencies of nouns and verbs included in the metabolism information based on the metabolism information for the divided section, generates a plurality of important sentences for the section, The summary information can be generated by determining the priorities of a plurality of important sentences.

The user terminal 200 can reproduce the received moving image content at normal or high speed. At this time, the user terminal 200 may require a moving image codec and a voice codec to reproduce moving images. For example, the video codec may be MPEG-1, MPEG-2, MPEG-4, DivX, Xvid, AVI and WMV, and the audio codec may be MP3, WMA, AAC and AC-3.

The user terminal 200 can display summary information according to the playback speed of the received moving image. At this time, the user terminal 200 can display summary information for each section divided into a plurality of sections.

The user terminal 200 may receive an input to reproduce at a first rate faster than the normal rate or an input to reproduce at a second rate which is faster than the first rate from the user interface. For example, the first speed may be 4 times speed, and the second speed may be 16 times speed. The user terminal 200 may display the first summary information according to the first rate or the second summary information according to the second rate based on the received input.

The server 100 or the user terminal 200 may generate a plurality of important sentences for a predetermined section of the moving picture, determine the priority of a plurality of important sentences, and determine, based on the determined priority, Summary information can be generated. For example, the first summary information may include N high-priority sentences of high priority, and the second summary information may include M high-priority sentences of high priority. At this time, N and M are natural numbers, and N may be greater than M.

At this time, the number of pages of the first summary information displayed for a predetermined section of the moving image may be larger than the number of pages of the second summary information. For example, the number of sentences per page of the first summary information displayed for a predetermined section of the moving picture can be made equal to the number of sentences per page of the second summary information. As another example, the number of words of the first summary information displayed for a predetermined section of the moving picture can be made larger than the number of words of the second summary information. As another example, the number of sentences of the first summary information displayed for a predetermined section of the moving picture can be made larger than the number of sentences of the second summary information.

The user terminal 200 receives the input skipping to the second section, which is the next section of the first section during reproduction of the first section of the moving image, and reproduces the first summary information for the first section while reproducing the second section Can be displayed. Also, the user terminal 200 receives an input to skip to the third section, which is the next section of the first section during reproduction of the first section of the moving image, and reproduces the third section while reproducing the first section and the second section The second summary information may be displayed. In this case, the first summary information and the second summary information may be different.

The user terminal 200 may display the summary information of the previous section and the next section during the reproduction of the first section of the moving image. At this time, the user terminal 200 can overlay the summary information on the moving picture.

One example of such a user terminal 200 is a Personal Communication System (PCS), a Global System for Mobile Communications (GSM), a Personal Digital Cellular (PDC), a Personal Handyphone System (PHS) Assistant, IMT (International Mobile Telecommunication) -2000, Code Division Multiple Access (CDMA) -2000, W-Code Division Multiple Access (W-CDMA), Wibro (Wireless Broadband Internet) terminals, And may be a wireless communication device 201 that is guaranteed to be portable and mobility. An example of the user terminal 200 may also include any type of handheld based wireless communication device 202, such as a smart pad, a tablet PC, and the like. One example of the user terminal 200 is a notebook, a netbook, an UltraBook, a subnotebook, a desk note, an Ultra-Mobile PC (UMPC), a desktop ), And the like.

2 is a configuration diagram of a computing device according to an embodiment of the present invention. Referring to FIG. 2, a computing device may include a computer-readable medium including a sequence of instructions for displaying summary information of a moving image, the device for displaying summary information of a moving image.

The computing device may include a memory 210 and a processing unit 220 arranged to interface with the memory.

The processing unit 220 reproduces the moving image at normal speed. The processing unit 220 can receive and reproduce a moving picture such as a video on demand (VOD) from the server 100 in a downloading or streaming manner. At this time, the processing unit 220 may require a video codec and a voice codec to reproduce the moving picture. For example, the video codec may be MPEG-1, MPEG-2, MPEG-4, DivX, Xvid, AVI and WMV, and the audio codec may be MP3, WMA, AAC and AC-3.

The processing unit 220 may display summary information on a section that is currently being played and a section that is currently being played back while playing a moving image from the user interface. For example, the processing unit 220 may display the summary information of the past first section while reproducing the second section. In another example, the processing unit 220 may display summary information on a second section, which is a section after the first section, during playback of the first section of the moving image. The summary information generation method performed in the processing unit 220 will be described in detail below with reference to FIGS. 3 through 5. FIG.

3 is a view showing a predetermined section according to an embodiment of the present invention. Referring to FIG. 3, the moving picture contents may be divided into content units or paragraph units. In addition, a start frame of a frame of video content classified by content unit can be designated as a key frame.

 For example, video content that includes frames from 1 to 99 can be divided into five paragraphs. At this time, the entire frame of the moving picture content is divided into the frames 1 to 14 of the first paragraph 310, the frames 15 to 34 of the second paragraph 320, the frames 35 to 49 of the third paragraph 330, Frames 50 to 78 'of the fourth paragraph 340 and' frames 79 to 99 'of the fifth paragraph 350. The first paragraph 310 includes 'frames 1 to 14', which may take up to about four minutes of playback time. At this time, the key frame of the 'frame 1 to 14' may be 'frame 1'. The first paragraph 310 may generate the 'summary information 1' based on the contents of the 'frames 1 to 14'. The second paragraph 320 includes 'frames 15 to 34', which may take up to about five minutes of playback time. At this time, the key frames of the 'frames 15 to 34' may be 'frame 15'. The second paragraph 320 may generate the 'summary information 2' based on the contents of the 'frames 15 to 34'. The third paragraph 330 includes 'frames 35 to 49', which may take a playback time of about three minutes. At this time, the key frames of the 'frames 35 to 49' may be 'frame 35'. The third paragraph 330 may generate the 'summary information 3' based on the contents of the 'frames 35 to 49'. The fourth paragraph 340 includes 'frames 50-78', which may take up to 3.5 minutes of playback time. At this time, the key frames of the 'frames 50 to 78' may be 'frame 50'. The fourth paragraph 340 may generate the 'summary information 4' based on the contents of the 'frames 50 to 78'. The fifth paragraph 350 includes 'frames 79 to 99' and may take about 4.5 minutes of playback time. At this time, the key frame of the 'frames 79 to 99' may be 'frame 79'. The fifth paragraph 350 may generate the 'summary information 5' based on the contents of the 'frames 79 to 99'.

As described above, the summary information of the entire moving image may include 'summary information 1', 'summary information 2', 'summary information 3', 'summary information 4', and 'summary information 5'.

4 is a flowchart illustrating a method for determining priorities for a plurality of important sentences according to an embodiment of the present invention. The method for determining the priorities of a plurality of important sentences performed by the server 100 or the user terminal 200 according to the embodiment shown in FIG. 4 is the same as that of FIG. 1). ≪ / RTI > 1, the contents already described with respect to the moving picture summary information display system 1 according to the embodiment shown in FIG. 1 are the same as those of the server 100 or the user terminal 200 ) Of a plurality of important sentences to be executed by the user. Hereinafter, it is assumed that the server 100 generates summary information.

Referring to FIG. 4, in step S410, the server 100 removes a word having a low appearance frequency in the metabolism information. In step S420, the server 100 extracts important words for each paragraph from the dialog information. In step S430, the server 100 applies a sentence rule to an important word to extract a main phrase. In step S440, the server 100 combines the main phrases included in the same sentence to generate an important sentence. In step S450, the server 100 calculates the weight of the important sentence.

In the above description, steps S410 through S450 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

5A to 5C are views for explaining a process of generating summary information according to an embodiment of the present invention. The server 100 can remove words having a low appearance frequency in the dialogue information using script information or caption information of the video contents. At this time, the words having a low appearance frequency may be, for example, abbreviations, abbreviations, synonyms, compound words, meaningless words, and the like.

The server 100 extracts important words for each paragraph from the dialog information. For example, the server 100 may analyze the morpheme based on the metabolism information of the predetermined section of the moving image, and then calculate the occurrence frequencies of the nouns and the verbs included in the metabolism information. As another example, the server 100 may select words having a high frequency of occurrence of nouns and verbs as important words. At this time, the server 100 can regard the verb written in the active form and the verb written in the manual form as the same verb.

5A is a diagram showing metabolism information in the first paragraph. Referring to FIG. 5A, the server 100 may extract important words from the first paragraph of the dialogue information. For example, suppose that the server 100 extracts important words of the first metabolism information from a metabolic interval of about one minute, which is a reproduction interval of '1: 21 ~ 2: 25'. At this time, the server 100 can extract the nouns and verbs of the first metabolism information. For example, the server 100 can extract nouns such as experiments, desks, mice, computers, balls, rollers, ropes, pulleys, springs, gestures, interfaces, equipment, motion, sensing, At this time, the server 100 can calculate the appearance frequency of a noun. For example, the server 100 may be configured to perform one experiment, one desk, six mice, one computer, two balls, five rollers, one row, one pulley, one spring, one gesture, After calculating the frequency of occurrence of nouns such as 1 interface, 1 device, 1 motion, 1 sensed, 1 world, 1 action, the words 'mouse', 'ball', 'roller' Can be selected. In another example, the server 100 can extract a verb such as connect, use, disassemble, embed, move, detect, concentrate, borrow, detach, arrange, have. At this time, the server 100 can calculate the occurrence frequency of the verb. For example, the server 100 may connect 2 times, use 1 time, disassemble 1 time, embed 1 time, move 3 times, detect 1 time, concentrate once, borrow 1 time, take off After calculating the frequency of appearance of the verb, such as 1 time, 2 times of arrangement, 2 times of making up, 1 time of follow up, it is possible to select "move", "connect", "make" have.

5B is a diagram showing metabolism information in the second paragraph. Referring to FIG. 5B, the server 100 can extract important words from the second paragraph of the dialogue information. For example, suppose that the server 100 extracts important words of the second metabolism information from the metabolic interval of about 40 seconds whose reproduction interval is '2: 26 ~ 3: 06'. At this time, the server 100 can extract the nouns and verbs of the second metabolic information. For example, the server 100 can extract nouns such as real life, digital world, sticky note, digital, SMS, schedule management, schedule, digital media, search, query, address, post-it, At this time, the server 100 can calculate the appearance frequency of a noun. For example, the server 100 may be configured to send a query to the server 100 once per real life, once per digital world, once per sticky note, once per digital, once per SMS, once per calendar, once per calendar, After calculating the frequency of occurrence of nouns such as once, address 1, post-it once, and paper input / output 1, 'sticky notes' can be selected with high frequency words. In another example, the server 100 may extract a verb such as integrate, use, communicate, interwork, manage, print, operate, At this time, the server 100 can calculate the occurrence frequency of the verb. For example, the server 100 may integrate once, many times, use twice, communicate once, interlock twice, manage once, print once, operate once, use After calculating the frequency of occurrence of the verb, such as once, it is possible to select "use" or "interlock" as a verb with a high frequency of appearance.

5C is a diagram showing metabolism information in the third paragraph. Referring to FIG. 5C, the server 100 may extract important words from the metabolic information in the third paragraph. For example, suppose that the server 100 extracts important words of the third metabolism information from the metabolic interval of about 15 seconds with the reproduction interval of '3: 06 ~ 3: 21'. At this time, the server 100 can extract the nouns and verbs of the third metabolism information. For example, the server 100 may extract the pen as a noun. At this time, the server 100 can calculate the appearance frequency of a noun. For example, the server 100 may calculate the occurrence frequency of a noun such as two pens, and then select a pen with a high frequency word.

The server 100 may compare the similarity degree with respect to the metabolism information of all the paragraphs, and then generate the summary information based on the similarity degree. For example, the server 100 compares the similarity of the first paragraph of the first paragraph, the second paragraph of the second paragraph, and the third paragraph of the metabolism information of all the paragraphs to the metabolism information of the first paragraph, The summary information can be generated based on the similarity between the meta information of the paragraph and the metabolism information of the third paragraph.

The server 100 can extract important phrases by applying sentence rules to important words and combine key phrases included in the same sentence to generate important sentences. At this time, the server 100 may extract, for example, a phrase combined with a noun keyword and a verb as a main sentence, and a phrase combined with a noun and a verb keyword may be excluded from the main sentence. In addition, when a phrase combining a noun keyword and a verb appears continuously in a main sentence, the server 100 can combine the main sentences into one.

For example, the server 100 may generate an important sentence by applying a sentence rule to a main word of the first sentence. The server 100 may be able to determine from the first paragraph the information in the first paragraph from "Starting with a mouse", "Connecting a mouse to a computer", "Mice incorporating a ball", " You can create important sentences such as 'Move to', 'Focus on the rollers', 'Roller is not enough + I borrowed the mouse', 'Pull from the mouse', or 'Connected by spring'.

In another example, the server 100 may generate an important sentence by applying a sentence rule to the main word of the second sentence. The server 100 may use the information in the second paragraph to describe 'Sticky note equipment', 'Sticky note', 'Sticky note to digital use', 'Automatically link with program' Can be generated.

As another example, the server 100 can generate important sentences by applying sentence rules to the main words of the meta information in the third paragraph. The server 100 can generate important sentences such as 'draw a three-dimensional drawing with a pen' or 'a pen can be used by a designer or a building designer' from the dialogue information in the third paragraph.

The server 100 may calculate a weight for the generated important sentence. For example, the server 100 may apply Equation 1 to apply weights to important sentences.

For example, the server 100 may calculate a weight for an important sentence in the first paragraph. In the case of the first important sentence, 'I started with a mouse', the occurrence frequency of 'mouse' is '6' and the weight is

You can earn a total of 12 points. In the case of the second important sentence, 'Connecting the mouse to the computer', the appearance frequency of 'mouse' is '6', the appearance frequency of 'connect' is '2'

A total of 14 points can be obtained. In the case of the third important sentence "When the mouse is embedded in the ball", the appearance frequency of "mouse" is "6", the appearance frequency of "ball" is "2"

A total of 16 points can be obtained. In the case of the fourth important sentence, "How the ball moves, how the mouse moves", "Roller" has a frequency of "5", "Ball" has a frequency of "2" Is '3' and the weight is

A total of 32 points can be obtained. In the fifth important sentence "Focus on the roller", the occurrence frequency of the "roller" is "5" and the weight is

You can earn a total of 10 points. In the case of the sixth important sentence "Roller is insufficient + borrowed mouse", the frequency of occurrence of 'roller' is '5', the frequency of occurrence of 'mouse' is '6'

You can get a total of 22 points. In the case of the seventh important sentence, 'from the mouse', the appearance frequency of 'mouse' is '6' and the weight is

You can earn a total of 12 points. In the case of the 8th important sentence, 'connected by spring', the appearance frequency of 'spring' is '1', the appearance frequency of 'connect' is '2'

You can earn a total of 4 points.

As another example, the server 100 may calculate a weight for an important sentence in the second paragraph. In the case of 'Think Sticky note equipment' which is the first important sentence, the appearance frequency of 'sticky note' is '3' and the weight is

You can earn a total of 6 points. In the second important sentence, 'Sticky note', the 'sticky note' frequency is '3' and the weight is

You can earn a total of 6 points. In the case of the third important sentence, 'Sticky note', 'sticky note' appears as '3' and its weight is

You can earn a total of 6 points. In the case of the fourth important sentence 'automatically linked with the program', the frequency of occurrence of 'linked' is weighted to '2'

You can earn a total of 4 points. In the case of the fifth important sentence, 'automatically linked', the frequency of occurrence of 'linked' is weighted to '2'

You can earn a total of 4 points.

As another example, the server 100 may calculate a weight for important sentences of the meta information of the third paragraph. In the case of the first important sentence, 'draw three dimensions with a pen', the appearance frequency of 'pen' is '2' and the weight is

You can earn a total of 4 points. In the case of the second important sentence, 'Pen is used by designers and architects,' the frequency of appearance of 'pen' is '2' and the weight is

You can earn a total of 4 points.

The server 100 may sum up the weights of all the important sentences to derive an average value, and generate sentences with weights exceeding the average value as summary information. In addition, the server 100 may generate summary information by selecting important sentences having a high weight. For example, the server 100 receives the second important sentence 'connect the mouse to the computer' from the plurality of important sentences of the first paragraph, 'the mouse embeds the ball', the third important sentence, You can create summary information by extracting the sixth important sentence 'Roller is not enough + Mouse has borrowed', which is 'how the roller + the ball moves + how the mouse moves'. As another example, the server 100 may consider the first important sentence 'Sticky note' equipment from the plurality of important sentences in the second paragraph, through the second important sentence 'Sticky note', and the third important sentence You can extract 'Use Sticky note like digital in digital' to generate summary information. As another example, the server 100 may use the first important sentence 'draw a three-dimensional drawing with a pen' from a plurality of important sentences in the third paragraph, and 'use a pen as a designer or a building designer' And generate summary information.

2, the processing unit 220 receives the input for reproducing the moving image at the first speed higher than the normal speed, displays the first summary information according to the first speed while reproducing the moving image at the first speed . In addition, the processing unit 220 may receive an input that reproduces the moving image at a second rate faster than the first rate, and may display the second summary information according to the second rate while reproducing the moving image at the second rate.

The server 100 or the user terminal 200 may calculate the appearance frequencies of nouns and verbs contained in the metabolism information based on the metabolism information for a predetermined section of the moving image and may search for the nouns and verbs based on nouns and verbs 1 summary information and second summary information. For example, the server 100 or the user terminal 200 may generate a plurality of important sentences for a predetermined section of the moving picture, determine the priority of a plurality of important sentences, and determine, based on the determined priority, Information and second summary information. The first summary information may include N high-priority sentences of high priority, and the second summary information may include M high-priority sentences of high priority. At this time, N and M are natural numbers, and N may be greater than M.

At this time, the number of pages of the first summary information displayed for a predetermined section of the moving image may be larger than the number of pages of the second summary information. For example, the number of sentences per page of the first summary information displayed for a predetermined section of the moving picture may be the same as the number of sentences per page of the second summary information. As another example, the number of words of the first summary information displayed for a predetermined section of the moving picture may be larger than the number of words of the second summary information. As another example, the number of sentences of the first summary information displayed for the predetermined section of the moving picture may be larger than the number of sentences of the second summary information.

The user terminal 200 can overlay the first summary information according to the first rate or the second summary information according to the second rate on the moving image.

6A to 6C are views for explaining exposure time of summary information according to a playback speed according to an embodiment of the present invention. The processing unit 220 may display the summary information for the first rate and the summary information for the second rate, respectively. For example, the processing unit 220 may adjust the number of significant sentences depending on the speed. The processing unit 220 arranges the important sentences in the paragraph unit in priority order, and selects only the upper important sentences among the important sentences listed in the priority order. The upper 16, the upper 4, the 16, You can expose important sentences like one. In another example, the processing unit 220 may fix the number of important sentences in a paragraph, and then adjust the number of important sentences to be displayed on one page of summary information according to the speed. In this case, the exposure time per page of the first summary information according to the first speed and the second summary information according to the second speed may be set to be the same.

6A is a diagram for explaining a summary information exposure time at a normal speed. Referring to FIG. 6A, if P1 (610) is a playback time for a motion picture section in a paragraph unit at a normal speed of 1X 600, the exposure time of one page of the summary information 611 to 612 is D1, The number of pages of the summary information exposed to the user is P1 / D1 = Dcnt1, the total number of important sentences in the corresponding section is n, and the number of important sentences exposed in one page of the summary information may be n / Dcnt1. At this time, the summary information of the first paragraph unit may include the important sentence 1 to the important sentence n, and n may be inversely proportional to the speed. In addition, the first page 611 of the summary information for the first paragraph unit may include the important sentence 1 to the important sentence n / D1, and the second page 612 of the summary information for the first paragraph unit It can include important sentence (n / D1) +1 to important sentence 2 * (n / D1).

For example, if P1 (610), which is the moving image reproduction time for the corresponding section at the normal speed of 1x 600, is 16 minutes and D1 which is the exposure time of one page of the summary information 611 to 612 is 1 minute, The number of pages of the summary information exposed for 16 minutes / 1 minute = 16 pages, the number n of important important sentences in the relevant section is 160, and the number of important sentences exposed in one page of the summary information is 160/16 = 10 Lt; / RTI >

6B is a diagram for explaining the summary information exposure time at the first speed. Referring to FIG. 6B, the summary information exposure time can be indicated when the first speed is the normal speed 4 × speed (620). For example, if the moving picture playback time for the corresponding section at the first speed is P1 / 4 (630), the exposure time of one page (631 to 632) of the summary information is D1, and the summary information The number of pages of the summary information is P1 / D1 = Dcnt1, the total number of important sentences in the interval is n, and the number of important sentences exposed per page of summary information may be n / Dcnt1. In this case, the summary information of the first paragraph unit section may include the important sentence 1 to the important sentence n, and n may be 1/4 of the normal speed. In addition, the first page 631 of the summary information for the first paragraph unit period may include the important sentence 1 to the important sentence n / D1, and the second page 632 of the summary information for the first paragraph unit period Can include significant sentences (n / D1) +1 to significant sentences 2 * (n / D1).

For example, if P1 / 4 (630), which is the moving picture playback time of the corresponding section, is 4 minutes at the 4x speed 620, which is the first speed, and D1, which is the exposure time of one page of the summary information 631 to 632, The total number of important sentences in the section is 40, and the number of important sentences exposed in one page of the summary information is 40/4 = 10 Lt; / RTI >

6C is a diagram for explaining the summary information exposure time at the second speed. Referring to FIG. 6C, the summary information exposure time when the second speed is the normal speed 16 times speed (640) can be shown. For example, if the moving picture playback time for the corresponding period is P1 / 16 at the second speed, the exposure time of one page 651 of the summary information is D1, and the number of pages of the summary information exposed for the corresponding interval is P1 / D1 = Dcnt1, the total number of significant sentences in the interval is n, and the number of important sentences exposed per page of summary information can be n / Dcnt1. In this case, the summary information of the first paragraph unit section may include the important sentence 1 to the important sentence n, and n may be 1/16 of the normal speed, 1x speed. In addition, the summary information first page 651 for the first paragraph unit section may include the important sentence 1 to the important sentence n / D1.

For example, if the moving picture playback time p1 / 16 (640) of the corresponding section is 1 minute and the exposure time D1 of one page 651 of the summary information is 1 minute at the 16x speed 640, which is the second speed, The number of pages of summary information in the unit of summary information is 1 minute / 1 minute = 1 page, the number of total important sentences in the relevant section is 10, and the number of important sentences exposed in one page of summary information is 10/1 = 10 . .

FIG. 7 is a diagram showing summary information in a user terminal 200 according to an embodiment of the present invention. Referring to FIGS. 3 and 7, it is assumed that the scene 331 currently being viewed by the user is located in the 'frames 35 to 49' of the third paragraph 330. The user terminal 200 may obtain summary information for the 'frames 15 to 34' 710 of the second paragraph 320, which is the previous paragraph of the third paragraph 330, The summary information for the 'frames 50 to 78' 720 of the first paragraph 340, the summary information for the 'frames 79 to 99' 730 of the fifth paragraph 350 and the summary information for the 'frame 100 To 120 '(740). For example, the user terminal 200 may display the summary information when receiving an input to jump to the second or third period, which is the next section of the first section during the reproduction of the first section.

The user terminal 200 includes a computer readable medium that when executed by a computing device causes the computing device to play back the movie at normal speed and to play the movie at a first rate that is faster than normal Receiving an input to reproduce a moving image at a first speed while displaying first summary information according to a first speed and receiving an input to reproduce the moving image at a second speed higher than the first speed, Lt; RTI ID = 0.0 > 2 < / RTI >

In addition, the user terminal 200 may further comprise a sequence of instructions, when executed by the computing device, to cause the computing device to overlay and display the first summary information and the second summary information over the video.

In addition, when executed by the computing device, the user terminal 200 may further include a sequence of instructions that causes the computing device to have more pages of first summary information displayed for a predetermined period of video than the second summary information page .

In addition, when the user terminal 200 is executed by the computing device, when the computing device receives an input to skip to the second or third section, which is the next section of the first section during reproduction of the first section of the moving image, And to display the summary information of the skipped section while reproducing the second section or the third section.

In addition, the user terminal 200 further includes a sequence of instructions, when executed by the computing device, to cause the computing device to display summary information for a previous section and a next section of the first section during playback of the first section of the video can do.

8 is a flowchart illustrating a method of displaying moving image summary information according to an embodiment of the present invention. The method for displaying the moving image summary information performed by the user terminal 200 according to the embodiment shown in FIG. 8 includes the steps of time series processing in the moving image summary information displaying system 1 according to the embodiment shown in FIG. 1 do. 1, the content already described with respect to the moving picture summary information display system 1 according to the embodiment shown in FIG. 1 is performed by the user terminal 200 according to the embodiment shown in FIG. 8 It also applies to how video summary information is displayed.

In step S810, the user terminal 200 reproduces the moving image at a normal speed. In step S820, the user terminal 200 receives an input for reproducing the moving image at a first speed higher than the normal speed. In step S830, the user terminal 200 reproduces the moving image at the first speed, and displays the first summary information according to the first speed. In step S840, the user terminal 200 receives an input that reproduces the moving image at a second speed higher than the first speed. In step S850, the user terminal 200 reproduces the moving image at the second speed while displaying the second summary information according to the second speed.

The first summary information or the second summary information may be displayed overlayed on the moving image. In this case, the exposure time per page of the first summary information and the second summary information may be set to be the same. For example, the number of pages of the first summary information displayed for the predetermined section of the moving image in the user terminal 200 may be larger than the number of pages of the second summary information. As another example, the number of sentences per page of the first summary information displayed for the predetermined period of the moving picture in the user terminal 200 may be equal to the number of sentences per page of the second summary information. As another example, the number of words of the first summary information displayed for the predetermined section of the moving picture in the user terminal 200 may be larger than the number of words of the second summary information. As another example, the number of sentences of the first summary information displayed for the predetermined section of the moving picture in the user terminal 200 may be larger than the number of sentences of the second summary information.

Although not shown in FIG. 8, the user terminal 200 may further include a step of generating a plurality of important sentences with respect to a predetermined section of the moving picture, and a step of determining priorities of a plurality of important sentences. For example, the first summary information may include N high-priority sentences of high priority, and the second summary information may include M high-priority sentences of high priority. In this case, N and M are natural numbers, and N may be greater than M.

Although not shown in FIG. 8, the user terminal 200 may be configured to calculate the appearance frequency of nouns and verbs included in the metabolism information based on the metabolism information for a predetermined section of the moving image, The first summary information and the second summary information may be generated.

Although not shown in FIG. 8, the user terminal 200 may include a step of receiving an input to jump to a second or a third section, which is a next section of a first section during reproduction of a first section of the moving image, And displaying the summary information of the skipped section while reproducing the three sections.

Although not shown in FIG. 8, the user terminal 200 may further include a step of displaying summary information on a second section, which is different from the first section, during reproduction of the first section of the moving image.

Although not shown in FIG. 8, the user terminal 200 may further include a step of dividing a moving image into a plurality of intervals and displaying summary information of the divided intervals.

In the above description, steps S810 to S850 may be further divided into further steps, or combined in fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

The moving picture summary information display method described with reference to FIG. 8 may also be implemented in the form of a recording medium including instructions executable by a computer such as a program module executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: Server
200: user terminal
210: memory
220: Processing unit

Claims (20)

A method of displaying summary information of a moving picture,
Reproducing the moving image at a normal speed;
Receiving an input that reproduces the moving picture at a first rate faster than the normal rate;
Displaying the first summary information according to the first rate while reproducing the moving picture at the first rate;
Receiving an input for reproducing the moving picture at a second rate higher than the first rate; And
Displaying the second summary information according to the second rate while reproducing the moving picture at the second rate,
And displaying the summary information of the moving picture.
The method according to claim 1,
Wherein the first summary information or the second summary information is overlaid on the moving picture.
The method according to claim 1,
Wherein the first summary information and the second summary information have the same exposure time per page,
Wherein the number of pages of the first summary information displayed for a predetermined section of the moving image is greater than the number of pages of the second summary information.
The method according to claim 1,
Wherein the number of sentences per page of the first summary information displayed for a predetermined section of the moving picture is equal to the number of sentences per page of the second summary information.
The method according to claim 1,
Wherein the number of words of the first summary information displayed for a predetermined section of the moving picture is greater than the number of words of the second summary information.
The method according to claim 1,
Wherein the number of sentences of the first summary information displayed for a predetermined section of the moving picture is greater than the number of sentences of the second summary information.
The method according to claim 1,
Generating a plurality of important sentences for a predetermined section of the moving picture;
Determining a priority of the plurality of important sentences;
Wherein the first summary information includes N high-priority sentences of high priority,
The second summary information includes M important sentences of high priority,
Wherein N and M are natural numbers and N is greater than M.
The method according to claim 1,
Calculating an appearance frequency of a noun and a verb included in the metabolism information based on metabolism information of a predetermined section of the moving image; And
Generating the first summary information and the second summary information based on nouns and verbs having a high appearance frequency;
And displaying the summary information of the moving picture.
A method of displaying summary information of a moving picture,
Receiving an input that skips to a second section, which is a next section of the first section, while reproducing a first section of the moving image; And
Displaying the first summary information for the first section while reproducing the second section
And displaying the summary information of the moving picture.
10. The method of claim 9,
Receiving an input that skips to a third section, which is a next section of the first section, while reproducing a first section of the moving image; And
Displaying the second summary information on the first section and the second section while reproducing the third section
And displaying the summary information of the moving picture.
10. The method of claim 9,
Displaying summary information on a previous section and a next section of the first section while reproducing the first section of the moving picture
And displaying the summary information of the moving picture.
10. The method of claim 9,
Dividing the moving picture into a plurality of sections, and displaying summary information on the divided sections
And displaying the summary information of the moving picture.
1. A computing device for displaying summary information of a moving picture,
Memory, and
A processing unit arranged to interface with the memory,
/ RTI >
The processing unit comprising:
Reproducing the moving picture at normal speed,
Receiving an input for reproducing the moving image at a first speed higher than the normal speed,
Displaying the first summary information according to the first speed while reproducing the moving picture at the first speed,
Receiving an input for reproducing the moving picture at a second rate higher than the first rate,
And to display the second summary information according to the second rate, while reproducing the moving picture at the second rate.
14. The method of claim 13,
The processing unit comprising:
And to display summary information on a second section that is different from the first section while reproducing the first section of the moving picture.
14. The method of claim 13,
The processing unit comprising:
And divide the moving picture into a plurality of intervals and display summary information for each of the divided intervals.
A computer readable medium comprising a sequence of instructions for displaying summary information of a moving image,
When executed by a computing device,
Reproducing the moving picture at normal speed,
Receiving an input for reproducing the moving image at a first speed higher than the normal speed,
Displaying the first summary information according to the first speed while reproducing the moving picture at the first speed,
Receiving an input for reproducing the moving picture at a second rate higher than the first rate,
And reproduces the moving picture at the second speed while displaying the second summary information according to the second speed.
17. The method of claim 16,
And when executed by the computing device, cause the computing device to overlay and display the first summary information and the second summary information on the video.
17. The method of claim 16,
Further comprising a sequence of instructions that when executed by the computing device causes the computing device to have the number of pages of the first summary information displayed for a predetermined period of time greater than the number of pages of the second summary information, Readable medium.
17. The method of claim 16,
When executed by the computing device, when the computing device receives an input to skip to a second section or a third section that is the next section of the first section while reproducing the first section of the moving picture, Further comprising a sequence of instructions for playing back the third section and displaying summary information for the skipped section.
17. The method of claim 16,
Further comprising a sequence of instructions that when executed by the computing device causes the computing device to display summary information for a previous section and a following section during playing the first section of the moving picture, .

Images