JP4270117B2 - Inter-viewer communication method, apparatus and program - Google Patents

Description

  The present invention relates to an inter-viewer communication method, apparatus, and program, and more particularly to an inter-viewer communication method, apparatus, and program for generating or changing a scene section to be communicated from comment information provided by a viewer. Related.

  Conventionally, as a method of communication while viewing a video, there is a system in which a video is divided into small sections called scenes, a bulletin board is installed for each section, and the bulletin board is also switched in conjunction with the switching of the sections (for example, Non-Patent Document 1).

  As a method for dividing a scene section, there is a method of detecting a cut point where image information of a video greatly changes, and manually setting the cut point to set a section having a meaningful unit as a scene section. is there.

Set a section that has a meaningful group in the video as a scene section, and install an electronic bulletin board in the wrong scene section, so that you can watch from the scene you want to see in the middle of the video, and multiple topics in the video If there is, you will be able to induce communication according to the topic you write.
Kazuho Yamada, Kazu Miyagawa, Masashi Morimoto, Haruhiko Kojima “Proposal for Interviewer Communication Method Using Structural Information of Video” Information Processing Society of Japan Research Groupware and Network Service, No.43-007,2001

  However, in the above conventional technique, it is necessary to divide the video into scenes of the same topic in advance in order to activate communication. Even when referring to automatically extracted event information such as the transition of video information and the appearance of audio and music when performing scene division, to determine the segmentation of the scene, grasp the video content and manually correct or check There is a problem that work is indispensable and takes time and effort.

  In order to save time and effort, it is possible to divide the scene at regular time intervals, but in this case, the video content of the scene section is not organized, so the viewer can comment on the electronic bulletin board in scene units. There is a problem that it is difficult to give.

  In addition, the scene section to be set in advance is defined as a section by the service provider's judgment, but after the system is operated, there is a section that is coherent for viewers who participated in communication, If it is different from the preset scene section, it is necessary to change the scene section during operation. In the above-described conventional technique, it is necessary to manually perform maintenance of such a scene section, and there is a problem that it takes time and effort.

  The present invention has been made in view of the above points, and automatically extracts a scene section from a comment received from a viewer. If a scene section has already been set, the comment received from the viewer. It is an object of the present invention to provide an inter-viewer communication method, apparatus, and program that can be appropriately updated based on the above.

  FIG. 1 is an explanatory diagram of the principle of the present invention.

According to the present invention (Claim 1), a comment can be given (registered) when an instruction to give a comment is obtained from a viewer who is watching a video, and a video viewing instruction is obtained from the viewer. In a communication method between video viewers, in which a video and a comment given (registered) by a viewer are synchronized and presented to a terminal device of the viewer,
A comment acquisition step (step 1) for acquiring comment information from a storage means storing comment information including a video, a comment, and at least a time when the comment is given and an identification number of the comment;
A comment grant time grouping step (step 2) for classifying the comments based on the time when the comment was given;
A scene section detecting step (step 3) for defining a scene section of a video on the basis of the first and last time among comment times grouped in the comment grouping step, and storing in a storage means;
A display step (step 4) of reading a comment and a video corresponding to the scene section from the storage means in units of the scene section and displaying them in synchronization with the viewer's terminal device;
I do.

The present invention (claim 2), in advance by dividing the movies image to the scene may be stored and scene section, and comments entered from the viewer with respect to the scene section in the storage means, the comments and the In the communication method between video viewers that synchronize the video and present it to the viewer's terminal device,
A comment acquisition step of acquiring comment information including a scene section stored in the storage means, a comment of the scene section, and a time when the comment is given ;
Against comments in the scene section, and comment attachment time grouping step of classifying the comment based on the time a comment is granted,
Based on the first and last time in the time grouped comment in the comment imparting time grouping step has been applied, the scene section detecting step of defining the scene section of the video,
Based on the scene section defined in the scene section detection step, a scene section dividing step for dividing the previously set scene section stored in the storage means;
A scene section update step for updating the scene section of the storage means using the scene section divided in the scene section division step;
A display step of reading out a comment and a video corresponding to the scene section from the storage means in units of a scene section, and displaying them in a synchronized manner on the viewer's terminal device;
I do.

The present invention (claim 3), advance to divide the movies image to the scene may be stored and scene section, and comments entered from the viewer with respect to the scene section in the storage means, the comments and the In the communication method between video viewers that synchronize the video and present it to the viewer's terminal device,
And comments acquiring the comments of scene section and scene section is stored in the storage means,
A scene section similarity calculation step for calculating the similarity between adjacent scene sections based on the appearance tendency of words in a comment in the scene section;
When the similarity obtained in the scene section similarity calculation step is equal to or greater than a preset value, a scene section integration step for integrating adjacent scene sections;
A scene section update step for updating the scene section of the storage means in the scene section integrated in the scene section integration step;
A display step of reading out a comment and a video corresponding to the scene section from the storage means in units of a scene section, and displaying them in a synchronized manner on the viewer's terminal device;
I do.

The present invention (Claim 4), in advance by dividing the movies image to the scene may be stored and scene section, and comments entered from the viewer with respect to the scene section in the storage means, the comments and the In the communication method between video viewers that synchronize the video and present it to the viewer's terminal device,
A comment acquisition step of acquiring comment information including a scene section stored in the storage means, a comment in the scene section, and a time when the comment is given ;
Against comments in the scene section based on the time a comment is granted, the comment attachment time grouping step of classifying the comment,
Based on the first and last time in the time grouped comment in the comment imparting time grouping step has been applied, the scene section detecting step of defining the scene section of the video,
Based on the scene section defined in the scene section detection step, a scene section dividing step for dividing the previously set scene section stored in the storage means and storing the divided scene section in the memory;
A scene section similarity calculation step for calculating the similarity between adjacent scene sections based on the appearance tendency of the words in the comments in the scene sections stored in the memory;
When the similarity obtained in the scene section similarity calculation step is greater than or equal to a preset value, a scene section integration step for integrating adjacent scene sections;
A scene section update step for updating the scene section of the storage means in the scene section integrated in the scene section integration step;
A display step of reading out a comment and a video corresponding to the scene section from the storage means in units of a scene section, and displaying them in a synchronized manner on the viewer's terminal device;
I do.

  FIG. 2 is a principle configuration diagram of the present invention.

According to the present invention (Claim 5), a comment can be given (registered) when an instruction to give a comment is obtained from a viewer who is watching a video, and a video viewing instruction is obtained from the viewer. A video viewer-to-video viewer communication device that synchronizes a video and a comment given (registered) by a viewer and presents it on a viewer terminal device,
Data storage means 2 storing comment information including a video, a comment, and at least a time when the comment is given and an identification number of the comment;
Comment acquisition means 3 for acquiring comment information from the data storage means;
Comment giving time grouping means 41 for classifying comments based on the time when the comment was given;
A scene section detecting means 42 for defining a scene section of a video with reference to the first and last time among the comment times grouped by the comment giving time grouping means 41, and storing it in the data storage means;
Display unit 1 that reads out a comment and a video corresponding to the scene section from the storage unit in units of a scene section and displays them in synchronism with the terminal device 10 of the viewer;
Have

The present invention (Claim 6), in advance by dividing the movies image to the scene may be stored and scene section, and comments entered from the viewer with respect to the scene section in the storage means, the comments and the An inter-viewer communication device that synchronizes video and presents it to a viewer's terminal device,
Data storage means for storing the video divided for each scene, the scene section, the comments of the viewer input to the scene section;
Comment acquisition means for acquiring comment information including a scene section stored in the data storage means, a comment in the scene section, and a time when the comment is given ;
Against comments in the scene section based on the time a comment is granted, the comment attachment time grouping means for classifying the comment,
A scene section detecting means for defining a scene section of a video on the basis of the first and last time among the times when the comments grouped by the comment giving time grouping means are given ;
A scene section dividing means for dividing the previously set scene section stored in the data storage means based on the scene section defined by the scene section detecting means;
A scene section updating means for updating the scene section of the data storage means using the scene section divided by the scene section dividing means;
Display means for reading a comment and a video corresponding to the scene section from the data storage means in units of scene sections, and displaying them in synchronization with the viewer's terminal device;
Have

The present invention (Claim 7), in advance by dividing the movies image to the scene may be stored and scene section, and comments entered from the viewer with respect to the scene section in the storage means, the comments and the An inter-viewer communication device that synchronizes video and presents it to a viewer's terminal device,
Data storage means for storing the video divided for each scene, the scene section, the comments of the viewer input to the scene section;
And comments acquisition means for acquiring a comment in the scene section, and the scene section is stored in the data storage means,
A scene interval similarity calculating means for calculating a similarity between adjacent scene intervals based on the appearance tendency of words in a comment in the scene interval;
When the similarity obtained by the scene section similarity calculation means is equal to or greater than a preset value, scene section integration means for integrating adjacent scene sections;
A scene section update means for updating the scene section of the data storage means in the scene section integrated by the scene section integration means;
Display means for reading a comment and a video corresponding to the scene section from the data storage means in units of scene sections, and displaying them in synchronization with the viewer's terminal device;
Have

The present invention (claim 8), leave divides Film image to the scene may be stored and scene section, and comments entered from the viewer with respect to the scene section in the storage means, the comments and the An inter-viewer communication device that synchronizes video and presents it to a viewer's terminal device,
Data storage means for storing the video divided for each scene, the scene section, the comments of the viewer input to the scene section;
Comment acquisition means for acquiring comment information including a scene section stored in the data storage means, a comment in the scene section, and a time when the comment is given ;
Against comments in the scene section, and comment attachment time grouping means for classifying the comment based on the time a comment is granted,
Based on the first and last time in the time grouped comment in the comment imparting time grouping means is assigned, and a scene section detecting means for defining the scene section of the video,
Based on the scene section defined by the scene section detecting means, the scene section dividing means for dividing the previously set scene section stored in the data storage means and storing the divided scene section in the memory;
A scene section similarity calculating means for calculating the similarity between adjacent scene sections based on the appearance tendency of words in comments in the scene sections stored in the memory;
When the similarity obtained by the scene section similarity calculation means is equal to or greater than a preset value, scene section integration means for integrating adjacent scene sections;
A scene section update means for updating the scene section of the data storage means in the scene section integrated by the scene section integration means;
Display means for reading a comment and a video corresponding to the scene section from the data storage means in units of scene sections, and displaying them in synchronization with the viewer's terminal device;
Have

  According to the present invention (claim 9), a comment can be given (registered) when an instruction to give a comment is obtained from a viewer who is watching a video, and a video viewing instruction is obtained from the viewer. A video viewer-to-viewer communication program that synchronizes a video and a comment given (registered) by the viewer and presents the video to a viewer's terminal device, for realizing the video viewer-to-viewer communication method according to claim 1. This program causes the computer to execute the process.

The present invention (claim 10), previously divided the movies image to the scene, and scene periods may be stored and comments entered from the viewer with respect to the scene section in the storage means, the comment said An inter-viewer communication program that is presented to a viewer's terminal device in synchronization with an image,
A program for causing a computer to execute processing for realizing the video viewer communication method according to claim 2.

  As described above, according to the present invention, in a communication system linked with video viewing, it is possible to automatically define a scene section from a comment received from a viewer, and a scene section is already set. If it is, it is possible to update appropriately, so that it is possible to save time and time for dividing the video into scene sections in advance.

  In addition, it is not necessary to perform maintenance for scene segment changes while operating a communication system linked to video viewing.

  In addition, since the scenes are appropriately segmented from the viewer's viewpoint, the scenes and comments necessary for the viewer will be more focused, and the desired scene will be understood while viewing the video and viewing the comment list. It becomes easy to search.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 3 shows a configuration of a communication apparatus according to an embodiment of the present invention. The communication apparatus shown in the figure includes an inter-viewer communication unit 1, a data storage unit 2, a comment acquisition unit 3, a scene segment detection unit 4 by comment analysis, a scene segment information update unit 5, and a setting file 6.

  The data storage unit 2 includes a video file that stores video, a comment information management table that stores information about comments given by viewers, and a scene section information table that manages information about scene sections. In this embodiment, the comment information is managed in the comment information management table as shown in FIG. 4, and the comment identification number, the time when the comment is given, the name of the comment giver, the comment content, the comment type (first Or a comment (thread) that is a reply to someone's comment). As shown in FIG. 5, the scene section information is managed in a scene section information table, and includes a scene ID, a scene start time, a scene end time, and a comment given within the scene start time-scene end time. Comment identification number.

  The setting file 6 stores the scene section information (scene ID, scene start time, scene end time) when the scene section information exists in the data storage unit 2, and when there is no scene section information, “NULL” is stored.

  The inter-viewer communication unit 1 presents the video from the data storage unit 2 in synchronization with the comment received from the viewer. Here, with reference to the setting file 6, when there is scene section information for the target video (scene start time, scene end time), it is determined that there is scene section information in the data storage unit 2, A list of comments given to the scene section together with a representative image of the video in the scene section from the data storage unit 2, for example, the first frame image of the scene section, and what scene sections exist, and each scene Make it possible to see what kind of comments are given to the section. When the viewer selects a scene section, the data for the section is searched for and reproduced from the data storage unit 2 based on the scene section, and a comment given to the section is displayed.

Also, when you enter a comment by carrying out the instructions of the comment attachment while watching the viewer, along with the scene section to be subjected to the comment input, it accepts a comment that has been input. The accepted comment is written in the data storage unit 2 together with the scene ID.

  The comment acquisition unit 3 reads comment information from the comment information management table in the data storage unit 2 at a preset timing, analyzes the read comment information, and outputs the comment information to the scene section detection unit 4.

  The scene section detection unit 4 detects a scene section from the comment information acquired from the comment acquisition unit 3 and outputs the detected scene section to the scene section information update unit 5.

  The scene section information update unit 5 updates the scene section information table stored in the data storage unit 2 according to the scene section received from the scene section detection unit 4.

  With the above configuration, the communication function of the video viewer is provided according to the scene section detected by the scene section detection unit 4 by comment analysis.

  FIG. 6 is a flowchart showing an outline of the operation of the communication apparatus according to the embodiment of the present invention.

  Step 101) The inter-viewer communication unit 1 refers to the setting file 6.

  Step 102) By referring to the setting file 6, it is determined whether a scene section is already set in the data storage unit 2. For example, in the setting file 6, if set, scene section information (for example, scene ID, scene start time / end time), a flag indicating that it is set (for example, “1”), etc. Is set. If it is not set, “NULL” or a flag indicating that it is not set (for example, “0”) is set. If it is not set, the process proceeds to step 103, and the process of the first embodiment to be described later is performed. If it is set, the process proceeds to step 110, and the processes of the second to fifth embodiments described later are performed.

  Step 103) As a first embodiment, the video and comments stored in the data storage unit 2 are synchronized and displayed on the user terminal.

  Step 104) When a comment is input from the viewer, the comment is stored in the data storage unit 2.

  Step 105) The comment acquisition unit 3 acquires and analyzes the comment information from the data storage unit 2, and passes the analysis result to the scene section detection unit 4.

  Step 106) The scene section detector 4 detects a scene section based on the acquired analysis result. Detailed processing will be described in the first embodiment.

  Step 107) The scene section information update unit 5 stores the detected scene section in the data storage unit 2.

  Step 108) The scene section information update unit 5 sets a flag or scene section information indicating that the scene section is set in the data storage unit 2 in the setting file 6.

  Step 109) The inter-viewer communication unit 1 displays the video and the comment corresponding to the scene section from the data storage unit 2 on the user terminal.

  Step 110) When a scene section exists in the data storage unit in Step 102, a list of representative videos of the scene section is displayed.

  Step 111) When a comment is input from the viewer, the comment is stored in the data storage unit 2 in association with the scene section.

  Step 112) The comment acquisition unit 3 acquires and analyzes the comment information from the data storage unit 2, and passes the analysis result to the scene section detection unit 4.

  Step 113) The scene section detection unit 4 detects a scene section based on the acquired analysis result. Detailed processing will be described in the second to fifth embodiments.

  Step 114) The scene section information update unit 5 stores the detected scene section in the data storage unit 2. Control goes to step 109.

[First Embodiment]
In this embodiment, the scene section information is not set in the data storage unit 2, and a process of newly detecting a scene section and setting it in the data storage unit 2 will be described.

  FIG. 7 is a flowchart of processing of the scene section detection unit based on comment analysis according to the first embodiment of this invention.

  The operation shown in the figure is that a scene section is undefined, that is, the scene section information managed by the data storage unit 2 is newly analyzed by comment analysis from the state where the beginning and end of the video are one scene. This defines a simple scene section.

  Step 201) The scene section detection unit 4 reads the time when the comment is given from the comment information management table of the data storage unit 2, and classifies the comment. At this time, with respect to the comments excluding those whose comment type is “Reply”, a process in which a given time is shorter than a preset value is set as the same group. At this time, processing may be added so that the time interval between comments decreases as the number of replies and the total number of comment characters increases. In addition, when the number of comments in each classified group is less than or equal to a preset value, by deleting the group, when the number of comments for the entire video is small, it is divided into many short sections. Can be prevented.

  The scene section detection unit 4 manages N comment groups in the memory with numbers n = 1, 2,...

  Step 202) With n = 1, the scene sections corresponding to the first group are sequentially detected.

  Step 203) The time ts (n) given first is detected among the comments belonging to the group number n.

  Step 204) The time te (n) given last is detected among the comments belonging to the group number n.

  Step 205) As a margin when defining the scene section, a margin time a for the start of the section and a margin time b for the end of the section are set in advance, and time ts (n) -a and time te (n) + b Is detected as the scene section time.

  Step 206) It is determined whether all comment groups have been processed. If so, the process proceeds to step 205. If not, the process of step 207 is executed.

  Step 207) Processing for the next comment group is performed.

  Step 208) When the scene section time setting processing is performed for all comment groups, the following sections are detected as scene sections.

The section from the beginning of the video time to the time ts (1) -a;
From time te (n) −a to time te (n) + b (n = 1, 2,..., N−1)
From time te (n) + b to time ts (n + 1) -a (n = 1, 2,..., N−1)
From time ts (N) -a to time te (N) + b
FIG. 8 shows how the scene section is defined by the above processing from the time te (N) + b to the end of the video time. In the figure, the comment groups are classified into three, and finally seven scene sections are defined.

  When the scene is defined, the scene section is transferred to the scene section update unit 5, and the scene section update unit 5 updates the scene section information in the data storage unit 2. The scene section update unit 5 assigns a scene ID to each scene obtained above, and identifies the start time (ts) and end time (te) for each scene, and comments within the start time and end time. The number is stored in the scene section information table of the data storage unit 2.

[Second Embodiment]
The configuration of the communication device in the present embodiment is the same as the configuration shown in FIG.

  In the following, a procedure for defining a new scene section by comment analysis when a scene section has already been defined (FIG. 6, Step 102, Yes) will be described.

  FIG. 9 is a flowchart of processing of the scene section detection unit by comment analysis according to the second embodiment of the present invention. In the following processing, operations similar to those in the flowchart shown in FIG. 7 are denoted by the same step numbers and description thereof is omitted.

  Step 301) s = 1 is set for s (s = 1, 2,..., S) which is an identification number of an existing scene section.

  Step 302) The comment information assigned to the scene section with the identification number s is read from the data storage unit 2.

  Step 201) The comment classification process of step 201 in FIG. 7 is performed on the comment information acquired in step 302.

  Step 303) It is determined whether or not the number of classified comment groups is larger than 1. If the number is larger, the process proceeds to Step 202. If not, the process proceeds to Step 305.

  Thereafter, the processing of steps 202, 203, 204, 206, and 207 in FIG. 7 is executed.

Step 304) The scene section s is divided into N sections of the number of comment groups. The separator between the nth and n + 1th scene sections is
te (n) + (ts (n + 1) -te (n)) / 2
And

  Step 305) It is determined whether all existing scene sections have been processed. If so, the entire process is terminated. If not, the process of step 304 is executed.

  Step 306) Perform processing for the next existing scene section.

  FIG. 10 shows how an existing scene section is divided by the processing described above. Since the existing “scene section 2” in the figure has been classified into two comment groups, it is divided as shown in the scene section defined after the end of processing. As described above, when there is a long scene section, it is appropriately divided.

[Third Embodiment]
The configuration of the communication device in the present embodiment is the same as the configuration shown in FIG.

  In the following, a procedure for defining a new scene section by comment analysis when a scene section has already been set (FIG. 6, step 102, Yes) will be described using FIG.

  In the present embodiment, when a section that is the same topic for the viewer is divided into a plurality of sections in the existing scene sections, the scene section detection unit 4 uses the similarities for the sections. Will be described.

  FIG. 11 is a flowchart of processing of the scene section detection unit by comment analysis according to the third embodiment of the present invention.

  Step 401) s = 1 is set for s (s = 1, 2,..., S) which is an identification number of an existing scene section.

  Step 402) The comment information given to the scene sections of the identification numbers s and s + 1 is read from the data storage unit 2.

  Step 403) A morphological analysis is performed on the comment portion of the comment information acquired in Step 402.

  Step 404) From the result of the morphological analysis, the frequency distribution of the noun for the scene section with the identification number s and the frequency distribution of the noun for the scene section with the identification number s + 1 are obtained. It is also effective to count similar nouns together by preparing dictionary data of nouns with similar meaning when obtaining the frequency distribution.

  Step 405) For the nouns with the above frequency set in advance, the number ns (s, s + 1) of nouns common in the scene section of the identification number s and the identification number s + 1 is calculated.

  Step 406) It is determined whether the number of common nouns ns (s, s + 1) is larger than a preset value NS. If it is larger, the process proceeds to step 407. If it is not larger, the process of step 408 is executed.

  Step 407) The scene sections of the identification number s and the identification number s + 1 are integrated into one section.

  Step 408) It is determined whether all existing scene sections existing in the data storage unit 2 have been processed. If so, the entire process is terminated. If not, the process of step 409 is executed.

  Step 409) Perform processing for the next existing scene section.

  An example in which existing scene sections are integrated by the above processing is shown in FIG. An example is shown in which it is determined that the existing “scene section 2” and “scene section 3” have a high degree of similarity, and these are integrated. As described above, when a section that is the same topic for the viewer is divided into a plurality of sections in the existing scene section, these sections are integrated.

[Fourth Embodiment]
The configuration of the communication device in the present embodiment is the same as the configuration shown in FIG.

  In the present embodiment, a scene segment division process and a scene segment integration process performed by the scene segment detection processing unit 4 based on comment analysis will be described. In other words, this is an example in which the scene segment division of the second embodiment is combined with the scene segment integration process of the third embodiment.

  The scene section is divided by the process described above with reference to FIG. 9, the divided scene sections are stored in the memory, and the scene sections stored in the memory after the division processing are performed are illustrated in FIG. The scene section integration process shown in FIG.

  With this process, if there are sections in the existing scene section that are divided into a plurality of sections that are the same topic as the section having a long scene section for the viewer, these sections are divided and integrated. Become so.

  Here, what is important is that sections having the same topic are always defined as the same scene section by performing a process of integrating the scene sections later based on the comment content.

[Fifth Embodiment]
FIG. 13 shows the configuration of the communication device in this embodiment. The configuration shown in the figure is a configuration in which a viewer view section storage unit 7 is added to the configuration shown in FIG. 3 of the first embodiment described above.

  In the present embodiment, a scene segment division process and a scene segment integration process performed by the scene segment detection processing unit 4 based on comment analysis will be described.

  When the scene section is already defined as described above, when it is determined that the scene section is divided or integrated in the process of dividing or integrating the existing scene section, the existing scene section is stored as data. The scene section that is held as it is in the section 2 and divided or integrated is stored in the viewer view section storage section 7 as a viewer view section separately.

  Thus, in step 150, the viewer communication unit 1 is set so that the viewer view section is defined in the viewer view section storage unit 7 and the viewer view is replaced with the scene section in accordance with an instruction from the user. In the case where it is done, the viewer view section of the viewer view section storage unit 7 is replaced with the scene section of the data storage unit 2, and the corresponding video and comment are read from the data storage unit 2 and presented.

  Through the process described above, the service provider wants to use the existing scene section in a fixed manner, and when there is a request from the viewer to change to the scene section based on the addition of the comment, Can be satisfied.

  In the first to fifth embodiments, any one of a section from the cut point where the image information in the video changes greatly to the next cut point, a speech section, and a sound generation section is detected as an event section. If the detected scene section overlaps with the event section, the start of the section is changed immediately before the event section, and the end of the section is changed immediately after the end of the event section. Note that an existing technique is used as a method for detecting an event section in a video.

  Moreover, it is also possible to construct | assemble each operation | movement of said 1st-5th embodiment as a program, install and run it in the computer utilized as a communication apparatus, or distribute | circulate through a network.

  The present invention is not limited to the above-described embodiment, and various modifications and applications can be made within the scope of the claims.

  The present invention is applicable to a system that displays scenes and comments in video.

It is a principle block diagram of this invention. It is a principle explanatory view of the present invention. It is a block diagram of the communication apparatus in one embodiment of this invention. It is a flowchart of the scene definition process in one embodiment of this invention. It is a detailed flowchart of the scene definition process in one embodiment of the present invention. It is a figure for demonstrating the state of the multiple scene definition in one embodiment of this invention. It is an example of the scene definition file in one embodiment of this invention. It is a flowchart of the video / comment synchronized playback processing in one embodiment of the present invention. It is a flowchart of the video comment synchronous reproduction | regeneration processing in one embodiment of this invention. It is an example of the comment stored in the user comment memory | storage part in one embodiment of this invention. It is a flowchart of the comment reception process in one embodiment of this invention. It is an example of a screen which acquires the comment with respect to a scene from the user in one embodiment of this invention. It is an example of the judgment method of scene ID at the time of the comment acquisition in one embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 User input terminal 11 Scene definition part 12 Scene definition means, Scene definition registration part 20 Display means, User display terminal 21 Image | video / comment synchronous reproduction | regeneration means, image | comment synchronous comment delivery part 22 User comment reception part 31 Image | video storage means, image | video storage Unit 32 Scene definition information storage unit, scene definition information storage unit 33 User comment storage unit, user comment storage unit

Claims (10)

A comment can be given (registered) when an instruction to give a comment is obtained from a viewer who is watching the video, and a video and a viewer are given (registered) when an instruction to view the video is obtained from the viewer. In the method for communication between video viewers to be synchronized with the comment and presented to the terminal device of the viewer,
A comment acquisition step of acquiring comment information from a storage means storing comment information including a video, a comment, and at least a time when the comment is given and an identification number of the comment;
A comment granting time grouping step for classifying the comments based on the time when the comment was given;
A scene section detecting step of defining a scene section of a video with reference to the first and last time among the comment times grouped in the comment grouping time grouping step, and storing it in the storage means;
Displaying a comment and video corresponding to the scene section from the storage means in units of the scene section, and displaying them in synchronization with the viewer terminal device;
A method for communicating between video viewers, characterized by: The movies image previously divided into scenes, a scene section may be stored and comments entered from the viewer with respect to the scene section in the storage unit, the viewer by synchronizing the comments and the video terminal In the communication method between video viewers presented on the device,
A comment acquisition step of acquiring comment information including a scene section stored in the storage means, a comment of the scene section, and a time when the comment is given ;
And comment attachment time grouping step of classifying the comments above with respect to comments scene section based on the time the comment is applied,
Based on the first and last time in the time that comments that are grouped by the comment attachment time grouping step has been applied, the scene section detecting step of defining the scene section of the video,
Based on the scene section defined in the scene section detecting step, a scene section dividing step for dividing the previously set scene section stored in the storage means;
A scene section update step for updating the scene section of the storage means using the scene section divided in the scene section dividing step;
Displaying a comment and video corresponding to the scene section from the storage means in units of the scene section, and displaying them in synchronization with the viewer terminal device;
A method for communicating between video viewers, characterized by: The movies image previously divided into scenes, a scene section may be stored and comments entered from the viewer with respect to the scene section in the storage unit, the viewer by synchronizing the comments and the video terminal In the communication method between video viewers presented on the device,
And comments acquiring the comments in the scene section and scene section stored in said storage means,
A scene interval similarity calculating step for calculating a similarity between adjacent scene intervals based on the appearance tendency of words in the comments in the scene interval;
When the similarity obtained in the scene section similarity calculation step is equal to or greater than a preset value, a scene section integration step for integrating adjacent scene sections;
A scene section update step of updating the scene section of the storage means in the scene section integrated in the scene section integration step;
Displaying a comment and video corresponding to the scene section from the storage means in units of the scene section, and displaying them in synchronization with the viewer terminal device;
A method for communicating between video viewers, characterized by: The movies image previously divided into scenes, a scene section may be stored and comments entered from the viewer with respect to the scene section in the storage unit, the viewer by synchronizing the comments and the video terminal In the communication method between video viewers presented on the device,
A comment acquisition step of acquiring comment information including a scene section stored in the storage means, a comment in the scene section, and a time when the comment is given ;
The relative comments scene section based on the time the comment is granted, the comment attachment time grouping step of classifying the comment,
Based on the first and last time in the time that comments that are grouped by the comment attachment time grouping step has been applied, the scene section detecting step of defining the scene section of the video,
A scene section dividing step of dividing a previously set scene section stored in the storage means based on the scene section defined in the scene section detecting step, and storing the divided scene section in a memory; ,
A scene section similarity calculation step for calculating a similarity between adjacent scene sections based on the appearance tendency of words in the comments in the scene section stored in the memory;
When the similarity obtained in the scene section similarity calculation step is equal to or greater than a preset value, a scene section integration step for integrating adjacent scene sections;
A scene section update step of updating the scene section of the storage means in the scene section integrated in the scene section integration step;
Displaying a comment and video corresponding to the scene section from the storage means in units of the scene section, and displaying them in synchronization with the viewer terminal device;
A method for communicating between video viewers, characterized by: A comment can be given (registered) when an instruction to give a comment is obtained from a viewer who is watching the video, and a video and a viewer are given (registered) when an instruction to view the video is obtained from the viewer. A viewer-to-viewer communication device that synchronizes the comment and presents it to the viewer's terminal device,
Data storage means storing comment information including a video, a comment, and at least a time when the comment is given and an identification number of the comment;
Comment acquisition means for acquiring comment information from the data storage means;
Comment giving time grouping means for classifying the comments based on the time when the comments were given;
A scene section detecting means for defining a scene section of a video with reference to the first and last time among the giving times of the comment group grouped by the comment giving time grouping means, and storing it in the data storage means;
Display means for reading the comment and video corresponding to the scene section from the storage means in units of the scene section, and displaying them in synchronism with the terminal device of the viewer;
A communication device between video viewers, comprising: The movies image previously divided into scenes, a scene section may be stored and comments entered from the viewer with respect to the scene section in the storage unit, the viewer by synchronizing the comments and the video terminal A communication device between video viewers to be presented to the device,
Data storage means for storing the video divided for each scene, the scene section, the comments of the viewer input to the scene section;
Comment acquisition means for acquiring comment information including a scene section stored in the data storage means, a comment in the scene section, and a time when the comment is given ;
The relative comments scene section based on the time the comment is granted, the comment attachment time grouping means for classifying the comment,
A scene section detecting means for defining a scene section of a video with reference to the first and last time among the times when the comments grouped by the comment giving time grouping means are given ;
A scene section dividing means for dividing a previously set scene section stored in the data storage means based on the scene section defined by the scene section detecting means;
A scene section updating means for updating the scene section of the data storage means using the scene section divided by the scene section dividing means;
Display means for reading out the comment and video corresponding to the scene section from the data storage means in units of the scene section, and displaying them in synchronism with the terminal device of the viewer;
A communication device between video viewers, comprising: The movies image previously divided into scenes, a scene section may be stored and comments entered from the viewer with respect to the scene section in the storage unit, the viewer by synchronizing the comments and the video terminal A communication device between video viewers to be presented to the device,
Data storage means for storing the video divided for each scene, the scene section, the comments of the viewer input to the scene section;
And comments acquisition means for acquiring a comment of the data scene section in the storage means is stored and within the scene section,
A scene interval similarity calculating means for calculating a similarity between adjacent scene intervals based on the appearance tendency of words in the comments in the scene interval;
When the similarity obtained by the scene section similarity calculation means is equal to or greater than a preset value, a scene section integration means for integrating adjacent scene sections;
A scene section update means for updating a scene section of the data storage means in the scene section integrated by the scene section integration means;
Display means for reading out the comment and video corresponding to the scene section from the data storage means in units of the scene section, and displaying them in synchronism with the terminal device of the viewer;
A communication device between video viewers, comprising: The movies image previously divided into scenes, a scene section may be stored and comments entered from the viewer with respect to the scene section in the storage unit, the viewer by synchronizing the comments and the video terminal A communication device between video viewers to be presented to the device,
Data storage means for storing the video divided for each scene, the scene section, the comments of the viewer input to the scene section;
Comment acquisition means for acquiring comment information including a scene section stored in the data storage means, a comment in the scene section, and a time when the comment is given ;
And comment attachment time grouping means for classifying the comments above with respect to comments scene section based on the time the comment is applied,
Based on the first and last time in the time that comments that are grouped by the comment attachment time grouping means is assigned, and a scene section detecting means for defining the scene section of the video,
Scene section dividing means for dividing a previously set scene section stored in the data storage means and storing the divided scene section in a memory based on the scene section defined by the scene section detecting means When,
Scene section similarity calculation means for calculating the similarity of adjacent scene sections based on the appearance tendency of words in the comments in the scene sections stored in the memory;
When the similarity obtained by the scene section similarity calculation means is equal to or greater than a preset value, a scene section integration means for integrating adjacent scene sections;
A scene section update means for updating a scene section of the data storage means in the scene section integrated by the scene section integration means;
Display means for reading out the comment and video corresponding to the scene section from the data storage means in units of the scene section, and displaying them in synchronism with the terminal device of the viewer;
A communication device between video viewers, comprising: A comment can be given (registered) when an instruction to give a comment is obtained from a viewer who is watching the video, and a video and a viewer are given (registered) when an instruction to view the video is obtained from the viewer. A viewer-to-viewer communication program that synchronizes the comment and presents it to the viewer's terminal device,
A computer-readable communication program for causing a computer to execute processing for realizing the communication method between video viewers according to claim 1. The movies image previously divided into scenes, a scene section may be stored and comments entered from the viewer with respect to the scene section in the storage unit, the viewer the comments in synchronization with the video terminal A communication program between video viewers to be presented on a device,
5. A program for communication between video viewers, which causes a computer to execute processing for realizing the communication method between video viewers according to claim 2.

Images