JP2006155384A - Video comment input/display method and device, program, and storage medium with program stored - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prescribe a video recorded/downloaded/manufactured by an individual, and to share comments by synchronizing the time of the prescribed video for realizing communication. <P>SOLUTION: This video comment input/display method is provided to acquire a video for realizing communication selected by a user, and to calculate a video identifier for prescribing the video, and to calculate a synchronizing place identifier for realizing temporal synchronization between videos, and to acquire a designated video time for viewing/comment, and to express the designated video time by using the video identifier and the synchronizing place identifier, and to acquire comment input by the user, and to store the comment and a video virtual time when the comment is input in a storage means by linking them with each other, and to acquire the comment information associated with the acquired video time from the storage means by using the video temporary time, and to display it at a display means. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a video comment input / display method and apparatus, a program, and a storage medium storing the program, and in particular, in a communication method via video, a video that a user is viewing and its location are assigned to the video. The present invention relates to a video comment input / display method and apparatus, a program, and a storage medium storing the program, which enable communication between unspecified videos held by individual users by specifying using an identifier.

  In recent years, a communication method using video has attracted attention in communication between users performed on a network.

  For example, there is a method in which a plurality of users can simultaneously communicate by writing comments in real time on a bulletin board on a network while simultaneously watching a specific TV program (in the example, a soccer program) (see Non-Patent Document 1, for example). ). Although there is a restriction that the same program must be watched at the same time, it is possible to communicate with a distant user while sharing the impression at that time as if watching a TV program with a family. High utility value. Such a communication method can be said to be a method that takes advantage of the characteristic of the network that “anywhere the user is present” is utilized.

On the other hand, it is also possible to use a method that centralizes communication via video on the network by taking a step further from the communication method combining different media such as “real-time TV video” and “bulletin board on the network” as described above. It's getting on. For example, it is a system that stores and displays a video distributed from a video distribution server and a comment input by a user in synchronization. In this system, in accordance with the user's video viewing, comments on the DB associated with the time on the video are synchronously displayed on the user side one after another. In addition, comments input during video viewing are stored on the DB in association with the time on the input video, and are displayed synchronously to the user viewing the same time of the video. While viewing the video, the user sequentially browses the comments of other users associated with the time on the video that changes every moment, and also inputs the comments and presents the opinions to other users, allowing the user to view the video. To communicate with each other. The feature of the method of communication using this system can be said to be “no choice of user's location” and “no choice of time for the user to communicate”. Since the video and comments are stored on the server side, the user can view the video and comments at any time by connecting to the server and can input comments. In a communication method that requires real-time characteristics, the content of video and comments changes every moment, so commenting on past comments is limited in order to prevent communication flow. However, when the system as described above is used, for example, since a comment can be made on a comment input one week ago, the user can achieve communication with less time constraints (for example, non-patent) Reference 2).
http://soccer.pos.to/ Kazuho Yamada, Kazu Miyagawa, Masashi Morimoto, Haruhiko Kojima “Proposal for Interviewer Communication Method Using Structural Information of Video” Information Processing Society of Japan Research Groupware and Network Service, No.43-007,2001

  In recent years, with the improvement in performance of personal computers (PCs), an increasing number of users own and store unspecified videos on PCs. On the other hand, in the conventional technology as described above, in order to display the video and the comment synchronously, the video being viewed by the user and the location thereof are managed in a unified manner. Therefore, the user must use specific video such as video distributed from the distribution server and video that can be downloaded from the public site. Even if he wants to communicate about unspecified video personally held, Communication is not possible unless the video is centrally managed on the system.

  Such a problem can be avoided by using a method of registering the user's video on the server side. However, since all the videos that only a few people want to share are registered, the server side is forced to have a very large capital investment cost and a load due to video distribution.

  In addition, the above problems are also related to copyrights and the like, and use that deviates from the purpose of individual viewing is impossible. Therefore, it is not realistic to register and publish all unspecified videos on the server side. Absent. Therefore, it is necessary to share only the comment information for the video without releasing the video held by the individual.

  However, the video held by each individual may have been edited, such as being partially cut according to the preference of the individual, and it is necessary to specify “which part of which video is the comment” It is difficult to communicate uniformly about a certain video.

  The present invention has been made in view of the above points, and in a situation where communication is performed via video, the video being viewed by the user and the location serving as a reference point are specified using an identifier assigned to the video. Thus, even in an unspecified video held by each user, a video comment input / display method and apparatus, a program, and a program storing the program that enable conventional communication between videos determined to be the same video The purpose is to provide a medium.

  FIG. 1 is a principle configuration diagram of the present invention.

The present invention (Claim 1) is a video comment input / display capable of sharing a comment between videos determined as the same video even in an unspecified video held by each user in communication related to video on a network. A device,
Video acquisition means 103 for acquiring video for communication selected by the user;
Video identifier calculating means 104 for calculating a video identifier for specifying the acquired video;
Synchronization part identifier calculating means 105 for calculating a synchronization part identifier for temporal synchronization between videos;
Video time designating means 107 for obtaining the time (video time) on the video to be viewed / commented designated by the user;
Video virtual time calculation means 108 for expressing the designated video time as relative time using the video identifier and the synchronization part identifier;
Comment information input means 109 for acquiring a comment input by the user;
Comment information / video virtual time storage means 110 for associating the comment with the video virtual time when the comment calculated by the video virtual time calculation means 108 is input and storing it in the comment information / video virtual time database 111;
Comment information acquisition means 112 for acquiring comment information related to the video time acquired in the video time specification procedure from the comment information / video virtual time database 111 using the video virtual time;
Comment information display means 113 for displaying the comment information acquired by the comment information acquisition means 112 on the display means.

  In the present invention, by using these means, for example, partial editing (cutting), video of different encoding methods, or main broadcasting and re-broadcasting are performed on videos held by individual users. Even when recording, it can be determined that the same video is used by using the video identifier, and the video time when the comment is input can be appropriately calculated by using the synchronization part identifier and the video virtual time. Even in the case of the video as mentioned above, it is possible to communicate without problem between users.

Further, the present invention (Claim 2), in the synchronization part identifier calculating means 105,
When calculating the synchronization location identifier, the synchronization location identifier is calculated using the video feature amount.

  In the present invention (Claim 3), the video identifier calculation unit 104 uses the video feature amount when calculating the video identifier.

In the present invention (claim 4), the comment information acquisition means 112
In the comment information / video virtual time storage means, the comment information is acquired by using the comment information stored in the comment information / video virtual time database 111 together.

  FIG. 2 is a diagram for explaining the principle of the present invention.

The present invention (Claim 5) is a video comment input / display capable of sharing a comment between videos determined as the same video even in an unspecified video held by each user in communication related to video on a network. A video comment input / display method in the apparatus,
A video acquisition procedure (step 1) for acquiring a video for communication selected by the user;
A video identifier calculation procedure (step 2) for calculating a video identifier for specifying the acquired video;
A synchronization location identifier calculation procedure (step 3) for calculating a synchronization location identifier for temporal synchronization between videos;
A video time designation procedure (step 4) for acquiring a time (video time) on the video to be viewed / commented designated by the user;
A video virtual time calculation procedure (step 5) for expressing the designated video time as a relative time using the video identifier and the synchronization part identifier;
A comment information input procedure (step 6) for acquiring a comment input by the user;
Comment information / video virtual time accumulation procedure (step 7) for associating the comment with the video virtual time inputted in the video virtual time calculation procedure (step 5) and accumulating it in the storage means;
A comment information acquisition procedure (step 8) for acquiring comment information related to the video time acquired in the video time specification procedure from the storage means using the video virtual time;
A comment information display procedure (step 9) for displaying the comment information acquired in the comment information acquisition procedure on the display means is performed.

  By performing these procedures, first, the video to be communicated can be specified by using the video identifier. The video identifier is an identifier for discriminating that the original video source is the same in a partially edited video, a main broadcast video / rebroadcast video in TV broadcasting, a video of a different encoding method, or the like. Next, by using the synchronization location identifier and the video virtual time, the time on the currently viewed video can be specified. For example, in the case of a TV video that has been recorded from the middle due to inadequate setting time or a video that has been edited, even if the time recorded on the video file is different, the synchronization location identifier and video virtual time should be used The time on the video that is not affected by the partial omission is specified, and a comment associated with the video time can be acquired. For this reason, comments can be input and displayed at appropriate locations in the edited video.

  Therefore, if comments are input and displayed based on these procedures, comments can be appropriately shared between videos that are determined to be the same video even for unspecified videos owned by individual users, and smoothly between users. Communication is planned.

Further, the present invention (Claim 6), in the synchronization location identifier calculation procedure,
When calculating the synchronization location identifier, the synchronization location identifier is calculated using the video feature amount.

  When calculating the synchronization part identifier as described in the claim, by calculating the synchronization part from the image feature amount of the video, for example, when the synchronization part cannot be calculated skillfully in the video that has been accumulated and edited in the past Since the synchronization part can be specified by using the image feature amount such as the cut point, it is possible to display and input an appropriate comment in various videos.

  Further, according to the present invention (Claim 7), the video feature amount is used when calculating the video identifier in the video identifier calculation procedure.

  As described in the claims, when calculating the video identifier, by calculating the video identifier from the video feature amount calculated from the entire video, for example, even in a video edited by connecting a plurality of videos, By calculating the video feature amount for each location and obtaining the video identifier, each partial video can be specified, and communication using a video that has been subjected to complicated editing becomes possible.

  Further, according to the present invention (claim 8), in the comment information acquisition procedure, the comment information is acquired by using the comment information stored in the storage means in the comment information / video virtual time storage procedure.

  If there is ambiguity in the comment information specified by the video identifier or the synchronization part identifier by acquiring the comment information together with the accumulated comment information as in the claim, for example, the specified video Since it is possible to determine that a reply comment for a comment already determined to be related to the virtual section is a comment related to the video virtual time, the comment can be acquired more accurately and stable communication is possible.

The present invention (Claim 9) provides a server device and a client device capable of sharing a comment between videos determined to be the same video even in unspecified video held by individual users in communication related to video on a network. A video comment input / display system consisting of:
The client device
Video acquisition means for acquiring video for performing communication selected by the user;
Video identifier calculating means for calculating a video identifier for specifying the acquired video;
Synchronization location identifier calculating means for calculating a synchronization location identifier for temporal synchronization between videos;
Video time designation means for obtaining a time (video time) on the video for viewing / commenting designated by the user;
Video virtual time calculating means for expressing the specified video time as a relative time using a video identifier and a synchronization part identifier;
Comment information input means for obtaining a comment input by the user;
Comment information / video virtual time transfer means for associating the comment with the video virtual time in which the comment calculated in the video virtual time calculation procedure is input and transmitting it to the server device;
Comment information display means for displaying the comment information received from the server device on the display means,
Server device
A comment information / video virtual time database for storing information associated with the comment received from the client device and the video virtual time when the comment is input;
Comment information acquisition means for acquiring comment information related to the video time acquired in the video time specification procedure from the comment information / video virtual time database using the video virtual time, and transmitting the comment information to the client device.

  According to the present invention (Claim 10), the synchronization part identifier calculating means of the client device of the video comment input / display system according to claim 9 uses the video feature amount to calculate the synchronization part identifier when calculating the synchronization part identifier. Is calculated.

  The present invention (Claim 11) uses the video feature amount when calculating the video identifier in the video identifier calculation means of the client device of the video comment input / display system according to Claim 9 or 10.

  Further, according to the present invention (claim 12), the comment information acquisition means of the server device of the video comment input / display system according to claim 9 uses the comment information accumulated in the comment information / video virtual time database in combination. Get information.

The present invention (Claim 13) is a video comment input / display capable of sharing a comment between videos determined to be the same video even in an unspecified video held by each user in communication related to video on a network. A program,
A program for causing a computer to execute processing for realizing the video comment input / display method according to claim 5.

The present invention (Claim 14) is a video comment input / display capable of sharing a comment between videos determined to be the same video even in an unspecified video held by individual users in video-related communication on a network. A storage medium storing a program,
A storage medium storing a program for causing a computer to execute processing for realizing the video comment input / display method according to claim 5.

  As described above, according to the present invention, when communication is performed via a video on a network, only a comment is shared between users who have the same content even if each user has a video. Therefore, it is possible to perform communication for a wide range of videos compared to the conventional method.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  In the following description of the embodiments of the present invention, video (video content) is not limited to content including video information and sound information, and any content including at least image information is referred to as video.

  The comments are not limited to character information, but include information that can be used for communication, such as URLs pointing to contents on the Web and images expressing emotions.

[First Embodiment]
The video comment input / display system according to the present embodiment is a system in which individual users accumulate videos, show comments written about those videos to other users, and communicate about the videos.

  For the sake of simplicity of explanation, in this embodiment, the video accumulated by the user is intended for TV broadcast video recorded by an individual, home video distributed from an acquaintance through a network, and the like. Then, it is not limited to them.

  FIG. 3 is a system configuration diagram according to the first embodiment of this invention.

  The video comment input / display system shown in the figure includes a plurality of client devices 1 and a server device 2. The client device 1 and the server device 2 are connected via a network (not shown) such as the Internet, for example. Although there are a plurality of client apparatuses 1, for the sake of simplicity of explanation, only one client apparatus 1 will be described below.

  The client apparatus 1 includes a video storage unit 101 that stores broadcast video and home video, a video DB 102 that stores video obtained by the video storage unit 101, and a video selection that selects a video to be viewed from a group of videos stored in the video DB 102. Means 103, video identifier calculation means 104 for calculating a video identifier used for identifying a video from the video selected by the video selection means 103, and synchronization location identifiers for synchronization between videos of the same content possessed by each user I want to communicate with other users in the video selected by the video selection means 103, the video playback means 106 that fetches and displays the video selected by the video selection means 103 from the video DB 102, and the video selection means 103 Video time specifying means 107 for specifying the time within the video, The video virtual time calculation means 108 for expressing the video time designated by the time designation means 107 using the video identifier and the synchronization location identifier, and the user's comment input on the video time designated by the video time designation means 107 is made possible. Comments stored in the comment information / video virtual time DB 111 of the server device 2 in association with the video virtual time calculated by the comment information input means 109 and the video virtual time calculation means 108 and the comments input by the comment information input means 109 The information / video virtual time storage unit 110 and the comment information display unit 113 for outputting the comment acquired from the server device 2 on the screen are configured.

  Further, the server apparatus 2 uses the comment information / video virtual time DB 111 and the comment information accumulated in the comment information / video virtual time DB 111 based on the video virtual time calculated by the video virtual time calculation unit 108 of the client apparatus 1. To comment information acquisition means 112 for acquiring comment information related to the video virtual time.

  In addition, this Embodiment is a specific example at the time of implementing Claim 1,5,9.

  The video storage unit 101 itself of the client device 1 is not an element constituting the present invention, but is used for explaining the present embodiment. Examples of this means include, for example, a PC equipped with a TV tuner built-in video encoder board, an HDD recorder, and a home video camera. These video storage means 101 generally store information associated with video, such as recorded time, channel, and program information by iEPG (Internet Electronic Program Guide) (registered trademark). In many cases, a simple video editing function for automatically cutting TVCM and extracting only a necessary part of the video is provided. The video storage means 101 in this embodiment is assumed to store not only videos but also these video information / edit information.

  The video DB 102 of the client device 1 stores the video obtained by the video storage unit 101 described above. The video DB 102 is not an essential element for configuring the present invention, but is used for explaining the present embodiment. Examples of this means include an HDD in a PC, an HDD in an HDD recorder, and a video tape inserted in a Handycam (registered trademark).

  Each component of the following client device 1 and server device 2 will be described in the order of operation.

  (1) As described in the video storage unit 101, the video storage unit 101 stores not only video but also video information accompanying the video and editing information that is a history of editing the video.

  (2) The video selection unit 103 of the client device 1 causes the user to select a video to view from the video group stored in the video DB 102. Although the video selection means 103 is not illustrated, it can be implemented with a simple interface such as a file selector, such as selecting videos from a list that lists and lists the titles, file names, recording dates, etc. of stored videos. The user uses the video selection interface to cause the user to select video stored in the video 102. Thereby, the video selection unit 103 transfers the selected video to the video identifier calculation unit 104.

  (3) The video identifier calculation unit 104 of the client device 1 calculates a video identifier used to identify the video from the video selected by the video selection unit 103.

Since the video identifier is an identifier for identifying videos having the same contents, information “time when video was recorded + channel” may be used as a simple example in the case of a TV video.
Even with such simple information, the identity of the video is maintained between users who have recorded TV programs of the same channel and at the same time. In some cases, a unique ID can be obtained by providing a service that guarantees the same program, such as a video ID issuing center.

  The video identifier used in the present embodiment is calculated on the assumption that the video recording state differs for each user. In other words, for example, recording can be performed based on video content regardless of the recording device, video encoding format and bit rate, editing presence / absence, broadcast area (channel), broadcast time difference, main broadcast / rebroadcast, etc. Program titles and subtitles in iEPG (registered trademark) information acquired at times are used. In addition, when assuming home video for home use, such as copying and distributing the captured video to friends, etc., the serial number of the device that recorded the video (ID uniquely specified by the device) or recording The video is identified using information such as the time and place.

  As to which of these pieces of information is used, for example, a method of automatically selecting according to a method of storing video in the video storage means 101 (when receiving and recording a TV broadcast or shooting with a home video camera) And a method of selecting by the user. In the present embodiment, the former is used, and in the case of broadcast video, a program title / subtitle, and in the case of personal video, a unique identification code is calculated from the serial number and shooting time of the shooting device and used as a video identifier (for example, This information is treated as character string data and is calculated using a one-way function such as MD5).

  (4) The motivation location identifier calculating unit 105 of the client device 1 calculates a synchronization location identifier for synchronizing between videos of the same content held by each user.

  As a simple calculation method of the synchronization location identifier, a method in which the start time of the video is used as the synchronization location is conceivable. This method can be applied when it is assumed that a user who holds a video having the same content does not perform any editing work on the video. For example, in the case of a TV video, synchronization between users who use a program video of the same channel in the same time zone without editing is possible.

  The synchronization location identifier in the present embodiment uses video information / edit information stored on the video DB 102 in order to relax the above restriction. The synchronization location identifier and its calculation method in the present embodiment will be described with reference to FIG.

  FIG. 4 is a schematic diagram showing the relationship between video information and editing information related to video stored in the video DB 102 according to the first embodiment of the present invention. In the example of the figure, an example is a TV broadcast video that is recorded with a slight delay from the broadcast time for some reason and then partially cut edited by the user.

  As shown in FIG. 4, the “video A stored in the video DB 102” is composed of a video section b (start time t0), a video section d (start time t1)... In comparison, there are missing parts, and there are parts deleted by editing.

  What restored | restored the image | video A using image | video information and edit information is "the original image | video A reproduced using each information." Using the video information (for example, program start time by iEPG (registered trademark)), the missing part is virtually complemented, and the video part cut from the editing information is reproduced.

  Information for synchronizing with other users who recorded the same video is calculated from the original video A reproduced in this way. Specifically, the relative time to each video section is calculated based on the program start time of the original video A. The calculation of the relative time is easy as apparent from FIG.

  By associating these relative times with the times in the video A stored in the video DB 102, the synchronization location identifier is calculated as shown in FIG. Accordingly, the time t0 in the video A is a relative time T0 from the reference time in the original video A, and similarly, it can be determined that the time t1 is the relative time T1, the time t2 is the relative time T2, and so on. Synchronization using the relative time Tn is possible between the user who started recording from the time and the user who performed different editing.

  FIG. 4 shows an example of a TV broadcast video in which a portion where recording was delayed is deleted. However, if the recording is accelerated or a video in which video is inserted is used, it is easy to use a similar mechanism to synchronize points. An identifier can be calculated. In addition, even a video such as a home video can be calculated by using a relative time based on the start time of the original video. These examples are easy to analogize and will not be described.

  (5) The video reproduction means 106 of the client device 1 takes out the video selected by the user in the video selection means 103 from the video DB 102 and displays it. A screen display example of the video reproduction means 106 is shown in FIG. The video playback means 106 of the present embodiment displays the video selected by the video selection means 103, and can easily reach a predetermined time in the video by using a fast forward / rewind button or a slider interface in the playback control button. It also has an accessible interface.

  (6) The video time specifying means 107 of the client device 1 causes the user to specify the time within the video in which the user wants to communicate with other users in the video selected by the video selection means 103.

  Examples of the method for designating the time in the video include an intuitive method using a fast-forward / rewind button of the playback control button shown in FIG. 5 and a slider interface, and a method of inputting the indicated time numerically. The function can be shared with the means 106.

  Another example is a method in which the video playback means 106 sequentially acquires video time during playback. Since the video reproduction means 106 automatically designates the time within the video instead of being arbitrarily designated by the user, the user can more easily use the system in the present embodiment. In the present embodiment, it is assumed that the video playback means 016 adopts a method of acquiring the stored video time.

  (7) The video virtual time calculation unit 108 of the client device 1 expresses the video time specified by the video time specification unit 107 using the video identifier and the synchronization location identifier.

  The calculated video virtual time is not the time on the video file in which editing or the like has been performed, but the time on the original video restored from the video information or the editing information. By using the video virtual time, it is possible to obtain a time that can be synchronized with other users regardless of actions such as editing.

  The video virtual time and its calculation method will be described with reference to FIG. FIG. 6 assumes that the video A used in FIG. 4 is used.

  Now, let tm be the time specified by the video time specifying means 107 by the user. From the synchronization location identifier (see FIG. 4) calculated by the synchronization location identifier calculating means 105, tm is easily calculated as a time that is relatively advanced by td from the synchronization time t1 in the synchronization location identifier before tm. The Thus, the reproduced time ti on the original video A is immediately calculated as ti = T1 + td by using the relative time T1 in the same column as t1 in the synchronization location identifier.

  If the video identifier of the video A calculated by the video identifier calculation means 104 is mID (A), the video virtual time finally calculated from tm is represented by Ti consisting of the video identifier mID (A) and the synchronization time ti. Is done.

  According to the above procedure, the time tm designated by the video time designation means 107 can be expressed as a relative time from the video identifier and the reference time in the video by the video virtual time Ti. Expressed as time.

  (8) The comment information input unit 109 of the client device 1 enables the user to input a comment on the video time specified by the video time specifying unit 107. Since a comment can be easily implemented by using a general text input interface, it is not illustrated here.

  The comment information handled in the present embodiment is collectively referred to as comment information, together with a comment text representing a user's opinion, and additional information such as a user ID and input time.

  The comment information / video virtual time storage unit 110 of the client device 1 has the server device 2 associating the video virtual time calculated by the video virtual time calculation unit 108 with the comment input by the comment information input unit 109. The comment information / video virtual time DB 111 is accumulated.

  An example of comment information and video virtual time accumulated in the comment information / video virtual time DB 111 is shown in FIG. In the present embodiment, the comment information includes uID (n) that is the ID of the user who input the comment and the input comment text cmt (n). The video virtual time includes a video identifier mID (n) and a synchronization time t (n). These are managed on the comment information / video virtual time DB 111 as ct (n) as being related.

  (10) The comment information acquisition unit 112 of the server device 2 uses the comment information stored in the comment information / video virtual time DB 111 based on the video virtual time calculated by the video virtual time calculation unit 108 on the client device 1. , Comment information related to the video virtual time is acquired.

  As a simple method for acquiring the comment information, it is only necessary to search for an entry that matches the video virtual time in the entry on the comment information / video virtual time DB 111. Alternatively, the video virtual time indicates one point on the video time, and it is difficult to input a comment that exactly matches the time, so the video virtual time calculated by the video virtual time calculation unit 108 A comment having a certain width may be acquired. The method of giving the width may be statically defined by the system, or may be determined dynamically such as by allowing the user to select. In the present embodiment, it is assumed that comment information input within 10 seconds before the video virtual time calculated by the video virtual time calculation unit 108 is acquired.

  (11) The comment information display unit 113 of the client device 1 outputs the comment acquired by the comment information acquisition unit 112 on the screen. The comment information display means 113 presents all or one of the acquired comment information to the user side. Moreover, you may show the new information (For example, the image etc. which are switched and displayed by the sex of the input user, etc.) produced | generated from some comment information.

  An example of the screen display result of the system realized by this embodiment is shown in FIG.

  The video time acquired during video playback by the video playback means 106 is sequentially converted into video virtual time, and comment information related to the video virtual time is displayed on the screen by the comment information display means 113. The video virtual time is also sequentially updated according to the video playback progress, so that the comment information is switched in accordance with the video playback, so that the comment input at that time can be viewed. In addition, by using the comment information input unit 109, a comment can be presented to a user browsing the corresponding video virtual time, and communication can be achieved.

  By using the means as described above, according to the first embodiment of the present invention, it is possible to determine the identity of each person's video by the video identifier, which is specified in the video by the synchronization location identifier and the video virtual time. The time that can be shared between videos can be expressed in a unified manner, so that comments that can be shared between users can be displayed and input for a certain time of the video. Accordingly, communication is possible even between videos having different video resolutions, formats, editing locations, etc. of individual users.

[Second Embodiment]
In the video comment input / display system according to the second embodiment of the present invention, each user accumulates videos, and comments written about the videos are shared on the server device, so that comments of other users can be shared. This is a system for showing comments that have been viewed or written to other users and communicating about video.

  In the present embodiment, unlike the first embodiment, the video accumulated by each individual user is assumed to be a video that has been edited other than the present system after the accumulation. That is, in the first embodiment, there is no editing information used when calculating the synchronization location identifier. In many cases, commercially available video editing software is attached to a video encoder board of a PC, and such a situation is easily assumed.

  The system configuration in the second embodiment of the present invention is the same as that in the first embodiment, and will be described with reference to FIG. Further, the present embodiment is not different from the first embodiment except for the synchronization location identifier calculated by the synchronization location identifier calculation means 105, and therefore description of the components other than those related to the synchronization location identifier is omitted. To do.

  In addition, this Embodiment has shown the specific example at the time of implementing Claim 1, 2, 5, 6, 9, 10.

  Since the video storage unit 101, the video DB 102, the video selection unit 103, and the video identifier calculation unit 104 on the client device 1 are the same as those in the first embodiment, description thereof is omitted.

  Hereinafter, each component shown in FIG. 3 will be described in the order of operation.

  (1) The synchronization location identifier calculating unit 105 of the client device 1 calculates a synchronization location identifier for synchronizing between videos of the same content held by each user.

  Unlike the first embodiment, the synchronization location identifier used in the present embodiment cannot be calculated from editing information, and thus is calculated using video feature values extracted from the video.

  Image features are physical or semantic information on the screen, such as color information on the screen, scene switching points, camerawork, objects being photographed, characters, utterance content, recognition results of speakers and music, etc. It is information indicating characteristics, and is information widely used in fields such as video management and video search.

  The video feature amount can be acquired using a known video analysis technique. For example, scene switching points and telop display sections are described in Japanese Patent No. 2839132 Public Information, Japanese Patent Application Laid-Open No. 9-238298, and Japanese Patent Application Laid-Open No. 11-178007, etc. Various studies have been conducted.

  The synchronization location identifier and its calculation method in the present embodiment will be described with reference to FIG.

  1) First, a cut point (scene switching point) is detected from the video A using the existing technology, and the video is divided into sections by the cut point. In this example, the video section b starts from t0, the video section d starts from t1, and so on.

  2) Next, a representative image in each video section is obtained. As a method for obtaining a representative image, an image of a few frames (a frame that seems to be stable after a scene change) from the first frame of each section is acquired.

  3) Next, a color histogram is obtained from each extracted representative image, and the color feature amount and the time length of the video section are set as representative video feature amounts in each video section.

  Since the video feature quantity extracted in this way characterizes each video section, if a feature quantity is designated in a certain video, it can be determined to which section in the video it corresponds. That is, in order to synchronize the comment with the video section that the user is viewing, the video feature amount associated with the video section may be used. However, for example, since the same CM is broadcast a plurality of times in a TV broadcast program, a plurality of sections may correspond from one feature amount.

  Therefore, in this embodiment, for each video section, the video feature amount calculated from the section, the ordered set of video feature amounts in the video, and the video feature amount in the set Let the position be the synchronization location identifier. By using an ordered set of video feature quantities and their positions as identifiers, the ambiguity at the time of specifying the synchronization point as described above is eliminated. A specific method of using the synchronization location identifier will be described later.

  Note that the video feature quantities in the present embodiment use cut points, color histograms, and the like. For example, the video sections may be specified using semantic sections such as “program opening”, As the feature quantity of each section, a video feature quantity that can specify the video section more accurately, such as camera work, the shape of an object shown in the section, or a recognized character string, may be used in combination.

  (2) The video reproduction means 106 and the video time designation means 107 on the client apparatus 1 are the same as those in the first embodiment, and thus description thereof is omitted.

  (3) The video virtual time calculating unit 108 of the client device 1 represents the video time specified by the video time specifying unit 107 using the video identifier and the synchronization location identifier.

  The video virtual time in the present embodiment will be described with reference to FIG.

  The video time tm designated by the video time designation means 107 is expressed as a relative time within the video section by the synchronization location identifier calculated by the synchronization location identifier calculation means 105. That is, tm is expressed as tm = t1 + td, where td is the relative time from the synchronization time t1 of the video section including tm (video section d in the figure).

  Since t1 is the start time of the synchronization location identifier of the video section d in the video A, the video virtual time Ti is finally determined by the video identifier mID (A), the synchronization location identifier, and the relative time td as shown in the figure. Expressed. The video virtual time is a time expression that other users can synchronize based on the video identifier for specifying the video, the synchronization location identifier for specifying the video section by the video feature amount, and the relative time from the head of the video section.

  (4) The comment information input unit 109 of the client device 1 is the same as that in the first embodiment, and a description thereof will be omitted.

  (5) The comment information / video virtual time storage unit 110 of the client device 1 associates the video virtual time calculated by the video virtual time calculation unit 108 with the comment input by the comment information input unit 109, and the server device 2 The comment information / video virtual time DB 111 is stored.

  An example of comment information and video virtual time stored in the comment information / video virtual time DB 111 is shown in FIG. In the present embodiment, the comment information includes uID (n) that is the ID of the user who has input the comment and the input comment text cmt (n). The video virtual time includes the video identifier mID (n), the synchronization time t (n) that is a component of the synchronization location identifier, the video feature amount f (n), and the ordered set F (n), F of the video feature amount. It is represented by the position p (n) of f (n) in (n) and the relative time td (n), and these are related and managed on the comment information / video virtual time DB 111 as ct (n).

  (6) The comment information acquisition unit 112 of the server device 2 is based on the comment information accumulated in the comment information / video virtual time DB 111 based on the video virtual time calculated by the video virtual time calculation unit 108 on the client device 1. , Comment information related to the video virtual time is acquired.

  A comment information acquisition method according to the present embodiment will be described with reference to FIG.

  First, comment information candidates that are considered to have been input at a specific time within the same video section of the same video are acquired.

  Step 11) First, the video virtual time calculated by the video virtual time calculation means 108 of the client device 1 is defined. That is, the video virtual time ct (x) is the video identifier mID (x), the synchronization time t (x), the video feature quantity f (x), and the video feature quantity set F (x), f (x) in the F (x). It is assumed that it consists of a position p (x) at x) and a relative time td (x).

  Step 12) From the comment information / video virtual time DB 111 of the server device 2, a set S (x) of comment information / video virtual time whose video identifier matches mID (x) is acquired. Thereby, the comment information in the same video is narrowed down.

  Step 13) From the set S (x), a subset S ′ (x) of comment information / video virtual time whose video feature amount is similar to f (x) is acquired. The video feature amount is a slightly different value for each video file, even for the same original video, depending on the video resolution, video format, filter setting at the time of video creation, and the like. For this reason, in the present embodiment, it is determined whether or not they are in the same video section based on the similarity between the video feature amounts.

  For example, when the color histogram in the image is used, the similarity of the video feature amount is expressed as an n-dimensional point having the value of each color element in the color histogram, and is determined by the Euclidean distance between the points. Possible ways to do this. That is, the video feature value f (x) at ct (x) is (cx (1), cx (2),..., Cn (N)), and a certain comment / video virtual time ct ( When the video feature value f (a) in a) is (ca (1),..., ca (n)), the similarity sim (X, A) is obtained by the following equation.

映像特徴量間で類似性が高いほどｓｉｍ（Ｘ，Ａ）の値は「０」に近づくため、ある閾値以下となる映像特徴量ｆ（ａ）を持つコメント情報・映像仮想時間ｃｔ（ａ）をＳ‘’（ｘ）の要素とすればよい。

Since the value of sim (X, A) approaches “0” as the similarity between the image feature amounts is higher, the comment information / image virtual time ct (a) having the image feature amount f (a) that is equal to or less than a certain threshold value. May be an element of S ″ (x).

  In the present embodiment, a simple similarity calculation method in a color histogram has been described for the sake of simplicity of explanation, but the similarity calculation method in various feature amounts can be applied depending on the embodiment. A description of the similarity calculation method is omitted because there are various existing technologies.

  Step 14) From the set S ′ (x), a subset S ″ (x) of comment information / video virtual time that is regarded as having the same relative time as td (x) is obtained. In order to consider that the relative times are the same, it may be determined whether the relative times td (i) and td (x) in a certain comment / video virtual time ct (i) in S ′ (x) exactly match. As described in the first embodiment, td (i) within a certain range as viewed from td (x) may be regarded as the same. In the present embodiment, it is assumed that td (i) in the range from 10 seconds before td (x) to td (x) is the same.

  S ″ (x) acquired in the above step is a candidate for comment information that seems to have been input at a specific time within the same video section of the same video. These candidates can be determined to be input at the same time on the same video if the video section can be uniquely determined by a certain video feature amount. However, if there are multiple video sections with the same content in the same video, such as TVCM in a TV program, it may be assigned to an unintended video section (different sections having the same video feature amount). There is sex.

  Therefore, as the next step, the comment information whose video virtual time exactly matches from the candidates is narrowed down.

  Step 15) First, an initialization process for narrowing down is performed. Specifically, the comment information / video virtual time in S ″ (x) is ct (i), and the total number of ct (i) in S ″ (x) is n. In addition, the index i used in and after step 16 is set to “0”. Also, the comment / video virtual time set R (x) holding the final result is set as an empty set.

  Step 16) The index i is determined. If the value of i is smaller than the total number n, the processing after step 17 is advanced. If i is greater than or equal to n, all ct (i) have been processed, and the process ends.

  Step 17) Define each element of ct (i). The video identifier of ct (i) is mID (i), the synchronization time t (i), the video feature quantity f (i), the video feature quantity set F (i), and the position p of f (i) in F (i). (I), relative time td (i).

  Step 18) With respect to the ordered sets F (x) and F (i) of the video feature values of ct (x) and ct (i), the corresponding processing of each video feature value in the set is performed.

  F (x) and F (i) are calculated from videos held by each user. Therefore, when video editing work is performed for each user, F (x) and F (i) have different element strings. The process in this step compares these different element strings and determines which element in F (i) corresponds to the element in F (x).

  In the present embodiment, the method for examining the correspondence relationship between the element strings is not particularly limited, but a general method includes DP matching. DP matching is a technique for efficiently searching for a correspondence relationship with another element sequence while inserting / deleting the element sequence. This algorithm is used in various fields, such as examining the correspondence between phoneme sequences and language models in speech recognition, and examining similarity between base sequences in DNA research, and details are not described here.

  Further, the technique described in “Japanese Patent Application No. 2002-130746” is also included. In this method, considering the possibility of erroneous detection in the calculation of video feature values and the fact that there is an error in the feature values depending on the resolution and format of the video, the similarity is calculated while matching the feature value sequences between videos. There is a special feature. By applying the method, a correspondence relationship in consideration of erroneous detection and error in the video feature amount is obtained.

  FIG. 13 is a diagram schematically showing the correspondence between element strings in F (x) and F (i) using these methods. Since F (x) and F (i) have an edited part and a missing part, the second element in F (x) does not necessarily correspond to the second element in F (i). By the processing of the step, it is calculated which element in F (i) the element F (x) _n in F (x) corresponds to.

  Step 19) From the correspondence result of Step 18 and p (x) and p (i), it is determined whether f (x) and f (i) correspond. If they correspond, the final result set R ( Add ct (i) to x).

  FIG. 14 is a diagram schematically showing the processing in step 19. As already described, F (x) and F (i) are different element strings. However, since the elements are associated with each other in step 18, f (x) and p (i) can be simply changed to f ( The correspondence between x) and f (i) can be examined. That is, it can be determined whether the video virtual time ct (x) calculated by the video virtual time calculation unit 108 and a certain entry ct (i) on the comment information / video virtual time DB 111 are the same time.

  Step 20) Add 1 to the index i and return to Step 16.

  By extracting the comment information from R (x) obtained by the above processing steps, the comment information acquisition unit 112 of the server apparatus 2 uses the video virtual time calculated by the video virtual time calculation unit 108 to comment information. Comment information related to the video virtual time can be acquired from the comment information stored in the video virtual time DB 111.

  (7) The comment information display means 113 on the client device 1 is not different from that of the first embodiment, and the description thereof is omitted.

  By using the means as described above, according to the second embodiment of the present invention, it is possible to determine the identity of an individual video by the video identifier, which is designated in the video by the synchronization location identifier and the video virtual time. The time that can be shared between videos can be expressed in a unified manner, so that comments that can be shared between users can be displayed and input for a certain time of video. Accordingly, communication is possible even between videos having different video resolutions, formats, editing locations, etc. of individual users.

  Further, by using the synchronization part identifier calculating means (procedure) according to claims 2, 6 and 10, even in a situation different from that of the first embodiment, that is, in a video that has been subjected to video editing processing outside the system. By calculating the synchronization location using the feature quantity, comment information associated with a certain video time can be acquired and input. Therefore, communication between a wider range of images is possible as compared with the first embodiment.

[Third Embodiment]
In the video comment input / display system according to the third embodiment of the present invention, each user accumulates videos, and comments written on the videos are shared on the server, so that comments of other users can be viewed. Or, it is a system for showing comments that have been written to other users and communicating about video.

  In the present embodiment, unlike the first and second embodiments, the video accumulated by each individual user includes video information such as titles and subtitles acquired from iEPG (registered trademark), editing information, and the like. Suppose a video that does not. For example, it is conceivable that the video recorded in the past in the VCR is converted into a video file and adapted to this system.

  The system configuration in the third embodiment of the present invention is the same as that in the first embodiment, and will be described with reference to FIG. Further, this embodiment is different from the first embodiment in that the video identifier and the synchronization part are calculated and stored by the video identifier calculation unit 104, the synchronization part identifier calculation unit 105, and the comment information / video virtual time storage unit 110. Since there is no difference in terms other than the identifier, comment information, and video virtual time, descriptions of the means other than the means related to the identifier and information are omitted.

  In addition, in this Embodiment, the specific example at the time of implementing Claims 1-12 is shown.

  Since the video storage unit 101, the video DB 102, and the video selection unit 103 on the client device 1 are the same as those in the first embodiment, description thereof is omitted.

  The video identifier calculation unit 104 of the client device 1 calculates a video identifier used for identifying a video from the video selected by the video selection unit 103.

  Unlike the first and second embodiments, the video identifier calculation unit 104 in the present embodiment does not have video information during video storage. Therefore, another identifier that can uniquely identify the video is required.

  In the present embodiment, video feature amounts are used for this. As described in the second embodiment, the video feature amount is information indicating a physical or semantic feature on the video, and various similar video search methods using the video feature amount have been studied. .

  In this example, the ordered set of video feature values used in the second embodiment is used as a video identifier. That is, when determining the identity between videos, the similarity is determined by comparing ordered sets of video feature quantities. A specific identity determination method will be described separately in the comment information acquisition unit 112.

  An example of a video identifier in the present embodiment is shown in FIG.

  The synchronization location identifier calculating unit 105 of the client device 1 calculates a synchronization location identifier for synchronizing the same contents of each user between videos.

  The synchronization location identifier in the present embodiment is calculated using video feature amounts as in the second embodiment. Since the calculation method has been described in the second embodiment, it is omitted here.

  Since the video reproduction means 106 and the video time designation means 107 on the client device 1 are the same as those in the first embodiment, description thereof will be omitted.

  The video virtual time calculation means 108 of the client device 1 represents the video time designated by the video time designation means 107 using the video identifier and the synchronization location identifier.

  The video virtual time in the present embodiment is the same as in the second embodiment, and the constituent elements are as shown in FIG. 10, but the video identifier mID (A) is an ordered set of video feature quantities. This is different from the second embodiment.

  The comment information input means 109 on the client device 1 is basically as described in the first embodiment, but in this embodiment, a reply (response, reply) is performed for a specified comment. Comments can also be entered.

  A general communication means such as a bulletin board has a function of inputting a comment for performing a response (response, reply) to a certain comment. By doing less, it is easy to understand which comment is said to which comment, so it is particularly effective when discussing. Hereinafter, in the present embodiment, “parent comment” refers to a comment for which a less was performed, and “child comment” refers to a comment for which a less is performed.

  The comment information / video virtual time storage unit 110 of the client device 1 has the server device 2 associating the video virtual time calculated by the video virtual time calculation unit 108 with the comment input by the comment information input unit 109. The comment information / video virtual time DB 111 is accumulated.

  An example of comment information and video virtual time stored in the comment information / video virtual time DB 111 is shown in FIG.

  In this embodiment, pID (i) indicating a parent comment is included as one piece of comment information. pID (i) indicates a parent comment in which the comment of ID (i) has performed a reply, and specifically indicates ct (p) that is the ID of the parent comment. If the comment does not have a parent comment, pID (i) is set to null or the like, so that it is possible to easily determine which comment is the one for which the comment is performed.

  Since other points are the same as those in the second embodiment, description thereof is omitted.

  Based on the video virtual time calculated by the video virtual time calculation unit 108 on the client device 1, the server apparatus 2 uses the comment information stored in the comment information / video virtual time DB 111 to make a comment related to the video virtual time. Get information. Comment information acquisition means 112 is included.

  A comment information acquisition method according to the present embodiment will be described with reference to FIG.

  Step 111) First, the video virtual time calculated by the video virtual time calculation means 108 is defined. That is, the video virtual time ct (x) is the video identifier mID (x), the synchronization time t (x), the video feature quantity f (x), the video feature quantity set F (x), and f (x) in F (x). It is assumed that it consists of a position p (x) at x) and a relative time td (x).

  Step 112) An initialization process relating to the comment information / video virtual time DB 111 is performed. Specifically, a set of comment information / video virtual time in the comment information / video virtual time DB 111 is CT, the number of elements is n, and each element is ct (i). Also, the comment / video virtual time set R (x) holding the final result is set as an empty set.

  Step 113) A process end determination is made. If elements remain in the CT, the processing from step 114 onward is advanced. When the number n of CT elements is “0” or less, the processing is terminated because all ct (i) have been processed.

  Step 114) Define each element of ct (i). The video identifier of ct (i) is mID (i), the synchronization time t (i), the video feature quantity f (i), the video feature quantity set F (i), and the position p of f (i) in F (i). (I), relative time td (i), parent comment iD pID (i).

  Step 115) The similarity Sim (mID (x), mID (i)) between the video identifier mID (x) and mID (i) is calculated. In the present embodiment, both mID (x) and mID (i) are ordered sets of video feature quantities. Therefore, when elements are compared with each other while considering the order, many similar elements are included. It is determined that the video is similar. A specific method is shown in FIG.

  1) First, as described in the second embodiment, association between element strings is performed using DP matching or the like.

  2) Next, the elements in the associated F (x) and F (i) are fx (i) and fi (j), respectively, the total number is m, and the similarity sim (fx (j ), Fi (j)) and the average value thereof is calculated, the reciprocal of the corresponding element number na (x) with respect to the total element number n (x) in F (x), and the total in F (i) A value obtained by multiplying the reciprocal of the corresponding element number na (i) to the element number n (i) is calculated. Let this be the similarity sim (mID (x), mID (i)) between F (x) and F (i). Specifically, the following equation is obtained. It is assumed that the similarity between elements is smaller as the similarity is higher.

この式は、対応要素の類似度が高く、映像に対する対応要素数が多いほど小さな値となる。対応要素数ｎａ（ｘ）及びｎａ（ｉ）を考慮するのは、映像の同一性における曖昧性を考慮するためである。例えば、図１８に示すように、確かに一致する部分の類似性は高いかもしれないが、別の映像の断片である映像を同一の映像であると判定してしまう可能性がある。この曖昧性を解消するため、本計算方法では、映像全体としてどの程度要素が対応するかを類似性に含め、取得されるコメントに矛盾が生じないようにする。

This expression has a smaller value as the degree of similarity between corresponding elements is higher and the number of corresponding elements for a video is larger. The reason why the number of corresponding elements na (x) and na (i) is taken into consideration is to consider ambiguity in video identity. For example, as shown in FIG. 18, the similarity of the matching parts may be high, but there is a possibility that a video that is a fragment of another video is determined to be the same video. In order to eliminate this ambiguity, in this calculation method, the degree to which elements correspond to the entire video is included in the similarity so that the acquired comment does not contradict.

  Step 116) A video having a certain threshold value or less with respect to sim (F (x), F (i)) is regarded as a similar video. The threshold value may be determined statically by the system or may be determined dynamically so that the identity can be determined more efficiently from the video identifier registered in the DB. If it is determined that they are similar, the process proceeds to step 117, and if not, the process returns to step 113 so as to perform the process for the next ct (i).

  Step 117) The similarity sim (f (x), f (i)) of the video feature quantities f (x) and f (i) in the section in which the comment is input is obtained. The method for calculating the degree of similarity has been described in detail in the second embodiment, and is omitted here.

  Step 118) In order to select comment information / video virtual time commented on the same video section, it is determined whether or not sim (f (x), f (i)) is below a certain threshold value. If it is equal to or less than the threshold value, the process proceeds to step 119; otherwise, the process returns to step 113.

  Step 119) It is determined whether the relative times td (x) and td (i) are the same time. Since the determination method has been described in the second embodiment, it is omitted here. If it is the same time, the process proceeds to step 120; otherwise, the process returns to step 113.

  Step 120) In order to narrow down the comment information having the same video virtual time from the comment information / video virtual time selected in the process up to Step 119, first, the ordered sets F (x) and F of the video feature amount are selected. For (i), the corresponding processing of each video feature amount in the set is performed. Since the correspondence method has been described in the second embodiment, the description thereof is omitted.

  Step 121) ct (i) is deleted from the set CT of comment information / video virtual time, and it is determined whether the correspondence result of Step 120 corresponds to p (x) and p (i). If it corresponds, ct (i) is added to the final result set R (x). Since the determination method has been described in the second embodiment, it is omitted here.

  Step 122) Check pID (i) recursively, and if ct (i) 's parent comment ct (p) is included in CT, ct (p) is deleted from CT and added to R (x).

  Step 123) For each ct (n) remaining in the CT, pID (n) indicating the parent comment of ct (n) is recursively checked to see if it contains ct (i). If ct (i) is included, ct (n) is deleted from CT and ct (n) is added to R (x).

  By the processing of step 112 and step 123, if the parent comment is a comment related to the specified time, the parent / child comment can also be acquired. Video identification and synchronization location identification using video feature amounts may not be skillfully discriminated depending on the feature amount or noise used. In communication in which a parent comment and a child comment exist, the context may be broken because a child comment following a certain comment is not displayed, and it may be difficult to communicate with each other. Steps 122 and 123 prevent this.

  Step 124) Recalculate the total number n of elements in the CT and return to Step 113.

  Through the above processing steps, the comment / video virtual time set R (x) includes a set of comment information / video virtual time input for the same video section in the video determined to be the same. Retained.

  The comment information display means 113 on the client device 1 is not different from that of the first embodiment, so that the description is omitted.

  By using the means as described above, according to the third embodiment of the present invention, first, by using the video identifier calculating means (procedure) according to claims 3, 7, and 11, the first and first Even in a situation different from the second embodiment, that is, in a video recorded and photographed in the past, the video identity can be evaluated by the video identifier using the video feature amount.

  Further, by using the synchronization part identifier calculating means (procedure) according to claims 2, 6 and 10, even in a situation different from that of the first embodiment, that is, in a video that has undergone video editing processing outside the system. The comment information associated with a certain video time can be acquired and input by calculating the synchronization location using the video feature amount.

  Further, by using the comment information acquisition means (procedure) described in claims 4, 8, and 12, it is possible to acquire a related comment based on the comment information regardless of the video identifier, the synchronization part identifier, and the video virtual time. Therefore, it is possible to present a comment without causing a failure in the dependency relationship between the comments. Therefore, compared with the first and second embodiments, in the video comment input / display method according to claims 1, 5, and 9, it is possible to achieve communication between users more broadly for video. become.

  In the above description, the system including the client device 1 and the server device 2 has been described. However, the system may be configured as one device regardless of the client device and the server device.

  In addition, the operation of each component of the first, second, and third embodiments is constructed as a program, installed and executed on a computer used as a drawing apparatus, or distributed via a network. It is also possible.

  It is also possible to store the constructed program in a portable storage medium such as a hard disk device connected to a computer used as a drawing device, a flexible disk, or a CD-ROM.

  The present invention is not limited to the above-described embodiment, and various modifications and applications can be made within the scope of the claims.

  The present invention can be applied to a technology for sharing comments on video recorded, downloaded, and produced by an individual.

It is a principle block diagram of this invention. It is a principle explanatory view of the present invention. It is a system configuration figure in a 1st embodiment of the present invention. It is a schematic diagram showing the relationship with the video information accumulate | stored on video DB102 in the 1st Embodiment of this invention, and edit information. It is a screen display example of the video reproduction | regeneration means 106 in the 1st Embodiment of this invention. It is a schematic diagram which shows the image | video virtual time in the 1st Embodiment of this invention, and its calculation method. It is an example of the comment information and image | video virtual time which were accumulate | stored in comment information and image | video virtual time DB111 in the 1st Embodiment of this invention. It is an example of a screen display result of the system in the 1st embodiment of the present invention. It is a schematic diagram which shows the synchronization location identifier in the 2nd Embodiment of this invention, and its calculation method. It is a schematic diagram which shows the video virtual time in the 2nd Embodiment of this invention. It is an example of the comment information and video virtual time which were accumulate | stored in comment information and video virtual time DB111 in the 2nd Embodiment of this invention. It is a processing procedure which shows the acquisition method of the comment information in the 2nd Embodiment of this invention. It is a schematic diagram showing the correspondence between the feature-value element strings in the 2nd Embodiment of this invention. It is a schematic diagram which shows the process step 19 in the comment acquisition means 112 in the 2nd Embodiment of this invention. It is an example of the video identifier in the 3rd Embodiment of this invention. It is an example of the comment information and video virtual time which were accumulate | stored in comment information and video virtual time DB111 in the 3rd Embodiment of this invention. It is a processing procedure which shows the acquisition method of the comment information in the 3rd Embodiment of this invention. It is an example in case there exists ambiguity in the correspondence of the image | video feature-value sequence in the 3rd Embodiment of this invention.

Explanation of symbols

1 Client device 2 Server device 101 Video storage means 102 Video DB
103 video acquisition means, video selection means 104 video identifier calculation means 105 synchronization location identifier calculation means 106 video playback means 107 video time designation means 108 video virtual time calculation means 109 comment information input means 110 comment information / video virtual time storage means 111 comment Information / Video Virtual Time DB
112 Comment information acquisition means 113 Comment information display means

Claims (14)

A video comment input / display device capable of sharing comments between videos determined to be the same video even in unspecified video held by individual users in communication related to video on a network,
Video acquisition means for acquiring video for performing communication selected by the user;
Video identifier calculating means for calculating a video identifier for identifying the acquired video;
Synchronization location identifier calculating means for calculating a synchronization location identifier for temporal synchronization between videos;
Video time designation means for obtaining a time (video time) on the video to be viewed / commented designated by the user;
Video virtual time calculating means for expressing the specified video time as relative time using the video identifier and the synchronization location identifier;
Comment information input means for obtaining a comment input by the user;
Comment information / video virtual time storage means for associating the comment with the video virtual time when the comment calculated by the video virtual time calculation means is input and storing it in the comment information / video virtual time database;
Comment information acquisition means for acquiring comment information related to the video time acquired in the video time specification procedure from the comment information / video virtual time database using the video virtual time;
Comment information display means for displaying the comment information acquired by the comment information acquisition means on a display means;
A video comment input / display device characterized by comprising: The synchronization location identifier calculating means includes
The video comment input / display device according to claim 1, wherein when calculating the synchronization location identifier, the synchronization location identifier is calculated using a video feature amount. The video identifier calculation means includes
The video comment / display device according to claim 1, wherein a video feature amount is used when calculating the video identifier. The comment information acquisition means
4. The video comment / display device according to claim 1, wherein the comment information / video virtual time storage means acquires the comment information by using the comment information stored in the comment information / video virtual time database together. In video communication on the network, video comment input / display method in the video comment input / display device can share comments between videos determined as the same video even for unspecified video held by individual users There,
A video acquisition procedure for acquiring video for communication selected by the user;
A video identifier calculation procedure for calculating a video identifier for specifying the acquired video;
A synchronization part identifier calculation procedure for calculating a synchronization part identifier for temporal synchronization between videos;
A video time designation procedure for obtaining a time (video time) on the video to be viewed / commented designated by the user;
Video virtual time calculation procedure for expressing the specified video time as relative time using the video identifier and the synchronization location identifier;
Comment information input procedure for obtaining comments input by the user,
Comment information / video virtual time storage procedure for associating the comment with the video virtual time in which the comment calculated in the video virtual time calculation procedure is input and storing it in a storage unit;
Comment information acquisition procedure for acquiring comment information related to the video time acquired in the video time specification procedure from the storage means using the video virtual time;
Comment information display procedure for displaying on the display means the comment information acquired in the comment information acquisition procedure;
A video comment input / display method characterized by: In the synchronization location identifier calculation procedure,
The video comment input / display method according to claim 5, wherein when calculating the synchronization location identifier, the synchronization location identifier is calculated using a video feature amount. In the video identifier calculation procedure,
The video comment / display method according to claim 5 or 6, wherein a video feature amount is used when calculating the video identifier. In the comment information acquisition procedure,
8. The video comment / display method according to claim 5, wherein, in the comment information / video virtual time storage procedure, the comment information is acquired by using the comment information stored in the storage means together. In a video communication on a network, a video comment input / display system comprising a server device and a client device that can share comments between videos determined to be the same video, even for unspecified videos held by individual users. There,
The client device is
Video acquisition means for acquiring video for performing communication selected by the user;
Video identifier calculating means for calculating a video identifier for identifying the acquired video;
Synchronization location identifier calculating means for calculating a synchronization location identifier for temporal synchronization between videos;
Video time designation means for obtaining a time (video time) on the video to be viewed / commented designated by the user;
Video virtual time calculating means for expressing the specified video time as relative time using the video identifier and the synchronization location identifier;
Comment information input means for obtaining a comment input by the user;
Comment information / video virtual time transfer means for associating the comment with the video virtual time in which the comment calculated by the video virtual time calculation means is input and transmitting it to the server device;
Comment information display means for displaying the comment information received from the server device on a display means,
The server device
Comment information / video virtual time database for storing information associated with the comment received from the client device and the video virtual time when the comment is input;
Comment information acquisition means for acquiring comment information related to the video time acquired in the video time specifying procedure from the comment information / video virtual time database using the video virtual time, and transmitting the comment information to the client device. Have
A video comment input / display system characterized by this. The synchronization part identifier calculating means of the client device is:
The video comment input / display system according to claim 9, wherein when the synchronization location identifier is calculated, the synchronization location identifier is calculated using a video feature amount. The video identifier calculation means of the client device is
11. The video comment / display system according to claim 9 or 10, wherein a video feature amount is used when calculating the video identifier. The comment information acquisition means of the server device is
The video comment / display system according to claim 9, wherein the comment information is acquired by using the comment information accumulated in the comment information / video virtual time database together. A video comment input / display program capable of sharing comments between videos determined to be the same video even in unspecified video held by individual users in communication on video on a network,
9. A video comment input / display program for causing a computer to execute processing for realizing the video comment input / display method according to claim 5. A storage medium storing a video comment input / display program capable of sharing comments between videos determined to be the same video even in unspecified video held by individual users in communication related to video on a network. ,
9. A storage medium storing a video comment input / display program, wherein a program for causing a computer to execute processing for realizing the video comment input / display method according to claim 5 is stored.

Images