JP2010226630A - Image processing apparatus having comment processing function, and method of processing comments of the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enhance determining capability of high-light scenes and reliability of this capability by supplying a large amount of information to determine the high-light scenes in a program. <P>SOLUTION: An image processing apparatus includes: a storage medium 102 for storing programs; a comment-receiving part 106 for receiving a plurality of comments from program viewers for the scenes of programs; and a detection part 108 for identifying high notable scenes to which higher attention of the program viewers has been paid, by analyzing the plurality of comments based on the preset determining criteria. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a video processing apparatus having a comment processing function and a comment processing method thereof, and is useful, for example, as an apparatus that supports creation of thumbnail video, digest video, and the like reflecting comments from viewers.

  An apparatus for creating index information reflecting viewer's preference has been developed (for example, Patent Document 1). This apparatus monitors whether or not there is a section in which many viewers play one distribution program at a standard speed without switching channels in order to determine a section in which index information is created. In other words, if there is a section in which many viewers are playing at a standard speed for a certain distribution program, it is determined that this section is a highlight section in which many viewers are interested. There is also a way of thinking that the rising of the audio signal is graphed and that the rising section corresponds to the thumbnail (for example, Patent Document 2).

JP 2002-16903 A JP 2005-317165 A

  However, the prior art has a small amount of information for analyzing the interests of viewers and has low reliability in determining a highlight scene.

  In view of this, the present invention uses viewer comments as information for determining a scene of interest to which many viewers are particularly interested in a program, increases the amount of information, and improves the determination capability and reliability of the scene of interest. An object of the present invention is to provide a video processing apparatus having a comment processing function and a comment processing method thereof.

  In order to solve the above-mentioned problems, the present invention provides a storage medium device for storing a program, a comment receiving unit for receiving a plurality of comments from viewers for the scene of the program, and setting the plurality of comments in advance. And a detection unit that identifies a scene of interest having a high degree of attention of the viewer.

  According to the above-described means, according to an embodiment of the present invention, the amount of information for specifying a scene with a high degree of attention is a comment from the viewer. There is an advantage of high.

It is a block diagram concerning one example of the present invention. It is a figure which shows the example of the viewer comment database shown in order to demonstrate the function of one Example of this invention. 4 is a flowchart illustrating a highlight detection method for explaining the function of an embodiment of the present invention. It is a figure which shows the example of the graph showing the comment addition speed | rate (representing the change of the input number of the comment per predetermined area) in order to demonstrate the function of one Example of this invention. It is a figure which shows the usage example of a viewer comment database, in order to demonstrate the function of one Example of this invention. It is a figure which shows the other example of the graph showing the comment addition speed | rate (representing the change of the input number of the comment per predetermined area) in order to demonstrate the function of one Example of this invention. It is a block diagram concerning other examples of the present invention. It is a figure which shows the example of the viewer comment database shown in order to demonstrate the function of the Example of FIG. It is a figure which shows the other example of the viewer comment database shown in order to demonstrate the function of the Example of FIG. It is a figure explaining the example of the digest of the popular scene of the program of the channel W, the program of the channel X, and the example of a thumbnail.

  Hereinafter, embodiments of the present invention will be described in detail. FIG. 1 is a block diagram showing a configuration of a recording apparatus 100 to which one embodiment of the present invention is applied. This recording apparatus 100 is an apparatus that can be connected to a network NT such as the Internet.

  Through the network NT, the recording apparatus 100 can capture viewer comment information. This function will be described in more detail later.

  The recording device 100 has a function in which the tuner unit 101 receives broadcast data via an antenna and records program data on a hard disk drive (HDD) 102 which is a recording medium device. The recorded program data is decoded by the decoder unit 103 such as MPEG2 (Moving Picture Image Coding Experts Group 2), and the video is output from the video output unit 104 to the television device 111 or the like. A central processing unit (CPU) 105 is a control unit that comprehensively controls each component of the recording apparatus 100.

  In addition to the configuration of the recording apparatus described above, a viewer comment receiving unit 106 is further provided. The viewer comment receiving unit 106 receives the viewer comment transmitted from the viewer comment input device (described later) via the network NT. The contents of the viewer comment include, for example, a date, time, channel, and comment. The received viewer comment is stored in the viewer comment database 107 set as a storage unit by the viewer comment receiving unit 106.

  FIG. 2 shows an example of the contents of the viewer comment database 107. The date on which the program was broadcast, the broadcast time of the program, the channel of the program, and comments received from viewers are grouped. A plurality of comments from a plurality of viewers are tabulated.

  When the recording of one program is started, the viewer comment receiving unit 106 starts receiving a comment from the viewer. The viewer comment highlight detection unit 108 acquires the viewer comment of the corresponding program from the viewer comment database 107 at the time when the recording of one program ends, and the time of the scene that becomes the highlight from the viewer comment (Referred to as comment highlight time) is detected (a detection method will be described later with reference to a flowchart).

  That is, the viewer comment highlight detection unit 108 receives a plurality of comments from the viewer with respect to the scene of the program, analyzes the plurality of comments based on a predetermined criterion, and receives the viewer's attention level. A high-profile scene is identified.

  The viewer comment highlight detection unit 108 can analyze a comment obtained by removing a preset vocabulary of negative contents from a plurality of comments, and can identify an attention scene (a popular scene). In addition, the viewer comment highlight detection unit 108 can analyze a comment including a vocabulary having a preset negative content in a plurality of comments, and specify a scene of interest (worst scene). Therefore, the names of the viewer comment highlight detection unit 108 and the viewer comment highlight video processing unit 109, which will be described later, are not necessarily specified as the names of highlight detection or highlight video processing.

  The viewer comment highlight detection unit 108 transmits the obtained comment highlight time (the detected time zone information of the attention scene with a high degree of attention) to the viewer comment highlight video processing unit 109. The viewer comment highlight video processing unit 109 acquires image data corresponding to the comment highlight time from the program video data in the HDD 102, and creates, for example, a thumbnail or a digest video. The created thumbnail or digest video is stored in the HDD 102 as a thumbnail or digest file.

  That is, the viewer comment highlight detection unit 108 and the viewer comment highlight video processing unit (109) specify a plurality of target scenes and extract videos of the respective scenes when obtaining a digest of the program regarding the same program. In addition, when obtaining a thumbnail of a video of a program, one of the attention scenes with the highest degree of attention is identified and the video of the scene is extracted.

  Note that the recording device 100 may have the functions of the viewer comment display device 200 and the components of the viewer comment input device 300 described below. Also, any number of recording devices 100 may be connected to the network.

  A viewer comment display device 200 and a viewer comment input device 300 are connected to the network NT in order to share comments of a plurality of viewers who have watched a video such as a TV program.

  The viewer comment display device 200 includes, for example, a viewer comment receiving unit 201 and a viewer comment display processing unit 202 incorporated in a personal computer, and can display a viewer comment on a display device 211 such as a monitor.

  The viewer comment input device 300 includes a viewer comment input unit 302 and a viewer comment transmission unit 301, and can input a viewer comment from an input device 312 such as a keyboard. Note that any number of viewer comment display devices 200 and viewer comment input devices 300 may be connected on the network NT.

  After recording one program, the recording apparatus 100 creates a thumbnail or digest of the scene of interest in the highlight section. A highlight detection method will be described with reference to FIG.

  In step S000, the viewer comment highlight detection unit 108 acquires all the viewer comments corresponding to the recorded program from the viewer comment database 107. In the next step S001, the viewer comment highlight detection unit 108 for the program calculates a comment amount (referred to as a comment addition speed) per fixed time. The comment addition speed calculated in step S001 can be represented by a graph as shown in FIG. Next, in step S002, the viewer comment highlight detection unit 108 determines the maximum value of the comment addition speed. The time Tmax having the maximum value of the comment addition speed is set as the comment highlight time.

  In step S003, the viewer comment highlight detection unit 108 transmits the comment highlight time calculated in step S002 to the viewer comment highlight video processing unit 109.

  In the next step S004, the viewer comment highlight video processing unit 109 creates a thumbnail using program video data of a time corresponding to the comment highlight time.

As described above, in the device of the present invention,
(A) a viewer comment receiving unit 106 that receives comments from viewers; and (b) analyzing at least a plurality of received comments for at least the same program, and the number of comments is a predetermined value or more per predetermined section. A viewer comment highlight detecting unit 108 for determining a section as a highlight section of the program; and (c) a viewer comment highlight that extracts a video of the program in the highlight section as a digest or thumbnail and uses it as a separate file. And a video processing unit 109. As a result, the amount of information for determining the highlight scene of the program is the viewer comment, and the amount of information is very large so that the analysis means is provided.

  The present invention is not limited to the above embodiments. In the above embodiment, the viewer comment highlight detection unit 109 may determine the comment highlight time by a certain time (Tmargin) earlier than the time Tmax having the maximum value of the comment addition speed as follows. This takes into account the time lag for the viewer to input comments.

Comment highlight time = Tmax − Tmargin
In the above embodiment, the viewer comment highlight detection unit 109 adds a level indicating whether the comment is positive or negative in the viewer comment database as shown in FIG. You may make it determine time with much comment highlight time. Basically, it is determined as a highlight section by excluding negative contents of a preset vocabulary of comments.

  In the above embodiment, the recording apparatus 100 may transmit the comment highlight time or the created thumbnail to another device via the transmission unit.

  Further, in the above embodiment, the video input means to the recording apparatus 100 may be other means such as a network instead of the tuner.

  In the above embodiment, the viewer comment highlight detecting unit 108 and the viewer comment highlight video processing unit 109 can create a digest scene. For example, as shown in FIG. 6, the viewer comment highlight detection unit 108 detects a plurality of times that are comment addition speeds exceeding the threshold, and the viewer comment highlight video processing unit 109 detects a scene of the time group digest. And the recording apparatus 100 outputs the digest video. The digest video is stored in the HDD 102 as a digest file.

  The present invention is not limited to the above embodiment. It may be a system in which video is streamed. Examples thereof will be described below.

  FIG. 7 is a block diagram showing another embodiment of the present invention. This system includes one or more video / viewer comment / thumbnail client device 300 (hereinafter referred to as client device) and one or more video / viewer comment thumbnail server device 400 (hereinafter referred to as server device).

  First, components related to processing of video data such as MPEG2 of the client device 300 will be described. The client device 300 includes a decoder 301 and a CPU 302, and has a function of decoding video data in real time. Further, the decoded video data can be output from the video / thumbnail / viewer comment display processing unit 303 (hereinafter referred to as display processing unit) to the monitor and displayed. In addition, the video / viewer comment / thumbnail receiving unit 304 (hereinafter referred to as a client receiving unit) has a function of receiving video data from the server device 400 in a stream. Further, the client device 300 can upload video data such as MPEG2 in the HDD 305 from the video / viewer comment transmission unit 306 (hereinafter referred to as client transmission unit) to the server device 400.

  Next, components related to the viewer comment processing of the client device 300 will be described. The user can add viewer comments while watching the video. The viewer comment input by the viewer comment input unit 307 is transmitted from the client transmission unit 306 to the server device 400. In the client device 300, a viewer comment corresponding to the video data can be received by the client receiving unit 304 and displayed on the monitor from the display processing unit 303.

  Next, components related to thumbnail or digest video processing of the client device 300 will be described. The user can select the video data in the server 400 as a thumbnail. The client reception unit 304 can receive the thumbnail or digest video, and the display processing unit 303 can output the display video.

  Next, components related to video data processing of the server apparatus 400 will be described. The server device 400 can receive the video data uploaded from the client device 300 from the video / viewer comment receiver 401 (hereinafter referred to as server receiver) and store it in the HDD 402. For example, video numbers (1, 2, 3...) Are allocated to the stored video data. Further, the server device 400 can transmit the video data to the client device 300 using the video / viewer comment / thumbnail receiving unit 403 (hereinafter referred to as a server transmitting unit).

  Next, components related to the viewer comment and thumbnail or digest video processing of the server device 400 will be described. Server device 400 receives a viewer comment by server reception unit 401. The received viewer comment is stored in the viewer comment database 404. FIG. 8 shows an example of data in the viewer comment database 404. Here, a video number (1, 2, 3...) Is assigned to the recorded program. It is managed in relative time from.

  The viewer comment highlight detection unit 405 and the viewer comment highlight video processing unit 406 perform a highlight thumbnail or digest from the viewer comment database 404 based on the viewer comment regarding the corresponding video data in the same manner as in the embodiment of FIG. Create a video.

  The server apparatus 400 can transmit the created thumbnail or digest video to the client apparatus 300. In addition, the server device 400 can transmit a viewer comment regarding the video from the server transmission unit 401. The CPU 407 controls the overall components of the server device 400 described above.

  Of course, the present invention may be implemented by combining the configurations of FIG. 1 and FIG. In the conventional technology, a thumbnail or a digest video cannot be obtained for a scene most viewed by the viewer, and the accuracy is poor. However, in the present invention, by creating a thumbnail from a viewer's comment, the scene that the viewer is most interested in can be made a thumbnail. Therefore, it becomes possible to search for a recorded program more suitable for the user in the recording apparatus.

  FIG. 9 further shows another example of the viewer comment database, and FIG. 10 is a diagram for explaining an example of a digest of popular scenes of a program of channel W and a program of channel X and an example of a thumbnail. In the database, the channel and the comment in the date and time zone are associated. Therefore, it is possible to specify the program using the electronic program information and to specify the program name recorded on the recording medium from the management information. As a result of analyzing the comments, a positive level is assigned from a positive vocabulary, and a negative level is assigned from a negative vocabulary. The larger the number, the stronger the positive or negative viewer willingness. By referring to these databases, it is possible to specify one or a plurality of attention scenes attracted by many viewers for one program. When one is specified, it can be used as a thumbnail, and when a plurality is specified, it can be used as a digest scene. It is also possible to classify popular scenes and unpopular scenes.

  FIG. 10A shows an example of a screen for setting which program is to be viewed on the television device 111 for the popular scene or the worst scene. FIG. 10A shows an example in which a popular scene is viewed as a digest in the W channel program name “Arashi no Umi”. FIG. 10B shows another setting example. FIG. 10B shows an example of viewing a thumbnail, which was popular in the program name “Hashiue” on the X channel.

  As shown in FIG. 10A, the setting screen and the execution screen may be switched, and as shown in FIG. 10B, the setting screen and the execution screen may be on the same screen.

  The present invention is effectively applied to a television receiver having a video processing device, a server, a recording / reproducing device, a personal computer, a set-top box, and an automatic editing device for home use or business use.

100 ... Recording device, 101 ... Tuner unit, 102 ... HDD, 103 ... Decoder unit, 104 ... Video output unit, 105 ... CPU, 106 ... Viewer comment receiver 107 ... viewer comment database, 108 ... viewer comment highlight detection unit, 109 ... viewer comment highlight video processing unit, 200 ... viewer comment display device, 201 ... viewing Viewer comment receiving unit, 202... Viewer comment display processing unit, 300... Viewer comment input unit, 301... Viewer comment transmission unit, 302.

Claims (10)

A storage medium device for storing the program;
A comment receiver for receiving a plurality of comments from viewers on the scene of the program;
A detection unit that analyzes the plurality of comments based on a predetermined determination criterion and identifies a scene of interest with a high degree of attention of the viewer;
A video processing apparatus having a comment processing function. 2. The comment processing function according to claim 1, wherein the detection unit analyzes the comment obtained by removing a preset negative vocabulary from the plurality of comments and identifies the attention scene. Video processing device. 2. The comment processing function according to claim 1, wherein the detection unit analyzes the comment including a vocabulary having a preset negative content in the plurality of comments to identify the attention scene. Video processing device. A video processing unit that processes the video of the program, the detection unit and the video processing unit,
When the digest of the program is obtained for the same program, a plurality of the scenes of interest are specified, videos of the respective scenes are extracted, and thumbnails of the videos of the program are obtained. 2. A video processing apparatus having a comment processing function according to claim 1, wherein the video of the scene is extracted by identifying the scene. 5. The video processing apparatus having a comment processing function according to claim 4, wherein the video processing unit extracts a program video that has progressed for a predetermined time from when the plurality of comments are received for digest or thumbnail use. . 5. The video processing apparatus having a comment processing function according to claim 4, further comprising an output unit for outputting a program video taken out for digest or thumbnail to a monitor. 5. The video processing apparatus having a comment processing function according to claim 4, further comprising a recording medium for storing the video extracted for the digest or the thumbnail. 5. The video processing apparatus having a comment processing function according to claim 4, further comprising: a transmission unit that transmits the video extracted for the digest or thumbnail to another device. The video processing apparatus having a comment processing function according to claim 1, further comprising a comment input unit for inputting the comment. In a comment processing method for a video processing apparatus having a receiving unit connected to a network and a processing unit for processing a received signal,
Receiving and storing the program, and receiving a plurality of comments from viewers for the scene of the program,
A comment processing method for a video processing apparatus, characterized in that the plurality of comments are analyzed based on a preset criterion, and an attention scene having a high degree of attention of the viewer is specified.

Images