JP2009188670A - Information processing apparatus and method, program, and, recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To efficiently reproduce entire contents including a missed portion when there is missing. <P>SOLUTION: A viewing state of a viewer is acquired by sensing. At the same time, contents are analyzed, thereby outputting, as a quantitative value, how the contents of a missed interval are. Information merging the viewing state of the viewer and the contents of the missed interval is then presented on a screen during viewing or after viewing. Thus, the viewer determines whether that it is necessary to view again the missed content term. Furthermore, while using a content analysis result in previous view to digest-reproduce contents of a non-missed term, the missed term is reproduced intensively. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an information processing apparatus, an information processing method, a program, and a recording medium on which the program is recorded, which are suitable for efficiently presenting content according to the viewing status of the content of the viewer.

  Conventionally, it is determined whether or not the viewer is viewing the content presented on the display device. If the content is missed as a result of the determination, recording is started, video display is stopped, and the display device is turned off. Alternatively, the video or the display device itself was processed on the spot, such as playing back the video. That is, the conventional one is a problem solving means in real time.

  For example, a technique is disclosed in which a program missed due to an unexpected interruption during viewing, such as interruption due to an incoming call or interruption due to a visitor, can be viewed over the interruption (see, for example, Patent Document 1). ).

  Further, a technique for performing appropriate reproduction control depending on whether or not the viewer is viewing the display unit is disclosed (for example, see Patent Document 2).

  In addition, when watching a program, the program cannot be continuously watched. For example, even when watching a program outdoors, the program can be overlooked by determining whether or not the viewer is watching the program. A technique is disclosed that allows a program to be sampled without occurrence (see, for example, Patent Document 3).

However, in fact, some of the facts that were missed were that the user wanted to see the content but could not see it, did not need to see it or did not see it There are various situations, such as when there was no need to see after all.
JP 2005-223778 A JP 2005-275046 A JP 2006-013645 A

  By the way, when the viewer views the content, there is a situation in which viewing must be interrupted due to a sudden event. For example, if the user is viewing broadcast content, the user will miss the content while viewing is interrupted. If the video is recorded on a recording device or the video recorded on a recording medium such as a DVD, the playback can be stopped by pause, but it is often impossible to execute it if the viewing is interrupted suddenly. In general, it is only necessary to review the same content again at that time, but it is difficult for the viewer to determine whether or not the content that has been missed is really necessary because it is not known. In other words, in the situation of oversight, “if you want to review because you missed”, “if you missed it but do not need to review”, “if you did not knowingly want to review”, “if you want to review” If you do not need to review. In any case, since the viewer does not watch the content for that period, it is difficult to determine whether it is necessary to review.

  The present invention has been made in view of such a situation, and an object of the present invention is to perform efficient reproduction of the entire content including a missed portion when there is an overlook.

  An information processing apparatus according to an aspect of the present invention is based on a receiving unit that receives information indicating the viewing state of the viewer with respect to the presented content displayed on the display device, and the received information indicating the viewing state of the viewer And a presentation processing unit for generating a digest of the presented content.

  An information processing method and program according to an aspect of the present invention are an information processing method and program for an information processing device that provides content to a viewer, and the viewer's viewing state with respect to the presented content displayed on a display device. Receiving the information indicating, and generating a digest of the presented content based on the received information indicating the viewing state of the viewer.

  In one aspect of the present invention, it is detected whether or not the viewer is viewing the presented information, and when an oversight occurs, a digest is created in consideration of the oversight.

  As described above, according to one aspect of the present invention, efficient reproduction can be performed in digest reproduction during re-viewing.

  Hereinafter, examples of embodiments of the present invention will be described with reference to the accompanying drawings.

  The embodiment described below is a specific example of a preferred embodiment for carrying out the present invention, and therefore various technically preferable limitations are given. However, the present invention is not limited to these embodiments unless otherwise specified in the following description of the embodiments. Therefore, for example, the materials used in the following description, the amounts used, the processing time, the processing order, and the numerical conditions of each parameter are only suitable examples, and the dimensions, shapes, and arrangements in the drawings used for the description The relationship and the like are also schematic showing an example of the embodiment.

  FIG. 1 is a block diagram showing an outline of an information presentation system to which the information processing apparatus according to the first embodiment of the present invention is applied.

  In FIG. 1, an information processing apparatus 1 which is an example of an information processing apparatus of the present invention is configured to include a tuner 2, a storage unit 3, a content analysis unit 4, and a presentation processing unit 7. In addition, the information processing device 1 receives signals input from the sensor 5 and the input device 9 and outputs content to be presented on the display device 8, that is, information. The sensing unit 5, the display device 8, and the input device 2 may be provided as an information presentation system, and are not necessarily configured integrally with the information processing device 1.

  The tuner 2 receives a television broadcast wave requested by a user (viewer) or the like from a plurality of television broadcast waves (television broadcast signals) via an antenna (not shown). A video signal and an audio signal constituting a broadcast program (hereinafter also simply referred to as “broadcast program”) are separated and demodulated in a predetermined format. The demodulated video signal and audio signal are supplied to the storage unit 3, the content analysis unit 4 or the presentation processing unit 7. In the present embodiment, the broadcast may be satellite broadcast instead of television broadcast. These broadcasts may be digital broadcasts or analog broadcasts. In addition, since it is sufficient that content such as a broadcast program can be received, content in a streaming data format may be downloaded using an interface (communication unit) such as a modem.

  The storage unit 3 temporarily records and stores the television broadcast program received by the tuner 2. When there are two or more tuners 2, the storage unit 3 records and stores a television broadcast program received by the tuner 2. For example, a hard disk drive (HDD), a DVD (Digital Versatile Disc), a semiconductor memory, or the like can be applied to the storage unit 3. The storage units 3 may be provided in the number corresponding to the number of tuners 2. Alternatively, one storage unit 3 may be divided into a plurality of partitions (areas), and a plurality of television broadcast programs received by the tuner 2 may be recorded in the respective areas.

  In the present invention, it is important to review the content again when it is overlooked. Therefore, as the content to be handled, a television broadcast program or video content downloaded via a network (not shown) as described above is used. Assume one stored in a hard disk drive or one stored on a recording medium such as a DVD. Only when recording at the same time while watching a real-time broadcast program, it is possible to apply content that was not originally stored.

  The content analysis unit 4 is an example of the “content analysis unit” recited in the claims, and receives content (video information, audio information, etc.) obtained from a content source such as a television broadcast wave input from the tuner 2. Analyze and output the analysis result to the presentation processing unit 7. At the same time, it is stored in a non-volatile recording means such as the storage unit 3. Analyzing content in the present embodiment means detecting a feature (or a feature at that time) accompanied by a time change of input content.

  The content analysis method includes a so-called climax due to the strength of the audio signal, or a section including a time when the scene change is detected using a known scene change detection method and a certain interval thereafter. Is an important section, or a method of determining a moment when the volume is large and the amount of activity of the video frame is large as a rising part.

  The sensor 5 is a detection unit that detects the viewer or the viewing environment and outputs the detection data indicating the viewing state of the viewer to the receiving unit 6. By directly detecting the movement of the viewer using the sensor 5 or detecting the viewing environment of the viewer, the viewing state of the viewer can be determined.

  The reception unit 6 is an example of a “reception unit” recited in the claims, and is an interface that receives detection data output from the sensor 5, performs predetermined processing as necessary, and transmits the detection data to the presentation processing unit 7. Function as. For example, when the detection data output from the sensor 5 is an analog signal, the detection data is sent to the presentation processing unit 7 after analog-digital conversion processing.

  In the viewing state detection using the sensor 5, it is only necessary to detect whether or not the viewer is viewing the screen on which the content is presented, or whether or not the screen can be viewed. . As for the method, various patterns are conceivable as shown in FIGS.

FIG. 2 is a diagram illustrating an example in which the orientation of the viewer's face or line of sight is detected using a camera.
As shown in FIG. 2, a camera 11 (still camera or video camera) is installed as a sensor 5 on the display device 8, and the orientation or line of sight of the viewer 10 is determined based on an image obtained from the camera 11. To detect.

FIG. 3 is a diagram illustrating an example in which the orientation of the viewer's face or the position of the head is detected using an external device.
As shown in FIG. 3, a headphone 12 incorporating an acceleration sensor is mounted as a sensor 5 on the head of a viewer 10 who is viewing the content displayed on the display device 8. Based on the acceleration data obtained from the headphones 12, the orientation (movement) of the viewer 10 or the position of the head is detected.

FIG. 4 is a diagram illustrating an example in which the orientation of the viewer is detected using a rotary chair or the like.
As shown in FIG. 4, a rotary encoder 14 is installed as the sensor 5 under the chair 13 on which the viewer 10 who is viewing the content displayed on the display device 8 sits. The rotary encoder 14 is a typical detector that converts a mechanical rotational displacement (analog amount) to be measured into an electrical pulse (digital amount), and thereby the rotation amount and rotation angle of the target device and thus the user 10. Rotational position etc. can be measured.

FIG. 5 is a diagram illustrating an example in which the viewer directly indicates the viewing state using an input device or the like.
As shown in FIG. 5, the viewer 10 who is viewing the content displayed on the display device 8 operates the input device 15 such as a remote controller and directly inputs his / her viewing state to the display device 8 (declaration). To do. By using the input device 15 instead of the sensor 5, the direction in which the viewer 10 is facing is detected.

FIG. 6 is a diagram showing an example of detecting a viewer's oversight by using fixed furniture or the like, where (a) shows a state where the viewer stands from a chair, and (b) shows a viewer. Represents the state of sitting on a chair.
As shown in FIG. 6, a pressure sensor 16 that detects pressure received from fixed furniture such as a chair 13 is provided and used as the sensor 5. Based on the pressure detected by the pressure sensor 16, the viewer 10 stands from the chair 13 (see FIG. 6A) and the viewer 10 is sitting on the chair 13 (FIG. 6B). ) To detect the viewing state of the viewer.

  Returning to the description of FIG. The presentation processing unit 7 is an example of a “presentation processing unit” and “missing information generation unit” described in the claims, and includes a processor (control unit) such as an MPU (Microprocessor). The presentation processing unit 7 receives content input signals from the tuner 2 or the storage unit 3, content analysis data from the content analysis unit 4, detection data from the sensor 5 via the reception unit 6, and input signals from the input device 9. Is done. The presentation processing unit 7 determines the viewing state of the viewer, that is, whether or not the viewer is viewing the presented content (presence / absence of oversight) based on these input signals and data, and according to the determination result Command is sent to each block to control the operation of each block.

  Also, the presentation processing unit 7 can decode the content input from the tuner 2 or recorded in the storage unit 4 and separate it into a video signal and an audio signal. The presentation processing unit 7 controls to output a video signal included in the content to the display device 8 described later in response to a user request. Hereinafter, the video signal may be simply referred to as “video”. Further, the presentation processing unit 7 outputs an audio signal included in content such as a broadcast program to a speaker (not shown) provided in the display device 8 and the like described later in response to a user request. Hereinafter, the audio signal may be simply referred to as “audio”.

  The presentation processing unit 7 includes an internal clock (internal clock) or the information processing apparatus 1 includes a clock unit (not shown), and is configured to be able to measure an arbitrary event and a time related to the processing according to the purpose. ing.

Here, the presentation processing unit 7 will be described in more detail.
FIG. 7 is a block diagram illustrating an example of an internal configuration of the presentation processing unit 7. The presentation processing unit 7 includes a missed information generation unit 7A, a digest creation unit 7B, a reproduction processing unit 7C, an OSD (on-screen display) signal generation unit 7D, and a video signal synthesis unit 7E.

  The missed information generating unit 7A is an example of the “missed information generating unit” described in the claims, and based on the information (detection data) indicating the viewing state of the viewer received from the sensor 5 by the receiving unit 6, Miss information including information regarding a location where the viewer missed the content presented on the display device 8 is generated.

  The digest creation unit 7B is configured to input the content (video) input based on the content analysis data input from the content analysis unit 4, the miss information generated by the miss information generation unit 7A, or parameters input by the user. Create an optimal digest video. Then, the created digest video is output to the reproduction processing unit 7C. Digest creation means include, for example, fast-forwarding, information thinning, and extracting only a rising part. It should be noted that if the user has not missed the content or has received an instruction not to create a digest, no digest is created.

  The playback processing unit 7C performs playback processing such as fast-forwarding of the video necessary for the digest video created by the digest creation unit 7B. Then, the digest video subjected to the predetermined reproduction process is output to the video signal synthesis unit 7E.

  The OSD signal generation unit 7D generates a video signal to be superimposed on content (video signal) such as a graphical user interface such as a setting screen. Then, the generated video signal is output to the video signal synthesis unit 7E. Similarly, the OSD signal generation unit 7D generates a video signal of the miss information generated by the miss information generation unit 7A and outputs the video signal to the video signal synthesis unit 7E.

  The video signal synthesis unit 7E synthesizes each video signal input from the reproduction processing unit 7C and the OSD signal generation unit, and displays the synthesized video signal as a video signal (presentation content) for finally presenting to the viewer Output to device 8.

  In the example shown in FIG. 7, the video signal has been described. However, the audio signal corresponding to the content of the video signal is also processed by the digest creation unit 7B and the reproduction processing unit 7C and synchronized with the video signal presented to the viewer. Then, it is output to a speaker attached to the display device 8 or an arbitrary speaker (not shown). Although it has been described that a digest is created for an audio signal corresponding to a video signal, the present invention is not limited to this example. For example, the digest creation unit 7B creates a digest of only the audio signal included in the content. It may be.

  Further, in the example shown in FIG. 7, a case in which the presentation processing unit 7 includes a miss information generation unit 7A, a digest creation unit 7B, a reproduction processing unit 7C, an OSD signal generation unit 7D, and a video signal synthesis unit 7E. Although described, it is not limited to this example. For example, these blocks may be provided independently, and various forms are conceivable, such as providing only the missed information generating unit 7A outside the presentation processing unit 7.

  Returning to the description of FIG. The display device 8 displays the video signal input from the presentation processing unit 7 on the display screen. In addition, an audio signal input from the presentation processing unit 7 is output (sounded) from an attached speaker. For example, an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence) display, a plasma display, an FED (Field Emission Display), a CRT (Cathode Ray Tube), or the like can be applied to the display device 8. The display device 8 may be a display system composed of a plurality of display devices, so-called multi-display. In the example of the present embodiment, a speaker (not shown) is disposed in the vicinity of the display screen of the display device 8, but the speaker may of course be separate from the display device 8.

  The input device 9 is composed of, for example, a remote controller, and transmits a parameter for arbitrary processing, a determination result of the user, and the like to the presentation processing unit 7 via a receiving unit (not shown) according to a user operation. For example, when a channel selection signal is transmitted from the input device 9, the presentation processing unit 7 receives a television broadcast wave of the channel selected by the user based on the channel selection signal received from the input device 9 to the tuner 2. The broadcast program of the television broadcast wave is displayed on the display device 8.

  Note that the information transmitted using the input device 9 is assumed to be a viewer's judgment result or numerical input of setting parameters, and the input device 15 used for inputting the viewer's viewing state (see FIG. 5). However, the input device 9 and the input device 15 may be the same. Further, the input device 9 may be an input means such as an operation key provided at a predetermined position of the housing of the information processing device 1.

  Next, the miss detection process by the presentation processing unit 7 will be described with reference to the flowchart of FIG.

  First, the viewer operates the input device 9 to start viewing the content received by the tuner 2 or the content read from the storage unit 3, thereby starting the miss detection process.

  In step S <b> 1, the presentation processing unit 7 starts the viewing time measurement at the same time that the user starts viewing the content, that is, starts the presentation of the content on the display device 8.

  In step S2, the content analysis unit 4 analyzes the content of the input content.

  In step S <b> 3, the presentation processing unit 7 determines whether the viewer is viewing the content presented on the display device 8. This determination is made based on viewing state detection data input from the sensor 5 via the receiving unit 6 or information directly input from the input device 15. When it is determined that the user is viewing the content, the process proceeds to step S8, and when it is determined that the content is overlooked, the process proceeds to step S5. Moreover, the process of step S4 is performed in parallel with the process of step S3.

  In step S4, the content analysis unit 4 outputs the result of content analysis to the presentation processing unit 7 as content analysis data together with the time code. Further, the content analysis data is stored in the storage unit 3. After this process is completed, the process proceeds to step S5.

  In step S <b> 5, the missed information generating unit 7 </ b> A of the presentation processing unit 7 performs missed evaluation based on the content analysis data when detecting the missed content by the viewer. This missed evaluation refers to a process of acquiring data of a time code in which an oversight occurred and creating data indicating a content analysis result and a missed section on the same time axis. After this process is completed, the process proceeds to step S6.

  In step S6, the presentation processing unit 7 stores the missed time data and the missed evaluation data created in step S5 in the storage unit 3, and outputs the missed time data and / or the missed evaluation data to the display device 8. After this process ends, the process proceeds to step S7.

  In step S <b> 7, the display device 8 receives the missed time data and / or missed evaluation data from the presentation processing unit 7, and displays both the content analysis result and information on the location that the viewer has not seen (missed). However, the present invention is not limited to this, and only the missed time may be displayed. After this process is completed, the process proceeds to the determination process in step S8.

  Here, display examples based on the video signal generated by the OSD signal generation unit 7D of the presentation processing unit 7 are shown in FIGS.

FIG. 9 shows an example in which only the miss time is displayed as miss information.
In this example, as the missed time, the total time 21 obtained by integrating the times missed by the user for a certain content is displayed as a numerical value. The total time 21 may be displayed at any position on the screen where the content is displayed, or at any position on the screen shown in FIGS. 10 and 11 below.

  By displaying the missed time (integrated time) in this way, the user can easily know the missed time of one content. Accordingly, it is possible to determine whether to review the content based on the ratio of the missed time to the content viewing time.

FIG. 10 shows a display example of content analysis results up to a predetermined time ago as missed information and a time when the missed occurrence occurred. (A) is a display example at a certain time, and (b) is shown in (a). It is an example of a display after predetermined time progress from time. 10A and 10B, the horizontal axis indicates time, and the vertical axis indicates the degree of excitement of content.
In this example, the screen 22 displays a certain content miss time (missing section 24) and content information (a climax curve 23, CM (commercial message) section 25) in real time. The swell degree curve represents the degree of swell of the content, that is, the content of the content, depending on its shape.

  The display content in this screen 22 changes with time. For example, the missed section 24 and the CM section 25 are displayed at a certain time as shown in FIG. 10 (a). However, the entire section transitions to the right as time passes, and at a time after a certain period of time, As shown in FIG. 10B, the missed section 24 moves to the right, and the display area of the CM section 25 almost disappears. Note that the CM is an advertisement broadcast broadcast during a program.

  In this manner, for example, by displaying the missed section 24, the climax curve 23, and the CM section 25 and displaying the missed time and the content information on the same screen, the contents can be easily grasped and overlooked. It is easy to see how the location and time zone are positioned in the content.

Returning to the flowchart of FIG.
In step S <b> 8, the presentation processing unit 7 determines whether or not the content to be presented ends or the miss detection process ends. If it is determined in this determination process that none has been completed, the process returns to step S2, content analysis is performed, and a series of processes is continued. On the other hand, when it is determined that the content is over or the overlook detection process is over, the process proceeds to step S9.

  In step S <b> 9, the missed information generating unit 7 </ b> A of the presentation processing unit 7 performs total missed evaluation when it is determined that the content is finished or the missed detection process is finished. That is, the total miss evaluation data for the entire content is evaluated by evaluating the analysis result of the content and the missed section. After this process is completed, the process proceeds to step S10.

  In step S <b> 10, the optimal display processing unit 6 stores the total miss evaluation data in the storage unit 3 and outputs the total miss evaluation data to the display device 8. After this process is completed, the process proceeds to step S11.

  In step S <b> 11, the display device 8 receives the total miss evaluation data from the presentation processing unit 7, and displays both the analysis result of the entire content and information on the location that the viewer has not seen (missed). After this process is completed, a series of missed detection processes is terminated.

FIG. 11 shows an example of display of a content analysis result, a section where an oversight has occurred, and a representative image in all sections where content is viewed.
In this example, information on a certain content (content content display area 32, CM display area 33) and a still image (representative image display area 34) representing the content content are displayed on the screen 31.

  In the content content display area 32, for example, a climax curve 35 is displayed to represent the content content. In the CM display area 33, for example, CM sections 37-1 and 37-2 are displayed, and the CM broadcast time and time can be read. In addition, in the representative image display area 34, for example, by displaying still images 38A to 38I that are cut out from the content at intervals of several minutes, at the beginning of the chapter, or at every rise, the outline and flow of the entire content can be understood. It can be done. The missed sections 36-1 and 36-2 are displayed so as to be superimposed on the content content display area 32 and the CM display area 33.

  In this way, for example, by displaying the content analysis result and the section where the oversight occurred in all sections where the content was viewed and the representative image on the screen of the display device 8, the contents can be easily grasped and missed. It is easy to see how the location and time zone are positioned in the content. The viewer can use the information displayed on the screen as a material for determining the importance of the missed location.

  As an example, the display forms shown in FIGS. 9 to 11 can be changed by the viewer using the input device 9 such as a remote controller. Further, the combination of contents to be presented such as a content analysis result graph (for example, a climax curve) and a still image is not limited to this, and a form that can be selected by the viewer is used. In the above-described example, the content level is detected and the content content is expressed. However, the content content may be expressed by other information related to the content.

  Next, with reference to FIG. 12 to FIG. 14, digest reproduction considering the oversight by the presentation processing unit 7 will be described.

FIG. 12 is a flowchart showing digest reproduction processing by the presentation processing unit 7.
In the present invention, when performing a digest playback, when a viewer has viewed the selected content before, it is possible to select the playback considering the oversight of the content. The reproduction in consideration of the overlook refers to the viewing mainly on the missed section detected when the content was previously viewed and the digest reproduction otherwise. If it is selected not to consider oversight, general digest playback is performed.

  In step S <b> 21, the presentation processing unit 7 determines whether digest viewing is selected based on the input signal from the input device 9. If it is determined that the digest viewing is selected, the process proceeds to step S22. On the other hand, if it is determined that the digest viewing has not been selected, the process proceeds to step S32, and normal content is reproduced and displayed.

  In step S <b> 22, the presentation processing unit 7 determines whether or not the selected digest reproduction is a digest reproduction that considers missing. If it is determined that the digest reproduction is not in consideration of oversight, the process proceeds to step S27, and normal digest reproduction is performed. On the other hand, when it is determined that the digest reproduction is in consideration of oversight, the process proceeds to step S23.

  In step S <b> 23, the presentation processing unit 7 reads content analysis data from the storage unit 3.

  In step S24, total miss evaluation data (time code and overall content information at that time) when the viewer has previously viewed the content is read from the storage unit 3. After the processes of steps S23 and S24 are completed, the process proceeds to step S25.

  In step S <b> 25, the presentation processing unit 7 sets the digest density based on the input signal from the input device 9. That is, for example, a playback menu screen is displayed on the display device 8 and the user is prompted to input the density of digest playback using the input device 9, and the density of digest playback is set by the input signal. After this process is completed, the process proceeds to step S26.

  Here, the density of digest reproduction in the present invention is a parameter for creating a digest, and in other words, refers to a digest reproduction method or a digest reproduction mode. This parameter may be, for example, the compression ratio of the content playback time, the presence / absence of CM removal, or a playback instruction at a user-specified location. Alternatively, the user may input the compression rate of the content (for example, the playback time is reduced from 30 minutes to 5 minutes, the playback time is reduced by what percentage, etc.), and the digest playback mode is determined based on the input compression rate. It may be.

  In step S26, the digest creation unit 7B of the presentation processing unit 7 creates a digest of the selected content based on the total miss evaluation data and the set digest reproduction density. The created digest is input to the video signal synthesis unit 7E via the reproduction processing unit 6C, and is supplied from the video signal synthesis unit 7E to the display device 8.

  Instead of waiting for the user to input the digest reproduction density using the input device 9, the digest density may be automatically set in advance. For example, when digest reproduction considering oversight is selected, the digest creating unit 7B creates a digest based on a preset density of digest reproduction.

  In step S32, the display device 8 receives the video signal of the content to be presented from the presentation processing unit 7 and displays it on the display screen. After this processing is completed, the viewer is further detected in the digest reproduction. In this way, when the miss detection is performed also in the digest playback, further digest playback considering the miss in the digest playback can be performed, which is a useful function for busy viewing. After this processing ends, a series of digest playback processing ends. Note that the miss detection process in step S33 is not essential and may be omitted.

  On the other hand, in step S27, it is determined whether or not the content analysis unit 4 has previously analyzed the selected content. When it is determined that the content has been analyzed previously, the process proceeds to step S28.

  In step S <b> 28, the presentation processing unit 7 reads the previously analyzed content analysis data from the storage unit 3. After this process is completed, the process proceeds to step S30.

  On the other hand, in step S29, when it is determined in step S27 that the content has not been analyzed before, the content analysis unit 4 analyzes the selected content. The analyzed content analysis data is stored in the storage unit 3. After this process is completed, the process proceeds to step S30.

  In step S <b> 30, the presentation processing unit 7 sets the digest density based on the input signal from the input device 9. That is, for example, a playback menu screen is displayed on the display device 8 and the user is prompted to input the density of digest playback using the input device 9, and the density of digest playback is set by the input signal. After this process ends, the process proceeds to step S31.

  In step S31, the digest creation unit 7B of the presentation processing unit 7 creates a digest of the selected content based on the content analysis data and the set digest reproduction density. The created digest is input to the video signal synthesis unit 7E via the reproduction processing unit 7C, and is supplied from the video signal synthesis unit 7E to the display device 8. After this process is completed, the process proceeds to step S32, and the digest of the selected content is displayed on the display screen of the display device 8.

  Next, two examples of the content digest created by the digest creating unit 7B will be described.

FIG. 13 is a diagram showing an example of a digest according to the first embodiment of the present invention.
The digest according to the first embodiment is created by the simplest method in which a section in which content is missed is reproduced as it is and digest reproduction is performed in other sections.

  In FIG. 13, the total missing evaluation data before the digest processing includes a content content display area 41 including a climax curve 43 and a CM display area 42. The content includes two missed sections 44-1 and 44-2, and the entire content is divided into three sections 45-1 to 45-3 that are not missed. In addition, this content includes CM sections 46-1 and 46-2, and one CM section 46-1 is in the range of the overlooked section 44-1.

  By performing digest processing on such content information and content including an overlooked section, a lower diagram of FIG. 13 is obtained. In this example, the sections 45-1 to 45-3 that are not overlooked are compressed while the overlook sections 44-1 and 44-2 are left as they are, and the digest sections 45A-1, 45A-2, 45A-3-1, and 45A- are compressed. 3-2. Digest section 45A-3-2 is originally CM section 46-2. By compressing the CM section into a digest section, more efficient reproduction can be performed.

FIG. 14 is a diagram showing an example of a digest according to the second embodiment of the present invention.
The digest according to the second embodiment uses a chapter function that is also installed in a general recording device by content analysis. Of the content divided into chapters by content analysis, the chapters in the section that has been overlooked are reproduced as they are, and the digest reproduction is performed with other chapters.

  In FIG. 14, the total missing evaluation data before the digest processing includes a content content display area 51 including a climax curve 53 and a CM display area 52. The content includes two missed sections 54-1 and 54-2, and the entire content is divided into three sections that are not missed. Further, this content includes CM sections 55-1 and 55-2, and before and after these CM sections, there are sections 56-1 to 56-6 divided into six chapters.

  By performing digest processing on such content information and content including an overlooked section, the lower diagram of FIG. 14 is obtained. In this example, the chapter sections 56-2, 56-3, and 56-5 including part of the missed sections 54-1 and 54-2 are reproduced as they are. However, it is more preferable to compress the CM section 55-2 into a digest section. In addition, the sections 56-1, 56-4, and 56-6 that are not overlooked are compressed to be digest sections 56A-1, 56A-4, and 56A-6.

  The above-described digest creation and chapter addition can be realized using known techniques. For example, Japanese Patent Application Laid-Open No. 2006-54622 discloses a technique for adding a chapter and determining a digest accordingly. Japanese Patent Application Laid-Open No. 2004-191780 discloses a technique for detecting a rising portion from an acoustic signal in an event or the like with high accuracy and adding an index to the rising portion. Japanese Patent Laying-Open No. 2005-328329 discloses a technique that ranks the importance levels of scenes and determines a digest accordingly.

  As described above, according to the present invention, overlooked time, content information (FIGS. 9 to 11), and the like are used as a determination material for determining whether the content presented to the viewer needs to be reviewed in the first stage. Present. And when it is judged that it is necessary to review, digest reproduction | regeneration is performed as a 2nd step and efficient presentation (refer FIG. 13, FIG. 14) is performed.

  With such a configuration, when the viewer misses when viewing the content, it is possible to easily know when and at what time (section) it missed.

  In addition, when the viewer misses when viewing the content, it is possible to easily know what kind of content has been missed.

  Further, by showing the viewer the accumulated time and importance of the missed section in the reproduced content, it is possible to provide a material for determining whether it is better to review again.

  In addition, in the digest playback at the time of re-viewing, by utilizing the missed section for the digest creation, it is possible to efficiently re-view the section that has been missed while the digest is being played back. That is, the missed information and the content analysis information obtained at the first viewing time are used as the judgment judgment material at the first playback time, and are used for efficient digest video creation at the second playback time.

  For example, it is very inefficient to view the entire content once viewed even if it is fragmented. In addition, even if the missed period is detected by detecting the missed period, even if only the missed period of content is seen, if the context of the story (story line) or the flow of the content is not known, it means that it is seen again Is likely not to communicate. Therefore, efficient reproduction is realized by performing a process of intensively reproducing the missed period while digest-reproducing the contents in the period not missed using the content analysis result when viewed before.

  Note that a series of processes performed by the information processing apparatus described above can be executed by hardware or can be executed by software. Needless to say, the function for executing these processes can also be realized by a combination of hardware and software. When a series of processing is executed by software, it is possible to execute various functions by installing a computer in which a program constituting the software is incorporated in dedicated hardware, or by installing various programs. For example, it is installed from a program recording medium in a general-purpose computer or the like.

  FIG. 15 is a block diagram illustrating a configuration example of a computer that executes the above-described series of processing by a program. The computer 101 may be, for example, a personal computer having a certain performance in addition to a dedicated computer with high performance for executing a series of processes.

  A CPU (Central Processing Unit) 111 of the computer 301 executes various processes in addition to the series of processes described above according to a program recorded in a ROM (Read Only Memory) 112 or a recording unit 118. A RAM (Random Access Memory) 113 appropriately stores programs executed by the CPU 111 and data. The CPU 111, the ROM 112, and the RAM 113 are connected to each other by a bus 114.

  An input / output interface 115 is also connected to the CPU 111 via the bus 114. The input / output interface 115 is connected to an input unit 116 including a keyboard, a mouse, and a microphone, and an output unit 117 including a display and a speaker. The CPU 111 executes various processes in response to commands input from the input unit 116. Then, the CPU 111 outputs the processing result to the output unit 117.

  The recording unit 118 connected to the input / output interface 115 includes, for example, a hard disk, and records programs executed by the CPU 111 and various data.

  The communication unit 119 communicates with an external device via a network such as the Internet or a local area network. A program may be acquired via the communication unit 119 and recorded in the recording unit 118.

  The drive 120 connected to the input / output interface 115 drives a removable medium 131 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and drives programs and data recorded there. Get etc. The acquired program and data are transferred to the recording unit 118 and recorded as necessary.

  A program recording medium that stores a program that is installed in a computer and can be executed by the computer is provided as a package medium by a removable medium 131 as shown in FIG. As the removable medium 131, a magnetic disk (including a flexible disk), an optical disk (including a CD-ROM (Compact Disc-Read Only Memory), a DVD (Digital Versatile Disc), a magneto-optical disk), or a semiconductor memory is applied. be able to. Alternatively, the program recording medium includes a ROM 112 that stores (records) a program temporarily or permanently, a hard disk that configures the recording unit 318, and the like.

  The program is stored in the program recording medium via a communication unit 119 that is an interface such as a router or a modem, as necessary, such as a local area network (LAN), the Internet, or digital satellite broadcasting. This is performed using a wireless communication medium.

  In the present specification, the processing steps describing the program stored in the program recording medium are not limited to the processing performed in time series in the described order, but are not necessarily performed in time series. This includes processing that is executed manually or individually (for example, parallel processing or object processing).

  Further, the program may be processed by a single computer, or may be processed in a distributed manner by a plurality of computers. Furthermore, the program may be transferred to a remote computer and executed.

  Furthermore, the embodiments of the present invention are not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the present invention.

It is a block diagram which shows the outline | summary of the system which concerns on the 1st Embodiment of this invention. It is explanatory drawing in the case of detecting the direction of a viewer's face, or a gaze using a camera. It is explanatory drawing in the case of detecting a viewer's face direction or head position using an external device. It is explanatory drawing in the case of detecting a viewer's direction using a chair etc. FIG. It is explanatory drawing in case a viewer directly indicates a viewing state using an input device or the like. It is explanatory drawing in the case of detecting a viewer's oversight by using the fixed furniture etc. It is a block diagram which shows the example of the internal structure of the presentation process part which concerns on the 1st Embodiment of this invention. It is a flowchart of the miss detection process concerning a 1st embodiment of the present invention. It is the figure which showed the example of a display of the time when the oversight occurred concerning the 1st Embodiment of this invention. It is the figure which showed the example of a display of the time which the content analysis result and oversight occurred until the predetermined time before concerning the 1st Embodiment of this invention. It is the figure which showed the example of a display of the content analysis result in all the sections which watched the content which concerns on the 1st Embodiment of this invention, the section which overlooked, and the representative image. It is a flowchart of the digest reproduction | regeneration processing which concerns on the 1st Embodiment of this invention. It is a figure which shows the example of digest production | generation concerning the 1st Embodiment of this invention. It is a figure which shows the example of digest production | generation concerning the 2nd Embodiment of this invention. And FIG. 11 is a block diagram illustrating an example of a configuration of a personal computer.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Information processing apparatus, 2 ... Tuner, 3 ... Accumulation part, 4 ... Content analysis part, 5 ... Sensor, 6 ... Reception part, 7 ... Presentation processing part, 7A ... Missed information generation part, 7B ... Digest preparation part, 7C ... Reproduction processing unit, 7D ... OSD signal generation unit, 7E ... Video signal synthesis unit, 8 ... Display device, 9 ... Input device, 10 ... Viewer (user), 11 ... Camera, 12 ... Headphone, 13 ... Chair, 14 DESCRIPTION OF SYMBOLS ... Rotation detection part, 15 ... Remote operation device, 16 ... Pressure detection part, 21 ... Total time of (missing), 23 ... Swell degree curve, 24 ... Overlook section, 25 ... CM section, 32 ... Content content display area, 33 ... CM display area, 34 ... Representative image display area, 35 ... Swell degree curve, 36-1, 36-2 ... Missed section, 37-1, 37-2 ... CM section, 38A to 38I ... Still image, 41 ... Content Content display , 42 ... CM display area, 43 ... climax curve, 44-1, 44-2 ... missed section, 46-1, 46-2 ... CM section, 45A-1, 45A-2, 45A-3-1, 45A-3-2 ... digest section, 51 ... content content display area, 52 ... CM display area, 53 ... climax curve, 54-1, 54-2 ... missed section, 55-1, 55-2 ... CM section, 56-1 to 56-6 ... chapter sections, 56 A- 1, 56 A- 4, 56 A- 6 ... digest sections

Claims (9)

A receiving unit that receives information indicating the viewing state of the viewer with respect to the presented content displayed on the display device;
A presentation processing unit that generates a digest of the presented content based on the received information indicating the viewing state of the viewer;
An information processing apparatus comprising: From the information indicating the viewing state of the viewer received by the receiving unit, the miss information generating unit that generates miss information including information on a location where the viewer missed the presentation content,
The information processing apparatus according to claim 1, wherein the presentation processing unit generates a digest of the presentation content in accordance with the miss information generated by the miss information generation unit. A content analysis unit for analyzing the content of the presented content,
The presentation processing unit acquires the missed information generated by the missed information generating unit and the analysis result of the content of the content analyzing unit as parameters for reproducing the missed information. Item 3. The information processing device according to Item 2. The information processing apparatus according to claim 3, wherein the presentation processing unit outputs and displays information on a location where the presentation content is missed on the display device. The information processing apparatus according to claim 4, wherein the presentation processing unit outputs and displays content information indicating a miss time in a certain range of the presented content and content of the presented content on the display device. The information processing apparatus according to claim 4, wherein the presentation processing unit outputs and displays content information indicating an oversight time of the entire presented content and content of the presented content on the display device. In an information processing method by an information processing apparatus that provides content to a viewer,
Receiving information indicating a viewing state of the viewer with respect to the presented content displayed on the display device;
Generating a digest of the presented content based on the received information indicating the viewing state of the viewer;
An information processing method comprising: In a program for causing a computer to execute processing for providing content to a viewer,
Receiving information indicating the viewing state of the viewer with respect to the presented content displayed on the display device;
Generating a digest of the presented content based on the received information indicating the viewing state of the viewer;
A program that causes a computer to execute. Receiving information indicating the viewing state of the viewer with respect to the presented content displayed on the display device in a recording medium in which a program for causing the computer to execute processing for providing the content to the viewer is recorded;
Generating a digest of the presented content based on the received information indicating the viewing state of the viewer;
The computer-readable recording medium which recorded the program for making a computer perform.

Images