JP2009105770A - Information processor, information processing method, program, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a viewer to efficiently comprehend contents. <P>SOLUTION: In an information processing apparatus which acquires contents performs predetermined processing thereto and outputs a result, first contents and second contents are acquired, and the acquired first contents and second contents are stored in a storage section. After the second contents read from the storage section are analyzed, a video image of the first contents is then outputted and based on a result of analysis, auxiliary information indicating features of the second contents with temporal changes is outputted. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an information processing apparatus, an information processing method, a program, and a recording medium suitable for presenting a plurality of contents, for example.

  In recent years, with the improvement of information processing technology, the multi-functionality of television receivers has progressed, not only receiving television broadcasts broadcast from broadcast stations and displaying images as television broadcast programs, but also various It has come to have a function.

  For example, first and second tuners that individually receive television broadcasts, and first video that decodes video data multiplexed in the television broadcasts received by the first tuner and outputs them as table program videos A decoder and a second video decoder for decoding a part of the image data constituting the video data multiplexed in the television broadcast received by the second tuner and outputting it as a back program image; There has been proposed a television receiver that adds an image (sub-image) to program information of a television broadcast received by a second tuner and outputs it (for example, see Patent Document 1).

The television receiver can provide the user with easy-to-understand information on the contents of programs (back programs) other than the program being viewed (front program) with a simple configuration.
JP 2005-347871 A

  By the way, in an experiment conducted by the applicant of the present application, it was found that when a viewer views a plurality of contents (video and audio) at the same time, it is efficient to view in a time division manner. For this reason, it is considered effective to view the content in a time division manner in order to understand the content. The same experiment also showed that knowing the contents of the next program to be watched can understand the program more quickly.

  The present invention has been made in view of these points, and enables a viewer to efficiently understand a plurality of contents.

  An information processing apparatus according to a first aspect of the present invention includes an acquisition unit that acquires first content and second content, and a storage unit that stores the first content and the second content acquired by the acquisition unit. The content analysis unit that analyzes the second content read from the storage unit, and the video of the first content are output, and the characteristics of the second content that change with time based on the analysis result of the content analysis unit And an optimum presentation processing unit that outputs auxiliary information to be displayed.

  An information processing method according to a first aspect of the present invention is an information processing method of an information processing apparatus that acquires content, performs predetermined processing, and outputs the content, and acquires and acquires the first content and the second content. The first content and the second content are stored in the storage unit. And after analyzing the 2nd content read from the memory | storage part, while outputting the image | video of a 1st content, the auxiliary information which shows the characteristic accompanying the time change of a 2nd content is output based on the result of an analysis. It is characterized by that.

  The program according to the first aspect of the present invention is a process for acquiring the first content and the second content, a process for storing the acquired first content and the second content in the storage unit, and reading from the storage unit. A process of analyzing the second content, and a process of outputting the video of the first content and outputting auxiliary information indicating characteristics of the second content with time change based on the result of the analysis. It is characterized by that.

  The program recorded on the recording medium according to the first aspect of the present invention is a process for acquiring the first content and the second content, and stores the acquired first content and second content in the storage unit. Processing, processing for analyzing the second content read from the storage unit, output of the video of the first content, and auxiliary information indicating characteristics of the second content with time change based on the analysis result Output processing.

  In the first aspect of the present invention, the first content and the second content are acquired, and the acquired second content is analyzed by the content analysis unit. And while outputting the image | video of 1st content, the auxiliary information which shows the characteristic accompanying the time change of 2nd content based on the analysis result of a content analysis part is output.

  According to the present invention, a viewer can efficiently understand a plurality of contents.

  Hereinafter, examples of embodiments of the present invention will be described with reference to the accompanying drawings. The embodiments described below are preferable specific examples of the present invention, and thus various technically preferable limitations are given. However, the present invention is particularly limited in the following description. Unless otherwise stated, the present invention is not limited to these forms. For example, the materials used in the following description, the amount used, the processing time, the processing order, and the numerical conditions of each parameter are only suitable examples, and the dimensions, shapes, and arrangement relationships in the drawings used for the description are also examples. It is the rough thing to show.

  FIG. 1 is a configuration diagram showing an overview of an information presentation system according to each embodiment (first to sixth embodiments). As shown in FIG. 1, the information presentation system performs processing described later on content obtained by receiving television broadcast waves and outputs the information to the display device 2, and the information processing device 1 outputs the information. The display device 2 displays content.

  The information processing apparatus 1 includes a tuner unit 3, a storage unit 4, a content analysis unit 5, an optimum presentation processing unit 6, and an input unit 7. A mode (assist mode) for presenting assist information, which will be described later, is selected by an operation input using the user's remote controller, and information presentation according to the selected mode is performed.

  The tuner unit 3 receives and demodulates a television broadcast wave requested by a user (viewer) from a television broadcast wave (television broadcast signal) including a program of a plurality of channels via an antenna (not shown). . The tuner unit 3 is an example of an acquisition unit described in the claims. In the present embodiment, the information processing apparatus 1 has two or more tuner sections 3 and can simultaneously receive television broadcast signals of two or more channels (so-called double tuner, triple tuner). ). Broadcasting may be satellite broadcasting instead of television broadcasting. These broadcasts may be digital broadcasts or analog broadcasts.

  The storage unit 4 is an example of a recording unit described in the claims, and temporarily stores a television broadcast program (hereinafter simply referred to as “program”) included in a television broadcast wave received by the tuner unit 3. (Record. When there are two or more tuner units 3, the storage unit 4 records and stores the television broadcast program received by each tuner unit 3. For example, a hard disk (HDD), a DVD (Digital Versatile Disc), a semiconductor memory, or the like can be applied to the storage unit 4. The storage units 4 may be provided in the number corresponding to the number of tuner units 3. Alternatively, one storage unit 4 may be divided into a plurality of partitions (areas), and a plurality of television broadcast programs received by the tuner unit 3 may be recorded in the respective areas.

  The content analysis unit 5 analyzes video information and audio information obtained from a content source such as a television broadcast wave input from the tuner unit 3, and outputs the analysis result to the optimum presentation processing unit 6. The content of the analysis is to detect a feature (or a feature at that time) accompanying a time change of the input content. In the case of a presentation mode that requires content storage (for example, when the received streaming data cannot be used), the content data is acquired from the storage unit 4 that has previously performed content storage processing. The process to do is necessary.

  The optimum presentation processing unit 6 receives information indicating a feature (or a feature at that time) accompanying a time change of the content as an analysis result from the content analysis unit 5. Based on the information including the analysis result, auxiliary information (assist information) for assisting the user in understanding the contents of the front program or the back program is output to output means such as the display device 2. In main presentation, that is, presentation of a table program, the content such as a normal television broadcast program is presented without any processing. When the auxiliary information of the back program (or front program) is presented, the assist information is presented to the user by a presentation method as shown in FIG. Such a presentation method is referred to as sub-presentation (sub-presentation).

  As shown in FIG. 2, the sub-presentation method includes (a) a method of presenting the sub-presentation screen 2b on the main screen (main screen) 2a by PinP (picture-in-picture), and (b) a main on the display screen. A method of presenting the sub-presentation screen 2b as a sub-screen together with the screen 2c, or a method of presenting it on the main screen 2A and the separate screen 2B in the case of a (c) multi-display system can be considered. In addition, a method of presenting assist information by voice can be considered.

  Further, the optimum presentation processing unit 6 controls the operation of the entire information processing apparatus 1 and issues a processing instruction to each unit in the information processing apparatus 1 in accordance with a user operation input input from the input unit 7. . Also, the optimum presentation processing unit 6 can decode each television broadcast program (content) input from the tuner unit 3 or recorded in the storage unit 4 and separate it into a video signal and an audio signal. The optimum presentation processing unit 6 controls to output a video signal included in the television broadcast program to the display device 2 described later in response to a user request. Hereinafter, the video signal may be simply referred to as “video”. The optimum presentation processing unit 6 outputs an audio signal included in the television broadcast program to a speaker (not shown) provided in the display device 2 to be described later in response to a user request. The auxiliary information described above is presented using these video signals or audio signals. Hereinafter, the audio signal may be simply referred to as “audio”.

  The input unit 7 receives an input signal for channel selection of the user using a remote controller (not shown) or the like and transmits it to the optimum presentation processing unit 6. Based on the input signal received by the input unit 7, the television broadcast program of the channel selected by the user is read from the storage unit 4, and the video signal and the audio signal are decoded by the optimum presentation processing unit 6 to be visualized. And voiced. The input unit 7 is used to input a command from a remote controller or the like when determining which back program assist information is to be sub-presented and which assist information using which feature amount is to be sub-presented. . Although the number of back programs and the number of assist information presented at the same time is not limited, each embodiment will be described as one case.

  The display device 2 displays the video signal input from the optimum presentation processing unit 6 on the display screen. In addition, the audio signal input from the optimum presentation processing unit 6 is output (sound emission) from an attached speaker. For example, an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence) display, a plasma display, an FED (Field Emission Display), a CRT (Cathode Ray Tube), or the like can be applied to the display device 2. Note that the display device 2 may be a display system including a plurality of display devices, that is, a so-called multi-display. In the example of the present embodiment, a speaker (not shown) is disposed in the vicinity of the display screen of the display device 2, but it is needless to say that the speaker may be separate from the display device 2.

  The plurality of contents in each of the following embodiments may be a front program / back program or a plurality of contents displayed on a multi-display, but in the following example, the front program and back program in the display device 2 having one display screen are used. Treat the program as multiple contents.

  Further, as an example of content, a television broadcast program received by the tuner unit 3 is cited, but the present invention is not limited to this. For example, a plurality of video content and audio content stored in an external recording medium (removable medium) may be recorded in each area of the storage unit 4. The video is not limited to moving images, and may be still images.

Next, a processing example of the entire system will be described with reference to the flowchart of FIG.
First, the assist mode that the user wants to present is selected by a remote controller or the like (step S1). Subsequently, the channel for which the user wants to present an assist is selected by a remote controller or the like (step S2).

  Here, the optimum presentation processing unit 6 determines whether or not the selected assist mode is a mode that requires content storage (step S3). For example, in the topic remaining time notification mode, the topic remaining time needs to be known in order to calculate the remaining time of the topic. In this way, the requested processing cannot be executed unless the content is stored in advance in the storage unit 4. Therefore, depending on the mode, it is necessary to store the content in the storage unit 4 in advance.

  In step S3, in a mode that does not require content accumulation, the optimum presentation processing unit 6 controls the content analysis unit 5 to acquire content data from the tuner unit 3 (step S4).

  On the other hand, in the mode that requires the accumulation of content in step S3, the optimum presentation processing unit 6 reads the content data from the accumulation unit 4 by the content analysis unit 5 (step S5), and further the preanalysis data from the accumulation unit 4 (Step S6).

  After the processing of step S4 and step S6 is completed, the content analysis unit 6 analyzes the acquired content (step S7).

  The optimum presentation processing unit 6 receives the analysis result from the content analysis unit 6 and creates optimum presentation data corresponding to the assist mode (step S8).

  Then, when the user selects a place where the user wants to present the assist with the remote controller (step S9), the optimum presentation processing unit 6 outputs the assist information to the display device 2 and presents it (step S10).

  Finally, the optimum presentation processing unit 6 causes the user to determine whether or not to end the assist mode. When the assist mode ends, the series of processes ends. If the assist mode is not terminated, the process returns to step S1 and continues.

  Here, definitions of terms used in this specification will be described.

"topic":
It refers to a break in a program (one topic of news, the first or second half of sports, one corner of a variety program, etc.). As an example of a topic detection method, a flowchart is shown in FIG. The example shown in FIG. 4 is a detection method that uses telop extraction at a specific position and scene change detection in combination. The telop extraction method and scene change detection are shown in the flowcharts of FIGS. 6 and 7 and will be described later.

"Camera work information":
This is information that detects the orientation, zoom, scene change, etc. of the camera (imaging means) that captures the content video. As an example of the camerawork information detection method, there is a method using interframe matching or interframe difference.

The method for detecting the topic will be described with reference to the flowchart of FIG.
First, the content analysis unit 5 detects the feature amount of the input content (step S21).

  Next, it is determined whether or not a telop is detected at a specific position in the video frame of the content (step S22). If a telop is detected at the specific position, the process proceeds to step S23. On the other hand, if no telop is detected at the specific position, the frame count value is incremented by 1 (step S24), and the process returns to step S21.

  Subsequently, after a telop is detected in step S22, it is determined whether or not a scene change has been detected immediately before (step S23). If a scene change is detected immediately before, it is counted as a topic milestone. That is, the frame count value is reset to 1 (step S25).

  On the other hand, if a scene change is not detected immediately before, the frame count value is incremented by 1 (step S24), and the process returns to step S21.

  The result of executing the topic detection algorithm shown in FIG. 4 is stored in advance in the storage unit 4 in the data format shown in FIG.

  In the data format shown in FIG. 5, there are items of an input frame, a topic break, a frame count, and a video frame. The input frame is a serial frame number of the video frame in the content. The topic delimiter represents a topic delimiter, and the code of the video frame at the start position of the topic is “1”. The frame count is a frame count value in the topic. In the video frame item, the video of each video frame is displayed as a thumbnail.

  The topic remaining time is calculated using the topic range detection data stored in the storage unit 4. The calculated result is presented as assist information.

  Next, the telop extraction process in step S22 of FIG. 4 will be described with reference to the flowchart of FIG.

  In FIG. 6, first, the content analysis unit 5 detects the number of pixels (edges) having a predetermined luminance value at a specific position of an arbitrary frame F (t) in the video, that is, the number of edges (step S31).

  Next, the content analysis unit 5 determines whether or not the detected number of edges is equal to or greater than a set threshold (step S32). If the number of edges is greater than or equal to the threshold, the process proceeds to step S33. On the other hand, if the number of edges is not greater than or equal to the threshold, the frame number t is set to t + 1, and the process returns to step S31 (step S35). That is, the telop extraction target is changed to the next frame.

  If it is determined in step S32 that the number of edges is greater than or equal to the threshold, the content analysis unit 5 adds 1 to the frame count (step 33).

  Then, after adding 1 to the frame count value, the content analysis unit 5 determines whether or not the frame count value is greater than or equal to a threshold value (step S34). If the frame count value is greater than or equal to the threshold, it is extracted as a telop (step S36), and the telop extraction process is terminated.

  On the other hand, if the frame count value is not greater than or equal to the threshold value, the frame number t is set to t + 1 (step S35), and then the process returns to step S31 and continues.

  Next, the scene change detection process in step S23 of FIG. 4 will be described with reference to the flowchart of FIG.

  In FIG. 7, the content analysis unit 5 first extracts arbitrary video frames F (t) and video frames F (t + 1) from the acquired video (step S41).

  An inter-frame difference between these two video frames F (t) and F (t + 1) is calculated (step S42).

  Next, the inter-frame difference in the video frame is calculated, and it is determined whether or not the average value of the differences for each pixel exceeds a set constant value (step S43). If the average value exceeds a certain value, time t is output as a scene change (step S44).

  On the other hand, if the average value does not exceed the predetermined value, the frame number t is set to t + 1, and the process returns to step S41 (step S46). That is, the detection target of the interframe difference is changed to the next frame.

  After determining the scene change in step S44 and outputting the time t, it is determined whether or not the frame number t + 1 is the last frame (step S45). If it is the last frame, the scene change detection process ends.

  On the other hand, if it is not the last frame, the frame number t is set to t + 1 and the detection target is moved to the next frame (step S46), and then the process returns to step S41 to continue the processing.

<First Embodiment>
Next, a first embodiment of the present invention will be described with reference to FIGS.
In the first embodiment, by detecting the top and end points of the topic of the back program that is not currently being viewed, the remaining time until the end time of the topic of the back program is presented to the user.

The topic time detection algorithm will be described with reference to the flowchart of FIG.
First, the topic time detection process starts from the opening of the program and the start of viewing. Alternatively, when the back program topic remaining time notification mode is selected by mode selection, this topic time detection process is started.

  After starting the topic time detection process, the content analysis unit 5 first detects the feature amount of the input content (step S51).

  Next, it is determined whether or not a telop is detected at a specific position in the video frame of the content (step S52). If a telop is detected at the specific position, the process proceeds to step S53. On the other hand, if no telop is detected at the specific position, the frame count value is incremented by 1 (step S54), and the process returns to step S51.

  Subsequently, after a telop is detected in step S52, it is determined whether or not a scene change is detected immediately before (step S53). If a scene change is detected immediately before, it is detected as a topic node, and the total frame count of the topic is obtained from the data stored in the storage unit 4 (see FIG. 5) (step S55).

  On the other hand, if no scene change is detected immediately before, the frame count value is incremented by 1 (step S54), and the process returns to step S51.

  Next, the content analysis unit 5 calculates the remaining time of the topic and outputs the result to the optimum presentation processing unit 6 (step S56).

  After step S56 is completed, the frame count is reset (step S57).

  After step S57 is completed, it is determined whether the video frame is the final frame (step S58). If it is the last frame, the topic time detection algorithm is terminated.

  On the other hand, if it is not the last frame in step S69, the process returns to step S51 and continues.

  The remaining time of the topic is calculated using the topic time detection algorithm and the topic range detection data stored in the storage unit 4 and is output from the optimum presentation processing unit 6 to the display device 2 as assist information. As a result, it is an assist (support) that prompts the user to decide whether to continue watching the front program or to switch to the back program.

  In this case, for example, if you want to skip the weather corner of the news program that is running in the back program, but want to watch it from the next news, the user will have enough time until the remaining time in the weather corner becomes zero. You can keep watching other channels.

  FIG. 9 shows an example of the back program topic remaining time notification. FIG. 9 shows the front program videos 11 to 14 and the back program videos 21 to 24 at that time. In the case of the front program video 11 (back program video 21), the sub-representation of the topic remaining time of the back program displayed on the display screen is “0:01:50”. If time passes and it becomes the video 13 of the front program (back program video 23), the sub-representation of the topic remaining time of the back program will be “0:00:01”. Immediately after this, in the back program, the current topic ends and a new topic starts. In the back program, it becomes a new topic, and the remaining time “0:10:30” of the new topic is displayed in the sub-presentation of the display screen in the case of the video 14 of the front program (the video 24 of the back program).

<Second Embodiment>
Next, a second embodiment of the present invention will be described with reference to FIGS.
In the second embodiment, by detecting the beginning and end point of a topic of a back program that is not currently being viewed, the elapsed time of viewing the topic of the back program is presented.

The topic viewing time detection algorithm will be described with reference to the flowchart of FIG.
First, the topic viewing time detection process starts from the opening of the program and the start of viewing. Alternatively, when the back program topic elapsed time notification mode is selected by mode selection, the topic viewing time detection process is started.

  After starting the topic viewing time detection process, the content analysis unit 5 first detects the feature amount of the input content (step S61).

  Next, it is determined whether or not a telop is detected at a specific position in the video frame of the content (step S62). If a telop is detected at the specific position, the process proceeds to step S63. On the other hand, if no telop is detected at the specific position, it is determined whether or not the user is looking at the topic (step S64). If not, the process returns to step S61. If the user is watching, the process proceeds to step S65, and the frame count value is incremented by 1 (step S65), and then the process returns to step S61.

  Subsequently, after a telop is detected in step S62, it is determined whether or not a scene change has been detected immediately before (step S63). If a scene change is detected immediately before, it is detected as a count of topics, and the total frame count number of the topic is acquired from the data (see FIG. 5) stored in the storage unit 4 (step S66).

  On the other hand, if no scene change is detected immediately before, the process proceeds to step S64. If the user is not viewing the topic, the process returns to step S61. If the user is viewing, the frame count value is incremented by 1 (step S65), and then the process returns to step S61.

  Next, the content analysis unit 5 calculates the viewing time of the topic, and outputs the result to the optimum presentation processing unit 6 (step S67).

  After step S67 is completed, the frame count is reset (step S68).

  After step S68 ends, it is determined whether the video frame is the last frame (step S69). If it is the last frame, the topic time detection algorithm is terminated.

  On the other hand, if it is not the last frame in step S69, the process returns to step S61 and continues.

  The topic viewing time is calculated using the topic viewing time detection algorithm and the topic range detection data stored in the storage unit 4, and is output from the optimum presentation processing unit 6 to the display device 2 as assist information. As a result, as in the first embodiment, the user can use it as a material for determining whether to continue watching the front program or to switch to the back program.

  For example, if a topic has just started in a news program in the back program, you can start watching from the beginning of the topic by switching between the back program and the front program immediately, but if the time has already passed, the current table A judgment such as continuing to watch the program can be made.

  FIG. 11 shows an example of notification of the back program topic elapsed time. In FIG. 11, videos 31 to 34 of the front program and videos 41 to 44 of the back program at that time are shown. In the case of the front program video 31 (back program video 41), since the back program is just before the topic break, the sub-presentation of the topic elapsed time displayed on the display screen is a large value of “0:10:30”. Then, since a new topic is started in the next video frame, when the front program video 32 (back program video 42) is reached, the sub-presentation of the topic elapsed time of the back program is “0:00:01”. . After that, the elapsed time is counted as time passes. For example, “0:01:50” is displayed in the sub-presentation for the front program video 34 (back program video 44) after a predetermined time has elapsed.

<Third Embodiment>
Next, a third embodiment of the present invention will be described with reference to FIG.
The third embodiment is a mode for notifying the time change of the back program for the camera. In FIG. 12, videos 51 to 54 of the front program and videos 61 to 64 of the back program at that time are shown. According to the present embodiment, camera work information in a back program is extracted and presented in an easy-to-understand arrow or simple video (camera work information 51A to 54A). As a result, changes in the video of the back program can be instantly communicated to the user in an easily understandable manner, which can be used as a channel switching judgment material.

  By sub-presenting the camera work information on the display screen, it can be seen that, for example, in the soccer broadcast in the back program, the attack direction has changed due to the camera direction changing from left to right. It is also possible to grasp the fact that the camera has been switched during the baseball broadcast in the back program while watching the front program.

<Fourth embodiment>
Next, a fourth embodiment of the present invention will be described with reference to FIG.
The fourth embodiment is a mode for presenting temporal changes such as feature quantities (sound gain, sound frequency, average value of difference between frames, average luminance value) in a back program as a waveform such as a spectrum. . In FIG. 13, videos 51 to 54 of the front program and videos 61 to 64 of the back program at that time are shown. As shown in FIG. 13, by displaying the waveform information 51B to 54B corresponding to the video of the back program on the display screen, the change occurring in the back program can be grasped, and it becomes a judgment material for channel switching.

  For example, the waveform of the audio gain of the back program can be presented, and it can be predicted that there will be excitement and CM (commercial) due to the rapid rise. In addition, the waveform of the average value of the difference between frames of the back program is presented, and if the change is small, the same scene continues, but if there is a sudden change, it is predicted that the scene has changed And the user can use it to determine whether to switch channels at that moment.

  According to the first to fourth embodiments described above, it is possible to assist (support or assist) understanding of the trend of the back program even when viewing a specific program (front program). In this way, when the back program information is sub-presented on the front program screen, the assisting presentation does not sub-present the back program as it is, but the video / audio information is reduced to feature quantities, etc. The influence on the viewing of the front program can be minimized. In addition, the user can acquire information on the back program even while concentrating on viewing the front program.

<Fifth embodiment>
Next, a fifth embodiment of the present invention will be described with reference to FIG.
The basic configuration and mechanism of the fifth embodiment is almost the same as that of the first embodiment. However, the difference is that the target to which information is sub-presented is not a back program but a front program. In the example of the topic remaining time notification of the front program shown in FIG. 14, videos 52 to 55 of the front program are shown, and there is a topic break between the video 54 and the video 55. In this case, it is possible to know the elapsed time until the current topic of the front program ends by sub-presentation.

<Sixth Embodiment>
Next, a sixth embodiment of the present invention will be described with reference to FIG.
The basic configuration and mechanism of the sixth embodiment is almost the same as that of the second embodiment. However, the difference is that the target to which information is sub-presented is not a back program but a front program. In the example of the topic missed time notification of the front program shown in FIG. 15, videos 54 to 57 of the front program are shown, and there is a topic break between the video 54 and the video 55. In this case, it is possible to know the elapsed time (missing time or viewing time) since the current topic of the front program is renewed by sub-presentation.

  According to the fifth to sixth embodiments described above, it is possible to perform assist presentation that gives a margin for viewing a back program by performing assist presentation so that the program can be efficiently viewed when the specific program is viewed. it can. As described above, when information on the front program itself is presented on the front program screen as an assist, the front program currently being viewed can be understood more efficiently, and a viewer can be afforded to view the back program. Also, by presenting information on the front program currently being viewed, the front program currently being viewed can be understood more efficiently, and a viewer can be afforded to view the back program.

  In each of the above-described embodiments, the case where the present invention is applied to an information processing apparatus that receives a television broadcast wave and outputs it to a display device has been described. However, the present invention is not limited thereto, and the television broadcast is not limited thereto. The present invention can be applied to a television tuner having a wave receiving function, a recording / playback apparatus that receives and records a television broadcast wave, and the like. Further, it can be applied to various television receivers such as a mobile phone and a personal computer having a function of receiving a television broadcast wave regardless of whether the display device is integrated or separated.

  The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, it is possible to execute various functions by installing a computer in which a program constituting the software is incorporated in dedicated hardware, or by installing various programs. For example, it is installed from a program recording medium in a general-purpose computer or the like.

  FIG. 16 is a block diagram illustrating a configuration example of a personal computer 110 that includes a tuner unit and executes the above-described series of processes by a program.

  A CPU (Central Processing Unit) 111 of the personal computer 110 executes various processes in addition to the series of processes described above according to a program recorded in a ROM (Read Only Memory) 112 or a recording unit 118. A RAM (Random Access Memory) 113 appropriately stores programs executed by the CPU 111 and data. The CPU 111, the ROM 112, and the RAM 113 are connected to each other by a bus 114.

  An input / output interface 115 is also connected to the CPU 111 via the bus 114. The input / output interface 115 is connected to an input unit 116 including a keyboard, a mouse, and a microphone, and an output unit 117 including a display and a speaker. The CPU 111 executes various processes in response to commands input from the input unit 116. Then, the CPU 111 outputs the processing result to the output unit 117.

  The recording unit 118 connected to the input / output interface 115 includes, for example, a hard disk, and records programs executed by the CPU 111 and various data.

  The communication unit 119 communicates with an external device via a network such as the Internet or a local area network. A program may be acquired via the communication unit 119 and recorded in the recording unit 118.

  The drive 120 connected to the input / output interface 115 drives a removable medium 131 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and drives programs and data recorded there. Get etc. The acquired program and data are transferred to the recording unit 118 and recorded as necessary.

  The tuner unit 121 receives and demodulates a television broadcast wave requested by a user from a television broadcast wave (television broadcast signal) including a program of a plurality of channels via an antenna (not shown). In the present embodiment, personal computer 110 has two or more tuner units 121 and can simultaneously receive television broadcast signals of two or more channels.

  A program recording medium that stores a program that is installed in a computer and can be executed by the computer is provided as a package medium by a removable medium 131 as shown in FIG. As the removable medium 131, a magnetic disk (including a flexible disk), an optical disk (including a CD-ROM (Compact Disc-Read Only Memory), a DVD (Digital Versatile Disc), a magneto-optical disk), or a semiconductor memory is applied. be able to. Alternatively, the program recording medium includes a ROM 112 that stores (records) a program temporarily or permanently, a hard disk that forms the recording unit 118, and the like.

  The program is stored in the program recording medium via wired or wireless communication such as a local area network (LAN), the Internet, or digital satellite broadcasting via a communication unit 119 that is an interface such as a router or a modem as necessary. The communication medium is used.

  In the present specification, the processing steps describing the program stored in the program recording medium are not limited to the processing performed in time series in the described order, but are not necessarily performed in time series. This includes processing that is executed manually or individually (for example, parallel processing or object processing).

  Further, the program may be processed by a single computer, or may be processed in a distributed manner by a plurality of computers. Furthermore, the program may be transferred to a remote computer and executed.

It is a lineblock diagram showing an outline of an information presentation system concerning an embodiment of the invention. It is explanatory drawing of a sub presentation method, (a) is PinP, (b) is a subscreen, (c) shows a multi-display. It is a flowchart which shows the process example of the whole system which concerns on embodiment of this invention. It is a flowchart which shows the example of the topic detection algorithm which concerns on embodiment of this invention. It is explanatory drawing which shows the example of the data format accumulate | stored in the storage part which concerns on embodiment of this invention. It is a flowchart which shows the example of the telop detection algorithm which concerns on embodiment of this invention. It is a flowchart which shows the example of the scene change detection algorithm which concerns on embodiment of this invention. It is a flowchart which shows the example of the topic time detection algorithm which concerns on the 1st Embodiment of this invention. It is explanatory drawing which shows an example of the back program topic remaining time notification which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the example of the topic viewing-and-listening time detection algorithm which concerns on the 2nd Embodiment of this invention. It is explanatory drawing which shows an example of the back program topic elapsed time notification which concerns on the 2nd Embodiment of this invention. It is explanatory drawing which shows an example of the back program camera work information notification which concerns on the 3rd Embodiment of this invention. It is explanatory drawing which shows an example of the time waveform notification of the back program feature-value based on the 4th Embodiment of this invention. It is explanatory drawing which shows an example of the table program topic remaining time notification which concerns on the 5th Embodiment of this invention. It is explanatory drawing which shows an example of the table program missed time notification which concerns on the 6th Embodiment of this invention. It is a block diagram which shows an example of an internal structure of a personal computer.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Information processing apparatus, 2 ... Display apparatus, 2a ... Main presentation screen, 2b ... Sub presentation screen, 2c ... Main presentation screen, 2A ... Main presentation screen, 2B ... Sub presentation screen, 3 ... Tuner part, 4 ... Accumulation part 5 ... Content analysis section, 6 ... Optimal presentation processing section, 7 ... Input section, 11-14 ... Front program video, 21-24 ... Back program video, 31-34 ... Front program video, 41-44 ... Back program video, 51-57 ... Front program video, 51A-54A ... Camerawork information, 51B-54B ... Time waveform, 61-64 ... Back program video, 110 ... Personal computer, 111 ... CPU, 112 ... ROM 113 ... RAM, 114 ... bus, 115 ... input / output interface, 116 ... input unit, 117 ... output unit, 118 ... recording unit, 119 ... communication unit, 120 ... drive, 121A, 121B ... chu Na part, 131 ... removable media, 121 ... tuner section

Claims (11)

An acquisition unit for acquiring the first content and the second content;
A storage unit for storing the first content and the second content acquired by the acquisition unit;
A content analysis unit that analyzes the second content read from the storage unit;
An optimum presentation processing unit that outputs the video of the first content and outputs auxiliary information indicating characteristics accompanying temporal change of the second content based on an analysis result of the content analysis unit;
An information processing apparatus. The first content and the second content are each a television broadcast program, the first television broadcast program is a front program, and the second television broadcast program is a back program. Information processing device. The information processing according to claim 2, wherein the auxiliary information indicating the current characteristics of the second content is a remaining time from the current playback position in the back program to the end position of the topic range including the playback position. apparatus. The information according to claim 2, wherein the auxiliary information indicating the current characteristics of the second content is an elapsed time from the start position of the topic range including the current playback position in the back program to the current playback position. Processing equipment. The information processing apparatus according to claim 2, wherein the auxiliary information indicating the current characteristics of the second content is camera work information of an imaging unit that is capturing the video of the back program. The information processing apparatus according to claim 2, wherein the auxiliary information indicating the current feature of the second content is waveform information indicating a temporal change in the feature amount in the back program. Display means for displaying at least the video of the table program output from the optimum presentation processing unit;
An information processing apparatus according to claim 2. The information processing apparatus according to claim 1, wherein the auxiliary information related to the second content is information including a current characteristic of the second content. An information processing method of an information processing apparatus that acquires content, performs predetermined processing, and outputs the content,
Obtaining a first content and a second content;
Storing the acquired first content and the second content in a storage unit;
Analyzing the second content read from the storage unit;
Outputting the video of the first content, and outputting auxiliary information indicating a feature accompanying a time change of the second content based on the result of the analysis;
An information processing method including: In a program to be executed by a computer that controls an information processing apparatus that acquires content, performs predetermined processing, and outputs the content,
Processing for obtaining the first content and the second content;
A process of storing the acquired first content and the second content in a storage unit;
A process of analyzing the second content read from the storage unit;
A process of outputting the video of the first content, and outputting auxiliary information indicating a feature accompanying a time change of the second content based on a result of the analysis;
A program that causes a computer to execute. In a recording medium recorded with a program to be executed by a computer that controls an information processing apparatus that acquires content, performs predetermined processing, and outputs the content,
Processing for obtaining the first content and the second content;
A process of storing the acquired first content and the second content in a storage unit;
A process of analyzing the second content read from the storage unit;
A process of outputting the video of the first content, and outputting auxiliary information indicating a feature accompanying a time change of the second content based on a result of the analysis;
A recording medium on which a program for causing a computer to execute is recorded.

Images