JP2007336283A - Information processor, processing method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain an information processor which provides an appropriate thumbnail. <P>SOLUTION: The information processor comprises a viewing/listening record storing section 122 for prestoring the viewing/listening record of video image, a section 102 for detecting a highlighted scene, i.e. a part of a video image characterizing the video image, from an inputted video image, a section 105 for forming a highlight video image including the highlighted scene thus detected, a section 106 for forming a preview video image including a limited highlighted scene from which a part including important information about the content of the video image is deleted from the highlighted scene, a section 108 for judging whether the highlight video image has been viewed/listened or not based on the viewing/listening record stored in the viewing/listening record storing section 122, a section 110 for selecting a preview video image as a thumbnail video image if the highlight video image has not been viewed/listened, and a display control section 109 for displaying a selected thumbnail video image. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an information processing apparatus, an information processing method, and an information processing program that provide thumbnail images of videos.

  In recent years, the mainstream of equipment for recording audio and video has shifted from conventional analog magnetic tapes to digital magnetic disks and semiconductor memories. Particularly in video recording / playback equipment using a large-capacity hard disk, the recordable capacity has been dramatically increased. By using such a device, it is possible to store videos of a large number of programs provided by broadcasting or communication or a large number of videos taken by the user, and the user can freely select and view them.

  Regarding the management of the stored video, a title (program), which is a unit of a program, etc. is filed, a name and other information are given, and a representative image (thumbnail) and name of the title are displayed in the list For example, there is a method of displaying such as side by side. In addition, one program (title) can be divided into units called chapters (segments), and can be reproduced and edited in units of chapters. In other words, assigning chapter names to chapters, displaying thumbnails of chapters as a list, selecting and playing back chapters that contain the desired scene from the list, and creating playlists that list the selected chapters It is possible to do. A VR (Video Recording) mode of DVD (Digital Versatile Disc) exists as one that defines these management methods.

  In addition, UPnP (Universal Plug and Play) Content Directory exists as a communication protocol related to video management, and DLNA (Digital Living Network Alliance) guidelines exist as specifications for interconnection of devices including this protocol.

  Furthermore, when there are a large number of programs (titles), it is possible to display a list by narrowing down according to conditions such as a program genre, or rearrange them in the order of program names. It is also possible to classify and manage programs (titles) into folders and display a list of programs (titles) in the folders. For example, a continuous drama program can be automatically recorded every week (weekly), and only the automatically recorded drama can be put in a specific folder.

  In general, thumbnails used when displaying a list of titles (programs) and chapters (segments) employ a reduced still image extracted from the top frame or a frame of a fixed time from the top.

  In addition, a technique for using a moving image as a thumbnail has been proposed. For example, Patent Document 1 proposes a technique for selecting a longest scene and generating a thumbnail by selecting a thumbnail group to be a thumbnail image from the selected longest scene.

JP 2001-298711 A

  However, in the method of Patent Document 1, since a thumbnail is selected based on a temporal attribute such as the length of a scene, there is a problem that a thumbnail that allows the user to accurately grasp the content of the video may not be selected.

  Further, in the method of Patent Document 1, for example, a scene including an important part of a video, such as a scoring scene in a sports program, and a scene that may impair the viewing value of the video when viewed at the stage of list display before viewing. There was a problem that thumbnails to include may be selected.

  The present invention has been made in view of the above, and an object thereof is to provide an information processing apparatus, an information processing method, and an information processing program capable of providing an appropriate thumbnail to a user who views a video. To do.

  In order to solve the above-described problems and achieve the object, the present invention provides a history storage means for preliminarily storing a video viewing history, and a highlight scene that is a part of the video characterizing the video from the input video. A highlight scene detecting unit for detecting the highlight scene, a highlight video generating unit for generating a highlight video including the detected highlight scene, and a limited high-level image in which a portion including important information regarding the content of the video is deleted from the highlight scene. Preview video generation means for generating a preview video including a light scene, viewing determination means for determining whether or not the highlight video has been viewed based on the viewing history stored in the history storage means, and the viewing When the judging means judges that the highlight video has not been viewed, the preview video is selected as a thumbnail video. And selection means, wherein said selecting means includes display control means for displaying a thumbnail image selected, the.

  The present invention also provides highlight scene detection means for detecting a highlight scene, which is a part of the video characterizing the video, from the input video, and a highlight video for generating a highlight video including the detected highlight scene. It is characterized by comprising: a video generation means; and a preview video generation means for generating a preview video including a restricted highlight scene in which a portion including important information regarding the content of the video is deleted from the highlight scene.

  In addition, the present invention provides a highlight video including a highlight scene that is a video portion characterizing the video, and a preview including a limited highlight scene in which a portion including important information regarding the content of the video is deleted from the highlight scene. Video storage means for storing video, history storage means for previously storing the viewing history of the video, and whether or not the highlight video has been viewed based on the viewing history stored in the history storage means. A viewing determination unit for determining, a selection unit for selecting the preview video as a thumbnail video when the viewing determination unit determines that the highlight video has not been viewed, and a thumbnail video selected by the selection unit is displayed. And a display control means.

  The present invention also provides video storage means for storing a preview video including a restricted highlight scene obtained by deleting a portion including important information regarding the content of the video from a highlight scene that is a video portion characterizing the video, and the video A reproduction control means for controlling reproduction of the image, highlight scene detection means for detecting the highlight scene from the video reproduced by the reproduction control means, and highlight for generating a highlight video including the detected highlight scene A video generation unit; a selection unit that selects the preview video as a thumbnail video when no highlight video is generated; and a display control unit that displays the thumbnail video selected by the selection unit. Features.

  The present invention also provides an information processing method and an information processing program capable of executing the above-described apparatus.

  According to the present invention, it is possible to generate a highlight video selected so as to make it easier to specify a video and a preview video selected so as not to impair the significance of viewing the video. As a result, it becomes possible to select a highlight video or a preview video as a thumbnail depending on whether or not the video has been viewed, and therefore an appropriate thumbnail can be provided to a user who views the video. Play.

  Exemplary embodiments of an information processing apparatus, an information processing method, and an information processing program according to the present invention are explained in detail below with reference to the accompanying drawings.

(First embodiment)
The information processing apparatus according to the first embodiment generates not only a highlight video including a highlight scene detected from acquired video information, but also a preview video that is a portion excluding an important part of the video information for viewing. Referencing the viewing history indicating whether or not it is completed, the preview video is presented to the user as a thumbnail when not viewed, and the highlight video including the highlight scene is presented to the user as a thumbnail when viewed. is there.

  As described above, in the first embodiment, an example will be described in which the video information is recorded in the storage unit and is realized as a video recording / playback apparatus capable of playing back the recorded video information.

  Note that a highlight scene is a portion of a video that characterizes the video. The highlight video refers to a video including a highlight scene, and includes a video obtained by combining a plurality of highlight scenes, a video obtained by adding image processing such as reduction / enlargement to the highlight scene, and the like.

  Also, the preview video refers to a video including a part including predetermined important information or a part from which an important part of the video is deleted from the highlight scene (hereinafter referred to as a restricted highlight scene).

  Hereinafter, a part including predetermined important information regarding an important part of a video is referred to as a specific scene, and an area including predetermined important information regarding an important part of a video is referred to as a specific area.

  FIG. 1 is a block diagram showing a configuration of a video recording / playback apparatus 100 according to the first embodiment. As shown in the figure, the video recording / playback apparatus 100 includes a video acquisition unit 101, a highlight scene detection unit 102, a specific scene detection unit 103, a specific area detection unit 104, a highlight video generation unit 105, Preview video generation unit 106, playback control unit 107, viewing determination unit 108, display control unit 109, video selection unit 110, video information storage unit 121, viewing history storage unit 122, and highlight video storage unit 123 and a preview video storage unit 124.

  The video information storage unit 121 is a storage medium that stores video related information related to videos to be viewed. FIG. 2 is an explanatory diagram showing an example of the data structure of video related information stored in the video information storage unit 121. As shown in the figure, the video information storage unit 121 stores video related information in which a video ID for uniquely identifying video information, a title of the video information, and data of the video information itself are associated with each other. Note that related information such as sound and metadata input together with the video information is stored in the video information storage unit 121 together with the video information.

  The viewing history storage unit 122 is a storage medium that stores a playback history controlled by the playback control unit 107 as a viewing history. FIG. 3 is an explanatory diagram showing an example of the data structure of the viewing history stored in the viewing history storage unit 122.

  As shown in the figure, the viewing history storage unit 122 stores a viewing history in which a video ID, a time, a frame number, and a viewing flag are associated with each other. The viewing flag is set to 0 when not viewed, and is set to 1 by the playback control unit 107 when viewed.

  A frame refers to a still image that is a unit constituting a video. For example, a moving image can be displayed by continuously displaying 30 frames of images per second. The frame number refers to a number representing the number of frames in 30 frames, for example. Here, the frame number is used to represent a position or section that is finer than the unit of time, but for example, it may be configured to represent a fine position or section by time in milliseconds instead of the frame number. Good.

  As a simple method, when the video information is simply played back or when it is played back for a certain period of time, the viewing flag for the entire video information is set to 1, and the viewing information is included in the video information with the viewing flag set to 1. It may be configured to determine that all scenes to be viewed have been viewed. Further, it may be configured to identify the user, manage the viewing history, and determine the viewing by using a different remote controller for each user.

  Also, the viewing history is used for limited playback of the target video information, control of charging at the time of viewing, deletion control for controlling processing to delete viewed, etc., viewing survey and tabulation, program recommendation processing based on viewing tendency, etc. You can also.

  The highlight video storage unit 123 is a storage medium that stores the highlight video generated by the highlight video generation unit 105 described later. FIG. 4 is an explanatory diagram showing an example of the data structure of the highlight video stored in the highlight video storage unit 123.

  As shown in the figure, the highlight video storage unit 123 stores the video ID and the highlight video data in association with each other. In addition, in the same figure, the example of storing the generated highlight video data itself has been described. However, it is also possible to store the highlight video according to the section information such as the time and frame number range in the video. Good. In addition, information of a plurality of highlight scene sections included in a highlight video and data of a plurality of highlight videos may be stored for one video ID.

  The preview video storage unit 124 is a storage medium that stores the preview video generated by the preview video generation unit 106 described later. FIG. 5 is an explanatory diagram showing an example of the data structure of the preview video stored in the preview video storage unit 124.

  As shown in the figure, the preview video storage unit 124 stores the video ID and the preview video data in association with each other. Similar to the highlight video storage unit 123, the preview video storage unit 124 may be configured to store the preview video based on the information of the section in the video. Further, information about a plurality of restricted highlight scene sections included in the preview video may be stored for one video ID.

  The video information storage unit 121, the highlight video storage unit 123, and the preview video storage unit 124 can use any storage medium such as an HDD (Hard Disk Drive), a semiconductor memory, a flash memory, and a DVD. Each storage unit may be removable or fixed. Furthermore, it may be configured by a device or the like that complies with NAS (Network Attached Storage) or DLNA (Digital Living Network Alliance) guidelines for reading and writing via a network.

  The video acquisition unit 101 acquires digital video information input from a receiving tuner (not shown) that receives a digital broadcast or the like and other digital video equipment (not shown). The video acquisition unit 101 acquires an analog video signal input from a broadcast receiving tuner (not shown) that receives an analog broadcast or the like, or other analog video equipment (not shown), and converts it into digital video information. You may comprise.

  The video acquisition unit 101 records the acquired digital video information in the video information storage unit 121 and transmits the video information to the highlight scene detection unit 102 and the specific scene detection unit 103 for detection of a highlight scene and a specific scene. Send.

  The video acquisition unit 101 is configured to acquire video information stored in the video information storage unit 121 in advance and transmit the acquired video information to the highlight scene detection unit 102 and the specific scene detection unit 103. Also good.

  The highlight scene detection unit 102 detects a highlight scene from the acquired video information. The highlight scene detection unit 102 detects the highlight scene by specifying the start time of the section, the start frame number at the start time, the end time of the section, and the end frame number at the end time.

  Specifically, the highlight scene detection unit 102 obtains an evaluation value indicating the degree of highlight for each portion of the acquired video information, and a scene where the evaluation value exceeds a predetermined threshold is set as a highlight scene. To detect.

  For example, when the highlight scene detection unit 102 obtains the degree of highlight based on cheering and applause in sports, the highlight scene detection unit 102 evaluates the volume (sound level) of audio corresponding to the video input together with the video. Can be a value. Note that the evaluation value for detecting the highlight scene is not limited to the audio level, but may be configured to use an evaluation value related to audio attributes including the audio height (pitch). Further, it may be configured such that the frequency spectrum of the voice is analyzed, collated with a spectrum pattern of cheers created in advance, and the similarity is used as an evaluation value.

  Further, the highlight scene detection unit 102 may be configured to detect a highlight scene by analyzing the video information. For example, a motion amount is evaluated as an evaluation value by referring to an MPEG motion vector, etc., a method of detecting a scene with a large evaluation value as a highlight scene, a degree of similarity compared with a predetermined motion as an evaluation value, and a similarity It is possible to use a method for detecting a scene in which an action to be performed exists as a highlight scene.

  The highlight scene detection unit 102 may detect a time interval at which a predetermined telop having a predetermined size is displayed as an evaluation value, and detect a scene having a large evaluation value as a highlight scene.

  The highlight scene detection unit 102 may recognize a character included in the video by a character recognition technique, and collate with a predetermined character string to detect a highlight scene using the degree of similarity as an evaluation value. For example, it is possible to collate with a character string representing a sports scoring scene such as “goal”, and to make a scene where a character string that matches or is similar exists as a highlight scene.

  The highlight scene detection unit 102 may be configured to detect a highlight scene with reference to metadata input together with the video and associated with the video. For example, it is possible to extract information on an event that becomes a highlight of a sport such as “shoot”, and to set the scenes before and after the event as a highlight scene.

  Further, the highlight scene detection unit 102 detects that the scene is a replay video by collating between scenes included in the video or detecting or collating special effects or telops, and the scene including the detected replay video is selected as a highlight scene. It may be configured to detect as The highlight scene detection unit 102 may be configured to detect the number of times the replay video is repeated as an evaluation value and detect a scene having a large evaluation value as a highlight scene.

  The specific scene detection unit 103 detects a specific scene that is a part of a video including predetermined important information related to an important part of the video from the acquired video information. Specifically, the specific scene detection unit 103 specifies the text information such as the telop included in the video, the closed caption input together with the video, and the metadata with a character string representing a predetermined important part. Detect scenes. For example, scoring scenes in sports or games, scenes in which offense and defense change, scenes in which the order changes, scenes at the end of a game, or related scenes are treated as important information, and these are detected as specific scenes. Further, score progress, rank information, time, game progress such as inning in baseball, set in tennis, etc. are treated as important information, and a scene in which such information is displayed in the video is detected as a specific scene.

  Further, the specific scene detection unit 103 recognizes the voice input together with the video, and detects the specific scene by collating the character information which is the voice recognition result with a character string representing a predetermined important part. You may comprise. Further, a specific scene may be detected by giving the character string, recognizing the voice, and collating with the voice input together with the video. Moreover, you may comprise so that after a predetermined time may be detected as a specific scene. For example, it can be configured such that a time including a game end time is determined in advance, and the time after that time is detected as a specific scene.

  Further, like the highlight scene detection unit 102, the specific scene detection unit 103 may be configured to use an evaluation value related to the attribute of the audio input together with the video. In this case, for example, the specific scene is detected based on an evaluation value different from the highlight scene detection, such as a change in the audio level and a duration of the audio level. For example, a scene after a scene where a cheerful fall of cheers exists can be detected as a specific scene. Further, for example, when the duration of the cheering peak exceeds a predetermined threshold, the sustained section can be detected as a specific scene.

  Further, the specific scene detection unit 103 may be configured to detect a certain time before the CM starts as a specific scene based on the CM section determination in consideration of the audio multiplexing mode or the like. Also, a typical composition that repeatedly appears in the video, for example, a pitching scene in baseball, may be determined, and a pitching scene immediately before the CM may be detected as a specific scene. Further, the entire scene of the batter immediately before the CM may be detected as a specific scene based on the metadata input together with the video or batter information in the program linked data broadcast. Further, when the time interval of the pitching scene exceeds a predetermined threshold, the entire scene of the batter after or immediately before the pitching scene may be detected as the specific scene.

  Note that the specific scene detection unit 103 is not a part of the acquired video information but a part of the video that includes predetermined important information regarding the important part of the video from the highlight scene detected by the highlight scene detection unit 102. A specific scene may be detected.

  The specific area detection unit 104 detects a specific area, which is an area including predetermined important information regarding an important part of the video, from each image included in the acquired video information. Specifically, the specific area detection unit 104 detects, as the specific area, an area where a telop including important information such as time, elapsed time, score progress, and the like is displayed. The specific area detection unit 104 may be configured to dynamically detect the specific area from the video by collating with a predetermined image, or detect a fixed area such as an upper / lower side of the screen as the specific area in advance. You may comprise. In addition, an area where the telop is displayed in the same place for a long time or repeatedly may be detected as the specific area by the telop detection.

  The specific area detection unit 104 is an area that includes predetermined important information related to an important part of the video from the highlight scene detected by the highlight scene detection unit 102, not from the entire acquired video information. You may comprise so that an area | region may be detected.

  The highlight video generation unit 105 refers to the highlight scene detected by the highlight scene detection unit 102 and generates a highlight video including the highlight scene. Specifically, the highlight video generation unit 105 combines the detected highlight scenes in chronological order to generate a highlight video.

  Note that the combination order of highlight scenes is not limited to the time-series order, and may be configured to combine, for example, in descending order of evaluation values in consideration of evaluation values. The highlight video is not limited to a moving image, and a slide show format image including a still image or a still image obtained by extracting and combining arbitrary still images may be used as the highlight video. Further, the highlight video may be configured to be output without associating audio. Further, the highlight video generation unit 105 may perform a video information reduction process so that a reduced still image or a reduced moving image is used as a highlight video.

  The preview video generation unit 106 generates a limited highlight scene that is a scene obtained by deleting the specific scene detected by the specific scene detection unit 103 from the highlight scene. The preview video generation unit 106 deletes the specific area detected by the specific area detection unit 104 from the generated limited highlight scene, and generates a preview video including the limited highlight scene from which the specific area is deleted. .

  Specifically, the preview video generation unit 106 generates a preview video by combining the restricted highlight scenes from which the specific area has been deleted in chronological order. Note that the combination order of the restricted highlight scenes is not limited to the time-series order, and may be configured so that, for example, the evaluation values are combined in descending order of evaluation values.

  When deleting the specific area, the preview video generation unit 106 replaces the specific area with a monochrome pattern, a meaningless pattern, or an irrelevant image. Further, the preview video generation unit 106 may be configured to perform image processing such as mosaic and blur on a specific area so as to make it difficult to visually identify the content, and to achieve an effect equivalent to deletion of the specific area. Good. Furthermore, the preview video generation unit 106 may generate a preview video that is cut out of a range that does not include the specific area and enlarged to the size of the original image.

  Similar to the highlight video generation unit 105, the preview video generation unit 106 may execute a video information reduction process so that a reduced still image or a reduced moving image is used as a preview video.

  When associating the acoustic information with the preview video, the preview video generating unit 106 performs a process of excluding the voice spoken by a human from the voice to be associated. This is to exclude voices that are likely to contain a lot of important information, such as voices spoken by announcers. For example, the preview video generation unit 106 can use audio that has been subjected to signal processing such as canceling a center sound in a stereo signal.

  Further, the preview video generation unit 106 may be configured to detect a section where a human voice exists from the voice to be associated, and to erase the sound of the detected section. When detecting a section where a human voice is present, the preview video generation unit 106 applies any method conventionally used, such as a method of detecting a harmonic structure generated by resonance of a vocal cord sound source in the vocal tract. can do.

  In addition, the preview video generation unit 106 may be configured to associate only an audio channel (for example, secondary audio) in which no human voice exists, or may be configured to delete the original audio and replace it with an irrelevant audio. May be. You may comprise so that acoustic information may not be matched with a preview image | video.

  In the above description, the preview video generation unit 106 generates the restricted highlight scene by deleting both the specific scene and the specific area from the highlight scene. However, only one of the specific scene and the specific area is deleted. You may comprise. In this case, the video recording / playback apparatus 100 may be configured to include only one of the specific scene detection unit 103 and the specific area detection unit 104.

  Further, the preview video generation unit 106 may be configured to generate the preview video on the condition relating to the time of the video information without using any specific scene or specific area.

  In this case, the preview video generation unit 106 selects a section having a predetermined time length from the top of the acquired video information and creates it as preview video information. If the CM and the main part can be divided by using audio multiplex information or the like, the video from the beginning of the main part may be used as the preview video. Alternatively, a video from a time (for example, 30 seconds from the top, 4 minutes from the top, etc.) that is highly likely to correspond to the vicinity of the top of the main part may be used as the preview video. This is because the possibility that an important part is included in the video is low in these time conditions. Alternatively, the preview video may be continuously played back until the user selects video information and performs playback, editing, deletion, and other processing without determining the end of the section.

  Even in such a case, it is possible to generate a preview video equivalent to the one obtained by deleting the important part from the highlight scene. Therefore, the highlight video is selected so as not to impair the significance of viewing the video. It is possible to generate a preview video.

  The reproduction control unit 107 controls processing for reading and reproducing the video information recorded in the video information storage unit 121 in accordance with a user operation or the like. When the playback control unit 107 controls playback, the played video is displayed on a display device (not shown). Note that the reproduction control unit 107 performs processing such as decoding of video information and output processing of video signals by a general method conventionally used.

  When the video is played back, the playback control unit 107 updates the viewing flag of the corresponding video information in the viewing history storage unit 122 to 1. Note that the playback control unit 107 records only the playback section related to the highlight video as the viewing history with reference to the frame information of the highlight section (each of which is a plurality of sections) included in the highlight video information. You may comprise as follows.

  Also, the playback control unit 107 is configured not to determine whether or not to view based on whether or not the playback has been performed, but to verify the user's viewing behavior and record the viewing history when viewing is verified during playback. May be. For example, the presence or absence of viewing can be verified by photographing a person or face watching a video displayed by an imaging device (not shown) and detecting a face or recognizing a facial expression. Further, a method may be applied in which it is determined that the user has watched when the user performs a predetermined operation with a remote controller or the like during viewing.

  The viewing determination unit 108 refers to the viewing history recorded in the viewing history storage unit 122 to determine whether or not the highlight section included in the highlight video information has been viewed. Specifically, the viewing determination unit 108 acquires the viewing flag of the time and frame number corresponding to the highlight section, and determines that the viewing is performed when the viewing flag is 1.

  In the case where the viewing history is recorded in the viewing history storage unit 122 by the time information of the reproduced section, the time information of the highlight section and the time information of the viewing history are collated, and the time corresponding to the highlight section When the information is stored in the viewing history storage unit 122, it is determined that the information has been viewed.

  The display control unit 109 selects a list display target from among those recorded in the video information storage unit 121 in accordance with an operation from the user for selecting video information to be played, edited, deleted, and other operations. The video information to be selected is selected and displayed. Further, the display control unit 109 acquires information on a representative video (thumbnail) selected by the video selection unit 110 described later, and creates a thumbnail for display. In addition, a list display screen on which the created thumbnails are appropriately arranged is displayed on the display device.

  Note that the display control unit 109 may be configured to combine and display a predetermined third video on a highlight video or a preview video. The third video is a video extracted so as to include an opening and a title screen, for example, separately from the highlight video and the preview video. You may comprise so that the information of a 3rd image | video may be recorded on a storage medium (not shown) previously.

  Further, the display control unit 109 may extract a still image from a highlight video or a preview video, and create a thumbnail for display in combination with the still image extracted from the third video.

  For the video information selected by the display control unit 109, the video selection unit 110, according to the determination of the viewing determination unit 108, displays a preview video when the determination result is not viewed, and a highlight video when the result is already viewed. To choose.

  When the highlight video includes a plurality of sections, the video selection unit 110 combines all the viewed highlight video sections and selects them as thumbnails. Note that the video selection unit 110 may be configured to select all the sections of the highlight video as thumbnails when it is determined that at least one of the plurality of sections has been viewed. Also, the video selection unit 110 is configured to generate a highlight video that does not include an unviewed section by combining only the sections that have been viewed among the plurality of sections, and select the generated video as a thumbnail. May be. Further, the video selection unit 110 may be configured to generate a video obtained by combining a section that has been viewed among a plurality of sections and a preview video, and select the generated video as a thumbnail.

  Furthermore, the video selection unit 110 sets a section selected by a method determined in advance based on time information, such as the last section, the last viewed section, and the longest section, as the highlight video. It may be configured. Also, based on the priority, which is a scale that integrates time information and evaluation values, etc., one or more sections are selected with priority given to scenes with higher priority, such as a more exciting highlight scene. May be.

  Further, the video selection unit 110 may select information on thumbnails designated by the user. That is, it is possible to make the user specify whether to display a highlight video or a preview video before displaying the list, and to select the highlight video or the preview video according to the user's specification. In addition, when such a user designation is not input, the selection may be made according to the above determination.

  Next, video generation processing by the video recording / playback apparatus 100 according to the first embodiment configured as described above will be described. FIG. 6 is a flowchart showing an overall flow of the video generation processing in the first embodiment.

  First, the video acquisition unit 101 acquires input video information (step S601). Next, the highlight scene detection unit 102 detects a highlight scene from the video information (step S602). Specifically, the highlight scene detection unit 102 displays a voice attribute such as a voice level (voice level) associated with the video information, a matching result with a predetermined character string (such as “goal”), and the like. A scene having an evaluation value larger than a predetermined threshold is detected as a highlight scene.

  Next, the highlight video generation unit 105 generates a highlight video including the highlight scene detected by the highlight scene detection unit 102 (step S603). Subsequently, the highlight video generation unit 105 stores the generated highlight video in the highlight video storage unit 123 (step S604).

  As described above, according to the video recording / playback apparatus 100 according to the present embodiment, the highlight scene that characterizes the video is detected using the audio attribute or the like as the evaluation value, and the video is specified by including the detected highlight scene. It is possible to generate a highlight image selected so as to be easily processed.

  Next, the specific scene detection unit 103 detects a specific scene from the video information (step S605). Specifically, the specific scene detection unit 103 collates character information such as telop included in the video, metadata input together with the video with a predetermined character string, or recognizes the voice input together with the video. The resulting character information is collated with a predetermined character string, and a scene including a matching or similar character string is detected as a specific scene.

  Next, the specific area detection unit 104 detects a specific area from the video information (step S606). Specifically, the specific area detection unit 104, specifically, the specific area detection unit 104 uses an area where time, elapsed time, score progress, etc. are displayed, or a fixed area at the top of the screen as the specific area. To detect.

  Next, the preview video generation unit 106 generates a restricted highlight scene that is a scene obtained by deleting the specific scene from the highlight scene (step S607). Subsequently, the preview video generation unit 106 deletes the specific area from the restricted highlight scene and generates a preview video including the restricted highlight scene (step S608).

  Next, the preview video generation unit 106 stores the generated preview video in the preview video storage unit 124 (step S609), and ends the video generation process.

  As described above, according to the video recording / playback apparatus 100 according to the present embodiment, not only the highlight video selected so as to easily identify the video but also the video in which the scene including the important part is deleted from the highlight video. A preview image can be generated.

  This makes it possible to present a promotional video as a preview video that recalls important information selected so as not to impair the significance of viewing the target video before watching the video. In addition, after viewing a video, it is possible to present a video that is a target of an operation such as viewing or deletion by a highlight video that is selected so as to make it easier to identify the target video centering on an impressive event.

  Next, video information display processing by the video recording / playback apparatus 100 according to the first embodiment configured as described above will be described. FIG. 7 is a flowchart showing the overall flow of the video information display process in the first embodiment.

  First, the display control unit 109 accepts a request for displaying a list of video information from the user (step S701). Next, the viewing determination unit 108 determines whether or not the highlight video is viewed for each video information (step S702).

  Next, the video selection unit 110 determines whether or not the highlight video has been viewed for each video information (step S703). If the video has been viewed (step S703: YES), the highlight video is selected as a thumbnail. (Step S704).

  If it has not been viewed (step S703: NO), the video selection unit 110 selects a preview video as a thumbnail (step S705).

  Next, the display control unit 109 displays the selected thumbnail on a list display screen (not shown) that displays a list of thumbnails of video information (step S706). Next, the display control unit 109 determines whether or not all the video information has been processed (step S707). If all the video information has not been processed (step S707: NO), the display information is then converted into the video information. The process is repeated (step S703).

  If all the video information has been processed (step S707: YES), the video information display processing is terminated.

  Next, a specific example of video generation processing by the video recording / playback apparatus 100 according to the present embodiment will be described. FIG. 8 is a schematic diagram illustrating an example of highlight scene detection processing.

  The video information shown in the figure is video information for two hours including a soccer game, and the upper part is a graph showing the size of the cheer (sound level) as an evaluation value. The vertical axis represents the magnitude of the evaluation value, and the horizontal axis represents the time in the video information. The left end is the start of the video (time 0: 00: 00.00), and the right end is the end of the video (time 2: 00: 00: 00). .00).

  In the same figure, a total of three rising portions are shown as portions where the size of the cheer exceeds the threshold value. From the left, a climax part 1 corresponding to “chance ... shoot! ... not a goal”, a climax part 2 corresponding to “goal!”, And a climax part 3 corresponding to “game end”. Note that the balloon text displayed corresponding to each location is for explaining the scene, and does not necessarily represent the voice of the live announcement or the like.

  The highlight scene detection unit 102 detects a highlight scene 801 corresponding to the rising portion 1, a highlight scene 802 corresponding to the rising portion 2, and a highlight scene 803 corresponding to the rising portion 3.

  FIG. 9 is a schematic diagram illustrating an example of a scene in which a specific scene and a specific area are detected. As in FIG. 8, the horizontal axis represents the time in the video information. For example, the specific scene detection unit 103 extracts a significant event by determining a sudden fall of a cheer or a peak of cheers, and detects a scene after the significant event as a specific scene. In the figure, an example in which the rising portions 921, 922 and 923 after the important event are detected is shown.

  In the drawing, the restricted highlight scene obtained by removing the specific scene from the highlight scene is shown as the climax portions 901, 902, and 903 before the important event.

  Also, in the figure, an example is shown in which the specific area detecting unit 104 detects the specific area where the score telop is displayed as the score telop display 911, 912, 913 together with the time zone.

  Specifically, the climax part 1 is divided into “after an important event” and “before an important event” before that due to a sharp fall of cheers. There is a time zone in which the score telop is displayed in “Before an important event”.

  In addition, the climax part 2 is divided into “after an important event” and “before an important event” before that because the peak of cheers continues. There is a time zone in which the score telop is displayed in “Before an important event”.

  The climax part 3 is divided into “after an important event” and “before an important event” before that, due to the sudden fall of cheers. In the climax part 3, the score telop, game time, etc. are displayed in all sections “before the important event”.

  FIG. 10 is a schematic diagram illustrating an example of the generated preview video. In the figure, an example in which a scene where no score telop is displayed is further detected from the restricted highlight scene and is generated as a preview video is shown.

  For example, scenes 1001 and 1002, which are sections excluding score telop displays 911 and 912 representing sections in which the score telop is displayed, are detected as the scenes constituting the preview video from the rising portions 901 and 902 before the important event. ing. It should be noted that, in the climax portion 903 before the important event, since all the sections overlap with the score telop display 913, a scene for preview video is not detected.

  FIG. 11 is a schematic diagram illustrating another example of the generated preview video. In the figure, an example is shown in which scenes 1101, 1102, and 1103 obtained by cutting out the area where the score telop is displayed from the restricted highlight scene are generated as preview videos.

  FIG. 12 is a schematic diagram showing still another example of the generated preview video. In the figure, an example is shown in which scenes 1201, 1202, and 1203 in which the blur processing is applied to the area where the score telop is displayed in the limited highlight scene are generated as preview videos.

  13 to 16 are explanatory diagrams showing display examples of preview videos. FIG. 13 shows an example of a preview image that cuts out and displays a rectangular region 1301 that does not include the detected score telop or the like.

  FIG. 14 shows an example of a preview video in which a rectangular area 1401 not including the detected score telop or the like is cut out and the surrounding area is filled with a meaningless image 1402 and displayed.

  FIG. 15 shows an example of a preview image displayed by performing blurring processing on the detected specific area 1501 so that the detected score telop or the like cannot be identified.

  FIG. 16 shows an example of a preview image that is displayed by performing blurring processing on a region 1602 other than the rectangular region 1601 that does not include the detected score telop so that the detected score telop cannot be identified.

  As described above, in the information processing apparatus according to the first embodiment, not only the highlight video including the highlight scene extracted from the acquired video information but also the preview video that is a part excluding the important part of the video information. It can be generated and stored in storage means.

  Further, in the information processing apparatus according to the first embodiment, the viewing history is referred to, the preview video is presented to the user as a thumbnail when not viewed, and the highlighted video including the highlight scene is viewed when viewed. It can be presented to the user as a thumbnail.

  For this reason, it is possible to present a thumbnail that is easy to identify the video when it has already been viewed without deteriorating the viewing value of the video that has not been viewed, and thus provide an appropriate thumbnail for the user who views the video. It becomes possible.

  In the first embodiment, by referring to the viewing history, it is possible to appropriately determine whether the content has been viewed or not for each content. That is, it is possible to determine whether or not the video has been viewed by reproducing the highlight video portion, and the determination criterion can be set for each content. Furthermore, since the information indicating whether or not the user has watched can be used for purposes other than the determination, the device can be configured economically.

(Second Embodiment)
The information processing apparatus according to the second embodiment generates not only a highlight video including a highlight scene from an acquired video but also a preview video that is a portion excluding an important part of the video, and stores the preview video in a storage unit. Is.

  That is, in the second embodiment, an example realized as a video recording apparatus having only a video information recording function among the functions of the video recording / playback apparatus according to the first embodiment will be described.

  FIG. 17 is a block diagram showing a configuration of a video recording apparatus 1700 according to the second embodiment. As shown in the figure, the video recording apparatus 1700 includes a video acquisition unit 101, a highlight scene detection unit 102, a specific scene detection unit 103, a specific area detection unit 104, a highlight video generation unit 105, and a preview. A video generation unit 106, a video information storage unit 121, a highlight video storage unit 123, and a preview video storage unit 124 are provided.

  The functions of the respective components are the same as those in FIG. 1 which is a block diagram showing the configuration of the video recording / playback apparatus 100 according to the first embodiment, and thus the same reference numerals are given and description thereof is omitted here. The overall flow of the video generation process according to the second embodiment is the same as that of FIG. 6 representing the flowchart of the video generation process of the first embodiment, and a description thereof will be omitted here.

  That is, the video recording apparatus 1700 according to the second embodiment executes a video generation process that is a process of generating a highlight video and a preview video in the video recording / playback apparatus 100 according to the first embodiment. 1 is a video recording apparatus having a configuration.

  Therefore, the information processing apparatus according to the second embodiment generates not only a highlight video including a highlight scene extracted from the acquired video information but also a preview video that is a portion excluding an important part of the video information. Can be stored in the storage means. For this reason, by using the stored video, it is possible to present a thumbnail that is easy to identify the video when the video has already been viewed without losing the viewing value of the video that has not been viewed. It is possible to provide an appropriate thumbnail.

(Third embodiment)
The information processing apparatus according to the third embodiment refers to a viewing history indicating whether or not viewing has been completed, and displays a preview video that is a portion excluding an important portion of video information when not viewing as a thumbnail. When the video is presented and viewed, a highlight video including a highlight scene is presented to the user as a thumbnail.

  That is, in the third embodiment, an example will be described in which the video recording / playback apparatus according to the first embodiment is realized as a video playback apparatus having only a video information playback function.

  FIG. 18 is a block diagram illustrating a configuration of a video reproduction device 1800 according to the third embodiment. As shown in the figure, a video playback apparatus 1800 includes a video information storage unit 121, a viewing history storage unit 122, a highlight video storage unit 123, a preview video storage unit 124, a playback control unit 107, and a viewing determination. Unit 108, display control unit 109, and video selection unit 110.

  The functions of the respective components are the same as those in FIG. 1 which is a block diagram showing the configuration of the video recording / playback apparatus 100 according to the first embodiment, and thus the same reference numerals are given and description thereof is omitted here. Further, the overall flow of the video information display process according to the third embodiment is the same as that of FIG. 7 showing the flowchart of the video information display process of the first embodiment, and therefore description thereof is omitted here. .

  That is, the video playback apparatus 1800 according to the third embodiment selects and displays the highlight video or the preview video with reference to the viewing history in the video recording / playback apparatus 100 according to the first embodiment. It is a video reproduction apparatus provided with the structure which performs the video information display process which is a process.

  In the present embodiment, the highlight video storage unit 123 and the preview video storage unit 124 respectively store the highlight video and the preview video in advance. That is, for example, various information such as video information, highlight video, and preview video is recorded, and various information is acquired via a network from an external service device having a function of providing information upon request. It is assumed that the video information storage unit 121, the highlight video storage unit 123, and the preview video storage unit 124 store in advance.

  As described above, in the information processing apparatus according to the third embodiment, the viewing history is referred to, the preview video is presented to the user as a thumbnail when not viewed, and the highlight including the highlight scene when viewed. The video can be presented to the user as a thumbnail. Therefore, it is possible to provide the user with an appropriate thumbnail according to the viewing situation.

(Fourth embodiment)
In the first embodiment and the third embodiment, a highlight video and a preview video are generated regardless of whether or not viewing is performed, and the viewing history stored in the storage unit independently of the generation of these videos. The thumbnails corresponding to the viewing situation were presented.

  On the other hand, the information processing apparatus according to the fourth embodiment generates a highlight video when the user views the video, and whether or not the information has been viewed based on whether the highlight video is generated without referring to the viewing history. It is to determine whether or not.

  FIG. 19 is a block diagram showing a configuration of a video recording / playback apparatus 1900 according to the fourth embodiment. As shown in the figure, the video recording / playback apparatus 1900 includes a video acquisition unit 101, a highlight scene detection unit 1902, a specific scene detection unit 103, a specific area detection unit 104, a highlight video generation unit 105, A preview video generation unit 106, a playback control unit 1907, a display control unit 109, a video selection unit 1910, a video information storage unit 121, a highlight video storage unit 123, and a preview video storage unit 124 are provided. Yes.

  In the fourth embodiment, the viewing determination unit 108 and the viewing history storage unit 122 are deleted, and the functions of the highlight scene detection unit 1902, the playback control unit 1907, and the video selection unit 1910 are the same as those in the first embodiment. It is different from the form. The other configurations are the same as those in FIG. 1 which is a block diagram showing the video recording / playback apparatus 100 according to the first embodiment, and thus the same reference numerals are given and the description thereof is omitted here.

  The highlight scene detection unit 1902 detects a highlight scene that is a part of the video characterizing the video from the video information reproduced by the reproduction control unit 1907. The highlight scene detection method is the same as that of the highlight scene detection unit 102 of the first embodiment.

  Similar to the playback control unit 107 of the first embodiment, the playback control unit 1907 controls processing for reading and playing back video information recorded in the video information storage unit 121 in accordance with a user operation or the like. Is. However, unlike the playback control unit 107 of the first embodiment, the playback control unit 1907 of the fourth embodiment does not execute the process of storing the viewing history in the storage unit even when video is played back. . Instead, the reproduced video information is transmitted to the highlight scene detection unit 1902.

  The video selection unit 1910 determines whether or not the highlight video is stored in the highlight video storage unit 123 for the video information selected by the display control unit 109. If the highlight video is not stored, When the preview video is stored, the highlight video is selected.

  Next, video generation processing by the video recording / playback apparatus 1900 according to the fourth embodiment configured as described above will be described. In the fourth embodiment, the video generation process is divided into a highlight video generation process for generating a highlight video and a preview video generation process for generating a preview video.

  FIG. 20 is a flowchart illustrating an overall flow of highlight video generation processing according to the fourth embodiment.

  First, the playback control unit 1907 plays back video information requested to be played back by the user (step S2001). Steps S2002 to S2004 are the same as steps S602 to S604 in FIG. 6 representing the video generation processing in the first embodiment, and a description thereof will be omitted.

  That is, in the first embodiment, the video acquisition unit 101 generates the highlight video when the video information is acquired. In the fourth embodiment, the playback control unit 1907 reproduces the video information. The difference from the first embodiment is that a highlight video is generated when this is done.

  FIG. 21 is a flowchart showing an overall flow of preview video generation processing in the fourth embodiment.

  First, the video acquisition unit 101 acquires the input video information (step S2101). The subsequent preview video generation processing itself is the same as in the first embodiment. That is, steps S2102 to S2106 are the same as steps S605 to S609 in FIG. 6 representing the video generation processing in the first embodiment, and thus the description thereof is omitted.

  Next, video information display processing by the video recording / playback apparatus 1900 according to the fourth embodiment configured as described above will be described. FIG. 22 is a flowchart showing the overall flow of the video information display process in the fourth embodiment.

  First, the display control unit 109 accepts a request for displaying a list of video information by the user (step S2201).

  Next, for each piece of video information, the video selection unit 1910 determines whether or not a highlight video exists in the highlight video storage unit 123 (step S2202). If it exists (step S2202: YES), a thumbnail is displayed. The highlight video is selected (step S2203).

  When the highlight video does not exist in the highlight video storage unit 123 (step S2202: NO), the video selection unit 1910 selects the preview video as a thumbnail (step S2204).

  Steps S2205 to S2206 are the same as steps S706 to S707 in FIG. 7 representing the video information display processing in the second embodiment, and a description thereof will be omitted.

  As described above, the information processing apparatus according to the fourth embodiment generates a highlight video when the user views the video, determines whether or not the video has been viewed based on whether or not the highlight video is generated, and is not viewed. In this case, a preview video can be presented to the user, and a highlight video including a highlight scene can be presented to the user when the video has already been viewed. Therefore, it is possible to present an appropriate thumbnail to the user according to the viewing situation.

  Note that the information processing apparatus according to the first to fourth embodiments is an apparatus having a video information recording function or a playback function, such as an HDD recorder or a DVD recorder that records and reproduces video information on an HDD, a DVD, or the like. Can be applied to. Further, the present invention can be applied to a normal computer including an HDD and a display device.

  FIG. 23 is an explanatory diagram illustrating a hardware configuration of the information processing apparatus according to the first to fourth embodiments.

  The information processing apparatus according to the first to fourth embodiments includes a control device such as a CPU (Central Processing Unit) 51, a storage device such as a ROM (Read Only Memory) 52 and a RAM (Random Access Memory) 53, and the like. A communication I / F 54 that communicates by connecting to a network, and a bus 61 that connects each unit are provided.

  An information processing program executed by the information processing apparatus according to the first to fourth embodiments is provided by being incorporated in advance in the ROM 52 or the like.

  An information processing program executed by the information processing apparatus according to the first to fourth embodiments is a file in an installable format or an executable format, and is a CD-ROM (Compact Disk Read Only Memory) or a flexible disk (FD). ), A CD-R (Compact Disk Recordable), a DVD or other computer-readable recording medium may be provided.

  Furthermore, the information processing program executed by the information processing apparatus according to the first to fourth embodiments is stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. It may be configured. Moreover, you may comprise so that the information processing program run with the information processing apparatus concerning 1st-4th embodiment may be provided or distributed via networks, such as the internet.

  The information processing program executed by the information processing apparatus according to the first to fourth embodiments includes the above-described units (video acquisition unit, highlight scene detection unit, specific scene detection unit, specific area detection unit, highlight video). A module configuration including a generation unit, a preview video generation unit, a playback control unit, a viewing determination unit, a display control unit, and a video selection unit. As actual hardware, the CPU 51 reads an information processing program from the ROM 52. By executing, the above-described units are loaded onto the main storage device, and the respective units are generated on the main storage device.

  As described above, the information processing apparatus, the information processing method, and the information processing program according to the present invention are suitable for a video information processing apparatus that generates thumbnail images used for video information list display and presents them to the user.

It is a block diagram which shows the structure of the video recording / reproducing apparatus concerning 1st Embodiment. It is explanatory drawing which shows an example of the data structure of the video information memorize | stored in a video information storage part. It is explanatory drawing which shows an example of the data structure of the viewing history memorize | stored in a viewing history memory | storage part. It is explanatory drawing which shows an example of the data structure of the highlight image | video memorize | stored in a highlight image | video storage part. It is explanatory drawing which shows an example of the data structure of the preview image | video memorize | stored in a preview image | video memory | storage part. It is a flowchart which shows the whole flow of the image | video production | generation process in 1st Embodiment. It is a flowchart which shows the whole flow of the video information display process in 1st Embodiment. It is a schematic diagram which shows the example of a highlight scene detection process. It is a schematic diagram which shows the example of the scene from which the specific scene and the specific area were detected. It is a schematic diagram which shows an example of the produced | generated preview image | video. It is a schematic diagram which shows another example of the preview image produced | generated. It is a schematic diagram which shows another example of the preview image produced | generated. It is explanatory drawing which showed the example of a display of a preview image | video. It is explanatory drawing which showed the example of a display of a preview image | video. It is explanatory drawing which showed the example of a display of a preview image | video. It is explanatory drawing which showed the example of a display of a preview image | video. It is a block diagram which shows the structure of the video recording apparatus concerning 2nd Embodiment. It is a block diagram which shows the structure of the video reproduction apparatus concerning 3rd Embodiment. It is a block diagram which shows the structure of the video recording / reproducing apparatus concerning 4th Embodiment. It is a flowchart which shows the whole flow of the highlight video generation process in 4th Embodiment. It is a flowchart which shows the whole flow of the preview image generation process in 4th Embodiment. It is a flowchart which shows the whole flow of the video information display process in 4th Embodiment. It is explanatory drawing which shows the hardware constitutions of the information processing apparatus concerning 1st-4th embodiment.

Explanation of symbols

51 CPU
52 ROM
53 RAM
54 Communication I / F
61 bus 100 video recording / playback apparatus 101 video acquisition unit 102 highlight scene detection unit 103 specific scene detection unit 104 specific area detection unit 105 highlight video generation unit 106 preview video generation unit 107 playback control unit 108 viewing determination unit 109 display control unit 110 Video selection unit 121 Video information storage unit 122 Viewing history storage unit 123 Highlight video storage unit 124 Preview video storage unit 801, 802, 803 Highlight scenes 901, 902, 903 Excited portions 911, 912, 913 Score telop display 921, 922,923 climax part 1001, 1002 scene 1101, 1102, 1103 scene 1201, 1202, 1203 scene 1301 rectangular area 1401 rectangular area 1402 meaningless image 1501 specific area 601 rectangular area 1602 area 1700 video recording apparatus 1800 video reproducing apparatus 1900 video recording and reproducing apparatus 1902 highlight scene detection unit 1907 reproduction control unit 1910 video selection unit

Claims (22)

History storage means for storing a video viewing history in advance;
Highlight scene detection means for detecting a highlight scene that is a part of the video characterizing the video from the input video;
Highlight image generation means for generating a highlight image including the detected highlight scene;
Preview video generation means for generating a preview video including a restricted highlight scene in which a portion including important information regarding the content of the video is deleted from the highlight scene;
Viewing determination means for determining whether or not the highlight video has been viewed based on the viewing history stored in the history storage means;
A selection unit that selects the preview video as a thumbnail video when the viewing determination unit determines that the highlight video has not been viewed;
Display control means for displaying the thumbnail video selected by the selection means;
An information processing apparatus comprising: The highlight scene detection means detects the highlight scene based on an audio attribute including at least one of a volume and a height of an audio input together with the video;
The information processing apparatus according to claim 1. The highlight scene detecting means detects the highlight scene based on text information including at least one of telop included in the video and metadata input together with the video;
The information processing apparatus according to claim 1. Specific scene detection means for detecting a specific scene that is a part of the video including the important information from the input video;
The preview video generation unit generates the limited highlight scene obtained by deleting the specific scene detected by the specific scene detection unit from the highlight scene, and generates the preview video including the generated limited highlight scene. thing,
The information processing apparatus according to claim 1. The specific scene detecting means collates character information including at least one of telop included in the video and metadata input together with the video with the important information, and includes the character information that matches the important information. Detecting a scene as the specific scene;
The information processing apparatus according to claim 4. The specific scene detecting means recognizes voice input together with the video, collates character information as a voice recognition result with the important information, and identifies the scene including the character information that matches the important information. Detecting it as a scene,
The information processing apparatus according to claim 4. For each of the images included in the highlight scene, further comprising a specific area detecting means for detecting a specific area that is an area including the important information,
The preview video generation means generates the limited highlight scene including an image from which the specific area detected by the specific area detection means is deleted, and generates the preview video including the generated limited highlight scene;
The information processing apparatus according to claim 1. The selecting means, when the viewing determining means determines that the highlight video has already been viewed, selecting the highlight video as a thumbnail video;
The information processing apparatus according to claim 1. The highlight scene detection means detects a plurality of the highlight scenes from the input video,
The highlight video generation means generates a highlight video including a plurality of detected highlight scenes,
The viewing determination means determines whether or not each of the plurality of highlight scenes included in the highlight video has been viewed,
The selection means selects the highlight video as a thumbnail video when it is determined that at least one of the plurality of highlight scenes has been viewed;
The information processing apparatus according to claim 1. The highlight scene detection means detects a plurality of the highlight scenes from the input video,
The highlight video generation means generates the highlight video including the detected plurality of highlight scenes,
The viewing determination means determines whether or not each of the plurality of highlight scenes included in the highlight video has been viewed,
The selection means generates a video combining only the highlight videos including the highlighted scene that has been viewed among the plurality of highlight scenes, and selects the generated video as a thumbnail video;
The information processing apparatus according to claim 1. The highlight scene detection means detects a plurality of the highlight scenes from the input video,
The highlight video generation means generates the highlight video including the detected plurality of highlight scenes,
The viewing determination means determines whether or not each of the plurality of highlight scenes included in the highlight video has been viewed,
The selection unit generates a video combining the highlight video including the highlighted scene that has been viewed among the plurality of highlight scenes and the preview video, and selects the generated video as a thumbnail video;
The information processing apparatus according to claim 1. Highlight scene detection means for detecting a highlight scene that is a part of the video characterizing the video from the input video;
Highlight image generation means for generating a highlight image including the detected highlight scene;
Preview video generation means for generating a preview video including a restricted highlight scene in which a portion including important information regarding the content of the video is deleted from the highlight scene;
An information processing apparatus comprising: Video that stores a highlight video including a highlight scene that is a part of the video that characterizes the video, and a preview video that includes a limited highlight scene in which a portion including important information regarding the content of the video is deleted from the highlight scene Storage means;
History storage means for previously storing the viewing history of the video;
Viewing determination means for determining whether or not the highlight video has been viewed based on the viewing history stored in the history storage means;
A selection unit that selects the preview video as a thumbnail video when the viewing determination unit determines that the highlight video has not been viewed;
Display control means for displaying the thumbnail video selected by the selection means;
An information processing apparatus comprising: Video storage means for storing a preview video including a restricted highlight scene in which a portion including important information regarding the content of the video is deleted from a highlight scene that is a video portion characterizing the video;
Playback control means for controlling playback of the video;
Highlight scene detection means for detecting the highlight scene from the video reproduced by the reproduction control means;
Highlight image generation means for generating a highlight image including the detected highlight scene;
A selection means for selecting the preview video as a thumbnail video when no highlight video is generated;
Display control means for displaying the thumbnail video selected by the selection means;
An information processing apparatus comprising: A highlight scene detection step of detecting a highlight scene that is a part of the video characterizing the video from the input video by the highlight scene detection means;
A highlight video generation step for generating a highlight video including the detected highlight scene by the highlight video generation means;
A preview video generation step of generating a preview video including a restricted highlight scene in which a portion including important information regarding the content of the video is deleted from the highlight scene by the preview video generation means;
A viewing determination step of determining whether or not the highlight video has been viewed based on the viewing history stored in the history storage unit in advance by the viewing determination unit;
A selection step of selecting the preview video as a thumbnail video when the viewing determination step determines that the highlight video has not been viewed by the selection means;
A display control step of displaying the thumbnail video selected by the selection step by a display control means;
An information processing method characterized by comprising: A highlight scene detection step of detecting a highlight scene that is a part of the video characterizing the video from the input video by the highlight scene detection means;
A highlight video generation step for generating a highlight video including the detected highlight scene by the highlight video generation means;
A preview video generation step of generating a preview video including a restricted highlight scene in which a portion including important information regarding the content of the video is deleted from the highlight scene by the preview video generation means;
An information processing method characterized by comprising: A viewing determination step for determining whether or not a highlight video including a highlight scene that is a portion of the video characterizing the video has been viewed by the viewing determination unit based on a viewing history stored in advance in the history storage unit;
A portion including important information regarding the contents of the video from the highlight scene, which is stored in advance as a thumbnail video in the video storage unit when the viewing determination step determines that the highlight video has not been viewed by the selection unit A selection step for selecting a preview image including the restricted highlight scene from which
A display control step of displaying the thumbnail video selected by the selection step by a display control means;
An information processing method characterized by comprising: A playback control step for controlling playback of the video by the playback control means;
A highlight scene detecting step for detecting a highlight scene that is a part of the video characterizing the video from the video reproduced by the reproduction control step by a highlight scene detecting unit;
A highlight video generation step for generating a highlight video including the detected highlight scene by the highlight video generation means;
When a highlight video is not generated by the selection unit, a restricted highlight scene is stored in advance as a thumbnail video in the video storage unit, and a portion including important information regarding the content of the video is deleted from the highlight scene. A selection step for selecting a preview image including,
A display control step of displaying the thumbnail video selected by the selection step by a display control means;
An information processing method characterized by comprising: A highlight scene detection procedure for detecting a highlight scene that is a part of the video characterizing the video from the input video;
A highlight video generation procedure for generating a highlight video including the detected highlight scene;
A preview video generation procedure for generating a preview video including a restricted highlight scene in which a portion including important information regarding the content of the video is deleted from the highlight scene;
A viewing determination procedure for determining whether or not the highlighted video has been viewed based on a viewing history stored in advance in a history storage unit;
A selection procedure for selecting the preview video as a thumbnail video when the viewing determination procedure determines that the highlight video has not been viewed;
A display control procedure for displaying the thumbnail image selected by the selection procedure;
An information processing program that causes a computer to execute. A highlight scene detection procedure for detecting a highlight scene that is a part of the video characterizing the video from the input video;
A highlight video generation procedure for generating a highlight video including the detected highlight scene;
A preview video generation procedure for generating a preview video including a restricted highlight scene in which a portion including important information regarding the content of the video is deleted from the highlight scene;
An information processing program that causes a computer to execute. A viewing determination procedure for determining whether or not a highlight video including a highlight scene that is a portion of the video characterizing the video has been viewed based on a viewing history stored in advance in the history storage unit;
When the viewing determination procedure determines that the highlight video has not been viewed, a restriction that is pre-stored in the video storage means as a thumbnail video and that deletes a portion including important information about the content of the video from the highlight scene A selection procedure for selecting a preview video including a highlight scene,
A display control procedure for displaying the thumbnail image selected by the selection procedure;
An information processing program that causes a computer to execute. Playback control procedure for controlling video playback;
From the video reproduced by the reproduction control procedure, a highlight scene detection procedure for detecting a highlight scene that is a part of the video characterizing the video;
A highlight video generation procedure for generating a highlight video including the detected highlight scene;
When a highlight video has not been generated, a preview video including a limited highlight scene is stored in advance as a thumbnail video in video storage means, and a portion including important information regarding the content of the video is deleted from the highlight scene. A selection procedure to select,
A display control procedure for displaying the thumbnail image selected by the selection procedure;
An information processing program that causes a computer to execute.

Images