JP2007274233A - Picture information processor, digital information recording medium, picture information processing method and picture information processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processor for generating a typical image that are easy to distinguish among a plurality of pictures. <P>SOLUTION: A picture acquiring part 11A acquires and records digital picture data on a storage medium 90A. A resembling part detector 12 generate resembling picture section information for distinguishing between resembling picture sections and other sections in the acquired picture data. A caption control information generator 31 generates information of a typical picture selected among resembling parts, information of a typical picture selected from others, and a caption selected information. A listing controller 41 selects a set of picture data for a listing object from the storage medium 90A, and a listing condition determiner 42 determines mutual similarity relation of the selected set of picture data, to select either of two typical pictures information regarding each picture data. A caption generator 52 acquires information on the selected typical picture from the caption control information generator 31 and prepares representative still image data for display. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an information processing apparatus that performs processing related to recording and reproduction of digital video, and a recording medium that records information of digital video.

  In recent years, the mainstream of equipment for recording audio and video has shifted from conventional analog magnetic tapes to digital magnetic disks and semiconductor memories. Particularly in video recording / playback equipment using a large-capacity hard disk, the recordable capacity has been dramatically increased. If such a device is used, videos of a large number of programs provided by broadcasting or communication are stored, and the user can freely select and view them.

  Here, in the management of the stored video, a title (program) which is a unit of a program or the like is filed, a name and other information are given, and a representative image (thumbnail) of the title is displayed in the list. ) And names etc. can be displayed side by side. In addition, one program (title) can be divided into units called chapters (segments), and reproduction and editing can be performed in units of chapters. Assign a chapter name, display a chapter representative image (thumbnail), select a chapter containing a desired scene from the chapter list and play it, create a playlist by arranging the selected chapters, etc. can do. There is a VR (Video Recording) mode of DVD (Digital Versatile Disc) as one that defines these management methods. Japanese Patent Application Laid-Open No. 2004-228561 proposes a method for managing a representative reduced image for a menu.

  In addition, there is a UPnP (Universal Plug and Play) Content Directory specification as a communication protocol related to video management, and there is a DLNA (Digital Living Network Alliance) guideline as a specification for interconnecting devices including this.

  Further, when the number of programs (titles) is large, the list can be narrowed down by conditions such as the program genre, or can be rearranged in the order of program names. In addition, programs (titles) can be classified and managed in folders, and programs (titles) in the folders can be displayed as a list. For example, a continuous drama program can be automatically recorded every time (weekly), and only that drama can be put in a specific folder.

  The representative image (thumbnail) used when displaying a list of titles (programs) and chapters (segments) is generally the first frame or a frame image of a certain time from the beginning. Based on the contents of the above, various types generated by a single algorithm have been proposed. Patent Document 2 also proposes a thumbnail generation and management method in which a plurality of selection criteria are arranged side by side.

  On the other hand, chapter (segment) division is generally based on detection of a silent part, switching of video (cut), switching of audio multiplexing mode (monaural, stereo, bilingual), and the like.

On the other hand, as a segment division based on the similarity of videos, Patent Document 3 discloses a video segmentation method using similar shots that appear repeatedly.
JP 11-215466 A JP 2003-196297 A JP 2005-130416 A

  When creating a group of titles, dividing chapters, or creating playlists (user programs) using similarities in the video, the conventional method uses representative images because of the similarity between target videos. However, there is a problem that it tends to be similar.

  The present invention has been made in consideration of such a situation, and an object thereof is to provide an information processing apparatus that generates easily distinguishable representative images for a plurality of similar target videos. .

  According to one aspect, the present invention includes a video information processing apparatus that handles a plurality of video data.

  An information processing apparatus according to the present invention includes a video acquisition unit that acquires a plurality of video data, and another portion of each of the video data or another video of the plurality of video data for each of the plurality of video data. Similar part detecting means for detecting a similar part to data, and heading control for generating heading control information for generating heading information when displaying a list of video data based on the similar part detection result in each video data Information generation means, list display control means for selecting a list display target from a plurality of video data, list condition determination means for determining a similarity relationship between the selected list display target video data, and the list condition Heading generation means for generating heading information using the determination result by the determination means and the heading control information, and the heading control information generation means The heading control information generated in this step includes first heading generation information for generating a heading from a portion similar to other video data, and a second heading for generating a heading from a portion other than the similar portion. The heading information generated by the heading generation unit is generated using either of the two heading generation information according to the determination result by the list condition determination unit.

  Another information processing apparatus according to the present invention includes a video acquisition unit that acquires a plurality of video data, and, for each of the plurality of video data, another part of the video data or another of the video data Based on the similar part detection result in each video data, heading control information for generating heading information when displaying the video data as a list is generated based on similar part detection means for detecting a similar part to the video data A heading control information generating means; and a heading control information recording means for recording the generated heading control information on a recording medium. The heading generated by the heading control information generating means and recorded by the heading control information recording means The control information includes first headline generation information for generating a headline from a part similar to other video data, and the similar part. From and a second heading generation information for generating a heading.

  Another information processing apparatus according to the present invention includes a list display control means for selecting a list display target from a plurality of video data, and a list condition determination for determining a similarity between the selected list display target video data. Means, heading generation information reading means for reading heading control information for generating heading information from a recording medium, and heading generation means for generating heading information using the determination result by the list condition judging means and the heading control information The heading control information read by the heading control information reading means generates first heading generation information for generating a heading from a portion similar to other video data and headings from other than the similar portion. And the second headline generation information for generating the headline generated by the headline generation means Information in accordance with the determination result by the list condition determining means, is generated by using one of the two headline generation information.

  According to another aspect, the present invention includes a recording medium on which a plurality of video data and control information thereof are recorded.

  In the recording medium according to the present invention, the control information includes heading control information for generating heading information of each video data when the video data is displayed as a list, and the heading control information in each video data is included in the video data. When displaying a list of video data, first header generation information for generating a header from a portion similar to other video data, second header generation information for generating a header from a portion other than the similar portion, and video data The header selection information for determining which of the two header generation information is used to generate the header information in combination with a plurality of other video data.

  According to another aspect, the present invention includes a video information processing method for handling a plurality of video data.

  An information processing method according to the present invention includes a video acquisition step of acquiring a plurality of video data, and, for each of the plurality of video data, another part in each video data or another video of the plurality of video data A similar part detecting step for detecting a similar part to data, and a heading control for generating heading control information for generating heading information when displaying a list of video data based on the similar part detection result in each video data An information generation step; a list display control step for selecting a list display target from a plurality of video data; a list condition determination step for determining a similarity relationship between the selected list display target video data; and the list condition A header generation step of generating header information using the determination result of the determination step and the header control information. The heading control information generated in the heading control information generating step generates first heading generation information for generating a heading from a portion similar to other video data and headings from other than the similar portion. The header information generated in the header generation step is generated using one of the two header generation information according to the determination result in the list condition determination step. Is done.

  Another information processing method according to the present invention includes a video acquisition step of acquiring a plurality of video data, and, for each of the plurality of video data, another part of the video data or another of the video data A similar part detecting step for detecting a similar part to the video data of the video and heading control information for generating heading information when displaying the video data as a list based on the similar part detection result in each video data A heading control information generation step and a heading control information recording step for recording the generated heading control information on a recording medium, the heading control generated in the heading control information generation step and recorded in the heading control information recording step The information includes first header generation information for generating a header from a portion similar to other video data, And a second heading generation information for generating a heading from other than the portion where the similar.

  Another information processing method according to the present invention includes a list display control step for selecting a list display target from a plurality of video data, and a list condition determination for determining a similarity between the selected list display target video data. A heading generation information reading step for reading heading control information for generating heading information from a recording medium, and a heading generation step for generating heading information using the determination result of the list condition determination step and the heading control information The heading control information read in the heading control information reading step generates first heading generation information for generating a heading from a portion similar to other video data, and headings from other than the similar portion. At least one of the second headline generation information for the headline generation step. The title information generated in response to the determination result by the list conditional step is generated using one of the two headline generation information.

  According to still another aspect, the present invention includes a video information processing program for causing a computer to perform video information processing that handles a plurality of video data.

  The video information processing program according to the present invention includes a video acquisition step of acquiring a plurality of video data, and for each of the plurality of video data, another part of the video data or another of the plurality of video data A similar part detecting step for detecting a similar part to video data, and a heading for generating heading control information for generating heading information when displaying a list of video data based on the similar part detection result in each video data A control information generation step; a list display control step for selecting a list display target from a plurality of video data; a list condition determination step for determining a similarity relationship between the selected list display target video data; and the list A header generation step for generating header information using the determination result in the condition determination step and the header control information. And the heading control information generated in the heading control information generation step includes first heading generation information for generating a heading from a portion similar to other video data, and other than the similar portion. Second headline generation information for generating a headline, and the headline information generated in the headline generation step is one of the two headline generation information according to a determination result in the list condition determination step. Generated using

  According to the present invention, there is provided an information processing apparatus that generates easily distinguishable representative images for a plurality of similar target videos.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 shows the configuration of a video information processing apparatus according to the first embodiment of the present invention.

  The video information processing apparatus according to this embodiment is a recording / playback device, and includes a video acquisition unit 11A, a similar part detection unit 12, and a heading control information generation unit 31 as components related to information generation, and a configuration related to display processing. As elements, a list display control unit 41, a list condition determination unit 42, a headline generation unit 52, and a storage medium 90A are provided.

(1) Components related to information generation First, components related to information generation will be described.

  The video acquisition unit 11A acquires digital video data input from a receiving tuner such as an external digital broadcast or other digital video equipment. The video acquisition unit 11A can also acquire an analog video signal input from an external broadcast receiving tuner or other analog video equipment, and convert it into digital video data. Furthermore, the video acquisition unit 11A records the acquired digital video data in the storage medium 90A.

  The similar part detection unit 12 detects a similar part in the acquired video data, and generates similar video section information that distinguishes the similar video section from the other parts.

  The heading control information generating unit 31 refers to the similar video section information, generates information on a representative image selected from similar parts as first heading generation information for each unit of video data, and generates a second heading. As the generation information, information on representative images selected from other than similar parts is generated. The heading control information generation unit 31 further generates heading selection information using the similar part identification information in the similar video section information used when generating the representative image information.

  The representative image information is information for generating a display representative still image and a display representative moving image. For example, representative still image data or representative moving image data may be used. Further, in order to generate a representative image from video data, it may be frame position information from which a representative still image is extracted or frame section information from which a representative moving image is extracted in association with the video data. It doesn't matter.

  FIG. 2 schematically illustrates an example of a similar section and a dissimilar section in the processing of the heading control information generation unit 31.

  The “similar pattern” is not the similarity of the representative image, but it is preferable to determine the similarity of a section (shot) divided by image switching (cut) or a time range such as a continuation thereof. When shots are classified into similar patterns and given alphabets, for example, as shown in FIG. 2, when ABCDEDEF (video data 81) and ABCGHJG (video data 82) are arranged side by side, ABC is a similar section. 1, an image included in, for example, B (A or C can be substituted) is selected as the first headline generation information (X1) corresponding to the similar section 1, and the dissimilar section DEDEF in the video data 81 is selected. To, for example, images included in D (F can be substituted), and in the video data 82, images included in the dissimilar section GHJG, for example, G (can be replaced by H), correspond to the similar section 1 respectively. It is selected as generation information (Y1). The headline selection information represents a similar section 1 as a similar part identifier (for example, “1”, “ABC”, etc.).

  FIG. 3 schematically shows another example of a similar section and a dissimilar section in the processing of the heading control information generation unit 31.

  Also, as shown in FIG. 3, when A, which is part of the similar section 1, becomes a similar section 2 in combination with another video data 83 arranged like AK... Are selected as the first headline generation information (X2) corresponding to the similar section 2, and from the dissimilar sections BCDEDEF (video data 81), BCGHJG (video data 82), K ... (video data 83), for example, B , B, and K are selected as second headline generation information (Y2) corresponding to the similar section 2.

  If there is such an inclusion relationship of similar sections, in the video data 81, it is defined that the similar section 1 is given priority over the similar section 2 according to the expression of header selection information, the order of arrangement, etc., and then X1, Y1, It is preferable to hold each headline generation information of X2 and Y2.

  In consideration of the similar section 1 in the inclusive relationship, the images included in the similar section A are X2, dissimilar sections DEDEF (video data 81), GHJG (video data 82), K (video data 83). For example, an image included in each of D, G, and K may be Y2. In that case, Y1 and Y2 are equivalent, so Y1 may be omitted. Further, X1 may be omitted and X2 may be substituted.

  Next, details of the similar part detection unit 12 will be described.

  The similar part detection unit 12 analyzes a single input video, detects image switching (cut), classifies sections (shots) delimited by the cut into similar patterns based on image information, and assigns IDs. . Specifically, still images in the vicinity of the cut may be extracted, analyzed and converted into feature values, and mutual similarities may be determined or classified into similar groups by clustering or the like. When encoding such as MPEG is performed, the feature amount may be a method of using only DC components of Y, Cb, and Cr from image information of an I picture, for example.

  Furthermore, when a plurality of similar sections (shots) are continuous, after collecting them, a new similar section ID may be given in addition to the individual similar section IDs to be configured.

  As another example of the similar part detection unit 12, a similar part may be detected between a feature quantity that is a key prepared in advance and a feature quantity that is extracted by analyzing an input video. A feature amount extracted from a still image of one frame may be used, or a feature amount extracted from a moving image of a plurality of frames may be used. What is extracted from speech having a predetermined time width may be used, or time-series data obtained by arranging them over time may be used.

  Thus, various implementation methods are assumed for the similar part detection unit 12.

  Next, details of the heading control information generation unit 31 will be described.

  FIG. 4 schematically shows an example of the heading control information generated by the heading control information generation unit 31.

  In this figure, there are two news programs, program 1 “TVX NEWS 07/21” and program 2 “TVX NEWS 07/22”, each of which is divided into a plurality of segments. Corresponding to each segment, a representative image and its identification name are generated.

  Program 1 is divided into six segments.

  A segment 1-1 is a headline portion at the beginning, and the representative image 1-X1 is selected from the opening title screen portion, and the representative image 1-Y1 is selected from other portions. Here, the title screen portion has been detected as similar to the previous broadcast, and is managed as a similar pattern ID = 1. Note that the number 1 of the representative image identifiers X1 and Y1 corresponds to the similar pattern ID.

  The segment 1-2 is a greeting portion, and only the representative image 2-Z is selected by a normal method because similarity is not detected or the similar portion cannot be clearly distinguished from the rest.

  The segment 1-3 is the first news topic part, and the representative image 3-X2 is selected from the caster part, and the representative image 3-Y2 is selected from the other part. Here, in the caster part, similarity is detected between the subsequent segments 1-4 and 1-5, or similarity with the previous broadcast is detected, and the similarity pattern ID = 2 It is managed.

  Segments 1-4 and 1-5 are the second and third news topics, respectively. Similarly, representative images 4-X2, 5-X2 from the caster part (similar pattern ID = 2) Representative images 4-Y2 and 5-Y2 are selected from the other portions.

  A segment 1-6 is a sports corner portion, and the representative image 6-X3 is selected from the corner title screen portion, and the representative image 6-Y3 is selected from other portions. Here, the similarity between the corner title screen portion and the previous broadcast is detected, and is managed as a similar pattern ID = 3.

  The program 2 is divided into a plurality of segments like the program 1, but only two segments are shown in FIG.

  A segment 2-1 is a headline portion at the beginning, and the representative image 7-X1 is selected from the opening title screen portion (similar pattern ID = 1), and the representative image 7-Y1 is selected from other portions.

  A segment 2-8 is a sports corner portion, and the representative image 8-X3 is selected from the corner title screen portion (similar pattern ID = 3), and the representative image 8-Y3 is selected from other portions.

  Thus, basically, two representative images X and Y are selected corresponding to each segment. The representative images of X1, X2, and X3 are generated from sections of similar patterns 1, 2, and 3, respectively. The representative images X corresponding to the same similar pattern may be similar to each other as a result of being generated by a predetermined representative image selection algorithm. In the drawing of this description, the representative images X are drawn as having high similarity in order to facilitate understanding, but in the present invention, they are not selected because of the similarity between the representative images. For example, it may be selected from different locations (shots) in the similar pattern video such as the first and second images of the opening title screen, and they are not necessarily similar.

  On the other hand, Y1, Y2, and Y3 also mean that they are generated from sections other than the similar patterns 1, 2, and 3, but usually there is no similarity between the representative images Y corresponding to the same similar pattern.

  As described above, the heading control information generated by the heading control information generation unit includes information of two representative images as the first and second heading generation information and the similar pattern ID as the heading selection information.

  The headline generation information may be information for enabling similar representative image generation. For example, information for distinguishing between similar and dissimilar sections in video data and corresponding video data (usually stored separately) Therefore, it is not necessary to prepare redundantly).

  In the case of having information on similar sections and dissimilar sections, for example, the end of the video data from the start of the video data to the relevant frame is represented as a similar section by the end frame of the similar part, and the end of the video from that frame by the start frame of the dissimilar part May be represented as dissimilar sections. Further, when the similar section and the dissimilar section are composed of a plurality of sections, each may be represented by a plurality of start / end frames.

  In addition, when considering other than similar sections as dissimilar sections, it is only necessary to have information on similar sections. For example, from the start of video data by a boundary frame that is a portion where a similar portion ends and a dissimilar portion starts. The frame up to the frame may be represented as a similar section, and the frame to the end of video data may be represented as a dissimilar section. In addition, when the similar section is composed of a plurality of sections, it may be represented by a plurality of start / end frames, and the dissimilar section is the other portion (from the start of the video to the start frame of the first similar section, each similar From the end of the section to the start frame and from the end frame of the last similar section to the end of the video).

  The storage medium 90A is a hard disk, a semiconductor memory, a flash, a DVD, etc., which may be removable or fixed, and is a device that conforms to NAS or DLNA guidelines for reading and writing over a network. Also good.

(2) Components Related to Display Processing Next, components related to the display processing will be described.

  The list display control unit 41 accepts an operation from the user, and selects a set of video data to be displayed as a list from among those recorded in the storage medium 90A.

  The list condition determination unit 42 determines a mutual similarity between the sets of video data selected by the list display control unit 41 based on the headline selection information generated by the heading control information generation unit 31, and sets each video data It is determined which of the two types of representative image information is used to generate the heading information. The list condition determination unit 42 selects the first headline generation information (the video acquired by the video acquisition unit 11A) for video data that is not the same and similar pattern to any of the other video data in the selected video data set. On the other hand, the first headline generation information (in the video acquisition unit 11A) is selected for video data having the same similar pattern as any of the other video data. The information of representative images selected from other than similar parts with respect to the acquired video data is selected.

  The header generation unit 52 acquires information on the representative image selected according to the determination result by the list condition determination unit 42 from the header control information generation unit 31, and generates representative still image data to be displayed. Also, a list display screen is created by appropriately arranging the created representative still image data.

  FIG. 5 schematically shows an example of heading information generated in the heading generation unit 52.

  The view A represents a case where the segment list of the program 1 is selected in the list display control unit 41. The list condition determination unit 42 determines that there are a plurality of segments (1-3, 1-4, 1-5) corresponding to the similar pattern ID = 2 among the six segments constituting the list. The representative image Y2 is selected. Otherwise, the representative image X or Z is selected.

  View B represents a case where a segment list of playlist 1 including three segments (1-3, 1-4, 1-5) is selected. The three segments constituting the list are the same as those in the view A, and the representative image Y2 is selected.

  View C represents a case where a segment list of playlist 2 including two segments (1-6, 2-8) is selected. The two segments constituting the list correspond to the similar pattern ID = 3, and the representative image Y3 is selected.

  View D represents the case where a total of four lists of program 1, program 2, playlist 1, and playlist 2 are selected. Although not shown in the figure, representative images corresponding to the entire program 1 are 1-X1 and 1-Y1, 7-X1 and 7-Y1 for the entire program 2, and 3 for the entire playlist 1. Since -X2 and 3-Y2 and 6-X3 and 6-Y3 are selected for the entire playlist 2, the representative image 1 is displayed at the portion corresponding to the similar pattern 1 in the list as shown in the figure. -X1, 7-Y1, and 3-X2, 6-X3 are selected in the other portions.

  As described above, the set of video data to be displayed as a list to be selected by the list display control unit 41 is a series of video programs, segments obtained by dividing the program, and a program for arbitrarily arranging and reproducing these programs and segments. Consists of lists.

  As a list display target at this time, a list of all recorded programs and playlists, a list of programs or playlists selected by the user, a list of segments included in the playlist, preset conditions or specified by the user It is possible to search for programs, segments, playlists, etc. Further, when all of them cannot be displayed at the same time, a predetermined number of pages are displayed by switching pages or scrolled, so only a part of them may be displayed.

  Further, a folder for managing a plurality of programs and playlists in groups may be provided. As a list display target at this time, a list of all recorded folders, a list of programs and playlists managed in the folder selected by the user, and a list of folders, preset conditions or users It is also possible to use a folder searched according to the conditions specified by.

  The range of the list display target and the method for selecting or limiting the range are not limited to the above.

  When the header generation information is representative image information, the header generation unit 52 generates a representative still image for display or a representative moving image for display from representative still image data or representative moving image data, or includes frame position information or frame section information. The representative still image for display and the representative moving image for display are generated from the video data.

  If the headline generation information is information that distinguishes between similar and dissimilar sections in video data, a display representative still image and a display representative moving image are generated from the corresponding video data.

  Next, the flow of processing in the components related to display processing will be described using the flowchart of FIG.

  First, as a list display control process corresponding to the list display control unit 41, an operation from a user is accepted, and a set of video data to be displayed as a list is selected from those recorded in the storage medium 90A (step S110).

  Next, video data list processing (PASS1) is performed for each video data to be listed (loop from step S121 to step S124).

  In the loop, as the heading control information reading process, the heading control information is read for each video data to be listed (step S122).

  In addition, as a combination determination process of the headline selection information corresponding to the list condition determination unit 42, a combination of headline selection information included in the read headline control information is determined, and two types of headline generation information of each video data are determined. Which is used to generate the heading information is determined (step S123).

  Next, a video data list display process (PASS2) is performed again for each video data to be listed (loop from step S131 to step S136).

  In the loop, according to the list condition determination result determined in step S123 (step S132), either the first headline generation information (step S133) or the second headline generation information (step S134) is selected, and the headline In the headline generation process corresponding to the generation unit 52, representative still image data to be displayed is created (step S135).

[Second Embodiment]
FIG. 7 shows the configuration of a video information processing apparatus according to the second embodiment of the present invention.

  The video information processing apparatus according to this embodiment is a recording / playback device, and includes a video acquisition unit 11B, a similar part detection unit 12, and a heading control information generation unit 31 as components related to information generation, and a configuration related to display processing. As elements, a list display control unit 41, a list condition determination unit 42, a headline generation unit 52, and a storage medium 90B are provided.

  The difference from the first embodiment is a video acquisition unit 11B and a storage medium 90B. Video data is recorded in advance in the storage medium 90B. The video acquisition unit 11B reads and acquires video data from the storage medium 90B.

  The similar part detection unit 12 may be the same as that of the first embodiment, but another example will be given here. The similar part detection unit 12 holds one or more feature quantities that are keys prepared in advance, and detects similar parts between the feature quantities extracted by analyzing the video acquired by the video acquisition unit 11B. To do. The feature amount is time-series data in which a power spectrum obtained by frequency analysis of audio included in a video with a predetermined time width is arranged over time, and similar sections may be detected by matching time-series data. . An ID is assigned to each key, and a similar section ID based on the key ID is assigned to a section in which a similarity with the key is detected.

  Further, when a plurality of similar sections are continuous, after collecting them, a new similar section ID may be given in addition to the individual similar section IDs to be configured. Here, instead of preparing keys corresponding to all possible similar sections, processing such as integrating cases where two similar sections are detected at a predetermined interval may be performed.

  As another example of the similar part detection unit 12, one or a plurality of recorded videos are acquired and analyzed, and a similar part between feature quantity series is detected or classified into similar groups by clustering or the like. By doing so, you may determine a similar part. The feature amount may be an analysis of a speech section cut out with a clue of silence or the like, or an analysis of an image of a section (shot) cut out with a change (cut) of an image as a clue. An image extracted from a still image of one frame may be used, or an image extracted from a moving image of a plurality of frames may be used. What is extracted from speech having a predetermined time width may be used, or time-series data obtained by arranging them over time may be used.

  Thus, various implementation methods are assumed for the similar part detection unit 12.

  The storage medium 90B is a hard disk, semiconductor memory, flash, DVD, etc., which may be removable or fixed, and is a device that conforms to NAS or DLNA guidelines for reading and writing over a network. Also good.

[Third Embodiment]
FIG. 8 shows the configuration of a video information processing apparatus according to the third embodiment of the present invention.

  The video information processing apparatus according to this embodiment is a recording / playback device, and includes a video acquisition unit 11A, a similar part detection unit 12, a division information generation unit 21, and a heading control information generation unit 31 as components related to information generation. As a component related to the display processing, a list display control unit 41, a list condition determination unit 42, a heading generation unit 52, and a storage medium 90A are provided.

  The difference from the first embodiment is that a division information generation unit 21 is provided. The similar video section information generated by the similar part detection unit 12 is divided into division information in addition to the heading control information generation unit 31. It is also used in the generation unit 21.

  The division information generation unit 21 refers to the similar video section information generated by the similar part detection unit 12 and divides immediately before the similar video section as a reference, or is specified in association with a previously registered similar pattern. Division information including time positions for dividing the video data according to the division position determination method is generated. As a method for determining the division position, for example, a method using a similar shot that repeatedly appears (Patent Document 3) may be used. It is also possible to make a determination by detecting a similarity with a voice pattern given in advance.

  The heading control information generation unit 31 refers to the similar video section information and the division information, and for each video data unit, information on the representative image selected from the similar part and information on the representative image selected from other than the similar part And generate

[Fourth Embodiment]
FIG. 9 shows the configuration of a video information processing apparatus according to the fourth embodiment of the present invention.

  The video information processing apparatus according to this embodiment is a recording / playback device, and includes a video acquisition unit 11B, a similar part detection unit 12, a division information generation unit 21, and a heading control information generation unit 31 as components related to information generation. As a component related to the display process, a list display control unit 41, a list condition determination unit 42, a headline generation unit 52, and a storage medium 90B are provided.

  The difference from the third embodiment is a video acquisition unit 11B and a storage medium 90B. Similar to the second embodiment, video data is recorded in advance in the storage medium 90B. The video acquisition unit 11B reads and acquires video data from the storage medium 90B. Similar to the third embodiment, the similar video section information generated by the similar part detection unit 12 is also used by the division information generation unit 21 in addition to the heading control information generation unit 31. In addition, the division information generation unit 21 generates division information including time positions for dividing the video data.

[Fifth Embodiment]
FIG. 10 shows the configuration of a video information processing apparatus according to the fifth embodiment of the present invention.

  The video information processing apparatus of this embodiment includes a video acquisition unit 11A, a similar part detection unit 12, a heading control information generation unit 31, a heading control information recording unit 32, and a storage medium 90C as components related to information generation. Yes.

  The video information processing apparatus according to this embodiment is a recording-dedicated device, and unlike the first embodiment, does not include components related to display processing.

  The video acquisition unit 11A acquires digital video data input from a receiving tuner such as an external digital broadcast or other digital video equipment. The video acquisition unit 11A can also acquire an analog video signal input from an external broadcast receiving tuner or other analog video equipment, and convert it into digital video data. Further, the video acquisition unit 11A records the acquired digital video data in the storage medium 90C.

  The heading control information recording unit 32 records the first heading generation information, the second heading generation information, and the heading selection information generated by the heading control information generation unit 31 in the storage medium 90C.

  The storage medium 90C is a hard disk, semiconductor memory, flash, DVD, etc., which may be removable or fixed, and is a device or the like that conforms to NAS or DLNA guidelines for reading and writing over a network. Also good.

[Sixth Embodiment]
FIG. 11 shows the configuration of a video information processing apparatus according to the sixth embodiment of the present invention.

  The video information processing apparatus of this embodiment includes a video acquisition unit 11B, a similar part detection unit 12, a heading control information generation unit 31, a heading control information recording unit 32, and a storage medium 90D as components related to information generation. Yes.

  The video information processing apparatus according to this embodiment is a recording-dedicated device, and unlike the second embodiment, does not include components related to display processing.

  The difference from the fifth embodiment is a video acquisition unit 11B and a storage medium 90D. Similar to the second and fourth embodiments, video data is recorded in advance in the storage medium 90B. The video acquisition unit 11B reads and acquires video data from the storage medium 90D. Similarly to the fifth embodiment, the heading control information recording unit 32 stores the first heading generation information, the second heading generation information, and the heading selection information generated by the heading control information generation unit 31 as a storage medium. Record in 90D.

  The storage medium 90D is a hard disk, semiconductor memory, flash, DVD, etc., which may be removable or fixed, and is a device that conforms to NAS or DLNA guidelines for reading and writing over a network. Also good.

[Seventh Embodiment]
FIG. 12 shows the configuration of a video information processing apparatus according to the seventh embodiment of the present invention.

  The video information processing apparatus of this embodiment includes a video acquisition unit 11A, a similar part detection unit 12, a division information generation unit 21, a division information recording unit 22, a heading control information generation unit 31, a heading as constituent elements related to information generation. A control information recording unit 32 and a storage medium 90E are provided.

  The video information processing apparatus of this embodiment is a recording-dedicated device, and unlike the third embodiment, does not include components related to display processing.

  The video acquisition unit 11A acquires digital video data input from a receiving tuner such as an external digital broadcast or other digital video equipment. The video acquisition unit 11A can also acquire an analog video signal input from an external broadcast receiving tuner or other analog video equipment, and convert it into digital video data. Furthermore, the video acquisition unit 11A records the acquired digital video data in the storage medium 90E.

  Similarly to the third embodiment, the division information generation unit 21 generates division information including time positions for dividing video data, and the division information recording unit 22 is generated by the division information generation unit 21. The division information is recorded on the storage medium 90E. Furthermore, the heading control information recording unit 32 records the first heading generation information and the second heading generation information generated by the heading control information generation unit 31 in the storage medium 90E.

  The storage medium 90E is a hard disk, a semiconductor memory, a flash, a DVD, or the like, which may be removable or fixed, and is a device that complies with NAS or DLNA guidelines for reading and writing over a network. Also good.

[Eighth Embodiment]
FIG. 13 shows the configuration of a video information processing apparatus according to the eighth embodiment of the present invention.

  The video information processing apparatus according to this embodiment is a recording-dedicated device, and includes a video acquisition unit 11B, a similar part detection unit 12, a division information generation unit 21, a division information recording unit 22, a heading control as constituent elements related to information generation. An information generation unit 31, a heading control information recording unit 32, and a storage medium 90F are provided.

  Unlike the fourth embodiment, the video information processing apparatus of this embodiment does not include components related to display processing.

  The difference from the seventh embodiment is a video acquisition unit 11B and a storage medium 90F. Similar to the second, fourth, and sixth embodiments, video data is recorded in advance in the storage medium 90F. The video acquisition unit 11B reads and acquires video data from the storage medium 90F. Similarly to the seventh embodiment, the division information recording unit 22 records the division information generated by the division information generation unit 21 in the storage medium 90F. Furthermore, the heading control information recording unit 32 records the first heading generation information and the second heading generation information generated by the heading control information generation unit 31 in the storage medium 90F.

  The storage medium 90F is a hard disk, semiconductor memory, flash, DVD, etc., which may be removable or fixed, and is equipment that complies with NAS or DLNA guidelines for reading and writing over a network. Also good.

[Ninth Embodiment]
FIG. 14 shows the configuration of a video information processing apparatus according to the ninth embodiment of the present invention.

  The video information processing apparatus according to this embodiment is a reproduction-only device, and includes a list display control unit 41, a list condition determination unit 42, a heading selection information reading unit 43, and a heading generation information reading unit 51 as components related to display processing. The headline generation unit 52 and the storage medium 90G are provided.

  Unlike the first to fourth embodiments, the video information processing apparatus according to this embodiment does not include components related to information generation.

  The information recorded in advance on the storage medium 90G is the same video data as in the second, fourth, sixth, and eighth embodiments, and the same as that recorded in the seventh and eighth embodiments. Division information, first headline generation information and second headline generation information similar to those recorded in the fifth to eighth embodiments, and similar to those recorded in the fifth and sixth embodiments This is the headline selection information.

  The header generation information and the header selection information are a series of video programs, segments obtained by dividing the program, playlists that allow these programs and segments to be arranged and played back, folders for managing a plurality of programs and playlists as a group Etc. may be recorded for each unit.

  The headline selection information reading unit 43 reads the headline selection information from the storage medium 90G and supplies it to the list condition determination unit 42.

  The list condition determination unit 42 determines a mutual similarity between the sets of video data selected by the list display control unit 41 based on the headline selection information supplied from the headline control information reading unit 43, and each video data It is determined which of the two types of representative image information is used to generate the heading information.

  The headline generation information reading unit 51 reads information on the representative image selected according to the determination result by the list condition determination unit 42 from the storage medium 90G.

  The header generation unit 52 acquires information on the representative image selected according to the determination result by the list condition determination unit 42 from the header generation information reading unit 51, and generates representative still image data to be displayed. Also, a list display screen is created by appropriately arranging the created representative still image data.

  The storage medium 90G is a hard disk, semiconductor memory, flash, DVD, etc., which may be removable or fixed, and is equipment that complies with NAS or DLNA guidelines for reading and writing over a network. Also good.

  In a service device that records the information and provides reading of the information via communication, the same video data, division information, first header generation information, second header generation information, and header selection information are stored in the player. It has a function to send in response to a request from the device.

  As another form of the service device, the heading information finally selected and generated may be transmitted in response to a list display request from the player device.

  The embodiments of the present invention have been described above with reference to the drawings. However, the present invention is not limited to these embodiments, and various modifications and changes can be made without departing from the scope of the present invention. Also good.

1 is a block diagram showing a configuration of a first embodiment of a video information processing apparatus according to the present invention. The schematic diagram which shows the example of the similar area and dissimilar area in the process of a heading control information generation part. The schematic diagram which shows another example of the similar area and dissimilar area in the process of a heading control information generation part. The schematic diagram which shows the example of the heading control information produced | generated in a heading control information generation part. The schematic diagram which shows the example of the heading information produced | generated in a heading production | generation part. The flowchart which shows the flow of a process in the component regarding a display process. The block diagram which shows the structure of 2nd Embodiment of the video information processing apparatus concerning this invention. The block diagram which shows the structure of 3rd Embodiment of the video information processing apparatus concerning this invention. The block diagram which shows the structure of 4th Embodiment of the video information processing apparatus concerning this invention. The block diagram which shows the structure of 5th Embodiment of the video information processing apparatus concerning this invention. The block diagram which shows the structure of 6th Embodiment of the video information processing apparatus concerning this invention. The block diagram which shows the structure of 7th Embodiment of the video information processing apparatus concerning this invention. The block diagram which shows the structure of 8th Embodiment of the video information processing apparatus concerning this invention. The block diagram which shows the structure of 9th Embodiment of the video information processing apparatus concerning this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11A, 11B ... Image | video acquisition part, 12 ... Similar part detection part, 21 ... Division information generation part, 22 ... Division information recording part, 31 ... Heading control information generation part, 32 ... Heading control information recording part, 41 ... List display control , 42 ... List condition determination unit, 43 ... Headline selection information read unit, 51 ... Headline generation information read unit, 52 ... Headline generation unit, 81,82,83 ... Video data, 90A, 90B, 90C, 90D, 90E, 90F, 90G ... Storage media.

Claims (38)

In a video information processing apparatus that handles multiple video data,
Video acquisition means for acquiring the plurality of video data;
For each of the plurality of video data, a similar part detecting means for detecting another part of the video data or a part similar to the other video data of the plurality of video data;
Heading control information generating means for generating heading control information for generating heading information when displaying a list of video data based on the similar part detection result in each video data;
List display control means for selecting a list display target from the plurality of video data;
List condition determining means for determining a similarity between the selected list display target video data;
Heading generation means for generating heading information using the determination result by the list condition determination means and the heading control information,
The heading control information generated by the heading control information generating means generates first heading generation information for generating a heading from a portion similar to other video data, and headings from other than the similar portion. Second headline generation information of
The video information processing apparatus, wherein the heading information generated by the heading generation unit is generated by using one of the two heading generation information according to a determination result by the list condition determination unit. . The heading control information generated by the heading control information generating means uses which of the two heading generation information to generate heading information when the selected list display target video data is displayed as a list. Further including headline selection information for determining in combination with other video data,
2. The list condition determining means determines a similarity relationship between video data based on a relationship between headline selection information for each of the selected list display target video data. Video information processing device. Further comprising division information generating means for dividing the video data based on the similar part detection result in each video data;
The heading control information generating means generates heading control information for each of the divided video data,
The video information processing apparatus according to claim 1, wherein the list display control unit selects a list display target from the plurality of divided video data. In a video information processing apparatus that handles multiple video data,
Video acquisition means for acquiring the plurality of video data;
For each of the plurality of video data, a similar part detecting means for detecting another part of the video data or a part similar to the other video data of the plurality of video data;
Heading control information generating means for generating heading control information for generating heading information when displaying a list of video data based on the similar part detection result in each video data;
Heading control information recording means for recording the generated heading control information on a recording medium,
The heading control information generated by the heading control information generation unit and recorded by the heading control information recording unit is similar to the first heading generation information for generating a heading from a portion similar to other video data, and the similarity And a second header generation information for generating a header from a portion other than the portion to be processed.   The heading control information generated by the heading control information generating unit and recorded by the heading control information recording unit uses either of the two heading generation information to display a list of video data to be displayed as a list. 5. The video information processing apparatus according to claim 4, further comprising heading selection information for determining whether to generate information in combination with a plurality of other video data. Division information generating means for dividing the video data based on the similar part detection result in the video data;
Division information recording means for recording the generated division information on a recording medium,
The heading control information generated by the heading control information generating unit and recorded by the heading control information recording unit is for generating a heading from a portion similar to other video data for each of the divided video data. 6. The video information processing apparatus according to claim 4, comprising first headline generation information and second headline generation information for generating a headline from a portion other than the similar part. In a video information processing apparatus that handles multiple video data,
List display control means for selecting a list display target from the plurality of video data;
List condition determining means for determining a similarity between the selected list display target video data;
Heading generation information reading means for reading out heading control information for generating heading information from the recording medium;
Heading generation means for generating heading information using the determination result by the list condition determination means and the heading control information,
The heading control information read by the heading control information reading means includes first heading generation information for generating a heading from a portion similar to other video data, and headings from other than the similar portion. Including at least one of the second headline generation information,
The video information processing apparatus, wherein the heading information generated by the heading generation unit is generated by using one of the two heading generation information according to a determination result by the list condition determination unit. . Based on the similar part detection result, when displaying the selected list-displayed video data as a list, which of the two header generation information is used to generate the header information and other video data. It further comprises heading selection information reading means for reading out the heading selection information for determination in combination from the recording medium,
8. The list condition determining unit according to claim 7, wherein the list condition determining unit determines a similarity relationship between the video data based on a relationship between heading selection information for each of the selected list display target video data. Video information processing device. The first headline generation information includes information on a representative image selected from a portion similar to the other video data,
9. The video information processing apparatus according to claim 1, wherein the second headline generation information includes information on a representative image selected from other than the similar part. The first headline generation information includes similar section information representing a portion similar to the other video data, and video data including a similar section,
9. The method according to claim 1, wherein the second headline generation information includes dissimilar section information representing other than the similar part and video data including the dissimilar section. The video information processing apparatus described. The first headline generation information includes video data including a similar section that is a portion similar to the other video data,
The second headline generation information includes video data including a dissimilar section other than the similar part,
The video information processing apparatus according to claim 1, further comprising similar section information as information common to both. The representative image information is representative still image data,
The video information processing apparatus according to claim 9, wherein the heading generation unit generates a representative still image for display including representative still image data. The information of the representative image is video data including frame position information in each video data and a corresponding frame position,
10. The video according to claim 9, wherein the header generation unit extracts representative still image data at the frame position from each of the video data, and generates a representative still image for display including the representative still image data. Information processing device. The representative image information is representative video data,
The video information processing apparatus according to claim 9, wherein the heading generation unit generates a representative moving image for display including the representative moving image data. The information of the representative image is frame data in each video data and video data including a corresponding frame section,
10. The video information processing according to claim 9, wherein the heading generation unit extracts representative moving image data of the frame section from each of the video data, and generates a display representative moving image including the representative moving image data. apparatus. The similar section information in the first headline generation information is similar frame position information representing a position where the similar part ends,
The video data including the similar section is video data extracted from the start of each video data to a similar frame as a similar section,
The dissimilar section information in the second headline generation information is dissimilar frame position information indicating a location where a dissimilar part starts,
The video information processing apparatus according to claim 10, wherein the video data including the dissimilar section is video data extracted from the dissimilar frame to the end of each video data as the dissimilar section. The similar section information in the first headline generation information is frame section information representing a position where each of one or more similar parts starts and ends,
The video data including the similar section is video data extracted from at least one of the similar sections,
The dissimilar section information in the second headline generation information is frame section information that represents a start position and an end position of one or more parts that are not similar,
The video information processing apparatus according to claim 10, wherein the video data including the dissimilar section is video data extracted from at least one of the dissimilar sections. The similar section information is boundary frame position information representing a position where the similar part ends,
The video data including the similar section is video data extracted from the start of each video data to a boundary frame as a similar section,
The video information processing apparatus according to claim 11, wherein the video data including the dissimilar section is video data extracted as the dissimilar section from the boundary frame to the end of the video data. The similar section information is frame section information representing a start position and an end position of one or more similar parts,
The video data including the similar section is video data extracted from at least one of the similar sections as a similar section from a start frame to an end frame of the section,
The video data including the dissimilar section includes the end of the video data from the start of each video data to the start frame of the section, from the end frame of the section to the start frame of another section, and from the end frame of the section. The video information processing apparatus according to claim 11, wherein the video data is extracted from at least one of the dissimilar sections, with up to a dissimilar section. The headline selection information is headline identification information for identifying the similar part,
The list condition determining means reads the headline identification information in each of the selected list display target video data to determine mutual matching,
The heading generation means generates heading information using the first heading generation information when there is no match, and uses the second heading generation information when there is a match. 9. The video information processing apparatus according to claim 2, wherein the heading information is generated.   The headline identification information can be mutually identified when the original part of the first headline generation information is similar to the original part of the first headline generation information in other video data. The video information processing apparatus according to claim 20, further comprising: a unique identifier configured as follows. The headline selection information is headline identification information for identifying the similar part,
The similar part detecting means extracts a section similar to the video data given in advance as a collation key from the video data to be processed,
6. The video information processing apparatus according to claim 2, wherein the heading identification information includes a key identifier that mutually identifies the collation keys when there is a similar section. The headline selection information is the first headline generation information;
The list condition determining means reads the first headline generation information in each of the selected list display target video data to determine mutual similarity,
The heading generation means generates heading information using the first heading generation information when there is no high similarity, and when there is a high similarity, the second heading is generated. 9. The video information processing apparatus according to claim 2, wherein the header information is generated using the generation information.   The display screen control means for generating screen information for list display using the heading information generated by the heading generation means, further comprising display screen control means. The video information processing apparatus according to claim 8.   The headline information recording means for recording the headline information generated by the headline generation means on a recording medium, further comprising: a headline information recording means. Video information processing device.   The video according to any one of claims 1 to 3, 7, and 8, further comprising header information transmitting means for transmitting the header information generated by the header generating means by communication. Information processing device.   The video data is defined by at least one unit of a video program, a segment obtained by dividing the program, and a playlist in which these are arbitrarily arranged and reproduced. Item 9. The information processing apparatus according to any one of Items 8 to 8.   9. The video information processing apparatus according to claim 1, wherein the video data is defined by a folder that manages a group of a plurality of programs and playlists. List display control
List of recorded programs and playlists and folders,
A list of segments included in the program or playlist selected by the user,
List of programs and playlists and folders managed in the folder selected by the user,
A plurality of video data including at least one of a program, a segment, a playlist, and a folder searched according to a preset condition or a condition specified by a user is selected for displaying all or a list thereof. 9. The video information processing apparatus according to claim 1, wherein a part of the list is a list display target. In a digital information recording medium that records a plurality of video data and control information thereof,
The control information includes heading control information for generating heading information for each of the plurality of video data when displaying a list of video data,
The heading control information in each of the plurality of video data includes first heading generation information for generating a heading from a portion similar to the other video data in each video data, and headings other than the similar portion. A combination of a plurality of second headline generation information for generating the headline information and which of the two headline generation information is used to generate the headline information when displaying the list of the video data, in combination with other video data A digital information recording medium including heading selection information for determination. The first headline generation information includes information on a representative image selected from a portion similar to the other video data,
The digital information recording medium according to claim 30, wherein the second headline generation information includes information of a representative image selected from other than the similar part. The first headline generation information includes similar section information representing a portion similar to the other video data, and video data including the similar section,
31. The digital information recording medium according to claim 30, wherein the second headline generation information includes dissimilar section information representing other than the similar part and video data including the dissimilar section. The first headline generation information includes video data including a similar section that is a portion similar to the other video data,
The second headline generation information includes video data including a dissimilar section other than the similar part,
The digital information recording medium according to claim 30, further comprising similar section information as information common to both. The headline selection information is headline identification information for identifying the similar part;
The headline identification information can be mutually identified when the original part of the first headline generation information is similar to the original part of the first headline generation information in other video data. 32. The digital information recording medium according to claim 30, wherein the digital information recording medium includes a unique identifier. In a video information processing method that handles multiple video data,
A video acquisition step of acquiring the plurality of video data;
For each of the plurality of video data, a similar part detecting step for detecting another part of the video data or a similar part with other video data of the plurality of video data;
A heading control information generating step for generating heading control information for generating heading information when displaying a list of video data based on the similar part detection result in each video data;
A list display control step of selecting a list display target from the plurality of video data;
A list condition determining step for determining a similarity relationship between the selected video data to be displayed in a list;
A headline generation step of generating headline information using the determination result by the list condition determination step and the headline control information,
The heading control information generated in the heading control information generation step generates a heading from the first heading generation information for generating a heading from a part similar to the other video data and a part other than the similar part. Second headline generation information for
The video information processing method, wherein the heading information generated in the heading generation step is generated using one of the two heading generation information according to a determination result in the list condition determination step. . In a video information processing method that handles multiple video data,
A video acquisition step of acquiring the plurality of video data;
For each of the plurality of video data, a similar part detecting step for detecting another part of the video data or a similar part with other video data of the plurality of video data;
A heading control information generating step for generating heading control information for generating heading information when displaying a list of video data based on the similar part detection result in each video data;
A heading control information recording step for recording the generated heading control information on a recording medium,
The header control information generated in the header control information generation step and recorded in the header control information recording step includes first header generation information for generating a header from a portion similar to the other video data, And a second headline generation information for generating a headline from a portion other than a similar part. In a video information processing method that handles multiple video data,
A list display control step of selecting a list display target from the plurality of video data;
A list condition determining step for determining a similarity relationship between the selected video data to be displayed in a list;
A header generation information reading step of reading header control information for generating header information from the recording medium;
A headline generation step of generating headline information using the determination result by the list condition determination step and the headline control information,
The heading control information read in the heading control information reading step includes first heading generation information for generating a heading from a portion similar to other video data, and headings from other than the similar portion. Including at least one of the second headline generation information,
The video information processing method, wherein the heading information generated in the heading generation step is generated using one of the two heading generation information according to a determination result in the list condition determination step. . In a video information processing program for causing a computer to perform video information processing that handles a plurality of video data,
A video acquisition step of acquiring the plurality of video data;
For each of the plurality of video data, a similar part detecting step for detecting another part of the video data or a similar part with other video data of the plurality of video data;
A heading control information generating step for generating heading control information for generating heading information when displaying a list of video data based on the similar part detection result in each video data;
A list display control step of selecting a list display target from the plurality of video data;
A list condition determining step for determining a similarity relationship between the selected video data to be displayed in a list;
A headline generation step of generating headline information using the determination result of the list condition determination step and the headline control information;
The heading control information generated in the heading control information generation step generates first heading generation information for generating a heading from a portion similar to other video data, and headings from other than the similar portion. Second headline generation information of
The headline information generated in the headline generation step is generated using one of the two headline generation information according to the determination result in the list condition determination step. .

Images