JP4701671B2 - Video signal processing apparatus and method, program, and data structure - Google Patents

Description

  The present invention relates to a video signal processing apparatus and method, a program, and a data structure, and in particular, a video signal processing apparatus and method capable of appropriately managing security information of a video signal recorded on an information recording medium, It relates to programs and data structures.

  In recent years, various types of optical disks have been proposed as disk-type information recording media that can be removed from the recording / reproducing apparatus. Such recordable optical discs have been proposed as large-capacity media of several gigabytes and are highly expected as media for recording digital video (moving image) signals.

  One encoding system for digitally compressing digital video signals is the MPEG (Moving Picture Experts Group) 2 system. MPEG2 is also applied to recording digital video signals on information recording media. For example, when an analog video signal is recorded on an information recording medium, the video signal is encoded in the MPEG2 system and recorded as an encoded bit stream on the information recording medium. In digital TV (television) broadcasting that has recently started, a video program encoded in the MPEG2 format is transmitted in a format called a transport stream. When recording a digital broadcast AV signal on an information recording medium, a method of recording a digital signal as it is without decoding or re-encoding the transport stream is used.

  When a video signal is recorded on an information recording medium in a digital signal format, the video signal can be copied to another information recording medium (recording medium) without any deterioration. However, this is a big problem for the copyright holder of the video content.

  From this point of view, in order to restrict the copying of the video signal, “Copy Free”, “Copy Once” can be copied to the video signal, “No More Copy” Copy control information (CCI) indicating copy generation management information (Copy generation management information) such as “Copy prohibited” and “Copy Prohibited” is added. An example of such a signal is a CGMS (Copy Generation Management System) signal. This signal is called CGMS-A for the analog interface and CGMS-D for the digital interface. Analog CGMS-A is also called VBID because it superimposes the ID on the VBI (Vertical Blanking Interval) of the video signal. This is standardized as EIAJ CP-1204.

  Also, a method is known in which a descriptor having this information is encoded in order to embed CCI in a transport stream for transmission. As this type of descriptor, there are DTCP descriptor defined by DTLA (Digital Transmission Licensing Administrator) and digital_copy_control_descriptor used in Japanese BS digital broadcasting defined by ARIB. Recently, a method of embedding copy generation management information as a watermark in a baseband video signal or MPEG video stream has also been studied in order to more strongly limit copying. Currently, standardization activities are being promoted for the watermark, and the Millennium method and Galaxy method have been proposed.

  When recording a video signal on an information recording medium, it is required to correctly limit recording according to the CCI of the input signal. In general, users can record video signals on information recording media when the CCI of the input signal is either “Copy Free” or “Copy Once”. Only if. When the CCI of the input signal is “Copy Once (only one generation can be copied)”, the CCI of the video signal on the information recording medium has to be updated to “No More Copy”.

  By the way, in order to make it easy to understand the content of the video signal recorded on the information recording medium, the video signal is a still image representing the content or an image extracted from a specific scene of the content as a still image. It may be recorded separately. These still images are called thumbnail images. For example, by displaying a list of thumbnail images on a menu screen for the user to select a position to start playback from the video signals recorded on the information recording medium, an interface that is easy for the user to understand is displayed. Can be provided. The thumbnail image may be an image selected from recorded video signals, or an image taken into an information recording medium from a personal computer, a digital still camera, or the like.

JP 2000-341628 A JP 2000-13720 A

  Conventionally, when a predetermined video signal is copied to another information recording medium from an information recording medium on which the video signal and its thumbnail image are recorded, it is often possible to copy only the video signal. However, when making such a copy, it is convenient for the user to be able to copy the thumbnail image along with the video signal. By doing so, the procedure for the user to add a new thumbnail image to the copied video signal becomes unnecessary.

  At this time, the problem is the copyright management of thumbnail images. For example, an image of a popular character in a movie or television is considered to have a copyright in many cases, and it is not preferable for the copyright holder to copy it illegally. However, conventionally, since the copy restriction of the thumbnail image is not considered, when considering an application for copying the thumbnail image together with the video signal as described above, it is possible to determine whether or not the thumbnail image can be copied. There is a problem that it is impossible to prevent unauthorized copying of thumbnail images.

  The present invention has been made in view of such a situation, and appropriately manages the content protection information (Content Protection Information. For example, CCI) of the thumbnail image recorded on the information recording medium. The purpose is to prevent simple and reliable copying.

A first video signal processing apparatus according to the present invention includes a generating unit that generates a thumbnail image corresponding to an input video signal, and a first control that generates content protection information corresponding to the thumbnail image generated by the generating unit. And a recording means for recording the video signal on an information recording medium together with the thumbnail image generated by the generating means and the content protection information generated by the first control means, and the size of the thumbnail image is variable , recording means, the content protection information corresponding to the thumbnail image, an arbitrary position corresponding to the size of the thumbnail images within a block of a predetermined size of recording the content protection information and the thumbnail image as the start position The thumbnail image is recorded in a format that is stored subsequent to the thumbnail image.

  The recording means can record the thumbnail image and the content protection information corresponding to the thumbnail image as a block in pairs.

  The content protection information can include copy generation management information.

  The content protection information can include analog copy protection control information.

  The generation unit generates a thumbnail image using an image in the video signal, and the first control unit generates content protection information of the thumbnail image based on the content protection information of the image included in the video signal. Can be.

  The generating means generates a thumbnail image using the image in the video signal, and the first control means receives the content protection information including an identifier indicating whether or not it is necessary to refer to the content protection information of the video signal. Can be generated.

  The recording means may record the thumbnail image after compressing it with the JPEG method.

  Reproducing means for reproducing a signal recorded on an information recording medium, and separating means for separating a video signal, a thumbnail image corresponding to the video signal, and content protection information corresponding to the thumbnail image from the signal reproduced by the reproducing means And second control means for restricting the output of thumbnail images based on the content protection information separated by the separation means.

  The content protection information may include an analog copy protection control signal, and the second control unit may control so that the copy protection signal is superimposed on the output signal in accordance with the analog copy protection control signal.

  The second control means may further restrict the playback of the thumbnail image based on the content protection information of the video signal.

  When copying the thumbnail image to another information recording medium, the second control means may restrict the copying of the thumbnail image based on the content protection information recorded in addition to the thumbnail image. it can.

  The content protection information may include copy generation management information, and the second control unit may limit the copying of the thumbnail image so as to observe the limitation of the copy generation management information of the thumbnail image.

  The second control means may further restrict copying of the thumbnail image based on the content protection information of the video signal.

The video signal processing method of the present invention corresponds to a thumbnail image corresponding to an input video signal, the generation step generating a thumbnail image whose size is variable, and the thumbnail image generated by the processing of the generation step Recording the content protection information to be recorded on the information recording medium together with the thumbnail image generated by the process of the generation step and the content protection information generated by the process of the control step. store the content protection information corresponding, any position corresponding to the size of the thumbnail images within a block of a predetermined size of recording the content protection information and the thumbnail image as the start position, following after the thumbnail image Recording step for recording in a format And wherein the door.

The program of the present invention includes a generation step for generating a thumbnail image corresponding to an input video signal , the size of which is variable, and a content protection corresponding to the thumbnail image generated by the processing of the generation step. A control step for generating information, and a video signal recorded on an information recording medium together with a thumbnail image generated by the process of the generation step and content protection information generated by the process of the control step, and corresponding to the thumbnail image content protection information, starting at any position corresponding to the size of the thumbnail images within a block of a predetermined size of recording the content protection information and a thumbnail image, in the form of store following the thumbnail image Process including recording step to record Characterized in that to execute the computer.

In the first aspect of the present invention, a thumbnail image corresponding to the input video signal, the thumbnail image having a variable size, is generated, and content protection information corresponding to the generated thumbnail image is generated, and the video signal, while being recorded on the information recording medium together with the thumbnail image and the content protection information, the content protection information corresponding to the thumbnail image, the in blocks of a predetermined size of recording the content protection information and thumbnail image An arbitrary position corresponding to the size of the thumbnail image is used as a start position, and the recording is performed in a format that is stored subsequent to the thumbnail image.

  According to the present invention, it is possible to protect the copyright of thumbnail images. Also, unauthorized copying of thumbnail images can be prevented. Furthermore, an information recording medium capable of preventing unauthorized copying of thumbnail images can be provided. Further, it is possible to make it more difficult to extract information from the thumbnail image file.

  FIG. 1 shows a simplified structure of an application format on an information recording medium used in an information recording / reproducing system to which the present invention is applied. This format has two layers, PlayList and Clip, for managing AV (Audio Visual) streams. Volume Information manages all Clips and PlayLists in the disc.

  A pair of one AV stream and its attached information is considered as one object, and is called Clip. The AV stream file is called a Clip AV stream file, and its attached information is called a Clip Information file (clip information file).

  One Clip AV stream file stores data in which an MPEG2 transport stream is arranged in a structure defined by a DVR (Digital Video Recorder) application format.

  In general, a data file used by a computer or the like is handled as a byte string, but the content of a Clip AV stream file is expanded on the time axis, and the PlayList designates access points in the Clip mainly by time stamps. When the PlayList points to the access point into the Clip with a time stamp, the Clip Information file is useful for finding address information to start decoding the stream in the Clip AV stream file.

  PlayList was introduced for the purpose of allowing the user to select a playback section that the user wants to see from the Clip and edit it easily. One PlayList is a collection of playback sections in a Clip. One playback section in a certain clip is called PlayItem, which is represented by a pair of IN point and OUT point on the time axis. Therefore, PlayList is a collection of PlayItems.

  There are two types of PlayList. One is Real PlayList, and the other is Virtual PlayList.

  The Real PlayList is considered to share the stream portion of the Clip that it refers to. That is, the Real PlayList occupies the data capacity corresponding to the stream portion of the clip that is referenced in the disc. When an AV stream is recorded as a new clip, a Real PlayList that refers to the reproducible range of the entire clip is automatically created. When a part of the playback range of the Real PlayList is erased, the data of the clip stream part to which it refers is also erased.

  The Virtual PlayList is regarded as not sharing Clip data. Even if the Virtual PlayList is changed or deleted, the Clip does not change anything.

  In the following description, the Real PlayList and Virtual PlayList are collectively referred to simply as “PlayList”.

  FIG. 2 is a diagram illustrating marks on the PlayList and marks on the Clip. Marks are used to specify highlights and characteristic times in Clip and PlayList.

  (1) A mark added to a clip designates a characteristic scene resulting from the contents of the AV stream. This mark is composed of, for example, a scene change point (scene start point). When playing a PlayList, it can be used by referring to a Clip mark referenced by the PlayList.

  (2) The mark added to the PlayList is set mainly by the user. This mark is composed of, for example, a bookmark specified by the user at an arbitrary point, a resume mark indicating the previous playback end point, or the like.

  (3) Setting a mark in Clip or PlayList is performed by adding a time stamp indicating the mark time to the mark list. Deleting a mark means removing the time stamp of the mark from the mark list. Therefore, setting or deleting a mark does not change the AV stream.

  A thumbnail is a still image added to Volume (disc), PlayList, or Clip. There are two types of thumbnails as shown in FIG. One is a thumbnail (menu thumbnail) as a representative picture representing the content. This is mainly used in a menu screen for the user to select what he / she wants to see by operating the cursor. The other is an image (mark thumbnail) representing the scene to which the mark points.

  Volume and each PlayList can have a representative picture. The representative image of the volume is used when a still image representing the contents of the disc is first displayed when a disc as an information recording medium is inserted into the player (see Menu Thumbnail in FIG. 4). The PlayList representative picture is assumed to be used as a still picture for representing the contents of the PlayList on the menu screen for selecting the PlayList (see Menu Thumbnail in FIG. 5). The simplest method for realizing the representative picture of the PlayList is to use the first picture of the PlayList as a thumbnail, but the first picture at the reproduction time 0 is not necessarily the optimum picture for representing the contents. This is the reason that an arbitrary image can be determined as a thumbnail of the PlayList.

  The two types of thumbnails are referred to as menu thumbnails. Menu thumbnails are frequently displayed, and are required to be able to be read from a disk at high speed. To satisfy this requirement, it is efficient to store all menu thumbnails in one file (see Menu Thumbnail file in FIG. 6). The menu thumbnail is not necessarily a picture extracted from a moving image in the volume, but may be an image taken from a personal computer (PC) or a digital still camera (DSC) (FIGS. 4 and 5).

  On the other hand, in Clip and PlayList, it is necessary to add a plurality of marks at arbitrary positions so that the contents of the mark positions can be easily seen from the image of the mark points. A picture representing such a mark point is called a mark thumbnail (see Mark Thumbnail in FIG. 5 and Mark Thumbnail in FIG. 7). Therefore, in this case, the source of the thumbnail can be an image taken from the outside, but the image of the mark point is mainly extracted rather than that. Unlike menu thumbnails, mark thumbnails are used in submenus and the like used to represent the details of a PlayList, so a short access time is not required. Therefore, it does not matter if it takes some time to open a file and read a part of the file each time a thumbnail is required. Also, to reduce the number of files existing in the volume, all mark thumbnails are stored in one file (mark thumbnail) so that the volume thumbnail and PlayList menu thumbnail are stored in one menu thumbnail file. (See Mark Thumbnail file in FIG. 6). The PlayList can have one menu thumbnail and a plurality of mark thumbnails, but since the Clip does not need to be directly selected by the user (usually specified via the PlayList), it does not have a menu thumbnail.

  The necessary directories on the DVR disk are as follows: root directory including "DVR" directory. "DVR" directory including "PLAYLIST" directory, "CLIPINF" directory, "STREAM" directory and "DATA" directory. FIG. 8 shows an example of the directory structure on the DVR disk.

  The root directory includes one directory.

  "DVR"-All files and directories defined by the DVR application format must be stored under this directory.

  The “DVR” directory stores the following files.

  "info.dvr"-A file that stores the overall information of the application layer created under the DVR directory. There should be only one info.dvr under the DVR directory. The file name is fixed to info.dvr.

  "menu.tidx" and "menu.tdat"-These two files store information related to menu thumbnail images. menu.tidx is a “thumbnail information file” for storing header information of menu thumbnail images. menu.tdat is a “thumbnail image file” for storing image data of menu thumbnail images.

  "mark.tidx" and "mark.tdat"-These two files store information related to mark thumbnail images. mark.tidx is a “thumbnail information file” for storing header information of mark thumbnail images. mark.tdat is a “thumbnail image file” that stores image data of a mark thumbnail image.

  The “DVR” directory includes three directories.

  “PLAYLIST” —Real PlayList and Virtual PlayList (FIG. 1) database files must be placed under this directory.

  "CLIPINF"-Clip (Figure 1) database must be under this directory.

  "STREAM"-AV stream files (Figure 1) must be placed under this directory.

  The “PLAYLIST” directory stores two types of PlayList files, which are Real PlayList and Virtual PlayList.

  “xxxxx.rpls” —This file stores information related to one Real PlayList. One file is created for each Real PlayList. The file name is “xxxxx.rpls”. Here, “xxxxx” is five numbers from 0 to 9. The file extension must be "rpls".

  “yyyyy.vpls” —This file stores information related to one Virtual PlayList. One file is created for each Virtual PlayList. The file name is “yyyyy.vpls”. Here, “yyyyy” is five numbers from 0 to 9. The file extension must be "vpls".

  The “CLIPINF” directory stores one file corresponding to each AV stream file.

  “zzzzz.clpi” —This file is a Clip Information file corresponding to one AV stream file (Clip AV stream file or Bridge-Clip AV stream file). The file name is “zzzzz.clpi”, where “zzzzz” is five numbers from 0 to 9. The file extension must be "clpi".

  The “STREAM” directory stores AV stream files.

  “zzzzz.m2ts” —This file is an AV stream file handled by the DVR system. This is a Clip AV stream file or a Bridge-Clip AV stream file. The file name is “zzzzz.m2ts”, where “zzzzz” is five numbers from 0 to 9. The file extension must be “m2ts”.

  The same five numbers “zzzzz” must be used for one AV stream file and the corresponding Clip information file.

  The structure of the AV stream file will be described. The AV stream file must have the structure of the DVR MPEG2 transport stream shown in FIG. The DVR MPEG2 transport stream has the following characteristics.

  (1) A DVR MPEG2 transport stream is composed of an integer number of Aligned units.

  (2) The size of the Aligned unit is 6144 bytes (2048 × 3 bytes).

  (3) The Aligned unit starts from the first byte of the source packet.

  (4) The source packet is 192 bytes long. One source packet includes a TP_extra_header and a transport packet. TP_extra_header is 4 bytes long, and the transport packet is 188 bytes long.

  (5) One Aligned unit consists of 32 source packets.

  (6) The last Aligned unit in the DVR MPEG2 transport stream is also composed of 32 source packets.

  (7) If the last Aligned unit is not completely filled with transport packets of the input transport stream, the remaining byte area must be filled with source packets with null packets (PID = 0x1FFF transport packets) Don't be.

  The TP_extra_header includes copy restriction information of the payload of the transport packet and an arrival time stamp indicating the time when the transport packet arrives at the decoder.

  Next, a database format for managing reproduction information of AV stream files will be described.

  FIG. 10 shows the syntax of UIAppInfpoDVR, which is a part of data stored in info.dvr. ref_to_menu_thumbnail_index indicates the information of thumbnail images representing Volume. When the ref_to_menu_thumbnail_index field is a value other than 0xFFFF, a thumbnail image is added to the Volume, and the thumbnail image is stored in the menu.tdat file. The image is referenced using the value of thumbnail_index in the menu.tidx file (described later with reference to FIG. 13). When the ref_to_menu_thumbnail_index field is 0xFFFF, it indicates that no thumbnail image is added to the Volume.

  FIG. 11 shows the syntax of PlayListMark, which is a part of data stored in the PlayList file. PlayListMark stores information on marks added to the PlayList. Note that the information of the representative image of the PlayList is also included in the PlayListMark.

  number_of_PlayList_marks indicates the number of mark entries stored in PlayListMark.

  mark_type indicates the type of the mark.

  ref_to_PlayItem_id indicates the value of PlayItem_id that specifies the PlayItem on which the mark is placed.

  mark_time_stamp stores a time stamp indicating the point where the mark is specified.

  ref_to_menu_thumbnail_index indicates information of thumbnail images indicating representative images of the PlayList. When the ref_to_menu_thumbnail_index field is a value other than 0xFFFF, there is a thumbnail image indicating a representative image of the PlayList, and the thumbnail image is stored in the menu.tdat file. The image is referenced using the value of thumbnail_index in the menu.tidx file (described later with reference to FIG. 13). When the ref_to_menu_thumbnail_index field is 0xFFFF, it indicates that there is no thumbnail image indicating the representative image of the PlayList.

  ref_to_mark_thumbnail_index indicates the information of the thumbnail image added to the mark. When the ref_to_mark_thumbnail_index field is a value other than 0xFFFF, a thumbnail image is added to the mark, and the thumbnail image is stored in the mark.tdat file. The image is referred to by using the value of thumbnail_index in the mark.tidx file (described later with reference to FIG. 13). When the ref_to_mark_thumbnail_index field is 0xFFFF, it indicates that no thumbnail image is added to the mark.

  FIG. 12 shows the syntax of ClipMark, which is a part of data stored in the Clip Information file. ClipMark stores information on a mark added to a Clip.

  number_of_Clip_marks indicates the number of mark entries stored in ClipMark.

  mark_type indicates the type of the mark.

  ref_to_STC_id is information for designating the time axis of the system time base of the Clip where mark_time_stamp is placed.

  mark_time_stamp represents a point where a mark is specified in the Clip AV stream based on the presentation time stamp.

  ref_to_mark_thumbnail_index indicates the information of the thumbnail image added to the mark. When the ref_to_mark_thumbnail_index field is a value other than 0xFFFF, a thumbnail image is added to the mark, and the thumbnail image is stored in the mark.tdat file. The image is referred to by using the value of thumbnail_index in the mark.tidx file (described later with reference to FIG. 13). When the ref_to_mark_thumbnail_index field is 0xFFFF, it indicates that no thumbnail image is added to the mark.

  Next, the contents of a file that stores information about thumbnails will be described.

  “menu.tidx” and “menu.tdat” (FIG. 8) store information of a menu thumbnail, that is, one picture representing Volume, and one picture representing it for each PlayList. The header information of all menu thumbnails is collected and managed in one menu.tidx. All menu thumbnail picture data is collected and managed in one menu.tdat.

  “mark.tidx” and “mark.tdat” (FIG. 8) store information about a mark thumbnail, that is, a picture pointed by a mark point. Header information of all mark thumbnails added to all Clips and PlayLists in the Volume is collected and managed in one mark.tidx. All mark thumbnail picture data is collected and managed in one mark.tdat.

  The thumbnail picture data is, for example, data obtained by encoding an image with JPEG.

  The syntax and semantics of these four files will be explained.

  “menu.tidx” and “mark.tidx” have the same syntax structure. FIG. 13 shows the syntax structure of “menu.tidx” and “mark.tidx”.

  number_of_thumbnails is the number of thumbnail pictures stored in menu.tdat in the case of menu.tidx, and the number of thumbnail pictures stored in mark.tdat in the case of mark.tidx.

  tn_block_size indicates the size of one tn_block in menu.tdat in the case of menu.tidx, and indicates the size of one tn_block in mark.tdat in the case of mark.tidx. This size is a size in units of 1024 bytes. For example, tn_block_size = 16 indicates that the size of one tn_block is 16 × 1024 bytes. One thumbnail picture must be stored in one tn_block.

  number_of_tn_blocks indicates the number of tn_blocks in menu.tdat in the case of menu.tidx, and indicates the number of tn_blocks in mark.tdat in the case of mark.tidx.

  thumbnail_index represents the index number of the thumbnail information following this thumbnail_index field. Do not use thumbnail_index with a value of 0xFFFF. In the case of menu.tidx, thumbnail_index is referenced by ref_to_menu_thumbnail_index in UIAppInfoVolume () and PlayListMark (). In the case of mark.tidx, thumbnail_index is referred to by ref_to_mark_thumbnail_index in PlayListMark () and ClipMark ().

  ref_to_tn_block_id refers to the value of tn_block_id in the syntax of menu.tdat / mark.tdat. In the case of menu.tidx, ref_to_tn_block_id indicates one tn_block in menu.tdat, and that tn_block stores a thumbnail image pointed to by thumbnail_index. In the case of mark.tidx, ref_to_tn_block_id indicates one tn_block in mark.tdat, and the tn_block stores a thumbnail image pointed by thumbnail_index.

  picture_byte_size [ref_to_tn_block_id] indicates the data length of the thumbnail image having the index number of thumbnail_index in bytes. The picture_byte_size must be (1024 × tn_block_size-N1) bytes or less (N1 will be described later with reference to FIG. 16). That is, the recording apparatus must encode the data length of one encoded thumbnail picture so as to be (1024 × tn_block_size-N1) bytes or less.

  horizontal_picture_size [ref_to_tn_block_id] indicates the number of pixels in the horizontal direction of the thumbnail image having the index number of thumbnail_index.

  vertical_picture_size [ref_to_tn_block_id] indicates the number of pixels in the vertical direction of the thumbnail image having the index number of thumbnail_index.

  FIG. 14 shows the syntax structure of “menu.tdat” and “mark.tdat”. "menu.tdat" and "mark.tdat" have the same syntax structure.

  tn_block (tn_block_id) indicates one tn_block pointed to by the argument of tn_block_id in the array of tn_block. In the case of menu.tdat, the value of tn_block_id is referenced by ref_to_tn_block_id in menu.tidx. In the case of mark.tdat, the value of tn_block_id is referred to by ref_to_tn_block_id in mark.tidx.

  In the case of menu.tdat, the size of one tn_block is indicated by tn_block_size in menu.tdat. In the case of mark.tdat, the size of one tn_block is indicated by tn_block_size in mark.tdat.

  FIG. 15 shows an example of how to use tn_block. Since thumbnails are frequently added and deleted, the add operation and the partial delete operation must be easy and can be executed at high speed. For this reason, menu.tdat and mark.tdat have a block structure. One thumbnail image is stored in one tn_block. In the example of FIG. 15, the thumbnail images a, b, and c are stored in tn_blocks of tn_block_id = 0, 1, and 3, respectively.

  There may be unused tn_blocks (tn_block with tn_block_id = 2 in the example of FIG. 15) in the tn_block columns of menu.tdat and mark.tdat. For example, when deleting a certain thumbnail, deleting thumbnail_index entered in the thumbnail information file and changing the thumbnail image file does not change tn_block in the tn_block column. .

  FIG. 16 shows the syntax of tn_block (tn_block_id).

  thumbnail_picture [tn_block_id] is an area for storing one thumbnail image indicated by the value of tn_block_id.

  In the case of menu.tdat, the value of tn_block_id is referenced by ref_to_tn_block_id in menu.tidx. In the case of mark.tdat, the value of tn_block_id is referred to by ref_to_tn_block_id in mark.tidx.

  The first byte of the thumbnail picture must match the first byte of thumbnail_picture [tn_block_id]. The encoded byte size of the thumbnail picture is equal to picture_byte_size [tn_block_id].

  CP_Info_thumbnail () is N1 byte information indicating the content protection information of the thumbnail image stored in thumbnail_picture [tn_block_id]. The content protection information will be described later in relation to the processing of the recording device in FIG.

  padding_byte is a 1-byte value having an arbitrary value, and the value of NP is calculated so as to satisfy the following expression.

  NP = tn_block_size × 1024-picture_byte_size [tn_block_id]-N1

  FIG. 17 shows the syntax of CP_Info_thumbnail ().

  CCI_thumbnail indicates copy generation management information of a thumbnail image. The meaning of the values is shown in FIG. “00” indicates copy free, “01” indicates no more copy, “10” indicates copy once, and “11” indicates copy prohibited.

  APS_thumbnail indicates analog copy protection information when a thumbnail image is output as analog video. The meaning of the value is shown in FIG. Each APS definition of “00” to “11” is described in Default Settings of the Macrovision Anti-taping Process for DVD Products, Revision 1.0, July 5, 1997. Note that 2L / 4L Colorstripe is applicable only to NTSC analog output.

  flag_need_AVstreamInfo indicates whether or not the content protection information in the Clip AV stream needs to be referred to as the content protection information of the thumbnail image when the thumbnail image is created from the image in the Clip AV stream. The meaning of the value is shown in FIG. “1” indicates “necessary”, and “0” indicates “not necessary”.

  Specific examples of content protection information other than CCI_thumbnail and APS_thumbnail include information that DTLA will add to DTCP_descriptor in the future. As of July 2001, DTCP_descriptor has only CCI and APS information, but when DTLA introduces new content protection information to the video signal in the future, it is a thumbnail created using the image included in the video signal. The new content protection information may need to be applied to the image. When this happens, this flag_need_AVstreamInfo is set to 1. When the value is 1, it is necessary to refer to the content protection information (DTCP descriptor, etc.) for the image in the Clip AV stream indicated by the mark_time_stamp of the mark associated with the thumbnail image as the content protection information of the thumbnail image.

  The content protection information other than CCI and APS is, for example, resolution limit information when video content is analog-reproduced, time limit information for copying video content, and the like.

  Integrity_Check_Value is a code for indicating that the contents of CP_Info_thumbnail () have not been tampered with. This is a code calculated by a predetermined encryption algorithm using data from the first byte of CP_Info_thumbnail () to the byte immediately before Integrity_Check_Value as an input. For example, an algorithm described in ISO / IEC 9797 (Information technology-Security techniques-Data integrity mechanism using a cryptographic check function using a block cipher algorithm) is used.

  Even if the content of CP_Info_thumbnail () is tampered with by a malicious user, the recording device can detect that CP_Info_thumbnail () has been tampered with by checking the value of Integrity_Check_Value. If it is detected that CP_Info_thumbnail () has been tampered with, CP_Info_thumbnail () can no longer be trusted, and the recording apparatus prevents playback of the thumbnail having CP_Info_thumbnail (). Alternatively, the entire menu.tdat file and mark.tdat file may be scrambled so that the contents of CP_Info_thumbnail () cannot be falsified.

    The reason why the syntax of tn_block () is in a format in which CP_Info_thumbnail () follows thumb_nail_picture [tn_block_id] as shown in FIG. This is because the start position of CP_Info_thumbnail () can be randomized in the thumbnail image file (menu.tdat / mark.tdat) by adopting this format. If CP_Info_thumbnail () is arranged before thumbnail_picture [tn_block_id], CP_Info_thumbnail () regularly appears in the thumbnail image file in units of tn_block_size. If CP_Info_thumbnail () is placed after thumbnail_picture [tn_block_id], the size of thumbnail_picture [tn_block_id] is variable depending on the size of the thumbnail image, so that the start position of CP_Info_thumbnail () can be made random. This has the effect of making it difficult to extract the contents of CP_Info_thumbnail () from the thumbnail image file.

  As shown in FIG. 21, CP_Info_thumbnail () may be stored in the menu.tidx / mark.tidx file.

  Next, FIG. 22 shows a block diagram of a recording apparatus that records an AV stream and encodes a representative image of the AV stream and an image of a mark point into a thumbnail.

  First, the case of recording an AV stream in which video and audio inputs from the terminals 12 and 10 are self-encoded will be described. The Macrovision (trademark) detection unit 13 detects the analog copy protection signal (APS) of the input video by a predetermined method, and restricts recording of the video signal. Only when the input video signal does not include APS, the video signal can be recorded. Therefore, when a video signal can be recorded, the APS is copy-free (00).

  When the input video signal does not include APS, the macrovision detection unit 13 supplies the input video to the CGMS detection / update unit 14. The CGMS detection / update unit 14 analyzes the CGMS (CGMS-A or CGMS-D) of the input video by a predetermined method, and supplies the CCI of the AV stream to be recorded (indicated by CCI_o in the figure) to the controller 21. To do. The CGMS detection / update unit 14 supplies the input video to the WM (Water Mark) detection / update unit 15.

  The WM detection / update unit 15 detects and analyzes the water mark of the input video by a predetermined method, and supplies the WM of the AV stream to be recorded (indicated by WM_o in the drawing) to the controller 21. The WM detection / update unit 15 supplies the input video to the MPEG2 AV encoder 16 and the video analysis unit 18.

  The MPEG2 AV encoder 16 encodes the input video and audio signals, and supplies the video stream and audio stream to the multiplexing / source packetizing unit 17.

  Based on the input CCI_o and WM_o, the controller 21 determines the value of E_CCI (Embedded CCI) to be encoded in the multiplexed stream to the multiplexing / source packetization unit 17 by a predetermined method. The multiplexing / source packetizing unit 17 multiplexes the video stream and the audio stream, and supplies the AV stream to the scramble unit (encryption unit) 22 and the stream analysis unit 20.

  The scramble unit (encryption unit) 22 encrypts the input AV stream by a predetermined method and supplies the encrypted AV stream to the ECC encoding unit 23. The AV stream is recorded on the information recording medium 26 as an AV stream file after the processing of the ECC encoding unit 23, the modulation unit 24, and the drive 25.

  The recording apparatus records an AV stream file and also records application database information (info.dvr, PlayList, Clip Information, thumbnail information file, thumbnail image file) related to the file. The application database information is created by the controller 21. Information input to the controller 21 includes video signal feature information from the video analysis unit 18, AV stream feature information from the stream analysis unit 20, and user instruction information input from the terminal 11.

  The characteristic information of the video signal from the video analysis unit 18 is automatically generated by the recording device. The video analysis unit 18 analyzes the content of the input video signal and generates information related to the image of the characteristic mark point in the input video signal. For example, the instruction information of the image of the mark point such as the program start point, scene change point, CM start / end point of the input video signal. Further, the image at the first mark point in the input video signal may be used as the representative image of the video signal (representative image of the PlayList).

  The video analysis unit 18 inputs a time stamp (mark position) indicating the image of the mark point in the video signal to the controller 21. The thumbnail encoder 19 encodes mark point images into thumbnail images and supplies the thumbnail images to the controller 21. The controller 21 stores the mark point time stamp, the CCI_o and WM_o corresponding to the mark point image, and the thumbnail image of the mark point image in association with each other. Further, the controller 21 determines the CCI_thumnail value of the above-described CP_Info_thumbnail () by a predetermined method based on the CCI_o and WM_o corresponding to the mark point image.

  Further, the stream analysis unit 20 detects content protection information (DTCP descriptor or the like) for the image in the AV stream indicated by the time stamp of the mark point. Then, it is analyzed whether content protection information (DTCP_descriptor, etc.) has content protection information other than CCI and APS. When there is content protection information other than CCI and APS, flag_need_AvstreamInfo = 1 of CP_Info_thumbnail () (FIG. 17) for the thumbnail image at the mark point is set. Alternatively, if there is no content protection information other than CCI or APS in the content protection information, flag_need_AvstreamInfo = 0 is set.

  FIG. 23 shows a summary of copy control processing when an AV stream obtained by self-encoding an input video signal is recorded.

  When CGMS or WM of the input signal is “01” or “101” (no more copy) and “11” (copy prohibited), recording of the input video signal is prohibited and “10” (copy once), the input video signal is recorded and rewritten to “01” or “101” (no more copy). When CGMS or WM of the input video signal is “00” (copy free), the input video signal is recorded and CGMS or WM is set to the value (“00” (copy free)) as it is.

  The controller 21 creates information about thumbnails to be stored in application database information (info.dvr, PlayList file, Clip Information file, thumbnail information file, thumbnail image file). The controller 21 supplies application database information to the scramble unit 22. The scrambler 22 encrypts the input application database information by a predetermined method and supplies it to the ECC encoder 23. The application database information is recorded on the information recording medium 26 as an application database file after the processing of the ECC encoding unit 23, the modulation unit 24, and the drive 25.

  Next, a case where the transport stream (TS) input from the terminal 27 is recorded will be described. The E_CCI (Embedded CCI) analyzing / updating unit 28 analyzes the E_CCI (Embedded CCI) encoded in the input TS by a predetermined method and records the CCI of the AV stream to be recorded (indicated by CCI_o in the figure). ) To the controller 21. Further, the E_CCI analysis / update unit 28 supplies the input TS to the WM detection / update unit 29.

  The WM detection / update unit 29 analyzes the Water Mark of the input video by a predetermined method, and supplies the WM of the AV stream to be recorded (indicated by WM_o in the drawing) to the controller 21. Further, the WM detection / update unit 29 supplies the input TS to the multiplexing / source packetizing unit 17. The multiplexing / source packetizing unit 17 converts the input TS into a stream of the source packet sequence, and supplies it to the stream analyzing unit 20 and the scramble unit 22.

  The scramble unit (encryption unit) 22 scrambles (encrypts) the input AV stream by a predetermined method and supplies the scramble unit (encryption unit) to the ECC encoding unit 23. The AV stream is recorded on the information recording medium 26 as an AV stream file after the processing of the ECC encoding unit 23, the modulation unit 24, and the drive 25.

  The input TS from the terminal 27 is input to the decoder 30. The decoder 30 decodes the video stream of the input TS and supplies the video signal to the video analysis unit 18. The processing of the video analysis unit 18 and the thumbnail encoder 19 is the same as the case where the input video from the terminal 12 is self-encoded.

  The stream analysis unit 20 analyzes content protection information (DTCP_descriptor or the like) in the input stream, extracts analog copy protection information (APS), and supplies it to the controller 21. Then, the APS corresponding to the mark point images of the input stream and the APS_thumbnail of the thumbnail images of those images are set to the same value.

  The values of CCI_thumbnail and flag_need_AvstreamInfo are determined by the stream analysis unit 20 in the same manner as in the case where the above-described input video is self-encoded.

  FIG. 24 shows a summary of the copy control processing when recording the input TS. The contents are substantially the same as those shown in FIG.

  The controller 21 supplies application database information to the scramble unit 22. The scrambler 22 encrypts the input application database information by a predetermined method and supplies it to the ECC encoder 23. The application database information is recorded on the information recording medium 26 as an application database file after the processing of the ECC encoding unit 23, the modulation unit 24, and the drive 25.

  FIG. 25 shows a flowchart of a process of recording an AV stream and encoding and recording a representative image and feature point image of the AV stream into a thumbnail.

  In step S101, the macrovision detection unit 13, the CGMS detection update unit 14, the WM detection update unit 15, the E_CCI analysis update unit 28, and the WM detection update unit 29 analyze the CCI of the input signal (video signal or TS).

  In step S102, the MPEG2AV encoder 16 and the multiplexed stream source packet unit 17 encode the input signal into an AV stream.

  In step S103, the video analysis unit 18 analyzes the video signal to detect mark point images (representative images and feature point images).

  In step S104, the controller 21 acquires a mark point image.

  In step S105, the thumbnail encoder 19 encodes the image of the mark point into a thumbnail image.

  In step S106, the controller 21 analyzes the content protection information (DTCP descriptor, etc.) at the position on the AV stream indicated by the time stamp of the mark point.

  In step S107, the controller 21 creates CP_Info_thumbnail () of the thumbnail image. Specifically, as described above, the controller 21 determines the values of CCI_thumbnail, APS_thumbnail, and flag_need_AvstreamInfo.

  In step S108, the controller 21 creates information about thumbnails to be stored in the application database information.

  In step S109, the scramble unit 22, the ECC encoding unit 23, the modulation unit 24, and the drive 25 record the AV stream and application database information on the information recording medium 26.

    Next, FIG. 26 shows a block diagram of a recording apparatus that records an AV stream recorded by adding a thumbnail of an image designated by the user.

  The application database read from the information recording medium 75 via the drive 74 is input to the controller 69 through the processes of the demodulator 73, the ECC decoder 72, and the descrambler 71. The controller 69 creates a menu screen for explaining the recorded contents of the information recording medium 75, outputs it to a monitor (not shown), and displays it. The user selects a PlayList to be played back via the UI input of the terminal 61. The controller 69 instructs to read out from the information recording medium 75 an AV stream necessary for playing the PlayList designated by the user.

  The AV stream file read from the information recording medium 75 via the drive 74 is input to the source depacketization / separation unit 66 through the processing of the demodulation unit 73, the ECC decoding unit 72, and the descrambling unit 71. The video stream separated by the source depacketizing / separating unit 66 is decoded by the MPEG2AV decoder 65, and a video signal is output. The video signal is subjected to predetermined processing by the CGMS insertion unit 64 and the macrovision insertion unit 63, and the video signal is output from the terminal 62, and is output and displayed on the monitor. The audio signal is output from a terminal 70 to a speaker (not shown).

  The user instructs the controller 69 through the UI input of the terminal 61 the scene (for example, favorite scene) to be marked from the video to be played.

  A thumbnail image to be recorded by being added to the mark point may be created from the image of the mark point, or may be created from an image taken into a recording apparatus via an external input from a personal computer or a digital still camera. .

  When creating a thumbnail image from the image of the mark point, the controller 69 acquires the time stamp of the image marked by the user. Then, the controller 69 acquires the image of the mark point from the MPEG2 AV decoder 65 and inputs the image to the thumbnail encoder 67. The thumbnail encoder 67 encodes the thumbnail image and inputs it to the controller 69. Further, the source depacketizing / separating unit 66 takes out the content protection information (DTCP descriptor, etc.) at the position on the AV stream indicated by the time stamp of the mark point and inputs it to the controller 69.

  The controller 69 analyzes the content protection information (DTCP_descriptor, etc.) and extracts CCI and analog copy protection information (APS). Then, the CCI_thumbnail and APS_thumbnail values of CP_Info_thumbnail () for the thumbnail image of the mark point image are set to the same values as the CCI and APS, respectively. Further, the controller 69 analyzes whether or not the content protection information includes content protection information other than CCI and APS. When there is content protection information other than CCI and APS, the controller 69 sets CP_Info_thumbnail () flag_need_AvstreamInfo = 1 for the thumbnail image at the mark point. If there is no content protection information other than CCI and APS in the content protection information, the controller 69 sets flag_need_AvstreamInfo = 0.

  Next, an operation in the case of creating a thumbnail image to be recorded by adding to a mark point from a still image taken into a recording apparatus via an external input such as a personal computer or a digital still camera will be described. The controller 69 acquires a still image from the external input terminal 85. Then, the content protection information detection unit 86 extracts content protection information (CGMS, APS, DTCP descriptor, etc.) of the input image and inputs it to the controller 69. The controller 69 analyzes the content protection information and extracts CCI and analog copy protection information (APS). Then, the controller 69 sets the CCI_thumbnail and APS_thumbnail values of CP_Info_thumbnail () for the thumbnail image to the same values as the CCI and APS, respectively. The controller 69 sets flag_need_AvstreamInfo to zero. The still image is input to the thumbnail encoder 67. The thumbnail encoder 67 encodes the thumbnail image and inputs it to the controller 69.

  When the thumbnail image and its content protection information can be created, the controller 69 then creates information about the thumbnail to be stored in the application database information (info.dvr, PlayList file, Clip Information file, thumbnail information file, thumbnail image file). To do. The controller 69 supplies application database information to the scramble unit 76. The scrambler 76 scrambles (encrypts) the input application database information by a predetermined method and supplies the scrambler 76 to the ECC encoder 77. The application database information is recorded on the information recording medium 75 as an application database file after the processing of the ECC encoding unit 77, the modulation unit 78, and the drive 74.

  FIG. 27 shows a flowchart of processing for recording an AV stream recorded by adding a thumbnail of an image designated by the user.

  In step S201, when a PlayList to be played back is designated by the user, the controller 69 inputs this designation.

  In step S202, the controller 69 controls the drive 74 to play back the video signal of the designated PlayList from the information recording medium 75. The reproduced signal is processed by a demodulator 73, an ECC decoder 72, a descrambler 71, a source depacketizer / separator 66, an MPEG2AV decoder 65, a CGMS inserter 64, and a macrovision inserter 63, and then a terminal 62 (video Signal) and terminal 70 (audio signal).

  In step S203, the user searches for a scene to be marked, and presses the mark button during playback or pause. A signal corresponding to this operation is input from the terminal 61 to the controller 69.

  In step S204, the controller 69 determines the position that has been output and displayed as the mark position at the timing taken in in the process of step S203.

  In step S205, the controller 69 outputs a message from the terminal 62, and requests the user to select whether to use the image at the mark position for the thumbnail or to acquire the still image used for the thumbnail from the terminal 85. . The user inputs a selection from terminal 61 based on this request. In step S205, the controller 69 determines whether to use the image at the mark position as a thumbnail based on this selection.

  When the image at the mark position is used for the thumbnail, the process proceeds to step S206, where the controller 69 acquires the image corresponding to the mark position from the output of the MPEG2AV decoder 65 and supplies it to the thumbnail encoder 67.

  In step S207, the controller 69 acquires the content protection information of the AV stream at the mark position from the output of the source depacketization separation unit 66.

  On the other hand, if it is determined in step S205 that the image at the mark position is not used for the thumbnail, the controller 69 proceeds to step S208, and acquires a still image used for the thumbnail from the terminal 85. In step S209, the controller 69 acquires the content protection information of the still image from the output of the content protection information detection unit 86.

  After the processing of step S207 or step S209, the process proceeds to step S210, and the controller 69 causes the thumbnail encoder 67 to encode the thumbnail image.

  In step S211, the controller 69 creates CP_Info_thumbnail () of the thumbnail image. Specifically, as described above, the controller 69 determines the values of CCI_thumbnail, APS_thumbnail, and flag_need_AvstreamInfo.

  In step S212, the controller 69 creates information regarding thumbnails to be stored in the application database information.

  In step S213, the controller 69 records the application database information on the information recording medium 75 in the same manner as described above.

  Next, FIG. 28 shows a block diagram of a playback apparatus that plays back an AV stream and plays back thumbnails of representative images and feature point images of the AV stream.

  The application database read from the information recording medium 75 through the drive 74 is input to the controller 69 through the processes of the demodulator 73, the ECC decoder 72, and the descrambler 71.

  The controller 69 determines the thumbnail image to be displayed on the video output. For example, it is decided to display a thumbnail of a representative image of a certain PlayList.

  The controller 69 acquires CP_Info_thumbnail () for the thumbnail image to be reproduced. When the flag_need_AVstreamInfo is 1, it is necessary to read from the information recording medium 75 the content protection information (DTCP descriptor, etc.) for the image in the Clip AV stream indicated by the mark_time_stamp of the mark associated with the thumbnail image.

  The controller 69 inputs the thumbnail image to the thumbnail decoder 80 and inputs the decoded image to the graphics image processing unit 81. Here, when flag_need_AVstreamInfo for the thumbnail image is 1, it is necessary to restrict playback of the thumbnail according to the read content protection information. For example, if the content protection information has resolution restriction information for analog reproduction of video content, thumbnail reproduction must be restricted based on the information. An output image from the graphics image processing unit 81 is processed by the image blender processing unit 82 and input to the CGMS insertion unit 64.

  The CGMS insertion unit 64 inserts a CGMS signal having the same meaning as CCI_thumbnail of CP_Info_thumbnail () for the thumbnail image into the output image. Next, the macrovision insertion unit 63 inserts an analog copy protection signal representing the same meaning as APS_thumbnail of CP_Info_thumbnail () into the output image. Then, the video is reproduced from the terminal 62.

  FIG. 29 shows a flowchart of the reproduction operation for reproducing thumbnails of representative images of AV streams and feature point images.

  In step S301, the controller 69 reads an application database information file. That is, data read from the information recording medium 75 by the drive 74 is supplied to the descrambling unit 71 through the processing of the demodulation unit 73 and the ECC decoding unit 72 and descrambled. The controller 69 acquires an application database information file from the output of the descrambling unit 71.

  The data output from the descrambling unit 71 is sent to the terminal 62 via the processing of the source depacketization separation unit 66, the MPEG2AV decoder 65, the image blender processing unit 82, the CGMS insertion unit 64, and the macrovision insertion unit 63. And output from the terminal 70.

  In step S <b> 302, the controller 69 determines a thumbnail image to be played based on a user instruction from the terminal 61.

  In step S303, the controller 69 acquires CP_Info_thumbnail () of the thumbnail image to be reproduced.

  In step S304, the controller 69 determines whether flag_need_AVstreamInfo is 1, and if it is 1, reads the content protection information of the AV stream at the mark position.

  In step S305, the descrambling unit 71 decrypts (descrambles) the thumbnail.

  In step S306, when flag_need_AVstreamInfo is 1, the controller 69 restricts playback of thumbnails according to the content protection information read out in step S304. For example, when the content protection information specifies that the resolution when the video content is analogly reproduced is limited, the controller 69 controls the graphics image processing unit 81 to limit the resolution of the thumbnail. Alternatively, the graphics image processing unit 81 reduces the thumbnail image frame based on the control of the controller 69.

  In step S307, the controller 69 controls the CGMS insertion unit 64 and the macrovision insertion unit 63 to add CGMS and macrovision (analog copy protection signal (CAPS)) to the thumbnail display image according to CP_Info_thumbnail (). This additional processing is also a kind of restriction.

  In step S <b> 308, the controller 69 outputs the thumbnail display image from the terminal 62 as a video.

  FIG. 30 shows a case where the DVR AV stream file and its associated database file are copied via the digital bus 103 from the copy source (output side) playback apparatus 101 to the copy destination (input side) recording apparatus 102. It is a block diagram which shows a structure.

  First, information instructing to copy a desired PlayList recorded on the information recording medium 201 of the playback apparatus 101 to the information recording medium 310 of the recording apparatus 102 is sent to the copy control command via a user interface (not shown). Get on and input to the playback device 101. This command is input to the control unit 208 via the digital bus interface 205 and the bus controller 207.

  The control unit 208 determines the stream portion of the AV stream necessary for playback of the PlayList, and instructs the drive 202 to read the AV stream data from the information recording medium 201. In addition, the control unit 208 instructs the drive 202 to read out the database file (PlayList file, Clip Information file and thumbnail file) related to the PlayList from the information recording medium 201.

  The control unit 208 instructs to supply the AV stream data read through the processing of the demodulation unit 203 and the ECC decoding unit 204 to the digital bus interface 205 as an AV stream file.

  On the other hand, a database file corresponding to AV stream data read from the information recording medium 201 is input to the memory 206 via the demodulator 203 and the ECC decoder 204. The control unit 208 creates a database (Clip Information file, PlayList file) necessary for reproducing the AV stream file output from the digital bus interface 205 based on the data in the memory 206. In addition, the control unit 208 creates a thumbnail file used by the clip corresponding to the AV stream file and the PlayList file to be copied.

  Then, the control unit 208 instructs to supply the newly created database file (Clip Information file, PlayList file, and thumbnail file) from the memory 206 to the digital bus interface 205.

  The bus controller 207 controls file output from the digital interface 205. The control unit 208 instructs the bus controller 207 to output the AV stream file and the database file from the digital bus interface 205.

  The AV stream file and the database file are input to the copy destination recording apparatus 102 via the digital bus 103.

  The bus controller 302 of the copy destination recording apparatus 102 controls file input from the digital bus interface 301. In addition, the bus controller 302 and the bus controller 207 exchange file copy control commands to control the timing of data transmission / reception.

  The control unit 308 of the recording apparatus 102 instructs to record the AV stream file input to the digital bus interface 301 on the information recording medium 310 through the processing of the ECC encoding unit 304, the modulation unit 305, and the drive 309. .

  In addition, the control unit 308 instructs to write the database file input to the digital bus interface 301 to the memory 303.

  Further, the control unit 308 reads the database file (Info.dvr file and thumbnail file) recorded on the information recording medium 310 to the memory 303 through the processing of the drive 309, the demodulation unit 307, and the ECC decoding unit 306. To instruct.

  Then, the control unit 308 updates the Info.dvr file and the thumbnail file in the memory 303. Specifically, the PlayList file name to be newly recorded is added to the TableOfPlayList of the Info.dvr file at the copy destination, and the thumbnail to be newly recorded is added to the thumbnail file at the copy destination.

  The control unit 308 instructs to read the database file in the memory 303 and record it in the information recording medium 310 through the processing of the ECC encoding unit 304, the modulation unit 305, and the drive 309.

  FIG. 31 is a flowchart for explaining copy source processing when a thumbnail image is copied from the copy source (output side) playback apparatus 101 to the copy destination (input side) recording apparatus 102.

  In step S701, the control unit 208 reads the application database information file (FIG. 13). That is, the control unit 208 controls the drive 202 and instructs the information recording medium 201 to read the application database information file. The application database information file read from the information recording medium 201 is supplied to and stored in the memory 206 through the processing of the demodulation unit 203 and the ECC decoding unit 204. The control unit 208 reads the application database information file stored in the memory 206.

  In step S702, the control unit 208 selects a thumbnail image to be transferred to the copy destination based on an instruction from the user.

  In step S703, the control unit 208 reads CP_Info_thumbnail () of the thumbnail image selected in step S702 from the application database information file (menu.tidx / mark.tidx) stored in the memory 206 (FIGS. 16 and 17). To get.

  In step S704, the control unit 208 determines whether flag_need_AvstreamInfo (FIG. 17) is 1, and in the case of 1, reads the content protection information of the AV stream at the mark position.

  In step S705, the control unit 208 determines whether or not flag_need_AvstreamInfo (FIG. 17) is 1, and in the case of 1, it restricts thumbnail copy according to the content protection information. For example, when the content protection information has copyable time limit information, the control unit 208 executes thumbnail copy restriction based on the copy time limit information.

  In step S706, if the CCI_thumbnail (FIG. 17) of CP_Info_thumbnail () is not copy free, the control unit 208 prohibits copying of the thumbnail.

  In step S707, the control unit 208 creates a thumbnail image file (menu.tdat / mark.tdat) and a thumbnail information file (menu.tidx / mark.tidx) for the thumbnail image that can be copied.

  In step S708, the control unit 208 transfers the thumbnail image file and the thumbnail information file to the copy destination.

  As described above, when recording an AV stream and recording a thumbnail image representing a representative image or feature point of the AV stream, the present invention adds the content protection information to the thumbnail image for recording. Can do.

  The content protection information includes at least one of copy generation management information (CCI) and analog copy protection information (APS).

  For example, when creating a thumbnail image using an image of a feature point in an AV stream, content protection information of the thumbnail image is created based on content protection information for the image of the feature point in the AV stream.

  Further, the content protection information of the thumbnail image includes an identifier (flag_need_AvstreamInfo) indicating whether or not it is necessary to refer to the content protection information in the AV stream when the thumbnail image is created from the image in the AV stream. . As a result, it is possible to cope with the case where information other than CCI and APS is required as the content protection information of the thumbnail image.

  In this way, since the content protection information is added to the thumbnail image and recorded, the thumbnail image can be recorded while protecting the copyright.

  The thumbnail image and its content protection information are recorded in units of a predetermined size block (tn_block). As a result, the thumbnail adding operation and the partial deleting operation can be executed easily and at high speed.

  In addition, when the content protection information is recorded in a format for storing following the thumbnail image, the size of the thumbnail image is thereby variable, so the start position of the content protection information in the block Can be random. This has the effect of making it difficult to extract the content protection information from the thumbnail image file.

  The thumbnail image format uses JPEG. Since JPEG is widely used as a de facto standard, it is relatively easy to implement and highly compatible. The format of the thumbnail image is not limited to JPEG, and MPEG I-picture, PNG, GIF, TIFF, or the like may be used.

  In the case of reproducing a thumbnail image from an information recording medium on which a representative image of the AV stream and a thumbnail image representing a feature point are recorded together with the AV stream, the present invention protects content recorded in addition to the thumbnail image. Based on the information, playback of thumbnail images is restricted. That is, reproduction is performed by adding a copy generation management signal or an analog copy protection signal to the reproduction signal. Furthermore, playback of thumbnail images is restricted based on the content protection information in the AV stream. In this way, unauthorized copying of the thumbnail image can be prevented.

  In the case where the AV stream and the thumbnail image are copied to another information recording medium from the playback device of the information recording medium in which the thumbnail image representing the representative image and feature points of the AV stream is recorded together with the AV stream, the present invention Then, the copy restriction of the thumbnail image is performed based on the content protection information recorded in addition to the thumbnail image. That is, it is determined whether or not the thumbnail image can be copied so as to keep the restriction of the copy generation management information (CCI) of the thumbnail image. Further, the copy restriction of the thumbnail image is performed based on the content protection information in the AV stream.

  Thus, an application for copying the thumbnail image together with the video signal can be realized while protecting the copyright of the thumbnail image. Compared to a case where only the AV stream can be copied, it is useful because a procedure for the user to add a new thumbnail image to the copied AV stream becomes unnecessary.

It is a figure explaining the structure of an application format. It is a figure explaining the mark on PlayList and the mark on Clip. It is a figure explaining a menu thumbnail and a mark thumbnail. It is a figure explaining the thumbnail representing the contents of a disc. It is a figure explaining the mark attached to a play list. It is a figure explaining the file which stores a thumbnail. It is a figure explaining the mark attached to a clip. It is a figure explaining the directory structure attached on a disk. It is a figure explaining the structure of a DVR MPEG2 transport stream. It is a figure which shows the syntax of UIAppInfpoDVR. It is a figure which shows the syntax of PlayListMark. It is a figure which shows the syntax of ClipMark. It is a figure which shows the syntax of a thumbnail information file. It is a figure which shows the syntax of a thumbnail image file. It is a figure explaining the method to store thumbnail image data in tn_block (). It is a figure which shows the syntax of tn_block. It is a figure which shows the syntax of CP_Info_thumbnail (). It is a figure explaining CCI_thumbnail. It is a figure explaining APS_thumbnail. It is a figure explaining flag_need_AVstreamInfo. It is a figure which shows the syntax of another thumbnail information file. It is a block diagram which shows the structure of a recording device. It is a figure explaining a copy control process. It is a figure explaining other copy control processing. FIG. 10 is a flowchart for describing thumbnail creation processing of an image at a mark point of an AV stream. FIG. FIG. 10 is a block diagram illustrating another configuration example of the recording apparatus. It is a flowchart explaining the creation processing of the thumbnail of the image designated by the user. It is a block diagram which shows the structural example of the reproducing | regenerating apparatus. 10 is a flowchart for explaining thumbnail image reproduction processing of a representative image of an AV stream and a feature point image. It is a block diagram which shows the structure in the case of copying a database file from a reproducing | regenerating apparatus to a recording device. It is a flowchart explaining the copy source process of a thumbnail file.

Explanation of symbols

  13 Macrovision detection unit, 14 CGMS detection update unit, 15 WM detection update unit, 17 Multiplexed source packetization unit, 18 Video analysis unit, 19 Thumbnail encoder, 20 Stream analysis unit, 21 Controller, 22 Scramble unit, 26 Information recording Medium, 28 E_CCI analysis update unit, 29 WM detection update unit, 30 decoder

Claims (15)

Generating means for generating a thumbnail image corresponding to the input video signal;
First control means for generating content protection information corresponding to the thumbnail image generated by the generation means;
Recording means for recording the video signal on an information recording medium together with the thumbnail image generated by the generating means and the content protection information generated by the first control means,
The size of the thumbnail image is variable,
Said recording means, the content protection information corresponding to the thumbnail image, an arbitrary position corresponding to the size of the thumbnail images within a predetermined size of blocks for recording the thumbnail image and the content protection information A video signal processing apparatus, characterized in that a start position is recorded in a format that is stored subsequent to the thumbnail image. The video signal processing apparatus according to claim 1, wherein the recording unit records the thumbnail image and the content protection information corresponding to the thumbnail image as a pair and recorded. The video signal processing apparatus according to claim 1, wherein the content protection information includes copy generation management information. The video signal processing apparatus according to claim 1, wherein the content protection information includes analog copy protection control information. The generating means generates the thumbnail image using an image in the video signal,
The video signal processing apparatus according to claim 1, wherein the first control unit generates content protection information of the thumbnail image based on content protection information of the image included in the video signal. The generating means generates the thumbnail image using an image in the video signal,
The video signal processing apparatus according to claim 1, wherein the first control unit generates the content protection information including an identifier indicating whether or not it is necessary to refer to content protection information of the video signal. . The video signal processing apparatus according to claim 1, wherein the recording unit compresses and records the thumbnail image by a JPEG method. Reproducing means for reproducing a signal recorded on the information recording medium;
Separating means for separating the video signal, the thumbnail image corresponding to the video signal, and the content protection information corresponding to the thumbnail image from the signal reproduced by the reproducing means;
The video signal processing apparatus according to claim 1, further comprising: a second control unit that limits output of the thumbnail image based on the content protection information separated by the separation unit. The content protection information includes an analog copy protection control signal,
The video signal processing apparatus according to claim 8, wherein the second control unit performs control so that a copy protection signal is superimposed on an output signal in accordance with the analog copy protection control signal. The video signal processing apparatus according to claim 8, wherein the second control unit further restricts playback of the thumbnail image based on the content protection information of the video signal. The second control unit restricts copying of the thumbnail image based on the content protection information recorded in addition to the thumbnail image when the thumbnail image is copied to another information recording medium. The video signal processing apparatus according to claim 8. The content protection information includes copy generation management information,
The video signal processing apparatus according to claim 11, wherein the second control unit restricts the copy of the thumbnail image so as to observe the restriction of the copy generation management information of the thumbnail image. The video signal processing apparatus according to claim 11, wherein the second control unit further restricts copying of the thumbnail image based on the content protection information of the video signal. Generating a thumbnail image corresponding to the input video signal, the thumbnail image having a variable size ;
A control step of generating content protection information corresponding to the thumbnail image generated by the processing of the generation step;
The video signal is recorded on an information recording medium together with the thumbnail image generated by the process of the generation step and the content protection information generated by the process of the control step, and the content protection corresponding to the thumbnail image format information, starting at any position corresponding to the size of the thumbnail images in the thumbnail image and blocks of a predetermined size of recording the content protection information, and stores followed after the thumbnail image A video signal processing method comprising: a recording step of recording in Generating a thumbnail image corresponding to the input video signal, the thumbnail image having a variable size ;
A control step of generating content protection information corresponding to the thumbnail image generated by the processing of the generation step;
The video signal is recorded on an information recording medium together with the thumbnail image generated by the process of the generation step and the content protection information generated by the process of the control step, and the content protection corresponding to the thumbnail image format information, starting at any position corresponding to the size of the thumbnail images in the thumbnail image and blocks of a predetermined size of recording the content protection information, and stores followed after the thumbnail image A program for causing a computer to execute a process including a recording step of recording in step (b).

Images