JP2006331592A - Reproducing apparatus and method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To eliminate the necessity for a user to select a stream to be reproduced which is captured in a certain recording medium and in a certain recording system. <P>SOLUTION: When an automatic reproducing mode is set, in which the stream to be reproduced is not selected by the user, first, recording systems of streams recorded in respective recording media set on a tray are confirmed. When the stream captured in a recording system 2 having higher recording rate than the recording system 1 is recorded in any recording medium, the streams are reproduced in the recording system 2 successively, when reproduction of the stream in the recording system 2 is finished, reproduction in the recording system 1 is started. This invention can be applied to a reproducing apparatus which can deal with one or a plurality of recording media. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a playback apparatus and method, and a program, and in particular, a playback apparatus and a playback apparatus that can save the user from having to select a recording medium to be played back by using a recording method. The present invention relates to a method and a program.

  Conventionally, in a personal computer or the like, a hard disk (HDD (Hard Disk Drive)) is used as a data recording medium. In recent years, HDDs have been used in various devices such as recording devices and portable music players in addition to personal computers because of their increased capacity, lower prices, and smaller size. .

  In addition to HDDs, optical discs such as CDs (Compact Disks) and DVDs (Digital Versatile Disks) are also used as data recording media. In recent years, data can be read and written faster and have a larger capacity than conventional DVDs. Next-generation optical discs that realize the above have been proposed. For example, next-generation optical disc formats for consumer devices include the Blu-ray Disc (trademark) method (hereinafter referred to as BD) and the HD-DVD (High Definition DVD) (trademark) method (hereinafter referred to as HD-DVD). Is proposed).

  A conventional DVD (hereinafter referred to as a normal DVD) can perform double-sided recording and double-layer recording. In the case of a DVD-ROM, the recording capacity is 4.7 GB for single-sided single-layer recording and 8. 5GB, 9.4GB for single-sided recording on both sides. On the other hand, the recording capacity of BD is 27 GB for single-sided recording. The transfer rate is 36 Mbps, and data can be read out at a higher speed than a normal DVD. The recording capacity of HD-DVD is single-sided single layer 15 to 20 GB, and double-layer 30 to 40 GB, which also has a larger recording capacity than normal DVD.

  Since it is difficult to replace all widely used recording and playback devices compatible with normal DVDs with recording and playback devices compatible with BD and HD-DVD in a short period of time, An optical disc capable of recording / reproducing data and recording / reproducing data on a normal DVD has been developed.

  By using a recording layer corresponding to BD or HD-DVD among optical discs corresponding to a plurality of recording methods, high-quality recording, long-time recording, and the like can be performed as compared with a normal DVD.

  Here, as a video (image) recording method, for example, a recording layer corresponding to BD or HD-DVD among optical discs corresponding to a plurality of recording methods and a recording layer corresponding to normal DVD are the same. A method of recording an image is conceivable. Specifically, taking advantage of characteristics such as high transmission rate and large capacity, image data is recorded in a high-quality mode with a high transmission rate on a recording layer that supports BD and HD-DVD, while it is compatible with normal DVDs. It is conceivable to record the same image data in the normal image quality mode with a low transmission rate on the recording layer.

  In this way, by recording a broadcast program or a movie in the high image quality mode and the normal image quality mode on one optical disc, the user can use, for example, a normal DVD in a portable playback device that is relatively uncomfortable with poor image quality. Data can be played back, and BD or HD-DVD data can be played back on a home-use playback device.

  The playback method is not simply playing back in chronological order in the order in which they were recorded, but playing back the scene that the user wants to see, or playing back only the scene (key frame) that seems to be important (digest playback). Two methods are possible. Thereby, the user can know the whole recorded thing, for example, without viewing all the continuous dramas and series programs recorded continuously in the order of the recording.

  In order to realize the former special reproduction, the following Patent Documents 1 and 2 automatically classify image data for each similar scene using feature data of recorded images and display thumbnails of representative images. Thus, a technique for allowing a user to select a reproduction position is disclosed.

  On the other hand, in order to realize the latter special reproduction, Patent Document 3 below discloses a technique for determining an important section based on recorded image feature data and reproducing only the determined important section.

  As processing using image feature data, it is conceivable to set so-called chapter points in an image based on the feature data. By using the image data in which such chapter points are set, the user can perform an editing process such as clipping or copying an image in the range of the designated chapter points.

JP 2002-44573 A JP 2002-344852 A JP 2003-219348 A

  By the way, when recording the same image on a recording layer corresponding to BD or HD-DVD and a recording layer corresponding to normal DVD using an optical disc that supports a plurality of recording methods, thumbnails of representative images as described above Feature data used for display, digest playback, editing processing, etc. is recorded on feature data obtained from images recorded on a recording layer compatible with BD and HD-DVD, and on a recording layer normally compatible with DVD. It is necessary to ensure consistency with the feature data obtained from the captured image.

  For example, the feature data is extracted based on features (for example, pixel values) appearing in the image, or when the image is recorded, a part of the data extracted from the entire data to be encoded It is obtained by making data into feature data. Therefore, even when the same image is targeted, if the recording method is different, different data may be acquired as feature data of each image having a different recording method.

  In this case, the chapter point, key frame position, etc. differ depending on the recording method.When playing back BD or HD-DVD data, the playback of the section in which the chapter point is specified is instructed, and normal DVD data When the same chapter point is specified and playback of the same section is instructed during playback, the playback position is different even though the recorded images are the same.

  The reason why different data is acquired as feature data is that, for example, the screen is recorded with a screen size of 16: 9 on a BD or HD-DVD, and is recorded with a screen size of 4: 3 on a normal DVD. There is a difference in size. Due to the different screen sizes, the signal characteristics of Y, Cb, and Cr are different even for signals of the same image. Therefore, characteristic data acquired based on these signals may be different.

  In addition, for audio feature data, even if the same audio is targeted, due to differences in the number of quantization bits, sampling frequency, etc., differences between 5.1 channel surround recording and 2-channel stereo recording, and other factors. The resulting feature data may be different.

  1A and 1B and FIGS. 2A and 2B are diagrams for explaining the consistency of feature data, respectively.

  The stream shown in FIG. 1A is an image stream recorded in the normal DVD format, and the stream shown in FIG. 2A is an image stream recorded in the BD format (or HD-DVD format). The contents of the images are the same. In FIGS. 1A and 1B and FIGS. 2A and 2B, one of squares with a number indicates one scene (a predetermined number of frames).

  In a state where such a stream is recorded, feature data extraction processing is performed based on the image stream recorded in the normal DVD format and the image stream recorded in the BD format. For example, assume that scenes 3, 7, and 13 as shown in FIG. 1B and scenes 5, 8, and 15 as shown in FIG. 2B are extracted as feature scenes (key frames), respectively.

  That is, although the contents of the recorded images are the same, the feature data is not consistent and different scenes are extracted as feature scenes.

  Since the user performs the editing process by viewing the representative image of the feature scene extracted based on the feature data, if the consistency of the feature data is not ensured in this way, the user is confused during the editing process. There is a risk that.

  For example, when an image stream recorded in the normal DVD format and an image stream recorded in the BD format are selected in the same range and copied to another recording medium, the editing process Since the representative images displayed at this time are different, the user cannot accurately select the same range to be copied from each stream by looking at the display of the representative images.

  In addition, when digest playback is instructed by the user, the playback position is performed according to the position of the feature point set based on the feature data. The playback position is different between digest playback of an image stream recorded in the DVD format and digest playback of an image stream recorded in the BD format, and a sense of discomfort may be felt.

  As described above, an apparatus that handles a plurality of streams having different recording methods has the following problems in addition to the above problems.

  That is, when the stream recorded as described above is reproduced, generally, the user wants to view a video with better image quality than that with inferior image quality. It is necessary to check the recording method of the stream.

  Such confirmation is further complicated when a tray (a tray on which a disc is installed) provided in one recording apparatus can install a plurality of discs.

  The present invention has been made in view of such a situation, and enables a user to save the trouble of selecting which recording medium is to be used to play back a stream captured by which recording method. is there.

  The present invention is provided in a tray when a determination unit / step for determining a recording method of a stream recorded on a recording medium based on attribute information and a mode in which the user does not select a stream to be reproduced are set. Among the streams recorded on one or more recording media, the stream recorded in the first recording method with high quality is converted into the first recording method based on the determination result by the determining means / step. It is characterized by comprising reproduction control means / step for reproducing with priority over a stream recorded by the second recording method with lower quality.

  The reproduction control means starts reproduction of the stream recorded in the second recording method when the reproduction of the stream recorded in the first recording method on all the recording media installed in the tray is finished. Can be.

  In the present invention, when the recording method of the stream recorded on the recording medium is determined based on the attribute information and a mode in which the user himself / herself does not select the stream to be played back is set, 1 or Of the streams recorded on two or more recording media, the second recording method in which the stream recorded by the first recording method with high quality is inferior to the first recording method based on the determination result Is played back with priority over the stream recorded in

  According to the present invention, it is possible to save the user from having to select a recording medium and a recording format to be played back by a user.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  Here, a feature extraction process of image / audio data (image / audio stream) is performed, feature data is detected from the result of the extraction process, and predetermined key frames (important points, important positions) and features are detected based on the detected feature data. Consider a case where a point is detected and an operation using feature data such as a digest playback (summary playback) operation or a chapter setting operation is realized.

The problem that the consistency of feature points determined based on feature data cannot be ensured when image and sound data having the same content described in the column “Problems to be Solved by the Invention” is captured by different recording methods As a method for solving the problem, for example,
(1) Feature extraction processing is performed by performing feature extraction processing for a baseband band of a single image / audio data, and the feature data is captured by image / audio data having a different recording method (when the image / audio data is captured by a different recording method). (2) A method used in common among a plurality of obtained image and sound data (2) Feature data is detected by performing feature extraction processing on any one of a plurality of image and sound data having different recording methods. In addition, a method of using the feature data in common between video and audio data having different recording methods is conceivable.

The embodiments of the present invention will be described in the following order.
(1) Information recording mode (1.1) Two recording systems (1.2) Three or more recording systems (2) Information playback mode (3) Recording of characteristic data and special playback data Aspects (3.1) Feature data (3.2) Special playback data (3.3) Recording mode (3.3.1) When the contents of video and audio data are the same (3.3.2) When the contents of image / audio data are different (3.4) Other recording modes (when recording to IC memory or IC tag)
(4) Operation in the reserved recording (reserved recording, timer recording) mode (5) Configuration example of the recording side (6) Digest playback and chapter processing using feature data (6.1) Digest playback using feature data (6) .2) Automatic chapter processing using feature data (7) Overall configuration (7.1) Recording side configuration (7.2) Playback side configuration (7.2.1) Normal playback mode operation (7.2.2) Digest playback mode, chapter mode (7.2.2.1) When playlist data and chapter data are recorded (7.2.2.2) When playlist data and chapter data are not recorded (7 (2.2.2.2.1) When feature data is recorded (7.2.2.2.2) When feature data is not recorded (8) Other overall configuration (8.1) Recording side Constitution ( .2) Playback-side configuration (9) Feature extraction processing (9.1) Speech system feature extraction processing (9.1.1) Silence feature extraction processing (9.1.2) Other speech feature extraction processing (9.2) ) Image system feature processing (9.2.1) Scene change feature (9.2.2) Color feature (9.2.3) Similar scene feature (9.2.4) Telop feature (10) Large capacity recording medium (10.1) Method for determining recordable recording method (10.2) Recording method (10.2.1) Recording method 1 and recording method for recording medium A (10.2.2) When only recording method 1 data is recorded on recording medium A (10.2.3) Recording method 2 data on recording medium A (11) A plurality of video and audio data of the recording method 1 is recorded as a recording method. (11.1) Operation mode setting order, operation order (12) Example when recording capacity is insufficient (12.1) In the case of a disc corresponding to two recording methods (12.2) Recording rate (13) Operation flowchart (14) Embodiment and others (15) Necessity of generating feature data and special reproduction data (16) Operation according to recording rate (16.1) Operation flowchart (16.2) Features Data consistency processing (17) When converting the recording system (18) Selecting a recording medium according to the recording rate (19) Example when a plurality of disks can be handled

(1) Information Recording Mode First, a data recording mode on a recording medium (optical disc) that is attached to and detached from the recording / reproducing apparatus according to an embodiment of the present invention will be described.

(1.1) In the case of two recording systems Here, the two recording systems are, for example, data are recorded on one optical disk (recording medium) by two different recording systems such as the normal DVD system and the BD system. Refers to the method. That is, the recording medium used in the recording / reproducing apparatus according to the embodiment of the present invention is provided with a plurality of layers, and data can be recorded on each layer by different recording methods. In addition, data recorded by different recording methods can be read and reproduced from the plurality of layers.

  3 and 4 are diagrams showing an example of data recording by the two recording method.

  FIG. 3 shows an example of a case where one stream supplied from the outside is recorded by two different recording methods, and shows a data recording method in a recording / reproducing apparatus to which the present invention is applied.

  FIG. 4 shows an example in which two streams are recorded by different recording methods, and is shown as a comparison with a data recording method in a recording / reproducing apparatus to which the present invention is applied.

  The recording medium 1 is provided with a recording method 1 layer that is a layer on which recording method 1 data is recorded and a recording method 2 layer that is a layer on which recording method 2 data is recorded. For example, the DVD method is usually used as the recording method 1, and the BD method (or HD-DVD method) is adopted as the recording method 2. In this case, when the transfer rate of the recording method 1 (transmission rate or recording rate) is compared with the transfer rate of the recording method 2, the transfer rate of the recording method 2 is higher.

  As shown in FIG. 3, the signal processing system 2-1 performs signal processing on the stream 1 supplied from the outside in the signal processing system 2-1, and the laser corresponding to the processing result data picks up the pickup 3-1. The stream 1 is recorded on the first recording system layer of the recording medium 1. Further, the stream 1 is subjected to signal processing of the signal processing method 2 in the signal processing system 2-2, and the stream 1 is recorded by irradiating the laser corresponding to the processing result data through the pickup 3-2. Recording is performed on the second recording method layer of the medium 1.

  On the other hand, in the example of FIG. 4, the stream 1 supplied from the outside is recorded in the recording method 1 layer of the recording medium 1 after being subjected to signal processing of the signal processing method 1 in the signal processing system 2-1. . Further, for the stream 2 which is a stream different from the one supplied to the signal processing system 2-1, the signal processing system 2-2 performs the signal processing of the signal processing method 2, and then the recording on the recording medium 1. Recorded in the method 2 layer.

(1.2) In the case of three or more recording systems In this case, as described above, the recording system 1 can be the normal DVD system, and the recording system 2 can be the BD system (or HD-DVD system). The recording method 3 can be a normal CD method. In this normal CD system, still images and images are recorded in addition to audio data.

  In this case, the recording medium 1 is provided with a layer for recording normal CD data in addition to the recording method 1 layer and the recording method 2 layer shown in FIGS.

  It is also possible to adopt the normal DVD system as the recording system 1, the HD-DVD system as the recording system 2, and the BD system as the recording system 3. When more layers are provided on the recording medium 1, the normal DVD system is used as the recording system 1, the HD-DVD system is used as the recording system 2, the BD system is used as the recording system 3, and the CD system is used as the recording system 4. It is also possible to record data on each layer using three different recording methods. Thus, in the recording medium 1, data can be recorded by two or more recording methods.

(2) Information Reproduction Mode FIG. 5 is a diagram illustrating an example of reproducing data recorded on the recording medium 1 by the two recording method.

  The data recorded in the normal DVD system on the recording system 1 layer is read out via the pickup 3-1, and the reproduction processing is performed in the signal processing system 10-1. The obtained reproduction signal (image signal, audio signal) is output to the subsequent configuration.

  Further, the data recorded on the recording system 2 layer by the BD system is read out via the pickup 3-2, and the reproduction processing is performed in the signal processing system 10-2. The obtained reproduction signal (image signal, audio signal) is also output to the subsequent stage configuration.

  As described above, the recording medium 1 can selectively reproduce at least one of the data recorded by the recording method 1 and the data recorded by the recording method 2.

(3) Recording Mode of Feature Data and Special Playback Data First, feature data and special playback data will be described.

(3.1) Feature Data Feature data is classified into image feature data and audio feature data, and the image feature data includes telop feature data, color feature data, and other feature data. The voice feature data includes silent feature data.

  For example, the telop feature data in the image feature data includes the position information of the field (or frame) in which the telop is displayed and the AC (Alternating Current) coefficient data of DCT (Discrete Cosine Transform) representing the telop feature. A pair of data. This is considered as data representing characteristics and characteristics at a certain position of the stream.

  If the recording start time, the recording start position, etc. are known, or if the feature data is the feature data at which position in the entire stream from the order of the feature data, the position information of the field is Except for this, only data such as DCT AC coefficients may be recorded on the recording medium 1 as feature data. That is, in this case, the feature data is DCT coefficient data arranged in the order of positions with reference to the recording start position, or DCT coefficient data arranged in the time series.

  The feature data is used when detecting a key frame that is a frame representing an important position in a stream. The position of the key frame is represented by a field number, a frame number, a time from the recording start point, and other position information, and the position information is generated as a playlist data by a process described later. That is, if there is feature data, play list data can be generated. The playlist data generated based on the feature data is used as appropriate during digest playback and chapter processing.

  Thus, the feature data is also used to generate playlist data. If there is playlist data, digest playback and chapter processing described later are possible. Since correction is also possible, the feature data is not deleted after the playlist data is generated, but is kept on a predetermined recording medium such as the recording medium 1 or the built-in HDD together with the playlist data. Also good.

  Also, since the playlist data of the stream may not be recorded on the recording medium on which the stream to be reproduced is recorded, the feature data should be left on a predetermined recording medium such as an internal HDD. It may be. For example, when the playlist data of the stream is not recorded on the recording medium on which the stream that has been reproduced in the past is recorded, the feature data is detected during the past reproduction, the playlist data is generated, etc. When the same stream is reproduced again, digest reproduction, chapter processing, etc. can be performed using the retained playlist data.

  A feature data detection method will be described later.

(3.2) Special reproduction data The special reproduction data includes playlist data and chapter data, and is, for example, position information of feature points (characteristic positions) used in special reproduction. The playlist data is generated by a feature point detection process based on the feature data.

  Here, special playback includes digest playback that plays back only the characteristic scenes of the entire stream, skip playback that plays back scenes for a predetermined time at predetermined intervals, and a screen at a predetermined position in the stream as a still image. Normal playback of the entire stream (or a specified range) in time-series order, such as displaying as a thumbnail (including thumbnail display) or displaying a screen at the position where a chapter is set as a still image (including thumbnail display) Playback methods other than playback are included.

  When only the key frame section is played back in the digest playback mode, the start position and end position of the key frame section can be considered as feature points, respectively, and the position information can be considered as playlist data. Further, only the start position of the key frame section can be considered as a feature point.

  Processing using these feature point data includes, for example, if you want to see scene changes in a broadcast program, or if you want to know an overview of the contents that have been edited or recorded, thumbnails of frames with those feature points are displayed. Used for processing such as displaying.

  The feature point and key frame position may be, for example, a position at which telop display is started, a start position of a scene similar to a certain scene, an end position of a CM section, or the like.

  Since the start position of the main part after the CM ends and the main part end position before the CM start can be obtained from the start position and end position of the CM, from another viewpoint, the end position of the main part before the CM start (end Point) and the start position (start point) of the main part after the end of the commercial, that is, the start position and the end position of the main part of the program can be used as feature points.

  FIG. 6 is a diagram illustrating an example in which playlist data is displayed as text data.

  Data such as a field number representing a feature point start position and a feature point end position as shown in FIG. 6 is recorded in a predetermined recording medium such as an HDD or a disk as a predetermined file or data itself.

  Of course, position information such as a frame number and time information from the start of program recording may be recorded as playlist data instead of the field number. Further, only the first position information of the feature section shown in the column (a) of FIG. 6 may be recorded as the playlist data.

  Such playlist data is used in a special playback mode such as skip playback or in a thumbnail display mode of feature points.

  In FIG. 6, the data in column (a) is information representing the start position of the feature section, and the data in column (b) is information representing the end position of the feature section. In the example of FIG. 6, the section specified by the first data registered in the playlist data is a section of 100 to 700 fields, and this section is a feature section.

  For example, in the digest playback mode, only the section specified by the data in the columns (a) and (b) in FIG. 6 is played back, and compared with a case where the entire stream is played back in time series. Thus, the stream is played back. In the case of the example in FIG. 6, only the sections of 100 to 700 fields, 900 to 1500 fields, 2000 to 2600 fields,..., 5000 to 5600 fields are skip-played, and the other sections are not played.

  In the thumbnail display mode, an image at a position specified by the data in FIG. 6A is displayed as a thumbnail.

(3.3) Recording Mode FIG. 7 is a diagram showing a recording mode of characteristic data and special reproduction data in the recording medium 1 on which streams of two recording modes (recording mode 1 and recording mode 2) are recorded. .

  As will be described later, the feature data and the special reproduction data may not be recorded on the recording medium 1 as necessary. Again, the recording method 1 is the normal DVD method and the recording method 2 is the BD method.

  (1) to (3) in FIG. 7 show combinations when the contents of the streams recorded in the recording method layer 1 and the recording method layer 2 are the same, and (4) shows different contents. A combination is shown.

(3.3.1) When the contents of the video and audio data are the same As shown in FIG. 7 (1), characteristic data and special reproduction data are recorded in the recording system 1 layer. It is possible to prevent recording on the two layers.

  A device having a BD or HD-DVD data playback function can generally play back a large amount of data and has a higher performance than a device having only a normal DVD playback function. The price is also considered high. For this reason, it is considered that a device having a recording / playback function of the BD system or HD-DVD system is usually additionally equipped with a recording / playback function of data of the normal DVD system. The combination shown in FIG. 7A is considered as one of effective recording methods.

  Further, as shown in FIG. 7 (2), the characteristic data and special reproduction data are recorded only in the recording system 2 layer without recording the characteristic data and special reproduction data in the recording system 1 layer. Can be.

  Further, as shown in FIG. 7 (3), the characteristic data and the special reproduction data can be recorded in both the recording system 1 layer and the recording system 2 layer. In the case of this combination, an apparatus having only a reproduction function of either one of the recording methods can be dealt with.

  It should be noted that the same stream is recorded in two recording methods, that is, the recorded movie content and program content are the same, and as shown in FIG. When the feature data and special playback data are recorded in both the recording layer and the recording method, the feature point is set at the corresponding position (the same scene position) in each stream, and the digest playback performed based on the feature point is set. It is preferable that the reproduction section ensure consistency between when the stream of one recording method is reproduced and when the stream of the other recording method is reproduced.

  For example, the user feels uncomfortable when the content to be reproduced differs between when the stream of one recording method is digest-reproduced and when the stream of the other recording method is digest-reproduced even though the content is the same You will feel.

  FIG. 8 is a diagram illustrating an example of the recording state of feature data and playlist data.

  As shown in FIG. 8A, feature data and playlist data (and chapter data described later) are recorded on the recording medium 1, or as shown in FIG. Only the playlist data can be recorded on the recording medium 1 without being recorded. Further, as shown in FIG. 8C, only the feature data can be recorded on the recording medium 1, and the playlist data can be prevented from being recorded.

  Further, as shown in FIG. 8D, the feature data and the playlist data can be prevented from being recorded on the recording medium 1. In the case of the combination shown in FIG. 8 (d), special reproduction of the stream recorded on the recording medium 1 cannot be performed in the present state. Therefore, if necessary, feature extraction processing and playlist data as described later are performed. The special reproduction is performed based on the creation process.

(3.3.2) When the content of the image / audio data is different In this case, as shown in FIG. 7 (4), as in the combination of FIG. 7 (3) when the stream has different content. The characteristic data and the special reproduction data can be recorded in both the recording system 1 layer and the recording system 2 layer.

(3.4) Other recording modes (when recording on IC memory, IC tag)
As described above, instead of recording in a predetermined area of the recording method 1 layer or the recording method 2 layer of the recording medium 1, the following recording modes of feature data and playlist data are also conceivable.

  9A and 9B are views of the recording medium 1 as viewed from above (perpendicular to the surface of the recording medium 1).

  FIG. 9A shows an example in which feature data and playlist data are recorded in the inner peripheral area 1A, which is an area different from the normal recording area (for example, a recording area recommended in the format) of the recording medium 1. Show. Of course, it may be recorded on the outer peripheral side.

  FIG. 9B shows an example in which the IC memory 1B is embedded at a certain position on the inner circumference side of the recording medium 1, and feature data and playlist data are recorded thereon. The IC memory 1B may be embedded on the outer peripheral side of the recording medium 1. For example, the IC memory 1B is prepared in the recording medium 1 by inserting an IC pattern into a predetermined layer in the process of manufacturing the recording medium 1.

  An IC tag may be used instead of the IC memory 1B. In this case, a reader / writer capable of wirelessly writing data to an IC tag provided on the recording medium 1 and reading data recorded on the IC tag wirelessly in the recording / reproducing apparatus of the recording medium 1. Is prepared.

  In FIG. 10, in addition to the recording method 1 layer and the recording method 2 layer, other recording areas (inner area 1A, IC memory 1B) of characteristic data and special reproduction data as shown in FIGS. 9A and 9B are provided. FIG. 6 is a diagram showing a recording mode of feature data and special reproduction data when the recording medium is in the state of recording.

  FIGS. 10 (1) to (6) show combinations when the contents of the streams recorded in the recording method layer 1 and the recording method layer 2 are the same. FIGS. 10 (7) to (11) A combination when the contents of these streams are different contents is shown.

(4) Operation in Reservation Recording (Reserved Recording, Timer Recording) Mode Here, the operation of the recording / reproducing apparatus when a long-time program is reserved and recorded according to the setting by the user will be described. Normally, it is assumed that the user wants to appreciate a stream recorded with as high a picture quality as possible, and in the default setting (initial setting), the stream is recorded in the recording mode 2 of the recording method 2 in which recording is performed with the highest possible picture quality.

  In order to record the entire program while recording a high-definition high-definition program in the recording area of the recording method 2 layer in the recording method 2 which is a high image quality recording mode, the recording method currently used is 2 layers. When it is automatically detected that the recording capacity of the recording medium is insufficient, or when it is automatically detected that the recording capacity is shortly short, the apparatus switches the recording system to another recording system, for example, recording system 1. The subsequent data is recorded.

  At this time, the recording method is switched, and the predetermined information indicating that the same program (program) has been continuously recorded on the other recording layers is the recording method one layer that is the switching destination recording layer or the recording source recording Recording is performed in a predetermined recording area of two layers of recording methods.

  Note that the user may be able to change the recording mode setting. For example, the user can change the default setting for recording in the recording system 2 (BD system or HD-DVD system) so that the recording is performed in the recording system 1 (normal DVD system).

(5) Configuration Example of Recording Side FIGS. 11 and 12 are block diagrams illustrating a configuration example of the recording side for recording the same content on the recording medium 1 by a plurality of recording methods.

  FIG. 11 shows a configuration in which features are extracted directly from an input stream (image / audio data) and feature data representing the extracted features are recorded in the recording medium 1.

  The stream input to the recording / reproducing apparatus is supplied to the recording method 1 encoding processing system 21 and the recording method 2 encoding processing system 22, and in each of them, encoding processing corresponding to the recording method is performed. The encoding result by the recording method 1 encoding processing system 21 is output to the recording method 1 recording signal processing system 24, and the encoding result by the recording method 2 encoding processing system 22 is output to the recording method 2 recording signal processing system 25.

  The stream input to the recording / reproducing apparatus is also supplied to the feature data signal processing system 23. The feature data signal processing system 23 obtains the image feature data by the predetermined image feature extraction process and the predetermined audio feature extraction process. Thus, the voice feature data is detected respectively. The detected feature data includes, in addition to feature data, playlist data and chapter data recorded on the recording medium 1 (for example, when obtaining the recording medium 1 on which data is recorded with the combination of FIG. 8A). Is output to the playlist data (chapter data) signal processing system 26, and only the feature data is recorded on the recording medium 1, and the playlist data and chapter data are not recorded (for example, data in the combination of FIG. 8C). Is output to the recording method 1 recording signal processing system 24 and the recording method 2 recording signal processing system 25.

  In the recording method 1 recording signal processing system 24, normal DVD recording for recording the data of the normal DVD method supplied from the recording method 1 encoding processing system 21 to the recording method 1 layer (layer a, layer b in the figure). The process and the process of recording the data supplied from the feature data signal processing system 23 and the playlist data (chapter data) signal processing system 26 in a predetermined recording layer (position) by the combination of FIG. 7 and FIG. Done.

  In FIG. 11, the layer a is a layer provided when the recording method 1 layer of the recording medium 1 corresponds to DVD DL (Dual Layer). The same applies to FIG.

  In the recording system 2 recording signal processing system 25, a recording process for recording data of the BD system or HD-DVD system supplied from the recording system 2 encoding processing system 22 to the recording system 2 layer, and a characteristic data signal A process of recording data supplied from the processing system 23 and the playlist data (chapter data) signal processing system 26 on a predetermined recording layer (position) by the combination of FIGS. 7 and 10 is performed.

  The memory system 27 indicated by a dotted line in FIG. 11 includes, for example, data supplied from the recording system 1 encoding processing system 21 by the recording system 1 recording signal processing system 24 and characteristic data obtained by the characteristic data signal processing system 23. (Or, if the playlist data (chapter data) obtained by the playlist data (chapter data) signal processing system 26 cannot be recorded on the recording medium 1 simultaneously), the data obtained by the feature data signal processing system 23 is Used when temporarily storing.

  For example, even when simultaneous recording cannot be performed, as shown in FIG. 7 (3), when feature data and playlist data are recorded on each recording layer, the feature data signal processing system 23 and the playlist are recorded. Data obtained by the data (chapter data) signal processing system 26 is temporarily stored in the memory system 27 and read at a recordable timing.

  The feature data obtained from the encoding result of the recording method 1 encoding processing system 21 is used as the feature data of the data of the recording method 1, and the feature data obtained from the encoding result of the recording method 2 encoding processing system 22 is used as the feature data of the recording method 2. Instead of using the feature data of the data, as described above, the feature data obtained from one stream and the playlist data obtained from the same are used as the common feature data and playlist of the recording methods 1 and 2 By recording the data in the recording medium 1, it is possible to prevent the consistency between the characteristic data of the recording method 1 data and the characteristic data of the recording method 2 data from being lost.

  In other words, thumbnail display and special playback are performed based on common feature data or playlist data obtained from it, so that the thumbnail image selection position and the playback position during special playback in the stream It is possible to prevent the difference between the case where the data of 1 is targeted and the case where the data of the recording method 2 is targeted, and to prevent the user watching the data from feeling uncomfortable. Can do.

  FIG. 12 shows feature data representing the extracted features by extracting features from the data obtained in the process performed in at least one of the recording method 1 encoding processing system 21 and the recording method 2 encoding processing system 22. Is recorded on the recording medium 1 as characteristic data common to the data of the recording method 1 and the data of the recording method 2. Portions corresponding to those in FIG. 11 are denoted by the same reference numerals.

  For example, data used for feature extraction (data obtained in the process) is an AC coefficient, a DC coefficient, or the like obtained by DCT processing when the MPEG encoding method is used.

  The encoding result by the recording method 1 encoding processing system 21 is used as data used for feature extraction, and feature data representing the extracted feature or special reproduction data such as playlist data obtained therefrom is recorded in the recording method 1, recording method. When the common feature data and special reproduction data of the two streams are used, the encoding result by the recording method 1 encoding processing system 21 is also supplied to the feature data signal processing system 23.

  In the feature data signal processing system 23, feature extraction processing is performed, and the obtained feature data is supplied to the recording method 1 recording signal processing system 24 and the recording method 2 recording signal processing system 25, and a predetermined recording position of the recording medium 1 is obtained. And is also supplied to the playlist data (chapter data) signal processing system 26 as needed. In the playlist data (chapter data) signal processing system 26, a process for generating playlist data and the like based on the feature data obtained by the feature data signal processing system 23 is performed, and the obtained playlist data is recorded in the recording method 1. The signal is supplied to the signal processing system 24 and the recording method 2 recording signal processing system 25, and is recorded at a predetermined recording position.

  As described above, when simultaneous recording cannot be performed on a plurality of recording layers, the feature data (or playlist data (chapter data) signal processing system 26 obtained by the feature data signal processing system 23 is used as necessary. The obtained playlist data and chapter data) are temporarily recorded in the memory system 27, read out at a predetermined timing, and recorded at a predetermined recording position of the recording medium 1.

  In addition, instead of the encoding result by the recording method 1 encoding processing system 21, the encoding result by the recording method 2 encoding processing system 22 is used as data used for feature extraction, and feature data representing the extracted feature or a playlist obtained therefrom When special reproduction data such as data is used as common feature data and special reproduction data for recording method 1 and recording method 2 streams, encoding by the recording method 2 encoding processing system 22 is performed as shown by a dotted line in FIG. The result is also supplied to the feature data signal processing system 23. Thereafter, the same processing as in the case of using the encoding result by the recording method 1 encoding processing system 21 as described above is performed in each system.

  As described above, the feature data obtained from the encoding result of one of the recording methods 1 and 2 (or the data obtained in the process of the encoding process), the playlist data obtained therefrom, and the like are recorded. By making the feature data common to the data 1 and 2, it is possible to prevent loss of consistency between the feature data of the recording method 1 data and the feature data of the recording method 2 data. .

  Here, in the configuration shown in FIG. 11 or FIG. 12, the order of recording data is shown in FIG.

  As shown in FIGS. 13 (1) to (6), the recording layer a → the recording layer b → the recording layer c, the recording layer a → the recording layer c → the recording layer b, and the recording layer b → the recording layer c → the recording layer a. Stream, feature data, etc. can be recorded in the order of recording layer b → recording layer a → recording layer c, recording layer c → recording layer b → recording layer a, recording layer c → recording layer a → recording layer b. .

  Each data may be recorded by three-layer simultaneous recording on the recording layers a, b, and c, or two-layer simultaneous recording on any two layers.

(6) Digest playback and chapter processing using feature data The signal processing related to the following operation outline will be described in detail in the following items in addition to the items here.

  FIGS. 14A to 14G are diagrams for explaining digest playback and chapter processing using feature data. First, digest reproduction using feature data will be described.

(6.1) Digest Playback Using Feature Data Here, it is assumed that there is an image / audio data sequence as shown in FIG. 14A. This video / audio data series is a broadcast program, movie software, or other content, and is read from a predetermined recording medium such as a hard disk (HDD), a magneto-optical disk, or a large-capacity semiconductor memory, and used for reproduction processing. .

For digest playback using feature data,
(A) A method for skip reproduction between feature points (feature positions) (b) A method for reproducing feature point sections (c) A predetermined semantic structure section is assumed based on feature data, and the semantic structure section The method of reproducing based on this is included.

  For example, the method (a) detects the start point and end point of a TV commercial, uses the start point and end point of the main program determined from the detected start point and end point of the TV commercial as feature points, and sets the main program section. Is the only way to play. Considering a TV commercial broadcast in Japan, there is a feature that a silent section can be detected every integer multiple of 15 seconds. For example, the detection of the start and end points of a TV commercial Based on.

  The method (b) is, for example, a method of reproducing a section in which a telop is displayed. In a news program or the like, a telop is often displayed for an important part, so that only a part considered to be important can be reproduced.

  The method (c) is, for example, a method of detecting “a section where the announcer is reading the news” as a semantic structure of the news program and reproducing the section. When the entire news program is viewed, it can be assumed that there are many scenes where the announcer has appeared, and when each image is classified into similar scenes, the scene with the highest appearance frequency (condition 1) Under condition 2), since it is a news program, it is assumed that there is a telop display (condition 3), and by detecting a section that satisfies the three conditions, a semantic structure section "section where the announcer is reading the news" is detected. can do.

  In addition, when such a detection process of a semantic section is considered, it may be considered that all three conditions are not satisfied.

  Therefore, the concept of evaluation value (score) may be used in the detection process. For example, the maximum of the evaluation value (a value representing the degree that satisfies the condition) is 100, and when all the above three conditions are satisfied, the perfect score (100), when only two conditions are satisfied, the evaluation value 70, and when only one condition is satisfied, the evaluation value It is also possible to perform a predetermined evaluation value setting process such as 30 and select a section where the set evaluation value exceeds the threshold as a semantic section and reproduce only that section.

  The method of setting the evaluation value is not limited to this, and each condition may be weighted according to the feature data, and may be set depending on whether or not the condition is satisfied. For example, when the above condition 1 (scene with the highest appearance frequency) is satisfied, the evaluation value 50 is satisfied. When the condition 2 (speaker voice section) is satisfied, the evaluation value 20 and condition 3 (telop display section) are satisfied. The evaluation value 30 may be set to a different evaluation value depending on the condition to be satisfied, and may be selected as a semantic section depending on whether or not the set evaluation value exceeds a threshold value. . When the threshold is set as 80, at least a section satisfying the two conditions of condition 1 and condition 3 is selected as a semantic section.

  FIG. 14B shows an example of a section in which a predetermined meaning is set and divided into a predetermined video structure (semantic video structure) according to a scene change, an audio segment, or the like in the video / audio data sequence of FIG. 14A. .

  Here, as shown in FIG. 14C, a predetermined evaluation value is set for each section of FIG. 14B (for each section such as a section recorded within a predetermined period of time or a predetermined program section). As the evaluation value, a higher evaluation value (evaluation data) is set for a section that is considered to be important in all sections, such as a section including a key frame section.

  In other words, since only the section for which high evaluation data is set is played back, the section includes the key frame section, so that the user can grasp the outline of the program without playing back all the sections. be able to.

  FIG. 14D is a diagram illustrating an example of a playback section based on the evaluation value.

  In this example, each section of the frames f1 to f2, f4 to f5, and f7 to f8 of the video / audio data series shown in FIG. 14A is set to a section where the evaluation value set in the section is equal to or greater than the threshold value Th. In this case, as shown in FIG. 14D, digest playback is realized by skip playback of the sections A1, A2, and A3.

(6.2) Automatic Chapter Processing Using Feature Data FIG. 14E is a diagram illustrating an example of chapter point setting positions.

  For example, as described above, a chapter point is located at the beginning or the vicinity of a predetermined key frame, and the beginning or the vicinity of a section that is not a key frame section that is connected to the end of the section of the key frame (connected last). Is set.

  FIG. 14F is a diagram illustrating an example of a frame in which chapter points are automatically set.

  In the example of FIG. 14F, the chapter frames f1, f4, and f7 are frames at the beginning (or the vicinity thereof) of the key frame sections A1, A2, and A3, respectively, and the f3, f6, and f9 are the key frame sections A1. , A2, A3, and the frame at the head (or the vicinity thereof) of the sections B1, B2, B3 that are not key frame sections.

  Breakpoints set by the so-called automatic chapter setting function of conventional DVD recording / playback devices can be used as a guideline for editing operations, fast forward playback (FF playback), fast forward reverse playback (rewind playback, REW playback) It is used when doing. For example, in the conventional automatic chapter setting function, chapters are set at predetermined time intervals such as 5-minute intervals, 10-minute intervals, 15-minute intervals, and the like. Accordingly, as shown in FIG. 14G, there is a case where the chapter point cannot be set at the start point of the position considered to be a key frame.

  In addition, the conventional DVD recording / reproducing apparatus has a function of setting a chapter point at an arbitrary position desired by the user, such as a manual chapter (manual chapter) process. Since the chapter point is set by actually viewing the program), it is a troublesome operation for the user and is not efficient.

  However, in the chapter point setting process using feature data as in the recording / reproducing apparatus to which the present invention is applied, as shown in FIG. 14E, at the beginning of the key frame section or its vicinity and at the end of the key frame section. The chapter point can be set appropriately and automatically at the beginning of the connected (or last) non-keyframe section or in the vicinity thereof, which is more effective than conventional chapter processing. It is possible to set chapter points (effective for editing and digest playback).

  FIG. 15 is a diagram illustrating a display example of a frame (chapter frame) in which chapter points are automatically set.

  In the example of FIG. 15, chapter images f1, f3, f4, f6, f7, and f9 selected based on the chapter points set at the positions shown in FIG. 14E are displayed as thumbnails at the bottom of the screen. .

  The user views the screen as shown in FIG. 15, for example, cuts out the key frame sections A1, A2, and A3 of FIG. 14D for a broadcast program recorded on a hard disk that is a built-in recording medium of the recording and playback device. The data of the section can be recorded on a disk recording medium such as the recording medium 1, or only a predetermined section following it can be skip-reproduced from the chapter images f1, f4, and f7.

(7) Overall Configuration FIG. 16 is a block diagram showing a configuration example of the entire recording / reproducing apparatus including the configuration on the recording side of FIG. 11 or FIG.

  Here, it is assumed that the video / audio data to be recorded is broadcast program data, and the broadcast program data is subjected to compression processing based on MPEG (Moving Picture Exports Group). Note that wavelet transformation, fractal analysis processing, and the like can be used as other compression processing. For example, in the following description, the DCT coefficient of image data corresponds to an analysis coefficient in multi-resolution analysis in the case of wavelet transform, and the same signal processing may be performed.

  In FIG. 16, one configuration including the audio encoding processing system 44 and the image encoding processing system 49 corresponds to each of the recording method 1 encoding processing system 21 and the recording method 2 encoding processing system 22 in FIG. The system 46 corresponds to the recording method 1 recording signal processing system 24 and the recording method 2 recording signal processing system 25 of FIG. Further, the feature extraction processing system 50 corresponds to the feature data signal processing system 23 of FIG. 11, the memory system 51 corresponds to the memory system 27 of FIG. 11, and the playlist data (chapter data) generation processing system 59 of FIG. This corresponds to the playlist data (chapter data) signal processing system 26. Further, the recording medium 63 (recording medium B) corresponds to the recording medium 1 described above. The recording medium 47 (recording medium A) is, for example, a built-in HDD.

(7.1) Recording-side configuration A predetermined broadcast program is received by the receiving antenna system 41 and the receiving system 42, and the audio signal is A with a predetermined sampling frequency and a predetermined number of quantization bits in the audio A / D conversion processing system 43. The / D conversion process is performed, and the obtained audio data is input to the audio encoding processing system 44.

  In the audio encoding processing system 44, signal processing is performed by a predetermined band compression method such as MPEG audio or AC3 audio (Dolby AC3 or Audio Code number 3).

  Similarly, the image signal of the received broadcast program is A / D converted at a predetermined sampling frequency and a predetermined number of quantization bits in the image A / D conversion processing system 48, and the obtained image data is image encoded. Input to the processing system 49.

  In the image encoding processing system 49, signal processing is performed by a predetermined band compression method such as MPEG video or wavelet transform.

  In order to perform feature extraction of an audio signal, a part of a signal input from the audio A / D conversion processing system 43 to the audio encoding processing system 44 or a signal obtained in the process of encoding processing by the audio encoding processing system 44 Are appropriately input to the feature extraction processing system 50.

  Similarly, in order to perform feature extraction of the image signal, a part of the signal input from the image A / D conversion processing system 48 to the image encoding processing system 49 or obtained in the process of encoding processing by the image encoding processing system 49 is obtained. A part of the signal is also appropriately input to the feature extraction processing system 50.

  In the feature extraction processing system 50, for example, feature data is sequentially extracted for each predetermined section when a broadcast program is recorded. The extracted feature data is recorded in a predetermined recording area of the recording medium A together with image / audio data subjected to a predetermined encoding process. The feature data generated by the feature extraction processing system 50 is supplied to the playlist data (chapter data) generation processing system 59 via the system controller system 60 as appropriate.

  In the play list data (chapter data) generation processing system 59, play list data or chapter data for performing digest reproduction is generated from the feature data.

  Here, the playlist data and chapter data generation signal processing process (signal processing process) performed by the playlist data (chapter data) generation processing system 59 will be described. The following can be considered for the signal processing process.

  (A) After feature data is accumulated in a predetermined amount in the memory area of the memory system 51 or the system controller system 60, playlist data and chapter data generation processing is performed based on the accumulated feature data.

  (B) Each time the feature extraction processing is performed, the feature data obtained thereby is sequentially recorded on the recording medium A together with the image and sound data, and after recording a predetermined amount, the feature data recorded on the recording medium A Is reproduced (reproduced), and playlist data and chapter data generation processing is performed based on the read feature data.

  In the case of (a), for example, when recording a broadcast program at a predetermined time t, all the characteristic data of the broadcast program is accumulated when time t has elapsed since the start of recording the broadcast program. At this time, it is possible to perform play list data generation processing for determining where the key frame corresponding to the digest playback time td will be in time t. That is, the feature data obtained at time t is stored in the memory area of the memory system 51 or the system controller system 60.

  On the other hand, in the case of (b), as in the case of (a), the characteristic data is recorded on the recording medium A from the start of recording of the broadcast program until the time t elapses, and the time t elapses. When it is detected that the feature data has been recorded on the recording medium A so far, the playlist data generation process corresponding to the digest playback time td is started.

  When the playlist data generation process is completed, preparation for digest playback is completed.

  The playlist data generated as described above is supplied to the recording processing system 46, subjected to predetermined processing, and then recorded in a predetermined recording area of the recording medium A.

  Here, as described with reference to FIG. 6, the playlist data is, for example, data of a pair of a reproduction start frame number and a reproduction end frame number for each section. The playlist data is used to realize digest playback by skipping only a predetermined section of the entire recorded image / audio data (program). In addition, it may be represented by a time code or a time stamp such as PTS (Presentation Time Stamp) or DTS (Decode Time Stamp) in MPEG.

(7.2) Playback Side Configuration (7.2.1) Normal Playback Mode Operation First, the operation when the normal playback mode is set will be described. When the mode of the recording / playback apparatus is set as the normal playback mode by the output from the user input I / F system 61, for example, predetermined image / audio data, feature data, etc. are read from the recording medium A, and the playback processing system The predetermined reproduction process is performed. Data obtained by the reproduction process is output to the reproduction data separation processing system 53.

  In the reproduction data separation processing system 53, a process of separating the image / audio data into image data and sound data is performed. The sound data obtained by the process is sent to the sound decoding processing system 54, and the image data is sent to the image decoding processing system 56. Are output respectively.

  In the audio decoding processing system 54, a predetermined decoding process corresponding to the signal processing method subjected to the band compression processing at the time of recording is performed on the audio data supplied from the reproduction data separation processing system 53, and the decoding result is processed. Thus, the audio signal obtained by performing the D / A conversion processing in the audio D / A conversion processing system 55 is output to the outside.

  Similarly, in the image decoding processing system 56, predetermined decoding processing corresponding to the signal processing method subjected to band compression processing at the time of recording is performed on the image data supplied from the reproduction data separation processing system 53. An image signal obtained by performing D / A conversion processing on the result in the image D / A conversion processing system 57 is output to the outside.

(7.2.2) Digest playback mode and chapter mode In the digest playback mode and chapter mode, the signal processing method depends on whether the feature data, playlist data, and chapter data are recorded on the recording medium along with the image / audio data. Different. Whether the feature data and the playlist data are recorded on the recording medium can be organized as shown in FIG.

(7.2.2.1) When Playlist Data and Chapter Data are Recorded Corresponding to the cases of FIGS. 8A and 8B, the playlist data and chapter data are recorded on the recording medium A and the recording medium B. These data can be used to perform digest playback in the digest playback mode and thumbnail display of chapter images in the chapter display mode.

  For example, when a command instructing to perform an operation in the digest playback mode is supplied from the user input I / F system 61 to the system controller system 60 in accordance with a user operation, feature data, playlist data, chapter data, etc. Are recorded on the recording medium A together with the image / audio data to be reproduced, these data are separated by the reproduction data separation processing system 53, and the separated feature data, playlist data, and chapter data are stored in the system controller system 60. Is input.

  In the system controller system 60, the reproduction processing system 52 and the like are controlled, and the digest reproduction is realized by performing the skip reproduction based on the playlist data. Further, based on the chapter data, processing is performed to display an image at or near a chapter point as a thumbnail image by the display processing system 65, thereby realizing display of the thumbnail image.

  If the reproduction data separation processing system 53 cannot separate the feature data, playlist data, and chapter data, the respective data are not input to the system controller system 60. Therefore, the reproduction data separation processing system 53 and the system The controller system 60 has a function of determining whether or not feature data, playlist data, chapter data, and the like are recorded on the recording medium A.

(7.2.2.2) When playlist data and chapter data are not recorded Corresponding to the cases of FIGS. 8C and 8D, the playlist data and chapter data are the recording medium A or the recording medium. In this state, the audio / video data recorded on the recording media A and B cannot be digest-reproduced in the digest reproduction mode, and the thumbnail image cannot be recorded in the chapter mode. A series of chapter related processes such as display and chapter reproduction (reproduction for a predetermined time with reference to the position of the chapter image) cannot be performed.

  In this state, video / audio data obtained by receiving a broadcast program or the like is not an object to be reproduced. For example, the recording medium B is DVD software such as a movie sold as a package, and is reproduced. It may also occur when reproducing image / audio data from which features are not extracted.

  If playlist data or chapter data has not been generated and cannot be played back, playlist data and chapter data are generated, and the above-described digest data is used to generate the digest data. Playback processing and chapter related processing are performed. The generated playlist data and chapter data are appropriately recorded on the same recording medium as the image / audio data.

  Similarly, when it is desired to regenerate the reproduced playlist data and the chapter data, digest data for the digest reproduction and chapter data for the chapter related processing are generated from the reproduced characteristic data.

(7.2.2.2.1) When Feature Data is Recorded Corresponding to the case of FIG. 8C, only feature extraction processing is performed when recording image / audio data (playlist data, When the feature data can be reproduced), the feature data is reproduced from the reproduction processing system 52 or from the reproduction data separation processing system 53. When the feature data can be reproduced, the playlist data (chapter) generation processing system is used. 59, the playlist data (chapter data) generation processing system 59 generates playlist data or chapter data.

  As described above, when only the feature data can be reproduced, when the user designates the digest reproduction mode, the display processing system 65 displays a message indicating that there is no playlist data or chapter data as shown in FIG. 17A. You may be made to do. Further, when playlist data or chapter data is generated, a message as shown in FIG. 17B may be displayed by the display processing system 65.

  The generated playlist data is input to the system controller system 60, and the playback control system 58 is controlled to skip playback of a predetermined section based on playlist data corresponding to a predetermined digest playback time by a user operation. This is performed by the controller system 60, and data is reproduced from the recording medium A by the reproduction control system 58.

  Also, the generated chapter data is input to the system controller system 60, and in accordance with a predetermined chapter-related operation mode by a user operation, thumbnail display of an image in which a predetermined chapter point based on chapter data is set, and chapter point cut is performed. Control for the playback control system 58 and control for the display processing system 65 so as to perform predetermined chapter-related operations such as editing processing such as and connection, skip playback of chapter points selected by the user, etc. Is done.

  For example, when the audio / video data recorded on the recording medium B is digest-reproduced, the same processing as described above is performed, and the reproduction control system 58 controls the reproduction of the data from the recording medium B. Digest playback processing is realized. Also, when performing chapter-related operations such as editing processing (editing operation) using chapter data, skip playback between chapter points (or the vicinity thereof), and display of thumbnail images at chapter points (or the vicinity thereof), The same processing as that described above is performed, and the reproduction control system 58 controls the reproduction of data from the recording medium B, thereby realizing the chapter related operations.

(7.2.2.2.2) Case where feature data is not recorded This corresponds to the case of FIG. In the above example, the case where playlist data and chapter data are generated from feature data has been described. For example, a case where image / audio data recorded on the recording medium B by another user is copied to the recording medium A is used. Considering this, it is possible to assume that the image / sound data can be reproduced from the recording medium A, but the characteristic data cannot be reproduced.

  As described above, when the video / audio data such as the broadcast program is recorded on the recording medium A but the characteristic data is not recorded and cannot be reproduced, the user can enter the digest reproduction mode or the chapter related operation mode. When instructed, the display processing system 65 may display a message indicating that there is no feature data, as shown in FIG. 18A.

  In this state, when the audio / video data recorded on the recording medium A is reproduced in the digest reproduction mode, the data reproduced by the reproduction processing system 52 is input to the reproduction data separation processing system 53, and the reproduction data separation processing system 53. The image data and audio data separated by the above are input to the feature extraction processing system 50. In the feature extraction processing system 50, processing for detecting DCT DC coefficients, AC coefficients, motion vectors (motion vectors), etc., which are image feature data, processing for detecting speech power, which is speech feature data, and the like are performed. .

  Further, in the feature extraction processing system 50, telop feature data (telop section determination data), person feature data, other image feature data (image feature section determination data), based on various types of image / sound feature data as described above, Further, extraction processing of speaker voice feature data (speaker voice determination data), applause cheer feature data (applause cheer determination data), and other voice feature data (speech feature section determination data) is performed as necessary.

  Various image feature data and audio feature data acquired by the feature extraction processing system 50 are sequentially input to the system controller system 60. When the feature extraction processing is performed by the feature extraction processing system 50 for a predetermined program or all of a predetermined image / audio section, it is determined that the feature extraction processing is completed.

  Here, when the feature extraction processing is being performed, a signal indicating that is input from the system controller system 60 to the display processing system 65, and a message as shown in FIG. 18B is displayed by the display processing system 65, for example. You may do it. Similarly, when the feature extraction process ends, for example, a message as shown in FIG. 18C may be displayed by the display processing system 65.

  Next, processing for generating playlist data and chapter data from the feature data acquired as described above will be described.

  For example, feature data extracted by the feature extraction processing system 50 is temporarily stored in the memory system 51 for each data extracted from a predetermined target section, and feature data extraction for all sections is performed. When the processing is completed, the data is input to the play list data (chapter data) generation processing system 59, and based on the input, play list data or chapter data is generated.

  Here, the feature data extracted from the predetermined section may be sequentially input from the feature extraction processing system 50 directly to the playlist data (chapter data) generation processing system 59. As described above, Generation of playlist data or chapter data in a playlist data (chapter data) generation processing system 59 by a signal from the system controller system 60 output when extraction of feature data for all sections is completed. May be started. The feature data extracted by the feature extraction processing system 50 may be input to the playlist data (chapter data) generation processing system 59 via the system controller system 60.

  When the playlist data (chapter data) generation processing system 59 finishes generating playlist data or chapter data, a signal indicating this is input from the playlist data (chapter data) generation processing system 59 to the system controller system 60. Then, digest playback according to the time requested by the user and chapter-related operations requested by the user are performed.

  When the generation of playlist data or chapter data is completed, the display as shown in FIG. 17B is performed, or the process is performed based on the generated playlist data or chapter data. A message indicating that the mode is the digest playback mode or the chapter related operation mode may be displayed by the display processing system 65.

  When the user performs digest playback, for example, if the recorded broadcast program is one hour, whether the user wants to summarize and play it back in 30 minutes or 20 minutes or so, the user desires Since the digest playback time is not known, playlist data corresponding to several types of summary times is generated in advance according to the total time length of all sections extracted from the characteristics of image and sound data such as recorded broadcast programs. It can also be done.

  Specifically, if the recording time of a broadcast program is 1 hour, each playlist data used when performing digest playback for 40 minutes, 30 minutes, and 20 minutes is generated. As described above, by generating a plurality of types of playlist data, when a time is selected by a user input to the remote control 62 (remote controller 62) or the like, the selected time can be immediately handled. The digest playback operation can be performed.

  When reproducing the image / audio data recorded on the recording medium B, the recording medium B is detected by the recording medium processing system 64, and reproduction of the detected image / audio data recorded on the recording medium B is performed by the reproduction processing system 52. Is done. In the reproduction data separation processing system 53, processing for separating image data and audio data from data reproduced by the reproduction processing system 52 is performed. The subsequent processing is the same as that in the case of reproducing the image / sound data recorded on the recording medium A as described above, and a detailed description thereof will be omitted.

(8) Other Overall Configuration Example FIG. 19 is a block diagram showing another configuration example of the recording / reproducing apparatus. The same parts as those in FIG. 16 are denoted by the same reference numerals. The overlapping description will be omitted as appropriate.

(8.1) Recording-side Configuration The recording / playback apparatus shown in FIG. 19 is characterized in that the feature data extraction processing at the time of data recording and the playlist data and chapter data generation processing are performed by the system controller system 60 in software. Different from the recording / reproducing apparatus of FIG.

  19, the software downloaded via the network system 72 such as the Internet is executed by the system controller system 60, and feature extraction processing, playlist data, and chapter data generation processing are appropriately performed. Is called.

  By allowing the software to be downloaded, for example, when there is a device that is not equipped with a function that implements feature extraction processing, playlist data, chapter data generation processing, There is an advantage that such a function can be added later. As a result, on the design and manufacturing side, due to time issues such as manufacturing and sales, when it is not possible to install the function for generating the feature extraction processing, playlist data, chapter data generation processing, etc. After providing a system (recording / reproducing apparatus) with a simple configuration that does not include such functions, those functions can be added and provided to the user.

  On the other hand, on the user side, after purchasing a system with a simple configuration that does not include such a function, the function can be added by software processing. In addition, when modifying or improving each processing system, it is possible to cope with it by downloading (upgrading) software.

  When downloading such software, the user operates the remote controller 62 or the like to connect to a site on the Internet via the network system 72 and perform it. The downloaded software is acquired by being decompressed by the system controller system 60, and the function is added by installing the software.

  By using a microprocessor (MPU or CPU) having a predetermined performance constituting the system controller system 60 and executing software on the microprocessor (MPU or CPU), the above-described predetermined feature extraction processing or the like can be performed. You can make it happen at the same time. As the memory system 51, a built-in data storage memory constituting the system controller system 60 may be used.

  In addition, when performing band compression of a predetermined method as recording processing, it may be possible to cause it to be performed by an MPU, CPU, or DSP (Digital Signal Processor) having predetermined performance, and this band compression processing is performed. Feature extraction processing, playlist data, chapter data generation processing, and the like may be performed by the same MPU, CPU, or DSP.

(8.2) Reproduction-side configuration Since it is the same as the case of FIG. 16 described above, the details of the processing performed by the reproduction-side configuration are omitted. Unlike the configuration example of FIG. 16, when feature data cannot be detected in the playback mode and it is necessary to perform feature extraction processing, the series of feature extraction processing is performed by software in the system controller system 60. Is to do.

  For example, similar to the processing at the time of recording, the processing at the time of playback is also performed by software in the MPU, CPU, etc. constituting the system controller system 60, so that feature extraction processing at the time of playback, playlist data, chapters, etc. Data generation processing can be performed simultaneously with reproduction processing.

(9) Feature Extraction Processing Next, details of the voice system feature extraction processing and the image system feature extraction processing will be described.
(9.1) Speech Feature Extraction Processing (9.1.1) Silence Feature Extraction Processing FIG. 20 is a block diagram illustrating an example of a configuration for performing speech feature extraction.

  In FIG. 20, the audio / video data (stream data) compressed by the MPEG method is input to the stream separation system 100, and the audio data separated by the stream separation system 100 is input to the audio data decoding system 101, and predetermined decoding is performed. Processing is performed.

The decoded audio data (audio signal) is input to the level processing system 102, the data counter system 103, and the data buffer system 104, respectively. In the level processing system 102, in order to calculate the average power (or average level) P _av of a predetermined section of the audio data, data absolute value processing is performed, and the data counter system 103 measures data of a predetermined number of samples. Until this is done, integration processing is performed in the audio data integration processing system 105.

Here, P _av is obtained by the following equation (1) with the value (level) of the audio data as Ad (n) (n represents the position of the section for which the average is obtained).

As the predetermined interval for calculating the average level, for example, about 0.01 sec (10 msec) to 1 sec is conceivable. When the sampling frequency F _{s is set} to F _s = 48 KHz, integration calculation of 480 to 48000 samples is performed, and the number of samples S _An average process is performed at _m , and an average level (average power) P _av is obtained.

The average level P _av output from the sound data integration processing system 105 is input to the determination processing system 106 and compared with the threshold value Ath set by the threshold value setting system 107, and the average level P _av is obtained. A process for determining whether or not the obtained section is a silent section is performed.

  Here, in setting the threshold value Ath by the threshold value setting system 107, it is conceivable that Ath is set as a fixed value Ath0. However, in addition to the fixed value Ath0, it varies depending on the average level of the voice section. It is also conceivable to set the threshold value Athm.

As the fluctuation threshold value Athm, for example, an interval in which processing is considered is n, and an average level P _av (n−k) in an interval (n−k) before that is considered, and expressed by the following equation (2). It is conceivable to use a value to be determined.

  For example, when t = 2, the fluctuation threshold value Athm is expressed by the following equation (3):

ｍは、おおよそ、２０〜２くらいの範囲から設定することが考えられる。

It is conceivable that m is set from a range of approximately 20 to 2.

(9.1.2) Other Audio Feature Extraction Processing The audio data accumulated in the data buffer system 104 is input to the frequency analysis processing system 108, and a predetermined frequency analysis processing is performed by the frequency analysis processing system 108.

  Here, FFT (Fast Fourier Transform) or the like can be considered as the frequency analysis processing, and the number of analysis sample data of the data from the data buffer system 104 is, for example, a predetermined power of 2 such as 512, 1024, 2048, and the like. It is a number.

  Data representing an analysis result by the frequency analysis processing system 108 is input to the determination processing system 109, and a predetermined determination process is performed by the determination processing system 109.

  Whether or not the section to be determined is a music (musical sound) section can be determined based on, for example, the continuity of a spectrum peak in a predetermined frequency band. This determination is disclosed in, for example, Japanese Patent Application Laid-Open No. 2002-116784.

  Whether or not the section to be discriminated is a speaker voice section, because there is a breathing section in the human speech voice waveform, a sharp rising or falling section is seen in the waveform, its rising, Alternatively, it can be determined by detecting a falling section. In this case, the music signal waveform is generally considered to have a lower probability of appearance of the rising or falling edge of the waveform than the signal waveform of the speaker voice. In consideration, the attribute determination of the audio signal may be performed comprehensively.

  Further, when the attribute determination of the voice signal is performed based on the difference between the waveform characteristics (waveform characteristics) of the speaker voice signal and the waveform characteristics of the music signal, the temporal physical characteristics in the waveform are detected. In addition to a method of performing a determination process after performing a frequency analysis (signal analysis and determination process in the frequency domain), a method of performing a determination process in the baseband domain (signal analysis and determination process in the time domain) is also conceivable. .

  FIG. 21 is a diagram illustrating a configuration example in the case of performing attribute analysis of a signal while the audio signal (audio data) is compressed without being subjected to decoding processing. The same parts as those in FIG. 20 are denoted by the same reference numerals.

  Video / audio data compressed by the MPEG method is input to the stream separation system 100, and the video / audio data is separated into image data and audio data by the stream separation system 100. The separated audio data is input to the stream data analysis system 110, subjected to signal analysis processing at a predetermined sampling frequency and the number of quantization bits, and the obtained audio data is input to the subband analysis processing system 111.

  In the subband analysis processing system 111, subband analysis processing is performed, and predetermined signal processing similar to that expressed by the above equations (1) to (3) is performed on data in a predetermined subband band.

  That is, the result of the subband analysis processing by the subband analysis processing system 111 is input to the audio data integration processing system 105, and the predetermined integration processing is performed until the data counter system 103 detects a predetermined number of sampling data. This is performed by the data integration processing system 105. After that, the determination processing system 106 performs a process of determining whether or not the current determination target section is a silent section based on a predetermined threshold set by the threshold setting system 107. .

  In the silence determination processing here, it is conceivable to use data in a subband band of approximately 3 KHz or less, which is a band in which a large amount of energy is collected in consideration of the spectrum of the audio data.

  In addition, although it has been described that the determination processing of the musical sound and the speaker voice is performed by frequency analysis, according to the configuration of FIG. 21, it is considered that the frequency analysis is performed by the subband analysis system 111. The attribute determination may be performed by a continuity determination process of a predetermined spectrum peak. In this case, the spectrum peak can be considered as the maximum data band in each subband band, and it is considered that the same signal processing as in the FFT analysis processing can be performed.

(9.2) Image System Feature Processing Next, image system feature extraction processing will be described. FIG. 22 is a block diagram illustrating an example of a configuration for performing feature extraction of an image system.

  In FIG. 22, for example, image data obtained by performing a predetermined separation process in a stream separation system (not shown) is input to the stream data analysis system 200, and predetermined data such as rate detection and pixel number detection are input. Data analysis is performed, and the analysis result is output to the DCT coefficient processing system 201.

  In the DCT coefficient processing system 201, predetermined DCT calculation processing (inverse DCT calculation processing) such as DCT detection of DCT and AC coefficient detection is performed, and image feature extraction is performed by each subsequent processing system based on the processing result. Processing is performed.

(9.2.1) Scene Change Feature In the scene change detection processing system 202, for example, an image of one frame is divided into a predetermined number of areas, and Y (luminance data) of DC coefficient data of DCT is divided into each area. , Cb, Cr (color difference data) are calculated. Further, based on the calculated average value, an inter-frame difference calculation or an inter-field difference calculation is performed, and a scene change is detected by comparing with a predetermined threshold value.

  When there is no scene change, the difference data between frames (or fields) in each area is smaller than a predetermined threshold value, and when there is a scene change, the difference data becomes larger than the threshold value. Can be detected.

  Here, the division number of one frame can be set to 36 divisions as shown in FIG. 23, for example. The method for dividing the frame area is not limited to that shown in FIG. 23, and it is conceivable to increase or decrease the number of divisions. However, if the number is too small, the accuracy of scene change detection becomes insensitive. Since it may be too sharp, it is conceivable to set an appropriate number of divisions in the range of about 4 to 400.

(9.2.2) Color characteristics
The color feature can be detected by the color feature detection processing system 203 from the average value of Y, Cb, and Cr data in a predetermined region of the DC coefficient of DCT. As the predetermined area, for example, an area as shown in FIG. 24 can be considered.

  For example, when the genre of the broadcast program is “sumo”, if a region including brown can be detected from the region of FIG. 24, it can be assumed that the scene has a high probability of “soil scene”.

  When such a color feature is combined with, for example, a cheering feature of voice, the scene that is currently focused on from the “soil scene” + “cheers scene” has a high probability of “the scene where the effort starts” Therefore, such a scene section is set as a key frame section.

(9.2.3) Similar Scene Features This is a process by the similar image detection processing system 204 that detects similar images (scenes) and assigns (adds or adds) the same ID to similar scenes. Details thereof are disclosed in, for example, Japanese Patent Application Laid-Open No. 2002-344872.

  In this process, for example, one frame is divided into a plurality of areas (for example, 25 areas), and an average DC coefficient of DCT of each divided area is obtained. Further, when the obtained average DC coefficient is a vector component and the vector distance between scenes is smaller than a predetermined threshold, those scenes are determined as similar scenes, and the scenes determined as similar scenes are determined. The same ID is assigned.

  The initial value of the assigned ID is, for example, 1. If a scene with a vector distance smaller than the above-mentioned predetermined threshold is not detected, a new ID is obtained by adding 1 to the maximum value of the ID. Assigned to.

(9.2.4) Telop Feature In the telop detection determination processing system 206, for example, an average value of AC coefficients of DCT in each region as shown in FIG. 24 is obtained. A telop including character information of a predetermined size or more has a relatively clear outline, and when a telop appears in any of the areas shown in FIG. 24, an AC coefficient equal to or greater than a predetermined threshold is set. The telop is detected by this.

  As described above, in addition to the method of detecting the AC coefficient of DCT, a method of detecting an edge in the baseband domain (time domain signal) is also conceivable. For example, an edge is detected based on a difference between frames of luminance data of an image. It is also possible. Similarly to the case where the AC coefficient is used by performing multi-resolution analysis by wavelet transform and calculating the average value of the area using data in a predetermined multi-resolution area including predetermined high-frequency component data. It is also possible to perform the process.

  In addition, in FIG. 22, a specific color (for example, skin color) is detected by the specific color determination processing system 205, and a person is detected by detecting a face.

  The feature data obtained by each system of FIGS. 20 to 22 as described above is supplied to the outside (for example, the playlist data (chapter data) generation processing system 59 of FIG. 16), and the playlist data and chapter data Used for generation.

(10) Embodiment in which Large Capacity Recording Medium and Other Recording Medium Can Be Used Together This embodiment is an example of recording medium A corresponding to “large capacity recording medium” in the recording / reproducing apparatus shown in FIG. This corresponds to an operation mode such as a copy recording process of data to the recording medium B corresponding to “another recording medium” or an edit recording process.

  Here, for example, as described above, the recording medium B corresponds to a plurality of recording methods, and includes a plurality of recording layers serving as recording destinations of data of the respective recording methods. It is a removable optical disk. As described above, an optical disc (recording medium) having a recording capacity smaller than that of the HDD, which is detachable from the recording / reproducing apparatus, such as video / audio data recorded on a recording medium having a large recording capacity, such as an HDD (recording medium A) It is conceivable as a usage method of the user that the data is directly copied to a predetermined recording layer corresponding to the recording method or recording rate of B) (copy recording process) or the edited one is recorded (edit recording process).

  Such copy recording processing, editing recording processing, and the like are performed automatically based on, for example, the operation mode of the recording / reproducing apparatus or in response to a manual operation by the user.

  Here, the recording medium A in FIG. 16 or FIG. 19 includes two types of video / audio data of a recording method 1 (normal DVD method) and a recording method 2 (BD or HD-DVD method), and the image / audio data. It is assumed that the obtained characteristic data and special reproduction data (playlist data, chapter data) are recorded.

  The copy recording process (copy operation mode) will be described below. For example, when the mode of the recording / reproducing apparatus is changed to the copy operation mode in accordance with the user's operation, first, the recording method that can be recorded on the recording medium B, which is a data copy destination, mounted in the recording / reproducing apparatus is determined. Is called.

(10.1) Determination Method of Recordable Recording Method In the recording / reproducing apparatus, data recording on the recording medium B in the recording method 1 and the recording method 2 is performed by a signal processing system as shown in FIG. In addition, reproduction of data recorded on the recording medium B by the recording method 1 and the recording method 2 is performed by a signal processing system as shown in FIG. 3 corresponds to the signal processing system on the recording side in the recording / reproducing apparatus of FIG. 16 or FIG. 19, and the signal processing system in FIG. 5 corresponds to the reproducing side in the recording / reproducing apparatus of FIG. It corresponds to the signal processing system.

  Confirmation of which recording method the recording medium B is compatible with is, for example, recording test data for the recording method 1 and recording method 2 on the corresponding layers of the recording medium B, and then in the playback mode. This is performed by determining whether or not the test data recorded immediately before can be normally reproduced.

  Further, whether or not the test data can be normally reproduced is determined at this time by detecting an error rate or by providing an error correction signal (not shown) provided as a reproduction signal processing system. This is automatically performed when an ECC flag ((Error-Correcting Code) flag) or the like is detected by the processing system. Specifically, an ECC flag signal is input from the reproduction processing system 52 of FIG. 16 or FIG. 19 to the system controller system 60, and the number of flags measured within a predetermined time in the system controller system 60 is a predetermined threshold value. It is automatically determined by comparing.

  When a physical identification ID is set for the recording medium B, the identification ID is detected, and based on the identification ID, it is confirmed which recording method the recording medium B corresponds to. It may be. In this case, for example, an identification ID and a recording method correspondence table are prepared in the recording / reproducing apparatus.

(10.2) Recording Method FIG. 25 is a diagram showing an example of a combination of data recording status of the recording medium A and recording methods that can be recorded on the recording medium B. Recording operations such as data copy recording processing and editing recording processing are performed according to the combinations shown in FIG.

  In FIG. 25 (1), data of recording method 1 and recording method 2 are recorded on recording medium A, and recording medium B corresponds to both recording methods of recording method 1 and recording method 2. The combination of cases is shown. FIG. 25 (2) shows a combination in the case where data of recording method 1 and recording method 2 are recorded on recording medium A, and recording medium B corresponds to only recording method 1. Further, FIG. 25 (3) shows a combination in the case where data of the recording method 1 and the recording method 2 is recorded on the recording medium A, and the recording medium B corresponds to only the recording method 2.

  Similarly, in FIG. 25 (4), only the recording method 1 data is recorded on the recording medium A, and the recording medium B corresponds to both the recording method 1 and the recording method 2. The combination of cases is shown. FIG. 25 (5) shows a combination in the case where only data of the recording method 1 is recorded on the recording medium A and the recording medium B corresponds to only the recording method 1. Further, FIG. 25 (6) shows a combination in the case where only the data of the recording method 1 is recorded on the recording medium A and the recording medium B corresponds to the recording method 2.

  FIG. 25 (7) shows a combination in which only the recording method 2 data is recorded on the recording medium A, and the recording medium B is compatible with both the recording methods 1 and 2. Indicates. FIG. 25 (8) shows a combination when only the recording method 2 data is recorded on the recording medium A and the recording medium B corresponds to only the recording method 1. Further, FIG. 25 (9) shows a combination in the case where only data of the recording method 2 is recorded on the recording medium A, and the recording medium B corresponds to only the recording method 2.

  In the above description, the process of copying data from the recording medium A to the recording medium B has been described. However, the reverse process, that is, the process of copying data from the recording medium B to the recording medium A is also performed in the recording / reproducing apparatus. The same is done. The recording medium B has been described as a disk-shaped recording medium that can be attached to and detached from a tray provided in the recording / reproducing apparatus. However, the recording medium B is not limited to this, and data recorded on the recording medium A can be used as a predetermined cable or the like. When recording to an external recording medium such as a USB (Universal Serial Bus) connected recording medium, IEEE (Institute of Electrical and Electronics Engineers) 1394 connected recording medium connected to the recording / playback device via The same applies when data is recorded on the recording medium A from the external recording medium.

  Next, the operation in the state of each combination shown in FIG. 25 will be described in detail.

(10.2.1) When data of both recording method 1 and recording method 2 are recorded on the recording medium A In the case of FIG. 25 (1):
This is because the system controller system 60 determines that the recording medium B is compatible with both the recording methods 1 and 2, and the audio / video data recorded on the recording medium A is recorded as the recording method. 1 is a combination in the case of recording on the recording medium B by both recording methods.

  For example, as described above, after the recording method that can be recorded on the recording medium B is automatically determined, the video / audio data of the recording method 2 having a higher transmission rate than the data of the recording method 1 is transferred from the recording medium A. Is reproduced by the reproduction processing system 52, subjected to a predetermined recording process in the recording processing system 46, and then recorded on the recording method two layers of the recording medium B through the recording medium processing system 64.

  Similarly, after the recording / processing system 52 reproduces the image / audio data of the recording method 1 and performs a predetermined recording process in the recording processing system 46, the recording method 1 of the recording medium B is passed through the recording medium processing system 64. Recorded on the layer.

  During such recording, characteristic data, special reproduction data, and the like are also read from the recording medium A and recorded in a predetermined recording layer and recording area as described with reference to FIGS. .

In the case of FIG. 25 (2):
This is because the system controller system 60 determines that the recording medium B is compatible only with the recording system 1 (normally the DVD system), and the audio / video data recorded on the recording medium A is recorded with the recording system 1. This is a combination when recording on the medium B.

  The audio / video data of the recording method 1 is reproduced by the reproduction processing system 52, subjected to a predetermined recording process in the recording processing system 46, and then recorded on the recording method 1 layer of the recording medium B via the recording medium processing system 64. Is done.

  Also in this recording mode, characteristic data, special reproduction data, etc. are read from the recording medium A and recorded in a predetermined recording layer and recording area as described with reference to FIGS. However, for example, in the case of FIG. 25 (2), those data are recorded in only one recording method layer or in another predetermined recording area.

In the case of FIG. 25 (3):
This is because the system controller system 60 determines that the recording medium B is compatible only with the recording system 2 (BD system or HD-DVD system), and the audio / video data recorded on the recording medium A is recorded. This is a combination when recording on the recording medium B by the method 2.

  The recording system 2 video / audio data having a higher transmission rate than the recording system 1 data is reproduced from the recording medium A by the reproduction processing system 52 and subjected to a predetermined recording process in the recording processing system 46. Recording is performed on the recording system B of the recording medium B via the processing system 64.

  In this recording mode, characteristic data, special reproduction data, and the like are read from the recording medium A and recorded in a predetermined recording layer and recording area as described with reference to FIGS. For example, in the case of FIG. 25 (3), those data are recorded only in the recording system 2 layers or in another predetermined recording area.

(10.2.2) When only recording method 1 data is recorded on the recording medium A In the case of FIG. 25 (4):
This is because the system controller system 60 determines that the recording medium B is compatible with both the recording methods 1 and 2, and the audio / video data recorded on the recording medium A is recorded as the recording method. 1 is a combination in the case of recording on the recording medium B by both recording methods.

  In this case, since only the recording method 1 (normal DVD method) image / audio data is recorded on the recording medium A and there is no recording method 2 image / audio data having a high transmission rate, the recording method 1 image / audio data is recorded. By performing up-conversion processing on the image, processing for generating image / sound data of the recording method 2 is performed. This is considered to be conversion processing from MP @ ML to MP @ HL in the MPEG system as shown in FIG.

  MPEG attributes such as the profile, level, and image size ratio (aspect ratio) shown in FIG. 26 can be confirmed by detecting predetermined bit data arranged in the image / audio data. In the recording / reproducing apparatus of FIG. 16 or FIG. 19, confirmation is made by the system controller system 60 based on signals from the reproduction processing system 52, the audio decoding processing system 54, or the image decoding processing system 56.

  The image / audio data of the recording method 1 is reproduced by the reproduction processing system 52, and the reproduced image / audio data is input to the recording processing system 46. In the recording processing system 46, up-conversion processing is performed, and recording of the recording method 2 image / audio data obtained by the up-conversion processing is performed via the recording medium processing system 64. As the recording destination.

  For the up-conversion process, a method of decoding the recording method 1 image / audio data as a reproduction signal and re-encoding the recording method 2 can be considered. It is conceivable to carry out by other methods such as predetermined transmission rate conversion, image size conversion (conversion from 4 to 3 to 16 to 9), other conversion processing, etc. without decoding all. .

  In addition, when the video / audio data of the recording method 1 is considered as simple data, for example, when recording in the recording method B layer of the recording medium B as MP @ ML, the above up-conversion processing, image size conversion processing, etc. are performed. Instead, the read data may be recorded as it is.

  On the other hand, for recording of the image / audio data of the recording method 1, the image / audio data is reproduced by the reproduction processing system 52, subjected to a predetermined recording process in the recording processing system 46, and then passed through the recording medium processing system 64. The recording method is recorded on one layer of the recording medium B.

  Also in this recording mode, characteristic data, special reproduction data, and the like are read from the recording medium A and recorded in a predetermined recording layer and recording area as described with reference to FIGS.

In the case of FIG. 25 (5):
This is because the system controller system 60 determines that the recording medium B is compatible only with the recording system 1 (normally the DVD system), and the audio / video data recorded on the recording medium A is recorded with the recording system 1. This is a combination when recording on the medium B.

  The audio / video data of the recording method 1 is reproduced by the reproduction processing system 52, subjected to a predetermined recording process in the recording processing system 46, and then recorded on the recording method 1 layer of the recording medium B via the recording medium processing system 64. Is done.

  Also in this recording mode, characteristic data, special reproduction data, etc. are read from the recording medium A and recorded in a predetermined recording layer and recording area as described with reference to FIGS. However, for example, in the case of FIG. 25 (5), those data are recorded only in one recording system layer or in another predetermined recording area.

In the case of FIG. 25 (6):
This is because the system controller system 60 determines that the recording medium B is compatible only with the recording system 2 (BD system or HD-DVD system), and the audio / video data recorded on the recording medium A is recorded. This is a combination when recording on the recording medium B by the method 2.

  In this case, since only the recording method 1 (normal DVD method) image / audio data is recorded on the recording medium A and there is no recording method 2 image / audio data having a high transmission rate, the recording method 1 image / audio data is recorded. By performing up-conversion processing on the image, processing for generating image / sound data of the recording method 2 is performed. That is, the same processing as that described above in the case of “FIG. 25 (4)” is performed.

  In this recording mode, characteristic data, special reproduction data, and the like are read from the recording medium A and recorded in a predetermined recording layer and recording area as described with reference to FIGS. For example, in the case of FIG. 25 (6), these data are recorded only in the recording system 2 layers or in another predetermined recording area.

(10.2.3) When only recording method 2 data is recorded on the recording medium A In the case of FIG. 25 (7):
This is because the system controller system 60 determines that the recording medium B is compatible with both the recording methods 1 and 2, and the audio / video data recorded on the recording medium A is recorded as the recording method. 1 is a combination in the case of recording on the recording medium B by both recording methods.

  In this case, the recording medium A records only the video / audio data of the recording system 2 (BD system or HD-DVD system), and there is no video / audio data of the recording system 1 having a low transmission rate. By performing a down-conversion process on the image / audio data, the process for generating the image / audio data of the recording method 1 is performed.

  The image / audio data of the recording method 2 is reproduced by the reproduction processing system 52, and the reproduced image / audio data is input to the recording processing system 46. In the recording processing system 46, down-conversion processing is performed, and recording of the recording method 1 image / audio data obtained by the down-conversion processing is performed via the recording medium processing system 64. As the recording destination.

  In the down-conversion process, a method of decoding the recording method 2 image / audio data as a reproduction signal and re-encoding the recording method 1 can be considered. However, the band-compressed recording method 2 image / audio data is reduced to the baseband band. It is conceivable to perform other methods such as predetermined transmission rate conversion, image size conversion (conversion from 16 to 9 to 4 to 3), other conversion processing, etc. without decoding all. .

  If the audio / video data of the recording method 2 recorded on the recording medium A is MPEG MP @ ML data shown in FIG. 26, the above-described down-conversion processing, image size conversion processing, etc. Instead, the read data may be recorded as it is.

  On the other hand, for recording of the audio / video data of the recording method 2, the audio / video data is reproduced by the reproduction processing system 52, subjected to a predetermined recording process in the recording processing system 46, and then passed through the recording medium processing system 64. The recording method is recorded on the recording medium B of the recording medium B.

  Also in this recording mode, characteristic data, special reproduction data, and the like are read from the recording medium A and recorded in a predetermined recording layer and recording area as described with reference to FIGS.

In the case of FIG. 25 (8):
This is because the system controller system 60 determines that the recording medium B is compatible only with the recording system 1 (normally the DVD system), and the audio / video data recorded on the recording medium A is recorded with the recording system 1. This is a combination when recording on the medium B.

  In this case, the recording medium A records only the video / audio data of the recording system 2 (BD system or HD-DVD system), and there is no video / audio data of the recording system 1 having a low transmission rate. By performing a down-conversion process on the image / audio data, the process for generating the image / audio data of the recording method 1 is performed. That is, the same processing as that described above in the case of “FIG. 25 (7)” is performed.

  In this recording mode, characteristic data, special reproduction data, etc. are read from the recording medium A and recorded in a predetermined recording layer and recording area as described with reference to FIGS. In the case of FIG. 25 (8), these data are recorded in only one recording system layer or in another predetermined recording area.

In the case of FIG. 25 (9):
This is because the system controller system 60 determines that the recording medium B is compatible only with the recording system 2 (BD system or HD-DVD system), and the audio / video data recorded on the recording medium A is recorded. This is a combination when recording on the recording medium B by the method 2.

  The recording system 2 video / audio data having a higher transmission rate than the recording system 1 data is reproduced from the recording medium A by the reproduction processing system 52 and subjected to a predetermined recording process in the recording processing system 46. Recording is performed on the recording system B of the recording medium B via the processing system 64.

  In this recording mode, characteristic data, special reproduction data, and the like are read from the recording medium A and recorded in a predetermined recording layer and recording area as described with reference to FIGS. For example, in the case of FIG. 25 (9), those data are recorded only in the recording system 2 layers or in another predetermined recording area.

(11) Example when recording a plurality of video and audio data of the recording method 1 by the recording method 2 A plurality of video and audio data of a recording method having a low recording rate (transmission rate) is recorded at a higher recording rate. May be re-recorded as video and audio data of the system.

  Among the recording layers of the recording medium B, the recording capacity of the recording system 2 layers corresponding to the BD system or the HD-DVD system is larger than the recording capacity of the recording system 1 layer corresponding to the normal DVD system. Recording a plurality of video and audio data of the recording method 1 by the recording method 2 means that the normal DVD video and audio data recorded in a plurality of sheets is recorded as BD or HD-DVD video and audio data. This is performed when recording is performed on the two recording layers of the recording medium B.

  Here, the recording capacity of a BD recording medium and the recording capacity of a normal DVD recording medium are considered.

The BD format disc is 27GB on one side, and the normal DVD format disc is 4.7GB.
27 / 4.7 = 5.7
Thus, data recorded on at least five normal DVD discs can be recorded on one BD disc.

  27A and 27B are diagrams showing the recording capacities of a normal DVD recording medium and a BD recording medium. In the example of FIG. 27A, the recording capacity of a normal DVD disc is represented by recording capacity 1.

  As shown in FIG. 27B (1), the total recording capacity of the normal DVD type discs 1 to 5 is smaller than the recording capacity 2 of one BD type disc.

  Such an operation of copying and recording a plurality of video and audio data recorded on a plurality of recording media onto one recording medium is performed by a recording / reproducing apparatus in accordance with a predetermined operation by a user.

(11.1) Operation Mode Setting Order, Operation Order When performing such an operation, first, the user operates the remote control 62 and the like, and the operation mode is selected and set.

  Next, the selection of how many pieces of data on the normal DVD format disc are copied and recorded on one BD format disc is input from the remote control 62 or the like. The input information is input to the system controller system 60 via the user input I / F system 61.

  When such an operation is performed by the user, when the data recorded on the normal DVD format disc for a predetermined number of times input by the user does not fit on one BD format disc, for example, In accordance with control by the system controller system 60, a predetermined warning display may be performed by the display processing system 65, or a predetermined warning sound may be output by the audio output system 66. As the warning sound, for example, a beep sound or a synthesized sound such as “cannot be recorded with one sheet” based on sound data stored in a ROM or the like in the system controller system 60 is output.

  FIG. 27B (2) is a conceptual diagram in the case where data recorded on the normal DVD format disc for the number of sheets input by the user cannot be recorded on one BD format disc. is there.

  In the example of FIG. 27B (2), since the data of the capacity a has already been recorded on the BD disc as the data recording source, only the data up to the normal DVD discs 1 to 3 can be stored in the BD format. Cannot be additionally recorded on other discs.

  In this way, when all of the data to be recorded cannot be recorded on one BD disc, for example, when there are two BD discs, all data can be recorded. Audio data may be read from the memory in the system controller system 60 and audio information such as “can be recorded with 2 sheets” is output by the audio output system 66, or the display processing system 65 may output the audio information. A predetermined message may be displayed.

  In the process of recording the data recorded on the normal DVD format disc as described above on the BD format disc, for example, conversion of image size from 4: 3 to 16: 9, predetermined re-encoding processing, etc. When the above signal processing is performed, the signal processing as in the combination of FIGS. 25 (4) and (6) can be applied to the processing. Further, the processing described with reference to FIGS. 7 and 10 can be applied to the processing for recording the characteristic data and special reproduction data recorded on the normal DVD disc.

(12) Examples when the recording capacity is insufficient (12.1) In the case of a disc corresponding to the two recording methods For example, in the recording method 2, data having a relatively high transmission rate such as MP @ HL is recorded on the recording medium B. During recording, there is a case where the recording capacity of the recording system 2 corresponding to the recording system 2 of the recording medium B is insufficient and it is not possible to record all of the audio / video data to be recorded. This is because, for example, timer recording is set using EPG (Electronic Program Guide) or the like, and the program (for example, sports program) recorded according to the timer recording does not end at the scheduled time, and the broadcast time This may occur when the recording time is extended with the extension of the recording time.

  As described above, it is assumed that the recording medium B in FIG. 16 or FIG. 19 is compatible with the recording system 1 (normal DVD system) and the recording system 2 (BD system or HD-DVD system), and recording with a high transmission rate is performed. When it is detected that the recording capacity of the recording method 2 layer is insufficient during recording of data in the method 2, the recording method is changed from the recording method 2 to the recording method 1 at the point p (time 1) in the middle of recording in FIG. Thereafter, data recording in the recording method 1 is performed until time 2 when recording of the target program ends.

  FIG. 28B shows an example in which the recording method is switched from the recording method 1 to the recording method 2. The recording method is switched from the recording method 1 to the recording method 2 at the point p (time 1) during the recording. Thereafter, data is recorded in the recording method 2 until time 2 when the recording of the target program ends.

  When the recording method is switched in this way, the data recording destination is a recording layer corresponding to the switched recording method as described with reference to FIG. Also, the feature data, special reproduction data, and recording destination are changed as necessary with the switching of the recording method.

  Further, for example, when the process of extracting the feature data from which the special reproduction data is generated is performed using the image / sound data of the recording method 2, the feature extraction process is also performed as the image / sound of the recording method 1. Switch to processing using data.

  Furthermore, when the feature extraction processing is performed in the baseband region of the image / audio data before performing the predetermined band compression processing, the output of the feature extraction processing is used as it is even if the recording method is switched. The recording destination of the feature data is switched to the area (position) as described with reference to FIG. 7 or FIG. The other areas other than the recording area of the recording system 1 layer corresponding to the recording system 1 and the recording system 2 layer corresponding to the recording system 2 described with reference to FIG. 10 are the recording destinations of the characteristic data and special reproduction data. In this case, even if the recording method is switched, the recording of the characteristic data and the special reproduction data is performed with the other area as the recording destination as it is.

(12.2) Recording rate switching Here, a case where recording rate switching is performed as processing when a shortage of recording capacity is detected will be described.

  Such switching of the recording rate is performed in accordance with the remaining recording capacity of the recording medium B as shown in FIG. 29, for example. Here, the recording method 1 is a normal image quality recording mode, and the recording method 2 is a high image quality recording mode. In the normal image quality recording mode, recording is performed at a normal recording rate. In the high image quality recording mode, recording is performed at a recording rate higher than the normal recording rate.

  As shown in FIG. 29A, if the recording capacity of the recording medium B is sufficient even if the recording is continued in the recording method 2, the recording in the recording method 2 is continued until the end of the recording, while FIG. As shown in FIG. 5, when recording is continued in the recording method 2, if the recording capacity of the recording medium B becomes insufficient, the recording method is switched from the recording method 2 to the recording method 1 at a point p which is a predetermined position. Recording in the recording method 1 is performed until the recording is completed.

  FIG. 30 is a diagram illustrating an example of characteristics of recording time and recording capacity for each recording method (recording rate).

  The characteristics from the point a to the point c indicate the characteristics when recording is performed with the recording method 2 (high recording rate). When the recording with the recording method 2 is continued, the amount of data to be recorded is the time t2. Thus, the maximum recording capacity D (recording capacity limit value) of the recording medium B is reached.

  The characteristics from point a to point e show the characteristics when recording is performed with recording method 1 (normal recording rate). When recording is continued with recording method 1, the amount of data to be recorded is at time t4. The maximum recording capacity D of the recording medium B is reached.

  As shown in FIG. 30, when the recording capacity is limited, the allowable recording time when recording is performed in the high image quality recording mode (recording method 2) is recorded in the normal image quality recording mode (recording method 1). It is shorter than the allowable recording time when performing.

  Therefore, recording is performed in the recording mode 2 of the recording method 2, and the recording mode is recorded at time t1 which is a time before time t2 when the data amount reaches the maximum recording capacity D as shown in FIG. By switching to the method 1, when the recording mode is not changed, it is possible to record until the time t3 where it can only be recorded until the time t2. That is, the recording time can be extended.

  In this case, when the feature extraction processing is performed using data that has been subjected to band compression processing such as MPEG, it is performed using the data obtained in the recording method 2 until the time t1, and the recording is performed. After the time t1 when the system is switched, the data obtained in the recording process by the recording system 1 is used.

  As described above, by switching the data used for the feature extraction processing according to the recording mode and the recording method, it is possible to detect feature data with which consistency is ensured and to generate special reproduction data.

(13) Operation Flowchart Next, recording processing by the recording / reproducing apparatus will be described with reference to the flowcharts of FIGS. 31 and 32.

  Here, it is assumed that the recording medium B corresponds to the recording of data of a plurality of systems, and that there is only one image / audio data to be recorded as shown in FIG.

  In step S1, it is determined whether or not the target audio / video data is to be recorded by a single recording method, and if it is determined to be recorded by a single recording method, the process proceeds to step S2.

  That is, it is determined whether or not the recording medium B is compatible with recording in the two recording systems 1 and 2, and when it is determined that the recording medium B is compatible with the two recording systems, It is determined whether recording is performed on a recording layer corresponding to the recording method or recording is performed on a recording layer corresponding to one of the recording methods. Whether or not the recording medium B supports data recording is determined based on the detection result of the error rate, for example, by recording the test data of the recording method 1 and the recording method 2 as described above. Is done.

  In step S2, it is determined whether the target audio / video data is recorded by the recording method 1 or the recording method 2. This determination is made, for example, based on a selection operation by the user, or automatically based on the type of input image / audio data.

  For example, in FIG. 16 or FIG. 19, when a high-definition broadcast is received by the receiving system 42 and the program is recorded, the recording method 2 is set to image / audio data so that it is recorded with as high image quality as possible. Is automatically selected as the recording method. Such automatic determination is performed by the system controller system 60 by inputting program metadata or identification information from the reception system 42 to the system controller system 60.

  If it is determined in step S2 that the target audio / video data is recorded by the recording method 1, the process proceeds to step S3, and the data is captured. The captured data is input to the feature extraction processing system 50.

  In step S4, feature extraction processing is performed by the feature extraction processing system 50, and feature data is detected. The detected feature data is appropriately input to a playlist data (chapter data) generation processing system 59, and special reproduction data is generated in the playlist data (chapter data) generation processing system 59. The characteristic data and special reproduction data obtained here are input to the recording processing system 46.

  Extraction of characteristic data, generation of special reproduction data, and recording thereof are performed, for example, by the following method.

  A method (processing method 1) in which data is taken in every predetermined section or every predetermined amount of data, feature data is detected and playlist data is generated, and the data is sequentially recorded on the recording medium B (processing method 1).

  A method of reading out the image / sound data after all the image / sound data has been recorded, detecting the feature data and generating the play list data, and re-recording it in a predetermined area and position of the recording medium (Processing method 2).

  Simultaneously with the recording of the image and sound data, the feature data is detected, and the detected feature data is recorded together with the image and sound data on the recording medium B. After the recording is completed, only the feature data is read out, and based on the read feature data The playlist data generated in this manner is recorded again on the recording medium B (processing method 3). The playlist data generated at this time can also be used for special reproduction of the image / sound data recorded on the recording medium B.

  In step S <b> 5, predetermined recording processing is performed on the image / audio data, and the image / audio data is recorded in the recording method 1 layer of the recording medium B.

  In step S6, it is determined whether or not to end the recording. If it is determined to end, the process ends. On the other hand, if it is not determined to end, the process proceeds to step S7.

  In step S7, it is determined whether or not to change (switch) the recording method. If it is determined that the recording method is not to be changed, the process returns to step S3, and the subsequent processing is repeated.

  If it is determined in step S7 that the recording method is to be changed, the process proceeds to step S8, and the subsequent processing is performed. If it is determined in step S2 that the target audio / video data is recorded by the recording method 2, the process proceeds to step S8, and the subsequent processing is performed.

  In step S8, data is taken in. The captured data is input to the feature extraction processing system 50.

  In step S9, feature extraction processing is performed by the feature extraction processing system 50, and feature data is detected. The detected feature data is appropriately input to a playlist data (chapter data) generation processing system 59, and special reproduction data is generated in the playlist data (chapter data) generation processing system 59. The characteristic data and special reproduction data obtained here are input to the recording processing system 46.

  In step S 10, predetermined recording processing is performed on the image / audio data and the like, and the image / audio data is recorded in the recording method layer 2 of the recording medium B.

  In step S11, it is determined whether or not to end the recording. If it is determined that the recording is to be ended, the process is ended. On the other hand, if it is not determined that the recording is to be ended, the process proceeds to step S12.

  In step S12, it is determined whether or not to change (switch) the recording method. If it is determined that the recording method is not to be changed, the process returns to step S8, and the subsequent processing is repeated.

  If it is determined in step S12 that the recording method is to be changed, the process proceeds to step S3, and the subsequent processing is performed. For example, if the recording capacity of the recording method B of the recording medium B is insufficient to record all the target audio / video data, it is determined that the recording method is changed, and recording in the recording method 1 is performed. Be started.

  On the other hand, if it is determined in step S1 that the target audio / video data is not recorded by a single recording method, that is, is recorded by a plurality of recording methods, the process proceeds to step S13 (FIG. 32).

  In step S13, data is fetched. The captured data is input to the feature extraction processing system 50.

  In step S14, feature extraction processing is performed by the feature extraction processing system 50, and feature data is detected. The detected feature data is appropriately input to a playlist data (chapter data) generation processing system 59, and special reproduction data is generated in the playlist data (chapter data) generation processing system 59. The characteristic data and special reproduction data obtained here are input to the recording processing system 46.

  Note that the feature data extraction process and the special reproduction data generation process here are performed when the obtained characteristic data and special reproduction data are reproduced from the image / audio data of the recording method 1 and the recording method. This is performed so as to ensure consistency with the case where the second image / audio data is reproduced.

  In step S15, predetermined recording processing is performed on the image / audio data and the like, and the image / audio data is recorded in the recording method layer 1 and the recording method layer 2 of the recording medium B. Feature data and special reproduction data obtained by ensuring consistency are also recorded in a predetermined area of the recording medium B.

  In step S16, it is determined whether or not to end the recording. When it is determined that the recording is to be ended, the processing is ended. On the other hand, when it is not determined that the recording is to be ended, the processing proceeds to step S17.

  In step S17, it is determined whether or not the recording method is changed to a single recording method. If not changed, the process returns to step S13, and the subsequent processing is repeated.

  If it is determined in step S17 that the recording method is changed to the single recording method, the process proceeds to step S2, and the subsequent processing is performed.

(14) Other Embodiments In the description of the block configuration example, the operation flowchart example, and the like, the case where a disk-shaped recording medium is used as the recording medium has been described. Similarly, the present invention can be applied to a tape-shaped recording medium, a semiconductor recording medium, a hologram recording medium, and other recording media corresponding to a plurality of recording methods.

(15) Necessity of generating feature data and special reproduction data When considering an operation mode such as copy recording, the copy source data is image / audio data, and there is no characteristic data or special reproduction data. In addition, it is conceivable to automatically generate such data and perform copy recording together with the image / sound data in accordance with the copy recording processing. The generation of the feature data and special reproduction data has been described with reference to FIG.

  For example, if the source of image / audio data to be copied is a DVD (DVD software) sold as a package, or a data server that records only image / audio data together, the DVD Or feature data corresponding to image / audio data acquired from a data server is often not prepared. In such a case, in order to realize special playback as described above, DVD or data It is necessary to generate feature data and special reproduction data on the device side that has acquired the image / sound data from the server.

  It can be considered to determine whether or not the copy source data is image / audio data based on a determination result of whether or not the data is MPEG format data, for example.

  For example, in FIG. 16, when performing copy recording from the recording medium A to the recording medium B, data to be copied from the recording medium A is reproduced by the reproduction processing system 52, and a predetermined data portion such as a header of the reproduced data is recorded. The system controller system 60 determines whether the structure is the same as the data structure of the MPEG format.

  When the system controller system 60 confirms that the structure of a predetermined data portion such as a header of reproduced data is the same as the data structure of the MPEG format, the system controller system 60 determines that the data to be recorded is image / audio data, When there is no feature data or the like, as described above, the data is automatically generated along with the copy recording process, and the generated data is recorded together with the image and sound data on the predetermined recording medium B of the copy recording destination. Record in the area.

  When the system controller system 60 confirms that the structure of a predetermined data portion such as a header of reproduced data is not the same as the data structure of the MPEG format, digest reproduction using the reproduced data is not performed. Therefore, it is determined that the data to be copied is simple data, and the copy process is performed as it is (without generating feature data or the like).

(16) Operation according to recording rate A case where predetermined data is recorded from a predetermined recording medium to another recording medium can be considered.

(16.1) Operation Flowchart FIG. 33 is a flowchart for explaining a process of recording by appropriately switching the method according to the recording rate.

  In step S51, the content to be recorded is selected, the process proceeds to step S52, and the recording rate (data rate) of the content selected in step S51 is detected.

  In step S53, it is determined whether the recording rate of the data to be recorded is a high image quality rate (for example, HD image quality data) or a normal image quality rate (for example, SD image quality data). If it is determined that there is a recording medium, the process proceeds to step S54, and it is determined whether or not a recording medium corresponding to the recording rate of the data to be recorded that can be used as a recording destination is prepared.

  Here, the recording medium corresponding to the recording rate of the data to be recorded is, for example, recording corresponding to the BD system or the HD-DVD system (recording system 2) when the data to be recorded is HD image quality data. It is a medium, and when the data to be recorded is data of SD image quality, it is a recording medium corresponding to the normal DVD system (recording system 1).

  For example, in a recording / reproducing apparatus as shown in FIG. 37 capable of handling a plurality of recording media, the recording medium corresponding to the recording method 2 is detected. As will be described later, the recording medium control system 306 in FIG. 37 can handle a plurality of recording media, and the system controller system 60 determines which recording system is installed at which location. It is determined whether it corresponds to.

  If it is determined in step S54 that a recording medium corresponding to the recording rate of the data to be recorded is prepared, the process proceeds to step S55, and the recording process by the recording method 2 is performed.

  In step S56, it is determined whether or not the recording is finished. Until it is judged that the recording is finished, the process returns to step S55, and the recording process is repeated.

  When a plurality of recording media can be handled as in the recording / reproducing apparatus shown in FIG. 37, when the remaining recording capacity of one recording medium decreases, this is detected by the system controller system 60 and recorded. Data recording may be performed by switching a recording medium as a destination and using a recording medium different from the recording medium that is the recording destination first.

  If it is determined in step S56 that the recording is finished, the process is finished.

  On the other hand, if it is determined in step S54 that a recording medium corresponding to the recording rate of the data to be recorded is not prepared, the process proceeds to step S57, and a predetermined warning process is performed. As the warning process, for example, a process of notifying the user that the recording medium is not supported by a predetermined audio output or screen display can be considered.

  In step S58, it is determined whether or not to end the process. If it is determined in step S58 that the process is to be terminated, the process is terminated. If it is determined that the process is not to be terminated, the process proceeds to step S59 to determine whether another content (data) is to be selected as data to be recorded. Is done.

  If it is determined in step S59 that another content is selected, the process returns to step S51, and the above-described processing is performed. On the other hand, if it is determined not to select another content, the process proceeds to step S60, and the recording rate is determined. Down-conversion processing such as conversion is performed. By down-conversion processing, for example, high-definition data of HD image quality that is to be recorded is converted to normal-rate data of SD image quality, and thereafter, the SD-quality normal-rate data obtained by conversion is converted. Recording is performed.

  In step S61, a recording process using the recording method 1 is performed, and the process proceeds to step S62 to determine whether or not the recording is finished. In step S62, the process returns to step S60 until it is determined that the recording is completed, and the recording process is repeated. If it is determined that the recording is completed, the process is terminated.

  On the other hand, if it is determined in step S53 that the recording rate of the data to be recorded is the normal image quality rate, the process proceeds to step S63.

  In step S63, the recording process by the recording method 1 is performed, and the process proceeds to step S64 to determine whether or not the recording is finished. In step S64, the process returns to step S63 until it is determined that the recording is completed, and the recording process is repeated. If it is determined that the recording is completed, the process is terminated.

(16.2) Processing for Consistency of Feature Data Here, for example, when the same program that differs only in broadcast times is on different recording media, the same program (contents) recorded on those recording media ) Consider the case where the feature points are consistent.

  A program that is the same as the program recorded on a certain recording medium (first recording medium) but has a different broadcast time is already recorded on another recording medium (second recording medium), and the second recording It is conceivable to record the image / audio data of the program recorded on the first recording medium on the medium.

  In such a case, whether or not the program to be recorded is the same program as the program already recorded on the second recording medium is determined based on, for example, a detection result of predetermined data included in the stream data. Determined by system 60. When it is determined that the program to be recorded is the same program as the program recorded on the second recording medium and the broadcast times are different, the image and sound data of the program to be recorded is transferred from the first recording medium to the first recording medium. When the characteristic data and the special reproduction data are in the first recording medium, they are recorded as they are in the recording destination second recording medium. As a result, for the program to be recorded, consistency of feature data and the like is ensured between the first and second recording media.

  In addition, when there is no feature data or special reproduction data in the first recording medium, it is conceivable that the characteristic data and special reproduction data are generated during the processing of steps S59 to S62 and recorded on the second recording medium. In this case, the generation of feature data and special reproduction data is performed based on, for example, data obtained by down-conversion.

  Furthermore, if there is no feature data or special reproduction data in the processing of steps S55 to S56 or steps S63 to S64, the feature data and special data are recorded based on the stream data of the predetermined recording method to be recorded at that time. Data for reproduction may be generated and recorded together with the stream data.

(17) Case of Converting Recording Method FIG. 34 is a flowchart for describing processing for appropriately converting the recording method of data to be recorded and recording the data obtained by the conversion.

  In step S101, it is determined whether or not the set operation mode is an operation mode for converting a recording method. If it is determined that the operation mode is not an operation mode for converting a recording method, the operation mode is shifted to a predetermined operation mode. The processing in the operation mode is performed.

  On the other hand, if it is determined that the set operation mode is an operation mode for converting the recording method, the process proceeds to step S102, and the content to be processed is selected. The content to be processed is selected from, for example, a screen (multi-screen) on which representative images as shown in FIG.

  In step S103, it is selected how to convert the recording method, and if it is selected to convert the recording method 1 to the recording method 2, the process proceeds to step S104.

  In step S104, it is determined whether or not the recording medium that is the recording destination is compatible with recording method 2. If it is determined that the recording medium is compatible, the process proceeds to step S105, and the content to be processed is selected. Up-conversion processing for converting from recording method 1 to recording method 2 is performed.

  In step S106, the recording process of the content of the recording method 2 obtained by the up-conversion process is performed, and the process proceeds to step S107 to determine whether or not the recording is finished.

  If it is determined in step S107 that recording has not ended, the processing returns to step S105, and the subsequent processing is repeated. If it is determined in step S107 that recording has ended, the process ends.

  On the other hand, if it is determined in step S104 that the recording medium that is the recording destination does not correspond to the recording method 2, the process proceeds to step S108, and a predetermined warning process is performed.

  In step S109, it is determined whether or not to end the process. If it is determined in step S109 that the process is to be terminated, the process is terminated. If it is determined that the process is not to be terminated, the process proceeds to step S110 to determine whether another content (data) is to be selected as data to be recorded. Is done.

  If it is determined in step S110 that another content is selected, the process returns to step S102, and the above processing is performed. On the other hand, if it is determined not to select another content, the process proceeds to step S111.

  In addition, if it is selected in step S103 that conversion from recording method 2 to recording method 1 is selected, the process proceeds to step S111.

  In step S111, the data to be processed is down-converted, and the process proceeds to step S112, where the data obtained by the down-conversion process is recorded by the recording method 1.

  In step S113, it is determined whether or not to end the recording process. If it is determined not to end the process, the process returns to step S111, and the subsequent processes are repeated. If it is determined to end, the process is ended.

(18) Selection of Recording Medium Based on Recording Rate FIG. 35 is a flowchart for describing processing for selecting a recording medium according to the recording rate and reproducing the content recorded on the selected recording medium.

  In step S151, a search is performed for information representing the content of content recorded on a predetermined recording medium (for example, all recording media placed on the tray of the recording / reproducing apparatus). This information is recorded in a predetermined part such as a header part added to the content.

  In step S152, thumbnail display processing of a representative image such as a frame in which a feature point is set is performed based on the special reproduction data of the content recorded on each recording medium.

  By viewing the representative image displayed by this processing, the user can know what the content recorded on each recording medium is.

  FIG. 36 is a diagram illustrating an example of thumbnail display of a representative image.

  The representative images A1 to A9 in FIG. 36 are representative images of high-quality recorded content, and the representative images B1 to B7 are representative images of normal-quality recorded content.

  As shown by the bold lines in FIG. 36, the representative images A1 to A9 are representative images B1 to B7 so that the representative image of the high-quality recorded content is more prominent than the representative image of the normal-quality recorded content. Are displayed differently. For example, the image frames of the representative images A1 to A9 are displayed in green, while the image frames of the representative images B1 to B7 are displayed in gray. Images A1 to A9 are displayed blinking.

  The representative images A1 to A9 may be displayed by the same method as that of the representative images B1 to B7 when a predetermined time elapses after the display for making the user noticeable is started. For example, the representative images A1 to A9 are displayed by a method different from that of the representative images B1 to B7 for a predetermined time such as 3 seconds immediately after the user finishes the reproduction operation mode and enters the screen display mode of FIG. It is possible to do so.

  Returning to the description of FIG. 35, in step S153, it is determined whether or not the user setting mode is an operation mode in which the user himself / herself sets the playback order (playback order of a plurality of contents), and the user setting mode is determined. If YES in step S154, the flow advances to step S154 to accept and set the playback order selected by the user watching the thumbnail display using the remote control 62 or the like.

  In step S155, the reproduction operation is performed in the order set in step S154, and the process proceeds to step S156 to determine whether or not the reproduction is finished.

  If it is determined in step S156 that the reproduction has not ended, the process returns to step S155, and the reproduction process is repeated. If it is determined in step S156 that the reproduction has ended, the process ends.

  On the other hand, if it is determined in step S153 that the playback order is not the operation mode (user setting mode) in which the user himself sets, that is, the automatic playback mode, the process proceeds to step S157, and the reproducible content includes It is determined whether there is content recorded by the recording method 2 for high image quality recording.

  If it is determined in step S157 that there is content recorded by the recording method 2 among the reproducible content, the process proceeds to step S158, and the content recorded by the recording method 2 is reproduced. That is, the high-quality recorded content is played back with priority over the normal-quality content.

  In step S159, it is determined whether or not the reproduction has ended. If it is determined that the reproduction has not ended, the process returns to step S158, and the reproduction process is repeated. If it is determined in step S159 that the reproduction has ended, the process ends.

  On the other hand, if it is determined in step S157 that there is no content recorded by the recording method 2 of the high-quality recording among the reproducible content (only the content recorded by the recording method 1), the process proceeds to step S160. The playback operation of the content recorded by the recording method 1 is performed.

  In step S161, it is determined whether or not the reproduction has ended. If it is determined that the reproduction has not ended, the process returns to step S160, and the reproduction process is repeated. If it is determined in step S161 that the reproduction has ended, the process ends.

(19) Embodiment in which a plurality of discs can be handled Here, a recording / reproducing apparatus capable of handling a plurality of recording media corresponding to a plurality of recording methods of recording method 1 and recording method 2 is considered.

  FIG. 37 is a block diagram showing a configuration example of a recording / reproducing apparatus capable of handling a plurality of recording media in this way.

  The operation performed by this recording / reproducing apparatus is basically the same as the operation of the recording / reproducing apparatus described with reference to FIGS. Here, the recording operation by the recording processing system 303 in FIG. 37 and the reproducing operation by the reproduction processing system 304 are the operation by the configuration on the recording side and the operation by the configuration on the reproduction side described with reference to FIGS. Since it is the same, overlapping description is omitted.

  The recording / playback apparatus of FIG. 37 is provided with a recording medium control system 306 that controls the operation of a predetermined disk selected from a plurality of disks placed on the tray. The recording medium control system 306 can also be considered as a disk-shaped recording medium changer. In the example of FIG. 37, six disc-shaped recording media are placed on the tray.

  Hereinafter, the case of handling a plurality of disc-shaped recording media will be described, but the present invention can be similarly applied to other recording media.

(19.1) Normal Playback Mode In FIG. 37, a plurality of recording media installed in the recording medium control system 306 (recording media placed on a tray that can be controlled by the recording medium control system 306) include a recording method 1 (Normal DVD) or video / audio data of recording system 2 (BD system or HD-DVD system) may be recorded together.

  When the normal playback mode is selected by operating the remote controller 62 and the like, and when playing back the image / audio data, if various contents of a plurality of recording methods are mixed, the user selects which content can be played back. However, it may be confusing or annoying.

  Therefore, it is usually considered to preferentially select and reproduce high-quality content.

  For example, in the normal playback mode, when an automatic playback mode is provided as a selectable mode, when the automatic playback mode is set, the content is recorded from a plurality of contents recorded on a plurality of recording media. Only the contents of the recording method 2 recorded with high image quality are sequentially reproduced by default, and when the reproduction of all the contents of the recording method 2 is finished, the contents recorded in the recording method 1 of the normal DVD are subsequently continued. Playback is performed.

  At this time, when the same content is recorded by two recording methods of recording method 1 and recording method 2, all the contents of recording method 2 are reproduced first, and then the content of recording method 1 is reproduced. In this case, the same content is prevented from being reproduced twice (reproduction of the content recorded by the recording method 1). Is not done).

  What kind of content is recorded on which recording medium and in what recording format is recorded when the device is started up such as when the device is turned on, or when a predetermined mode is operated such as when the playback mode is set. Information representing the recording contents of the medium is sequentially reproduced from each recording medium installed in the recording medium control system 306, and is determined by the system controller system 60 based on the information. In the system controller system 60, as described above, the priority order of reproduction is set according to the recording method based on the information representing the recording contents of the recording medium, and each system is configured to automatically reproduce the contents sequentially. Be controlled.

(19.2) Representative image display mode For example, a list of representative images is displayed when an operation mode for displaying representative images representing recorded contents is set, or playback is performed when a predetermined playback mode is set. Operations such as displaying a list of representative images in order to prompt the user to select content are performed in the recording / reproducing apparatus of FIG.

  In the recording / reproducing apparatus of FIG. 37, in such a representative image display mode, the recorded data is sequentially reproduced on the recording medium installed in the recording medium control system 306. The reproduced data is output to the buffer processing system 301 and supplied to the reproduction processing system 304 via the data bus DB. In the reproduction processing system 304, predetermined reproduction processing is performed, and the special reproduction data obtained based on the feature data is supplied to the system controller system 60, and the system controller system 60 uses the representative image based on the special reproduction data. Is displayed.

  As the representative image, for example, for each predetermined program such as a recorded program, the image information at the first position specified by the special reproduction data is considered, and the image may be displayed based on the image information. Good.

  Further, when displaying a representative image, each representative image may be classified and displayed for each image quality of the content.

  For example, as described with reference to FIG. 36, representative images A1 to A9, which are representative images of high-quality content recorded by the recording method 2, are displayed as a group, and separately, the recording method 1 The representative images B1 to B7, which are representative images of the normal-quality content recorded in step 1, may be displayed as a group.

  In such a representative image display, it is placed in any location of the recording medium control system 306 (tray) in FIG. 37 so that the user can confirm the information of the content represented by each representative image. Predetermined information such as information indicating whether the content is recorded on the recording medium or information indicating the title of the content is displayed below the representative image, for example, as indicated by the dotted arrow (1) in FIG. It may be displayed at a predetermined position.

  In such a representative image, image data of a predetermined feature point (feature position) is reproduced from the recording medium in accordance with control by the system controller system 60 based on the detected special reproduction data, and a reproduction processing system is applied to the image data. It is generated by performing processing by 304 or processing by the system controller system 60 (thumbnail processing).

  The representative image thumbnail processing data obtained by performing thumbnail processing on the data recorded on each recording medium is stored in a predetermined memory system in the system controller system 60 and placed in the recording medium control system 306. When thumbnail processing is performed on data recorded in all the recording media, the data recorded in the memory system is supplied to the image signal output system 310 via the data bus DB. In the image signal output system 310, signal processing for performing screen display as shown in FIG. 36 is performed, and representative images are displayed as thumbnails.

(19.3) Recording Mode Here, it is conceivable that the audio / video data recorded on the recording medium A in FIG. 37 is edited and recorded on a predetermined recording medium installed in the recording medium control system 306. .

  As described above, the system controller system 60 determines which recording method the recording medium installed in the recording medium control system 306 can handle, based on data sequentially reproduced from the recording medium.

  When performing the above-described editing recording and copy recording in a predetermined operation mode, the recording rate of the data to be recorded is determined by the system controller system 60 based on predetermined attribute data detected by the reproduction processing system 304. The Further, based on the determination result, it is determined which of the recording media placed in the recording medium control system 306 is to record the data from the recording medium A.

  For example, when high-quality content with a high recording rate is the data to be recorded, the data from the recording medium A is recorded on a predetermined recording medium corresponding to the recording method 2 placed in the recording medium control system 306. Automatically recorded in the area. Further, when the normal image quality content is the data to be recorded, the data from the recording medium A is automatically stored in a predetermined recording area of the recording medium corresponding to the recording method 1 installed in the recording medium control system 306. To be recorded.

(20) Simultaneous recording / reproducing mode on a two-layer disc When a two-layer disc corresponding to recording method 1 and recording method 2 is used, data of recording method 1 recorded on a predetermined recording layer is reproduced and reproduced. It is possible to consider a simultaneous playback recording mode in which the recorded data is recorded in the recording area of a different layer by the recording method 2.

  FIG. 38 shows a block configuration example for realizing this simultaneous reproduction recording.

  Data of the recording method 1 reproduced from the recording method 1 layer of the recording medium 1 for each predetermined unit by the signal processing system 351-1 is temporarily recorded in the buffer memory system 352. The data of the recording method 1 is read from the buffer memory system 352 when a predetermined amount is accumulated, and then subjected to predetermined processing by the signal processing system 351-2. Recorded in a predetermined area.

  When a dual-layer disc corresponding to recording method 1 and recording method 2 is used, data of recording method 2 recorded in a predetermined recording layer is reproduced, and the reproduced data is recorded in a recording area of a different layer. It is also possible to consider a simultaneous playback recording mode in which recording is performed by the recording method 1.

  FIG. 39 shows a block configuration example for realizing the simultaneous reproduction and recording.

  Data of the recording method 2 reproduced for each predetermined unit from the recording method 2 layer of the recording medium 1 by the signal processing system 361-2 is temporarily recorded in the buffer memory system 362. The data of the recording system 2 is read from the buffer memory system 362 when a predetermined amount is accumulated, and then subjected to a predetermined process by the signal processing system 361-1. Recorded in a predetermined area.

  In the above description, the BD format or the HD-DVD format is used as a format capable of recording with higher image quality than a normal DVD. However, the format is not limited to this, for example, the BD format It may be one format in which both HD-DVD formats are versatile.

  The series of processes described above can be executed by hardware, but can also be executed by software. In this case, the apparatus for executing the software is constituted by a personal computer as shown in FIG. 40, for example.

  40, a CPU (Central Processing Unit) 401 performs various processes according to a program stored in a ROM (Read Only Memory) 402 or a program loaded from a storage unit 408 to a RAM (Random Access Memory) 403. Execute. The RAM 403 also appropriately stores data necessary for the CPU 401 to execute various processes.

  The CPU 401, ROM 402, and RAM 403 are connected to each other via a bus 404. An input / output interface 405 is also connected to the bus 404.

  The input / output interface 405 includes an input unit 406 including a keyboard and a mouse, a display including an LCD (Liquid Crystal Display), an output unit 407 including a speaker, a storage unit 408 including a hard disk, and a network. A communication unit 409 for performing all communication processes is connected.

  A drive 410 is also connected to the input / output interface 405 as necessary. A removable medium 411 including a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately installed in the drive 410, and a computer program read from the removable medium 411 is installed in the storage unit 408 as necessary.

  When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a network or a recording medium into a general-purpose personal computer or the like.

  As shown in FIG. 40, the recording medium is distributed to provide a program to the user separately from the apparatus main body, and includes a magnetic disk (including a flexible disk) on which the program is recorded, an optical disk (CD- ROM (Compact Disk-Read Only Memory), DVD (including Digital Versatile Disk)), magneto-optical disk (including MD (registered trademark) (Mini-Disk)), or removable media 411 made of semiconductor memory, etc. In addition, the program is configured by a ROM 402 in which a program is recorded and a hard disk included in the storage unit 408 provided to the user in a state of being incorporated in the apparatus main body in advance.

  In the present specification, each step includes not only processing performed in time series according to the described order but also processing executed in parallel or individually, although not necessarily performed in time series.

It is a figure explaining the consistency of feature data. It is another figure explaining the consistency of feature data. It is a figure which shows the example of a recording by 2 recording systems. It is a figure which shows the other example of the recording by 2 recording systems. It is a figure which shows the example of reproduction | regeneration. It is a figure which shows the example at the time of displaying a play list as text data. It is a figure which shows the example of the combination of the recording destination of characteristic data and special reproduction data. It is a figure which shows the example of the recording state of characteristic data and play list data. It is the figure which looked at the disk-shaped recording medium from the upper direction. It is a figure which shows the other example of the combination of the recording destination of characteristic data and special reproduction data. It is a block diagram which shows the structural example on the recording side which records the same content with a some recording system. It is a block diagram which shows the other structural example of the recording side which records the same content with a some recording system. It is a figure which shows the example of a recording order. It is a figure explaining a digest reproduction | regeneration and a chapter process. It is a figure which shows the example of a display of a chapter image. It is a block diagram which shows the structural example of the whole recording / reproducing apparatus. It is a figure which shows the example of a display of a message. It is a figure which shows the example of a display of another message. It is a block diagram which shows the other structural example of the whole recording / reproducing apparatus. It is a block diagram which shows the example of a structure which performs the feature extraction of an audio system. It is a block diagram which shows the other example of the structure which performs the feature extraction of an audio system. It is a block diagram which shows the example of the structure which performs the feature extraction of an image type | system | group. It is a figure which shows the example of the area | region used for the detection of a scene change. It is a figure which shows the example of the area | region used for the detection of a telop area | region and a color feature. 6 is a diagram illustrating an example of a combination of data recording status of a recording medium A and a recording method that can be recorded on a recording medium B. FIG. It is a figure which shows the data attribute in an MPEG system. It is a figure which shows the example of the recording capacity of data. It is a figure which shows the example of the recording system employ | adopted in each time slot | zone. It is a figure which shows the other example of the recording system employ | adopted in each time slot | zone. It is a figure which shows the example of the characteristic of recording time and recording capacity. It is a flowchart explaining a recording process. It is a flowchart following FIG. 31 explaining a recording process. It is a flowchart explaining the process which switches and records according to a recording rate. It is a flowchart explaining the process which converts the recording system of the data of recording object, and records the data obtained by converting. It is a flowchart explaining the process which selects the recording medium according to a recording rate, and reproduces the content currently recorded on the selected recording medium. It is a figure which shows the example of the thumbnail display of a representative image. FIG. 22 is a block diagram illustrating a configuration example of a recording / reproducing apparatus capable of handling a plurality of recording media. It is a block diagram which shows the structural example which implement | achieves simultaneous reproduction | regeneration recording. It is a block diagram which shows the other structural example which implement | achieves simultaneous reproduction | regeneration recording. And FIG. 16 is a block diagram illustrating a configuration example of a personal computer.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Recording medium, 2-1 Signal processing system (Signal processing system 1), 2-2 Signal processing system (Signal processing system 2), 10-1 Signal processing system (Signal processing system 1), 10-2 Signal processing system ( Signal processing method 2), 21 recording method 1 encoding processing system, 22 recording method 2 encoding processing system, 23 characteristic data signal processing system, 24 recording method 1 recording signal processing system, 25 recording method 2 recording signal processing system, 26 playlist Data (chapter data) signal processing system, 27 memory system, 303 recording processing system, 304 reproduction processing system, 305 feature extraction processing system, 306 recording medium control system

Claims (4)

In a playback device provided with a tray on which a plurality of recording media can be installed,
Determination means for determining a recording method of a stream recorded on the recording medium based on attribute information;
When a mode in which the user himself / herself does not select a stream to be played is set, based on a determination result by the determination unit among streams recorded on one or more recording media installed in the tray, Playback control means for playing back a stream recorded with a high quality first recording method in preference to a stream recorded with a second recording method having a lower quality than the first recording method. A reproducing apparatus characterized by that. When the reproduction control unit finishes reproducing the stream recorded in the first recording method on all the recording media installed in the tray, the reproduction control unit outputs the stream recorded in the second recording method. The playback apparatus according to claim 1, wherein playback is started. In a reproducing method of a reproducing apparatus provided with a tray on which a plurality of recording media can be installed,
A determination step of determining a recording method of a stream recorded on the recording medium based on attribute information;
When a mode in which the user does not select a stream to be played is set, based on a determination result obtained by the determination step, out of streams recorded on one or more recording media installed in the tray. A playback control step of playing back a stream recorded by the first recording method having a high quality in preference to a stream recorded by the second recording method having a lower quality than the first recording method; A playback method comprising: In a program for causing a computer to execute reproduction processing of a reproduction apparatus provided with a tray on which a plurality of recording media can be installed,
A determination step of determining a recording method of a stream recorded on the recording medium based on attribute information;
When a mode in which the user does not select a stream to be played is set, based on a determination result obtained by the determination step, out of streams recorded on one or more recording media installed in the tray. A playback control step of playing back a stream recorded by the first recording method having a high quality in preference to a stream recorded by the second recording method having a lower quality than the first recording method; The program characterized by including.

Images