JP2002118820A - Information signal processing apparatus, information signal processing method, and information signal recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information signal processing apparatus that can easily realize special reproduction even when copying or editing is conducted independently of a format of compressed data, a recording medium and a structure of recording data, and to provide an information signal processing method and an information signal recording medium. SOLUTION: In the recording of an information signal of image and audio data such as a broadcast program to the information signal recording medium, the information signal processing unit of this invention detects a scene change 13, as an image audio point at which special reproduction such as reproduction of a similar scene designated by a user or proper digest reproduction in response to a broadcast program can be executed, so as to generate imbedded data, and the data are imbedded (16) to the image or audio signal and the resulting data are recorded on the recording medium. A replaced image 17 for special reproduction imbedded at recording is detected from a reference image 14 of the image audio signal at the reproduction and proper special reproduction is performed in response to an operation by the user.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for recording an information signal such as a video signal and an audio signal on a recording medium such as a magneto-optical disk, a hard disk, and a semiconductor memory. An information signal processing device that detects a scene section, records the information signal on a recording medium, and performs special reproduction according to the detection section without depending on a recording medium or an information recording method; The present invention relates to an information signal processing method and an information signal recording medium.

[0002]

[Prior Art] With the development of research and development of information and communication technology,
For home information equipment, data compression technology uses MPEG
(Moving Picture Experts G
loop), wavelet transform and other techniques, and as a recording medium, a magneto-optical disk, a hard disk, a large-capacity semiconductor recording medium, and the like have been used in addition to a tape recording medium.

[0003] When editing and copying are to be performed when various data formats exist and various recording media also exist, conversion of the data structure according to the corresponding recording medium and data format is performed. And the conversion of compressed data itself is required.

[0004] Even in a video tape recording medium which is widely used at present, different recording contents are recorded in the same cassette, for example, a VHS (Video Home).
In the (System) method, MPEG data is used for image data compression
2, a D (Digital) -VHS recording method and a conventional analog recording method coexist.

[0005] Moreover, even in the 8 mm video system, D is used for image compression.
CT (Discrete Cosine Transf)
(Digital Video) using DV
o) The recording system and the conventional high-eight recording system are mixed.

In recent years, various broadcast programs have been broadcast, and if the recording medium has a relatively large capacity and a low price, various broadcast programs may be recorded for a long time. Reproducing a broadcast program stored on various recording media for a long time and trying to grasp its contents is time-consuming.

[0007] It is conceivable to digest the contents of a broadcast program recorded for a long time and to grasp the contents in a relatively short time, or to edit or copy only necessary parts.

In the case of performing such digest reproduction, feature data is detected from image data and audio data, identification data is generated and recorded in a predetermined recording area, and reproduction is performed in order to realize more effective reproduction. Sometimes, a technique of reproducing the identification data recorded in the predetermined area and performing an effective digest reproduction is considered.

For example, an effective digest reproduction of a music program can be realized by detecting a tone signal section from an audio signal in a music program or the like, generating an identification signal, and recording and reproducing the signal.

[0010] Also, Japanese Patent Application Laid-Open No. 10-290359,
Japanese Patent Laying-Open No. 10-290424 discloses that date information and language information are recorded by using a digital watermark technique.

[0011]

In the prior art, identification data for digest reproduction can be easily copied by copying between recording media of the same data format and the same type.
Even when copying is performed, digest reproduction can be realized.

However, as described above, there are various data compression methods and data recording media, and when copying data to different types of recording media or converting data into different formats, the conventional technology is used. However, there was a problem that it was not possible to easily cope with the problem. In addition, there is an inconvenience that the technique disclosed in the above-mentioned publication cannot cope with special reproduction.

In view of the above, the present invention does not depend on the format of the compressed data, the recording medium and the recording data structure, and can easily perform the same digest reproduction as that of the first recorded broadcast program even if it is copied or edited. An object of the present invention is to provide an information signal processing device, an information signal processing method, and an information signal recording medium capable of realizing trick play.

[0014]

SUMMARY OF THE INVENTION An information signal processing apparatus according to the present invention comprises a characteristic data detecting means for detecting predetermined characteristic data from a first information signal for each predetermined section, and a response to a signal from the characteristic data detecting means. An information signal generating means for generating a predetermined second information signal, a second information signal being generated in the first information signal at a predetermined time or a predetermined section in the first information signal. , The third generated in association
And a recording means for recording the third information signal output from the related information signal generating means on a predetermined recording medium.

Further, another information signal processing apparatus of the present invention comprises a characteristic data detecting means for detecting predetermined characteristic data from a first information signal for each predetermined section, and a predetermined data signal in response to a signal from the characteristic data detecting means. An information signal generating means for generating a second information signal; a second information signal as the first information signal;
Related information signal generating means, which is generated at a predetermined time point or a predetermined section in the information signal of (i), and is a third information signal generated in association with the third information signal output from the relevant information signal generating means. Recording means for recording an information signal on a predetermined recording medium, reproducing means for reproducing a third information signal recorded on the recording medium, and a first information signal and a first information signal based on the reproduced signal reproduced from the reproducing means. And a reproduction control unit for controlling reproduction in accordance with the second information signal from the signal separation detection unit.

Further, according to the information signal processing method of the present invention, predetermined characteristic data is detected from a first information signal for each predetermined section, and a predetermined second information signal is generated in accordance with a signal from the characteristic data detection. Then, the second information signal is added to the first information signal,
At a predetermined time or a predetermined section in the first information signal, a third information signal is generated by a related information signal generation process, and the third information signal output from the related information signal generation process is recorded on a predetermined recording medium. Reproducing the third information signal recorded on the recording medium, separating and detecting the first information signal and the second information signal from the reproduced signal from the reproduction, and converting the first information signal and the second information signal into the second information signal from the signal separation detection. The reproduction is controlled accordingly.

Further, the information signal recording medium of the present invention detects predetermined characteristic data from the first information signal for each predetermined section, and generates a predetermined second information signal according to the signal from the characteristic data detection. Then, the second information signal is added to the first information signal,
A third information signal generated at a predetermined point in time or in a predetermined section of the first information signal by a related information signal generation process, and the third information signal output from the related information signal generation process is recorded on a predetermined recording medium. It is.

The information signal processing device, the information signal processing method and the information signal recording medium of the present invention have the following functions. According to the present invention, when recording an image / audio information signal such as a broadcast program on an information signal recording medium such as a magneto-optical disk, a hard disk, and a semiconductor memory, an appropriate scene corresponding to a similar scene specified by a user or the broadcast program A video / audio point at which predetermined special reproduction such as digest reproduction can be performed is detected, a predetermined identification signal is generated, and the identification signal is embedded in an image or audio signal and recorded on a recording medium.

At the time of reproduction, an identification signal for special reproduction embedded at the time of recording is detected from an image / audio signal, and appropriate special reproduction is performed in accordance with a user operation.

Even when copying from the first recorded recording medium to another type of recording medium or when converting the first recorded data to another data and recording it,
Special reproduction that does not depend on the recording medium, data configuration, or data format can be easily performed.

For example, predetermined characteristic data is detected from image or audio data as a first information signal for each predetermined section which is an integral multiple of a frame or a field of an image signal.

A predetermined second information signal such as a digest reproduction identification signal is generated according to the characteristic data detection signal.

A second information signal such as the identification signal is converted into a third information signal by performing a predetermined embedding process as a related information signal generation process such as a digital watermark on the first information signal such as the image / audio signal.

The information signal embedding processing of the third
Is recorded on a predetermined recording medium such as a hard disk or a magneto-optical disk.

The third information signal recorded on the recording medium is reproduced to separate and detect the first information signal and the second information signal.

Based on the signal separation detection, the reproduction is controlled in accordance with the second information signal, and predetermined special reproduction such as digest reproduction is performed.

[0027]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described with reference to the drawings in the following order. (1) Operation principle (2) Block configuration example of embodiment (3) Modification example 1 (4) Modification example 2 (5) Example of operation flowchart (6) Example of other operation flowchart

(1) Operation Principle FIG. 1 is a diagram for explaining the operation principle of the present invention. As an example, consider a case where data for special reproduction is embedded in image data by multi-resolution analysis by wavelet analysis.

Here, in the special reproduction, for example, in consideration of recording of a certain broadcast program, a user detects an image similar to an image at a certain point in time, and performs a predetermined reproduction including an image scene whose similarity is detected at the time of reproduction. It is possible to grasp the outline of the recorded program by playing back only the scenes of the section, analyze the audio signal by predetermined signal processing, detect the music signal section, and play back only the music section in a song song or song program with a digest Cases are conceivable.

Here, the method of detecting similar images and music described above will be described in an embodiment described later, but similar image detection is performed by detecting an average luminance level and an average chrominance level. Detection can be performed by detecting a spectrum peak of FFT (Fast Fourier Transform).

The data to be embedded by the multi-resolution analysis described above is identification data for identifying the time when the similar image is detected or music is detected.

In some cases, the analysis data itself such as an average luminance level and an average color difference level may be used.

Here, for example, as a data embedding technique by wavelet transform, IEICE technical report: Onishi et al. (VOL. 97, NO. 565 (CQ97 70-79); PAGE. 3)
7-42) (1998) "Digital Watermarking Method for Digital Images by Multi-resolution Analysis" Also, IEICE Technical Report: Hayashima et al. (IE98-26, PRMU98-49, MVE98-49)
(1998); PAGE9-14) "Application of Wavelets in Digital Watermarking" or IEICE Technical Report: Ejima et al. (IT98-57; PAGE13-18) (1999) "Watermarking Method Using Wavelets" And a method of embedding desired data in predetermined subband data by performing wavelet transform of image data.

In FIG. 1, even when embedding the analysis data itself, the data size is at most about 24 bits, as will be described in a later embodiment, and embedding such data is considered.

The original image sequence 1, 2,.
If there is a scene change 13 between the image 4 and the image 5 in the presence of 3,..., A wavelet analysis 15 is performed on the image 5 and data is embedded in a predetermined frequency resolution area. Step 16 is performed.

Here, an image 6 of the original image sequence indicated by 11
Is replaced with a replacement image 5a indicated by 17 in which data is embedded, and a new image sequence 1, 2,.
3, 4, 5, 5a, 6, 7,..., When the image sequence after processing indicated by 12 is recorded on a recording medium and reproduced, the reference image 14 at the time of detection of the embedded data 16 is used.
Can be used as the image 5.

That is, when similar scene detection is considered, similar scene detection can be performed efficiently by embedding data in a scene change image without embedding data in all frames of the image.

Here, as a specific simple example, a case is considered in which, for example, in a news program such as a broadcast program, only the scene of an announcer is detected and digest reproduction is performed.

In general, an announcer gives an overview of news, and then a scene change occurs, and a news image is often broadcast. In order to detect the similarity of an announcer part, the time of a scene change is detected and the part of that part is detected. It can be seen that similarity detection can be performed by using the analysis data.

The scene change detection is performed by calculating a difference between frames of image data and calculating, for example, an average value of the data. For example, at the time of embedding data at the time of recording or at the time of detecting embedded data at the time of reproduction. Can also be easily detected.

Further, for example, considering the average luminance level or color difference level in a horizontal direction in a plurality of portions such as an upper portion, a center portion, and a lower portion of an image, an inter-frame difference is calculated. Scene change can also be detected by a method such as detecting that the value of.

Here, at the time of reproduction, it is considered that the embedded data 16 is detected, and the image 6 of the original image sequence 11 is used as the reference image 14 for the detection.
Although the image is replaced with the replacement image 5a shown in FIG. 7, it is assumed that it is not so noticeable to human vision because one screen is replaced immediately after the scene change 13. The order of the replacement images 5a indicated by the images 5 and 17 in the image sequence 12 after the new processing can be changed.

Here, in the above-mentioned known technique, IEICE Technical Report IT98-57 (1999) “Study of Digital Watermarking Method Using Wavelet”, a technique for detecting embedded data that does not require an original image is disclosed. 1A, the original image 6 is replaced with the replacement image 1 in FIG. 1A.
It is also conceivable that the image 5 of the processed image sequence 12 is processed as it is as the data-embedded image 5a without replacing it with the image 7.

FIG. 1B is a conceptual diagram of the multi-resolution analysis in the case where the image is subjected to wavelet transform. As shown in FIG. In this example, the predetermined sub-band image plane is divided into 64 as shown in FIG. 1C, and a predetermined 2
It is also conceivable to select four areas, assign each area to a predetermined bit area as described later, and embed bit data.

Here, the number of screen divisions is not limited to 64 as in the above example as long as a predetermined number of bits can be assigned, and it is conceivable to set more or less.

In this case, the embedded bit data of each divided area only needs to be able to identify the bit. For example, in the case of <0> as shown in FIG. 1D, no data is embedded and the data of <1> is embedded. In this case, a method of embedding a predetermined number of random data in a dispersed manner as indicated by dots may be considered.

In this case, when data is embedded at the time of detection, the average energy level of the divided area becomes larger than that when the data is not embedded. Detection by a method is also conceivable.

As described above, by embedding the data dispersedly in the area, the influence on the image quality can be reduced as much as possible.

In FIG. 1B, for example, the image plane of the HL area conceptually shows that multi-resolution analysis by wavelet transform is performed in order of high-frequency processing in the horizontal direction and low-frequency processing in the vertical direction.

FIG. 2 shows the processing of the wavelet transform, and the multiple resolution analysis LLLL, LLH in FIG. 1B.
L, LLLH, LLHH, HL, LH, HH. In FIG. 2A, for example, Hh1 represents the high frequency component of the subband when the first wavelet transform is performed on the image data in the horizontal direction, and Lv1 is the case where the first wavelet transform is performed on the vertical direction. Represents the low-frequency component of the sub-band, and the other is similarly considered.

In FIG. 1B or FIG. 2, the number of wavelet transforms is considered up to two for simplicity.
For example, when embedding data in an image of a lower frequency component, it is conceivable to perform the wavelet transform by increasing the number of times.

In addition to the data embedding technique based on the wavelet analysis described above, the embedding may be performed by embedding processing by DCT (discrete cosine transform) processing.

For example, Japanese Patent Application Laid-Open No. Hei 10-290424 discloses a technique for embedding character information by an embedding technique using DCT.

In the above description of the embodiment, the case of embedding data in an image has been described, but a method of embedding an identification signal in an audio signal is also conceivable.

For example, as described in an embodiment below, it is possible to determine whether an audio signal is a music signal or not, generate an identification signal in accordance with the signal, and embed the identification signal in the audio signal by predetermined signal processing. Conceivable.

As a technique for embedding data in an audio signal,
For example, there is a technique disclosed in Japanese Patent Application Laid-Open No. 2000-196861, et al., But it is possible to embed predetermined identification data by using an auditory characteristic of a human voice signal such as a masking effect.

(2) Example of Block Configuration of Embodiment [2.1] Recording System Signal Processing First, the recording system signal processing will be described. FIG. 3 is an example of a block configuration diagram when the present embodiment is applied to a recording / reproducing apparatus. In this embodiment, a case where the video data is analyzed to detect a similar scene and a scene change is detected, and a case where the audio data is analyzed to detect a musical sound section are considered. The case of embedding in "."

The video signal is converted to a video signal A / D conversion processing system 31.
And a predetermined A / D conversion process is performed. The processed video signal is input to a data embedding processing system 32 and a video data analysis system 42.

The video data analysis system 42 performs a scene change detection process, a similar scene detection process, and the like with a configuration as shown in FIG. 4 described later.

Here, scene change detection can be performed by calculating the difference between frames of video data, and similar scene detection can be performed by calculating, for example, errors in the average luminance signal level and color signal level of a predetermined portion. Can do it.

FIG. 4 shows an example of a block configuration of a video data analysis system. In the example of FIG. 4, data of three lines in the horizontal direction is considered after averaging the input image data in the horizontal and vertical directions, for example, by 1/4, respectively. You may also
Data in the vertical and oblique directions can also be considered.

The average level calculation systems 51 to 53 calculate the average luminance levels of the three parts A to C. In some cases, an average color difference level may be used.

When a user inputs a command to the system controller system 49 to detect a scene similar to an image of a certain scene, the analysis data of each part is temporarily stored in the data memory systems 54 to 56, and is sequentially analyzed. The data to be processed and data operation processing systems 57 to 59 perform predetermined operation processing such as error operation processing.

The outputs from the data operation processing systems 57 to 59 are input to comparison processing systems 60 to 62, are compared with a predetermined threshold value, and are input to a determination processing system 63.
For example, similar scene detection is determined by majority processing.

In the comparison processing of each part in the comparison processing systems 60 to 62, weighting processing may be performed in some cases. For example, in the case of a broadcast program, text information such as a telop may be displayed at the upper or lower part of the screen, and a process such as giving a margin to the threshold relatively to the part at the center may be considered. .

The scene change detection can be performed by a configuration similar to the block configuration of FIG. In that case,
The data memory systems 54 to 56 are frame memories, and when a scene change is detected, there is a high probability that the change in the characteristics of the analysis data becomes large.
By comparing it with a predetermined threshold value at ~ 62, it can be detected in the same manner as in the case of the similar scene detection described above.

Returning to FIG. 3, the audio signal is input to the audio signal A / D conversion processing system 43, subjected to a predetermined A / D conversion process, and input to the audio signal encoding processing system 44 and the audio data analysis 50.

The audio signal encoding processing system 44 performs a predetermined data compression process and then inputs the data to the multiplexing processing system 34.

In the audio data analysis processing system 50, for example, after extracting audio data for each predetermined section, FFT (Fast Fourier Transform) processing is performed to detect the time-system continuation length of the spectrum peak, and a predetermined threshold value is set. An audio signal having a long peak duration in the comparison processing is determined to be a tone signal.

Here, regarding the sound detection, for example, as described in “Technical Report of the Institute of Television Engineers of Japan (published on February 3, 1995)“ Video browsing interface using sound information ”, There is disclosed a technique that can be performed by detecting an envelope and determining its characteristics.

The output from the video data analysis system 42 and the output from the audio data analysis system 50 described above are input to the system controller system 49, and the detection sections are a similar scene detection section, a scene change time point, and a tone signal detection section. An identification signal for identifying such as is generated by the identification signal generation system 41.

The predetermined identification signal generated by the identification signal generation system 41 is input to a data embedding processing system 32, where a predetermined data embedding process is performed, and then a predetermined encoding process is performed by a video signal encoding processing system 33. Is input to the chemical processing system 34.

The multiplexing processing system 34 multiplexes the predetermined encoded image data and audio data, the predetermined time stamp signal from the system controller system 49, and the like, and the recording signal processing system 35 adds an error correction code. For example, predetermined signal processing is performed and recorded on the recording medium 36.

By the way, in the above description, the processing by wavelet transform can be used for the compression processing of the image data in the video signal encoding processing system 33. In this case, the signal processing system integrated with the data embedding processing system 32 is constituted. There is an advantage that the system configuration is simplified.

[2.2] Reproduction System Signal Processing Next, reproduction system signal processing will be described. The signal reproduced from the recording medium 36 is subjected to predetermined signal processing such as error correction processing in a reproduction signal processing system 37 and input to a reproduction signal separation processing system 38, where predetermined data such as video data, audio data, and time stamp data are separated. It is processed.

The separated video data is input to a video signal decoding processing system 39 and is subjected to a predetermined decoding process, and then is input to a video signal D / A conversion processing system 40 and specified D / A conversion processing is performed.
A conversion processing is performed, and a video signal is output.

Similarly, the audio data is input to an audio signal decoding processing system 47, where the audio data is subjected to a predetermined decoding process. The audio signal D / A conversion processing system 48 performs a predetermined D / A conversion process, and the audio signal is output. You.

The signal from the video signal decoding processing system 39 is input to an embedded data detection system 46, which detects predetermined identification data embedded in image data by predetermined signal processing, and inputs the same to a system controller system 49.

The system controller system 49 controls the recording medium control system 45 to perform predetermined special reproduction according to the detected special reproduction identification signal when a user input command is received.

(3) Modification 1 [3.1] Recording Signal Processing System FIG. 5 is a block configuration example of a modification of the present embodiment.
First, the recording signal processing system will be described. Here, there is a portion that overlaps with the operation description in the embodiment of FIG. 3 described above, and thus a different portion will be described.

In this modification, the analysis data itself is embedded in the image data and recorded instead of the special reproduction identification data.

In the similar scene detection of the above-described embodiment, it is assumed that the user inputs a detection command at the time of recording and performs similar scene detection. However, in this modification, analysis data is embedded, so that an arbitrary data is embedded. Any similar scene detection can be performed at the time.

The place where data is embedded need not be in the same frame as the recorded image data. If the position of the analysis data and the image data corresponding to the analysis data is known, the data may be recorded in a separate frame. .

For example, it is conceivable that the time or frame number from the start of recording on the recording medium and the analysis data are combined and embedded in the forward image data. In that case,
The image data may be temporarily stored in the memory by the data embedding processing system 32 of FIG. 5 and the data corresponding to the image data after that may be embedded.

Here, the analysis data to be embedded may be the data of the average luminance level in FIG. 4 described above.

Here, let us consider the amount of data to be embedded assuming that the recording time of the recording medium 36 is 2 hours. Assuming that the range of the average luminance level value is 0 to 255, the recording time of the first recording medium is 2 hours, and that the image data is 30 frames per second, the analysis data is 8 bits per part and 3 parts now. Therefore, the following equation (1) is obtained.

[0087]

## EQU1 ## 3 (part) × 8 (bit) = 24 (bit)

Since the number of frames of an image is considered to be two hours, the following equation (2) is obtained.

[0089]

2 (time) × 60 (minutes) × 60 (seconds) × 30 (frames / second) = 216000 (frames) This is 18 bits. From the above, the following Expression 3 is obtained.

[0090]

[Formula 3] 24 (bits) +18 (bits) = 42 (bits) From this, it can be seen that it is sufficient to embed at most 24 (bits) of data.

[3.2] Reproduced Signal Processing System Next, the reproduced signal processing system will be described. Since there is a portion that overlaps with the description of the operation in the embodiment of FIG. 3, a different portion will be described.

As in the case of FIG. 3, the embedded data detection system 46 detects predetermined data embedded from image data.

As described above, the detected data is analysis data in this modified example.

When the user inputs a command to the system controller system 49 to detect a similar scene at a certain point in time, the data detected by the embedded data detection system 46 is stored in the data memory system 70.

Thereafter, similarly to the case of FIG. 4 described above, predetermined processing such as error calculation processing is performed by the data calculation processing system 71 and the data detected sequentially, and the output is input to the system controller system 49. .

In response to the output signal from the data operation processing system 71, the system controller system 49
5 to perform special reproduction such as detection of a predetermined similar scene.

(4) Modification 2 As a method for embedding the data for special reproduction, for example, a method of replacing the uppermost or lowermost data of the image data on the screen, or replacing and using the rightmost or leftmost data may be used. Conceivable.

When the horizontal data at the bottom of the screen is used as the identification data, the data has a visual effect on the screen.

(5) Example of Operation Flowchart FIG. 6 is an example of an operation flowchart of the present embodiment. Here, for the sake of simplicity, in the operation described in the above-described embodiment, the audio signal is analyzed, a tone section is detected, a predetermined identification signal is generated, embedded in the image data, and recorded. In the case of the reproducing operation, a special reproducing operation for skip-reproducing a musical sound section will be described.

First, starting from step S0, it is determined in step S1 whether the mode is the recording mode or the reproducing mode. If the mode is the recording mode, the process proceeds to the next step S2, and if the mode is the reproducing mode, the process proceeds to step S10.

In the case of the recording mode in step S1, the voice data is sequentially analyzed for each predetermined section in step S2, and it is determined in step S3 whether or not the section is a tone signal section.

If it is determined in step S3 that the section is a tone signal section, then in step S4, as the identification signal ID, for example, <1
>, Otherwise <0> is generated as the identification signal ID in step S9.

At step S5, the generated identification signal is embedded in the image data by a predetermined signal processing, and
At 6, the data is recorded on a predetermined recording medium.

At step S7, it is determined whether the stop or the recording medium capacity is completed. If the stop or the recording medium is completed, the operation is stopped at step S8.
If not, the process returns to step S2 to continue the operation.

In the case of the reproduction mode in step S1, it is determined in step S10 whether the mode is the special reproduction mode or the normal reproduction mode. In the case of the special reproduction mode, the process proceeds to step S11 and shifts to the special reproduction mode.

In step S12, after predetermined data reproduction, embedded data detection is performed. In step S13, the identification signal ID of the embedded data is determined.
Is <1>, which is determined to be a tone signal, step S1
4 and a skip reproduction operation is performed.

If the detected identification signal ID is <0>, a predetermined reproducing operation is performed in step S16 and step S15
Then, it is determined whether or not the stop or the recording medium capacity is completed.

If it is determined in step S15 that the operation has been stopped or the recording medium capacity has ended, the operation shifts to step S8 to stop the operation. Otherwise, the operation returns to step S12 to continue the operation.

If it is determined in step S10 that the reproduction is the normal reproduction, the flow shifts to step S17 to start the reproduction operation, and the flow advances to step S17.
At 18, it is determined whether the stop or the recording medium capacity is completed. If the stop or the recording medium capacity is completed, the process is stopped at step S8. If not, the process returns to step S10 to continue the operation.

(6) Another Example of Operation Flowchart FIG. 7 is another example of an operation flowchart according to the present embodiment. In the operation flowchart of FIG. 6 described above, the process of embedding data at the time of recording is performed for all image data. However, as described in the operation principle of the present embodiment, for example, scene change of an image may be performed. It is also conceivable to embed data only at a point in time or in the neighborhood thereof.

The description of the operation flowchart of FIG. 6 overlaps with that of the first embodiment, and therefore, a different operation flow will be described here.

The operation from step S0 to step S4 in FIG. 7 is the same as that in FIG. 6. After a predetermined identification signal ID is generated in step S4 or step S9, step S2 is performed.
At 0, as described above, it is determined whether it is a predetermined embedded signal processing time or a section such as a scene change time.

If it is a predetermined signal processing time, a predetermined data embedding process is performed in step S5, and a recording process is performed after the predetermined encoding process in step S6.

If it is determined in step S20 that the time is not the predetermined signal processing time or section, the data embedding process is not performed, and the process proceeds to step S6 where the image data in which no data is embedded is subjected to the predetermined encoding process. Recording processing is performed.

In the present embodiment described above, an example is shown in which an identification signal is inserted at the time of a scene change, or an identification signal may be inserted in all sections of a scene change. Further, in the above-described embodiment, the recording / reproducing apparatus has been described, but it goes without saying that the present invention can be applied to the recording apparatus and the reproducing apparatus. In the above operation flowchart, only the audio signal has been described,
The same applies to video signals.

[0116]

According to the present invention, there is no need to specially provide an identification data recording area for special reproduction in addition to an information signal recording area in various recording media.

Thus, even when copying or editing between different types of recording media, or when converting a recorded broadcast program into data, the same effective digest reproduction as that of the first recorded recording medium can be easily performed. .

Further, instead of embedding the embedding data in the entire section of the signal, the embedding data is set at a predetermined characteristic change point or section of the original information signal, so that the data can be embedded when viewed in the entire video / audio signal sequence. The deterioration of the characteristics of the video and audio signals due to the above is small.

Further, when embedding data is made random and is embedded in an image by dispersing only data corresponding to, for example, bit <1>, the influence on the image quality can be further reduced. A special reproduction system that does not depend on the system can be realized with a relatively simple configuration.

Further, in the recording processing, for example, it is possible to incorporate the processing into a predetermined encoder system such as wavelet transform or DCT processing, thereby simplifying the system configuration and inexpensively configuring the apparatus.

[Brief description of the drawings]

FIG. 1 is a diagram for explaining the operation principle of the present embodiment, and FIG.
1B shows an original image sequence and an image sequence after processing. FIG. 1B shows a wavelet conversion screen for explaining data embedding by screen division, and FIG. 1C shows a wavelet conversion screen for explaining data embedding by screen division. Assignment of embedded data, FIG. 1D is an example of embedded data.

2A and 2B are explanatory diagrams of multi-resolution analysis of an image by wavelet transform. FIG. 2A is a conceptual diagram of wavelet transform, and FIG. 2B is a conceptual diagram of an image of wavelet transform.

FIG. 3 is a diagram illustrating an example of a block configuration according to the present embodiment.

FIG. 4 is a diagram showing an example of a block configuration of a video data analysis system.

FIG. 5 is a diagram showing an example of a block configuration of a modification.

FIG. 6 is a diagram illustrating an example of an operation flowchart.

FIG. 7 is a diagram showing an example of another operation flowchart.

[Explanation of symbols]

31 video signal A / D conversion processing system, 32 data embedding processing system, 33 video signal encoding processing system, 3
4 multiplex processing system 35 recording signal processing system 36
... Recording medium, 37 ... Reproduction signal processing system, 38 ... Reproduction signal separation processing system, 39 ... Video signal decoding processing system, 40
… Video signal D / A conversion processing system, 41… identification signal generation system, 42… video data analysis system, 43… audio signal A /
D conversion processing system, 44... Audio signal encoding processing system, 4
5 recording medium control system, 46 embedded data detection system, 47 audio signal decoding processing system, 48 audio signal D / A conversion processing system, 49 system controller system, 50 audio data analysis System, 51 ... A part average level calculation system, 52 ... B part average level calculation system, 53 ... C
Partial average level calculation system, 54 Data memory system, 55
…… Data memory system, 56 …… Data memory system, 5
7 Data processing system 58 Data processing system
59: Data operation processing system, 60: Comparison processing system, 61
... Comparison processing system, 62... Comparison processing system, 63... Determination processing system, 70... Data memory system, 71.

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI theme coat ゛ (reference) H04N 7/24 H04N 7/13 Z F term (reference) 5C053 FA14 FA15 GB09 GB40 HA21 HA29 JA01 JA30 5C059 KK36 KK43 MA24 NN43 PP04 RB14 RC00 SS19 5D044 AB05 AB07 DE03 DE17 DE49 EF05 FG18 FG23 GK08 5J064 AA05 BA16 BC01 BC02 BC06 BC07 BC14 BD03

Claims (20)

[Claims] 1. A characteristic data detecting means for detecting predetermined characteristic data from a first information signal for each predetermined section; and a second predetermined characteristic signal in response to a signal from the characteristic data detecting means.
An information signal generating means for generating an information signal of the first information signal;
A related information signal generating means which is generated at a predetermined time point or a predetermined section on the signal, and which is a third information signal generated in association with the third information signal; Recording means for recording the information signal on a predetermined recording medium. 2. The information signal processing device according to claim 1, wherein the first information signal is an image or an audio signal. 3. The related information signal generation process according to claim 1, wherein
The information signal of the first information signal is subjected to a predetermined frequency domain analysis or a signal processing of a predetermined time domain such that a normal reproduction characteristic of the first information signal is within an allowable range. 2. The information signal processing apparatus according to claim 1, wherein a signal is embedded. 4. The information signal processing apparatus according to claim 1, wherein the characteristic data is predetermined data that can identify a predetermined scene section in the first information signal. 5. The predetermined time point or the predetermined section in the first information signal is a predetermined characteristic change time point or a characteristic change section in the first information signal detected from the second information signal, or a characteristic change section thereof. 2. The information signal processing device according to claim 1, wherein the information signal processing device is a portion in the signal sequence of the first information signal capable of determining a time point and a section. 6. A characteristic data detecting means for detecting predetermined characteristic data from a first information signal for each predetermined section, and a predetermined second characteristic signal according to a signal from the characteristic data detecting means.
An information signal generating means for generating an information signal of the first information signal;
Related information signal generating means, which is generated at a predetermined time point or a predetermined section in the information signal, and is a third information signal generated in association with the information signal; and the third information signal output from the relevant information signal generating means. Recording means for recording the information signal on a predetermined recording medium, reproducing means for reproducing the third information signal recorded on the recording medium, and the first signal from the reproduction signal reproduced from the reproducing means. Signal separation detection means for separating and detecting an information signal and the second information signal; and reproduction control means for controlling the reproduction in accordance with the second information signal from the signal separation detection means. An information signal processing device characterized by the above-mentioned. 7. The information signal processing device according to claim 6, wherein the first information signal is an image or an audio signal. 8. The method according to claim 1, wherein the related information signal generation process includes the step of:
Embedding said second information signal by frequency domain analysis of said information signal or signal processing in a predetermined time domain such that the normal reproduction characteristic of said first information signal is within an allowable range. The information signal processing device according to claim 6. 9. The information signal processing device according to claim 6, wherein the characteristic data is predetermined data that can identify a predetermined scene section in the first information signal. 10. The predetermined time point or the predetermined section in the first information signal is a predetermined characteristic change time point or a characteristic change section in the first information signal detected from the second information signal, or a characteristic change section thereof. 7. The information signal processing device according to claim 6, wherein a time point and a section can be distinguished from each other in a signal sequence of the first information signal. 11. Detecting predetermined characteristic data from a first information signal for each predetermined section, generating a predetermined second information signal in accordance with a signal from the detection of the characteristic data, The second information signal to the first
A third information signal is generated at a predetermined time or a predetermined section of the information signal by a related information signal generation process, and the third information signal output from the related information signal generation process is recorded on a predetermined recording medium. Reproducing the third information signal recorded on the recording medium; separating and detecting the first information signal and the second information signal from a reproduced signal from the reproduction; An information signal processing method, comprising: controlling the reproduction in accordance with the second information signal. 12. The information signal processing method according to claim 11, wherein the first information signal is a video signal or an audio signal. 13. The related information signal generation processing includes a frequency domain analysis of the first information signal or a signal processing of a predetermined time domain such that a normal reproduction characteristic of the first information signal is within an allowable range. 12. The information signal processing method according to claim 11, wherein the second information signal is embedded by the following. 14. The information signal processing method according to claim 11, wherein the characteristic data is predetermined data capable of identifying a predetermined scene section in the first information signal. 15. The predetermined time point or the predetermined section in the first information signal is a predetermined characteristic change time point or a characteristic change section in the first information signal detected from the second information signal, or a characteristic change section thereof. The information signal processing method according to claim 11, wherein the time point and the section are determined as a portion in the signal sequence of the first information signal. 16. Detecting predetermined characteristic data from a first information signal for each predetermined section, generating a predetermined second information signal in accordance with a signal from the detection of the characteristic data; The second information signal to the first
And a third information signal output from the related information signal generation process at a predetermined time or a predetermined section of the information signal of the related information signal, and recorded on a predetermined recording medium. Signal recording medium. 17. The information signal recording medium according to claim 16, wherein said first information signal is a video signal or an audio signal. 18. The signal processing for generating the related information, wherein the first information signal is subjected to a frequency domain analysis or a signal processing in a predetermined time domain such that a normal reproduction characteristic of the first information signal is within an allowable range. 17. The information signal recording medium according to claim 16, wherein the second information signal is embedded by: 19. The information signal recording medium according to claim 16, wherein said characteristic data is predetermined data capable of identifying a predetermined scene section in said first information signal. 20. The predetermined time point or the predetermined section in the first information signal is a predetermined characteristic change time point or a characteristic change section in the first information signal detected from the second information signal, or a characteristic change section thereof. The information signal recording medium according to claim 16, wherein the information signal recording medium is a portion in a signal sequence of the first information signal that can determine a time point and a section.