JP2002124021A - Information signal processor, information signal processing method and information signal recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information signal processor which can easily perform special reproduction even when a copy record is performed between different recording methods, enhances the added value of a recording medium, and creates a possibility of utilization wider than before even with the same recording medium, and to provide an information signal processing method and an information signal recording medium. SOLUTION: When there is the recording medium main body 21 recording a prescribed image and sound, an original image and sound is analyzed to record a signal for special reproduction on another recording medium 22. Thereby, it becomes unnecessary to change the recording method or the like of the recording medium 22 for special reproduction to perform a copy when the recording medium main body 21 is copied to the other recording medium 22 by another recording method. The recording medium 22 for special reproduction recording the same data is loaded on the recording medium main body 21 of a copy destination.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a magnetic tape, a magneto-optical disk, a hard disk, a semiconductor memory, etc. capable of recording information signals such as video signals and audio signals, for recording video and audio signals such as movies and broadcast programs. An information signal processing device, an information signal processing method, and an operation for performing a predetermined digest reproduction operation or performing an operation of not reproducing only a predetermined climax scene or a predetermined signal section and efficiently grasping desired contents in a short time. The present invention relates to an information signal recording medium.

[0002]

2. Description of the Related Art With the development of information and communication technology, VTR (Vi
video tape recorder) or DVD (Dig)
MPEG (Moving) for consumer devices such as ital Versatile Disk
Picture Experts Group: video compression standard, JPEG (Joint Photograph)
phy Image Coding Experts
Group: Still image compression standard, DV (Digita)
l Video: Digital VCR for consumer (Video
Various recording techniques such as cassette recorder (Recording Standard) are used, and various recording media such as tapes, magneto-optical disks, hard disks, and semiconductor memories are widely used.

As a result, a large amount of information is recorded on various recording media, and information such as desired image and sound is searched for as efficiently as possible from the recorded recording medium, and the content is relatively compared among the efficiently recorded information. It may be required to grasp in a short time.

[0004] In a conventional system such as a VCR or DVD, a special reproduction function such as a high-speed reproduction function in the forward direction is provided so that an overview of a recorded broadcast program or the like can be viewed in a short time. Are doing.

There is also a technique in which an index signal for identifying a desired section is recorded on a video tape or the like in a predetermined recording area of the tape medium, and the other sections are jump-reproduced so that the desired section is reproduced at the time of reproduction. .

[0006]

However, VTRs and DVDs
In conventional high-speed playback, such as that, you can grasp the outline of the recorded broadcast program in a relatively short time, but sometimes skip the scene you want to see or the playback speed is too fast and you may not understand the contents well There was an inconvenience.

As described above, in the presence of various recording media and recording methods, it is also conceivable to use copy recording of image / audio signals between different recording media or between different recording methods.

In the case of recording the special reproduction identification signal on the tape as described above in consideration of such copy recording, it is necessary to consider that the identification signal is also separately copied and recorded, and the operation is complicated. Become.

In view of the above, the present invention can easily perform special reproduction even when performing copy recording between different recording methods, enhance the added value of the recording medium, and use the same recording medium. It is another object of the present invention to provide an information signal processing device, an information signal processing method, and an information signal recording medium that create a wider possibility of use than before.

[0010]

According to the present invention, there is provided an information signal processing apparatus comprising: a first information signal recorded on a first information signal recording medium or a first information signal recorded on a first information signal recording medium; When recording on the medium, the second information signal generated at the time of recording or reproduction of the first information signal and identifying a predetermined reproduction section of the first information signal recording medium is converted to the first information signal. A signal analyzing means for analyzing and generating, and a second information signal or a predetermined identification signal generated in response to a signal from the signal analyzing means, for a first information signal recorded on a first information signal recording medium. The second point corresponds to the playback point one-to-one.
Signal recording means for recording on the information signal recording medium.

Further, the information signal processing device of the present invention has a first
A first reproducing means for reproducing the first information signal recorded on the information signal recording medium, and a first information signal recorded on the second recording medium in a one-to-one correspondence with the reproduction on the first information signal recording medium. A second reproducing means for reproducing the second information signal, a signal analyzing means for analyzing a reproduced signal from the second reproducing means by a predetermined signal processing, and a first signal processing means for receiving a signal from the signal analyzing means. Reproduction control means for controlling the operation of the reproduction means.

Further, the information signal processing method of the present invention comprises the following steps:
Reproduction of the first information signal recorded on the information signal recording medium, and the second information signal recorded on the second recording medium in one-to-one correspondence with the reproduction on the first information signal recording medium. Is reproduced, the reproduction signal from the second reproduction is analyzed by predetermined signal processing, and the operation of the first reproduction is controlled according to the signal from the signal analysis.

Further, the information signal processing method of the present invention is characterized in that:
Generated from the first information signal recorded on the first information signal recording medium or when the first information signal is recorded on the first information signal recording medium during recording or reproduction of the first information signal. A second information signal for identifying a predetermined reproduction section of the first information signal recording medium, which is generated by analyzing the first information signal, and a predetermined identification generated in response to the signal from the signal analysis; The signal or the second information signal is one-to-one with the reproduction time of the first information signal recorded on the first information signal recording medium.
Is recorded on the second information signal recording medium so as to correspond to the above.

Further, the information signal recording medium of the present invention has a first
Generated from the first information signal recorded on the first information signal recording medium or when the first information signal is recorded on the first information signal recording medium during recording or reproduction of the first information signal. Generating a second information signal for identifying a predetermined reproduction section of the first information recording medium by analyzing the first information signal, and generating the second information signal in accordance with the second information signal or a signal from the signal analysis; The predetermined identification signal is recorded on the second information signal recording medium so as to have a one-to-one correspondence with the reproduction time of the first information signal recorded on the first information signal recording medium.

According to the information signal processing device, the information signal processing method and the information signal recording medium of the present invention, the following operations are performed. When a predetermined image / audio signal such as a movie or a broadcast program is recorded on a predetermined first information signal recording medium, or the image / audio signal is reproduced from the first information signal recording medium, and the climax scene is digest-reproduced. When performing a specific special reproduction, such as not reproducing a desired or similar scene or a predetermined signal section that is not considered to be a great obstacle to grasping the outline of the movie or broadcast program, such as a silent section, etc. A predetermined analysis process for generating an information signal necessary for the above is performed.

An information signal for performing special reproduction or an identification signal for performing special reproduction in accordance with a predetermined analysis process is generated, and the identification signal is used for reproduction of the first information signal recording medium.
Recording is performed on the second information signal recording medium so as to correspond to one to one. For example, a tape-shaped recording medium, a disk-shaped recording medium, a semiconductor memory, or the like is used as a first information signal recording medium,
When recording the first information signal from a first information signal such as an image / audio signal recorded on the information signal recording medium of the first type or when recording the first information signal on the first information signal recording medium, A second information signal necessary for performing a predetermined special reproduction such as a digest reproduction is generated by analyzing the first information signal.

A predetermined special reproduction identification signal is generated in accordance with the signal from the signal analysis, and the identification signal or the second information signal is reproduced at the time of reproduction of the first information signal recorded on the first information signal recording medium. And is recorded on the second information signal recording medium so as to correspond one to one.

[0018]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described with reference to the drawings in the following order. (1) Description of operation of embodiment (2) Example of block configuration of embodiment (3) Description of operation of modification (4) Example of block configuration of modification (5) Example of operation flowchart

(1) Description of the operation of the embodiment of the present invention In this embodiment, priorities for special reproduction of movies and broadcast programs are set in advance, and an identification signal (ID data) corresponding to the priorities is set. Is generated on a second recording medium different from the recording medium main body, which is the first recording medium for recording the movie or the broadcast program, so as to correspond one-to-one with reproduction of the first recording medium. The identification signal is recorded.

FIG. 1 is a conceptual diagram of the operation of this embodiment. FIG. 1A is a video scene at each time point 1 to 20, and it is assumed that there are scene changes C1, C2, C3, and C4 at time points 2, 8, 12, and 17, respectively.

In the scene change detection, data difference calculation is performed between adjacent image frames, or an average luminance level of a predetermined portion is calculated as described later, and difference calculation is performed between adjacent frames. Can be detected.

FIG. 1B shows a musical tone detection section. In this example, A1 and A1 are used in sections 14 to 16 and 19 to 20, respectively.
It is assumed that a tone is detected as indicated by A2.

The tone can be detected, for example, by performing FFT (Fast Fourier Transform) processing on the audio signal for each predetermined section and determining the time duration of the spectrum peak.

As a technique for detecting a musical tone signal section from an audio signal, for example, Kenichi Minami et al .: "Video browsing interface using sound information" (Technical Report of the Institute of Television Engineers of Japan, Vol. 19, No. 7, pp. 1-6) 1995)
A technique has been disclosed in which an audio signal is cepstrum-analyzed to determine a time duration.

FIG. 1C shows a temporal change of the average audio level in each predetermined section in each scene section.

The predetermined section is, for example, 0.1 second to 1 second.
Considering the range of seconds, and calculating the average audio level in that section.

In FIG. 1C, s1 and s2 are thresholds of the set sound level. As described above, it is assumed that the scene is simply a climax scene based on the sound level, and the sound level is s1 or less and s1 to s2 or s2 or more. Set the range.

Here, for the sake of simplicity, it is assumed that a broadcast program, a movie, or the like is considered, a tone signal and a silent section (small audio level section) are detected from the audio signal, and the reproduction order of the section is lowered. .

Further, the scene change detection and the sound level detection of the image are performed, and the priority of the reproduction is made higher in the scene change portion. Even when there is no scene change, the section where the sound level is higher than a predetermined value is assumed to be a climax section and the reproduction is performed. The priority shall be higher.

FIG. 1D is a conceptual diagram of the reproduction priority set from the above. For simplicity, priority levels 1 to 5 are considered. It becomes lower in the order of 3, 2, 1.

For example, in the ~ T1 section, the reproduction priority is 2, the reproduction priority is 5 for T1 and T2 because of scene change C1, the reproduction priority is 3 for T2 and T3, and the audio level is s2 or more for T3 and T4. Because of the climax, the reproduction priority is 4, T4 to T5 is reproduction priority 3, T5 to T6
Is a scene change C2, so the playback priority is 5, T6 ~
T7 is a reproduction priority of 3, T7 to T8 is a scene change C3, the reproduction priority is 5, T8 to T9 is a reproduction priority of 3, T9 to T10 is a scene change C4, and the reproduction priority is 5, T10 to T10. Has a reproduction priority of 3.

The identification signal is set in accordance with the priority. In this case, since three ranks are considered, three bits are sufficient as the identification data.

The special reproduction identification data as described above is used as a second recording medium, for example, in an EPROM (Erasable Prism).
Assuming that the data is recorded in a semiconductor memory such as a grammable read only memory), consider the required memory capacity.

Assuming that the image is 30 frames per second and the recording time is 2 hours, the number of frames is given by the following equation (1).
This amounts to 18 bits.

[0035]

[Equation 1] 2 (hours) x 60 (minutes) x 60 (seconds) x 30 (frames / second) = 216000 (frames)

The identification data is 3 as described above.
Since only bits are required, address 18 bits, data 3 bits
Memory is enough. FIG. 7A shows an example of a memory arrangement of identification data for special reproduction. In FIG. 7A,
A frame number is recorded in 18 bits of a memory address of the memory, and special reproduction priority data is recorded in 3 bits of data.

Here, as the second recording medium for recording the identification data as described above, a medium that can be mounted on the first recording medium as shown in FIGS. 2A and 2B can be considered.

In FIG. 2A, a label-shaped recording medium 22 is used as a second recording medium, and a recording medium main body 2 on which image data and audio data as a first recording medium are recorded.
It is assumed that a material such as an adhesive tape is attached to the back surface for attachment or attachment to the side surface of the device.

As shown in FIG. 2C, a label recording medium or a semiconductor memory 26 as a second recording medium is used.
A case 25, which is a mounting aid slightly larger than itself, can be pre-mounted on the first recording medium, and a label-shaped recording medium or a semiconductor memory 26 can be inserted into the case 25 or mounted in a self-contained manner. It is also conceivable to make

It is assumed that the label recording medium or the semiconductor memory 26 can write and read data without contact.

As a technique for writing and reading data in a non-contact manner as described above, for example, Japanese Unexamined Patent Publication No.
No. 308088, “Recording / reproducing device and method, input / output device and method, storage device, sending device, and information processing device and method”, discloses a technique of writing and reading data wirelessly by electromagnetic coupling using a memory label. ing.

Similar processing may be performed by electrostatic coupling in addition to the non-contact data writing and reading by electromagnetic coupling.

FIG. 2B shows a case where a small semiconductor memory 24 as a second recording medium is mounted on a part of the surface of a recording medium main body 23 on which image data and audio data as a first recording medium are recorded. , This small semiconductor memory 24
Then, the special reproduction identification data corresponding to the position where the image and audio data are recorded on the first recording medium is written and read.

As a technique for writing and reading data corresponding to data recorded on the recording medium body one-to-one by using such a small memory, for example, Japanese Patent Application Laid-Open No. There is a technique of mounting a small memory on a video cassette tape, transmitting and receiving data by connection, and writing and reading data.

(2) Example of Block Configuration of Embodiment FIG. 3 is an example of a block configuration diagram of a signal processing device of a recording signal processing system of the present embodiment. This figure is a block diagram of a recording system, and reproduction will be described later.

The video signal is a video signal A / D conversion processing system 31
, And a predetermined A / D conversion process is performed, and is input to the video signal encoder processing system 32 and the video signal analysis processing system 36.

The video signal encoder processing system 32 is, for example, an MPEG (Moving Picture Exp) for recording the compressed image data on the first recording medium 35.
erts Group 2), and the video signal analysis processing system 36 detects a scene change by a predetermined analysis process such as an inter-frame difference process.

A signal from the video signal encoder processing system 32 is input to a multiplexed signal processing system 33, and a signal from an audio encoder processing system 38 and a time stamp signal of a time code Tc from a system controller system 47, which will be described later. Multiplexing processing is performed with predetermined data.

The data from the multiplexed signal processing system 33 is input to the recording signal processing system 34 and is recorded on the first recording medium 35 after being subjected to predetermined error correction code addition, predetermined signal processing such as interleaving processing or scrambling processing, and the like. Is done.

The audio signal is converted to an audio signal A / D conversion processing system 37.
After a predetermined A / D conversion process is performed, the audio signal encoder processing system 38 and the audio signal level detection system 4
3. Input to the FFT analysis system 45.

In the audio signal encoder processing system 38, MP
Compressed signal processing of predetermined audio data such as EG audio is performed, input to the multiplexed signal processing system 33, and predetermined multiplexed signal processing is performed with other signals.

The FFT analysis system 45 performs an FFT analysis on the audio signal for each predetermined section, calculates a power spectrum in the next tone detection system 46, finds a spectrum peak, detects the temporal continuation length and the like by arithmetic processing, and detects a tone signal. Is detected.

The signal from the video signal analysis processing system 36, the signal from the audio level detection system 43, and the signal from the musical sound detection system 46 are input to an analysis signal determination processing system 44, for example, an image signal for special reproduction. Is calculated by the predetermined processing as described in the operation of the above-described embodiment.

The signal from the analysis signal determination processing system 44 is input to the system controller system 47, and the identification data generation system 3
In step 9, predetermined identification data is generated.

The address generation system 40 generates a write address when the second recording medium 42 is a semiconductor memory.

The recording signal processing system 41 transfers the data from the identification data generating system 39 and the address generating system 40 to the first recording medium 35 mounted on the first recording medium 35 as described in the operation of the above embodiment. A process for writing predetermined data to the second recording medium 42 in a non-contact manner or by transmitting a predetermined signal is performed.

In the above description of the embodiment, the writing of the identification data to the second recording medium is performed automatically. For example, it is assumed that a drama in a movie or a broadcast program is produced or edited. It is also conceivable to manually record the identification signal by hand.

Next, the reproducing system will be described. FIG. 4 is a block diagram of a reproduction signal processing system. This apparatus detects an identification signal from a second recording medium and performs a predetermined special reproduction.

The data recorded on the first recording medium 35 is subjected to predetermined signal processing such as error correction and deinterleaving by a reproduction signal processing system 50, and is input to a reproduction data separation processing system 51.

Video data,
Predetermined data such as audio data and time stamps are separated, video data is decoded by video data decoding processing system 52 at the time of recording by MPEG2 or the like by predetermined processing, and audio data is processed by audio signal decoding processing system. At 54, a predetermined decoding process is performed on data compressed at the time of recording with MPEG audio or the like.

The time stamp data and the like separated by the reproduction data separation processing system 51 are transmitted to the system controller 47.
And the decoded video data is the video signal D
/ A processing system 53, and the audio data is an audio signal D / A
The signals are input to the processing system 55, subjected to predetermined D / A conversion processing, and output.

From the second recording medium 42 to the reproduction signal processing system 5
7, predetermined identification data is read by a read address generated in the address generation system 58 under the control of the system controller 47.

The read predetermined identification data is input to the system controller 47, and the reproduction control system 56 is controlled in accordance with the identification data to control the reproduction of the first recording medium 35 to perform the predetermined special reproduction. .

(3) Modification of the Embodiment In the embodiment described above, the first recording medium for generating an identification signal (ID data) for special reproduction such as digest reproduction and recording an image / audio signal. Although the identification signal is recorded on another second recording medium corresponding to the reproduction of the main body on a one-to-one basis, this modification does not record the identification signal on the second recording medium but performs special reproduction. The necessary analysis data itself is recorded on the second recording medium.

For example, if the analysis data of the image signal itself is recorded on the second recording medium, the analysis data can be read out before the image signal is reproduced, and a similar scene of a certain image is detected. In consideration of the above, the analysis data of the image to be detected for similarity is read out, temporarily stored in a memory, the analysis data other than the image is sequentially read out, and the analysis data stored in the memory is correlated with a predetermined calculation such as a correlation calculation or an error calculation. A similar image can be detected by performing arithmetic processing and comparing and judging with a predetermined threshold value.

By recording the analysis data on the second recording medium, the judgment process and the threshold value setting can be performed by the reproduction system, so that the special reproduction such as the predetermined digest reproduction is completed within the time desired by the user. Parameters such as thresholds can be set.

FIG. 5 is a conceptual diagram of the similar image detection described above. FIG. 5A shows an example of an image scene, for example, a news program of a broadcast program.

In the news program, an announcer first gives an overview of the news, and then broadcasts the news in detail or broadcasts a place where the incident occurred.

Therefore, the summary of the news program can be grasped by digest-reproducing the part where the announcer speaks the summary of the news.

In each of the image scenes shown in FIG.
Consider b and c and three parts or an area near the three parts, and calculate an average luminance level in the part or the area near the three parts.

Each section of the image scenes 1 to 3 and 7 to 9 in FIG. 5A is a part where an announcer appears on the screen, and each image is similar.

FIG. 5B, FIG. 5C, and FIG. 5D show the characteristics of the average luminance level in the areas a, b, and c or the areas near each described above.

For example, looking at the characteristics of the portion a in FIG. 5B,
It can be seen that the image scene sections 1 to 3 and 7 to 9 sections are similar image sections and their average luminance levels fall within almost the same range a1 to a2.

Similarly, it can be seen that the average luminance levels of the parts b and c in FIGS. 5C and 5D are in the ranges of b1 to b2 and c1 to c2 in the similar image scene sections 1 to 3 and 7 to 9 respectively.

Therefore, as described above, for example, the user designates the time point of an image for which he or she wants to detect similarity, and analyzes data an, bn, and cn of the portions a, b, and c, and analysis data ax of the unspecified portion. , Bx, and cx, or three analysis data values, respectively, are assumed to be vector components (an, bn, cn) and (ax, bx, cx). It is considered that there is a high possibility that a section equal to or less than the value is a similar section.

That is, the distance L between vectors is given by
It becomes an expression.

[0077]

L = | an-ax | + | bn-bx | + | cn
−cx |

Assuming that the threshold value is Lth, a section represented by the following equation 3 is set as a similarity detection section.

[0079]

L <Lth

Alternatively, the distance L between the vectors is given by
Equation 5, Equation 5 and Equation 6 are obtained.

[0081]

L1 = | an-ax |

[0082]

L2 = | bn−bx |

[0083]

L3 = | cn−cx |

The threshold values L1th, L2th, L3
When th is set, a section represented by the following Expression 7, Expression 8, and Expression 9 is set as a similarity detection interval.

[0085]

L1 <L1th

[0086]

## EQU8 ## L2 <L2th

[0087]

## EQU9 ## L3 <L3th

Here, looking at the characteristics of the portion c in FIG. 5D, there are cases where the similarity detection determination range (c1 to c2) exists in the vicinity of the image scene sections 4 to 5 and 12 to 13; Considering the logical product (AND) condition of Expressions 7 to 9, the probability of erroneous detection is low.

Here, for the sake of simplicity, the average luminance levels of three portions in the horizontal direction have been considered. However, the luminance levels of more portions may be considered, and the characteristics in the vertical direction may also be considered. .

In addition to considering the average luminance level from the frequency domain signal in the baseband of the image,
Attention is paid to data in the frequency domain processed by EG, wavelet transform, etc., and the value of a predetermined horizontal or vertical portion is calculated as described above, and predetermined processing such as error calculation as described above is performed and determined. Processing is also conceivable.

Here, when the analysis data is recorded on the recording medium, it may be performed for all frames or fields of the image signal. However, as shown in FIG. 6A, scene change points TA, TB, TC, TD, TE, T
F and TG are detected, and the analysis data near the scene change shown in FIG.
As in f3, f4, f5, f6, and f7, for example, recording for several frames to several tens of frames may be considered.

In the example of FIG. 6A, TA, TB, TC, T
Scene changes have occurred at each time point of D, TE, TF, and TG.
As shown in FIG. 6B, f is a section after the scene change.
The analysis data is recorded in each section of 1, f2, f3, f4, f5, f6, f7.

The scene change can be detected by calculating the difference of the image data between adjacent frames or fields, and calculating the difference of the average luminance level described above between the adjacent frames. Detection is also conceivable.

In the above example, the average luminance level is considered.
The same can be considered by considering the average color difference signal of the predetermined portion.

It is also conceivable that the same processing as described above is performed using wavelet transform of image data and using an average coefficient of a predetermined portion or an FFT (fast Fourier transform) or DCT (discrete cosine transform) coefficient for each subband.

Here, as an example, the average luminance level of the three portions in the horizontal direction described above is used as the analysis data,
For example, an EPROM (Erasable Programmable Re
ad Only Memory) and consider the required memory capacity assuming semiconductor memory.

Assuming that the range of the average luminance level value is 0 to 255, the recording time of the first recording medium is 2 hours, and that the image data is 30 frames per second, the analysis data is 8 bits per part. I'm thinking about three parts now,
It becomes 24 bits as in the following equation (10).

[0098]

## EQU10 ## 3 (part) × 8 (bits) = 24 (bits)

Since the number of frames of an image is two hours, the number of frames is represented by the following equation (11).

[0100]

[Equation 11] 2 (hours) × 60 (minutes) × 60 (seconds) × 30 (frames / second) = 216000 (frames) This is 18 bits.

As described above, the second recording medium has the address 18
It turns out that only 24 bits are required.

Here, as an example, FIG. 7B shows an example of a memory arrangement of analysis data for special reproduction in a memory. FIG.
In B, a frame number is recorded in 18 bits of a memory address of this memory, and a partial analysis data, a b partial analysis data, and a c partial analysis data are recorded in 24 bits of data.

(4) Example of Block Configuration of Modification Example FIG. 8 is an example of a block configuration diagram of a signal processing device of a recording signal processing system in the modification example described above. This drawing is an example of a block configuration of a recording system, and a reproducing system will be described later.

The video signal is a video signal A / D conversion processing system 31
, And a predetermined A / D conversion process is performed, and is input to the video signal encoder processing system 32 and the video signal analysis processing system 36.

The video signal analysis system 36 performs an average luminance level or wavelet transform of a predetermined portion, and analyzes and calculates an average coefficient of the predetermined portion.

In some cases, it is conceivable to use the data processed by the video signal encoding processing system 32 to use the average data in a predetermined portion or the analysis data itself in the encoding process.

The audio signal is converted to an audio signal A / D conversion processing system 37.
, A predetermined A / D conversion process is performed, a predetermined signal process such as MPEG audio is performed in an audio signal encoding processing system 38, and the resulting signal is input to a multiplexed signal processing system 33.

The multiplexed signal processing system 33 performs predetermined multiplexed signal processing on a signal from the video signal encoder processing system 32, a signal from the audio signal encoder processing system 38, and data such as time stamp data from the system controller 47. .

The data from the multiplexed signal processing system 33 is subjected to predetermined error correction code addition, interleaving or scrambling by a recording signal processing system 34, and the data is recorded on a first recording medium 35.

In the address generation system 40, the second recording medium 4
2 is generated and input to the recording processing system 41, and the data from the video signal analysis processing system 36 is recorded on the second recording medium 42 by the same processing as in the above-described embodiment.

Next, an example of a block configuration of a modified reproduction signal processing system will be described with reference to FIG. First recording medium 3
The data recorded in 5 is subjected to predetermined signal processing such as error correction and deinterleaving by a reproduction signal processing system 50 and input to a reproduction data separation processing system 51.

Video data,
Predetermined data such as audio data and time stamps are separated, and the video data is
The data compressed at the time of recording by PEG2 or the like is decoded by a predetermined process, and the audio data is subjected to a predetermined decoding process at the audio signal decoding processing system 54 on the data compressed at the time of recording by the MPEG audio or the like.

The time stamp data separated by the reproduced data separation processing system 51 is transmitted to the system controller 47.
And the decoded video data is the video signal D
/ A processing system 53, and the audio data is an audio signal D / A
The signals are input to the processing system 55, subjected to predetermined D / A conversion processing, and output.

According to the read address generated by the address generation system 58 under the control of the system controller system 47, predetermined analysis data is read from the second recording medium 42 via the reproduction signal processing system 57.

The predetermined analysis data read from the second recording medium 42 is transmitted to the data memory system 91 by a control signal indicated by a dotted line when there is a user input to the system controller system 47 and a command for a similar scene detection operation is issued. The analysis data at the time of the similarity detection is temporarily stored in the memory.

The analysis data temporarily stored in the data memory system 91 is subjected to predetermined judgment signal processing for each frame by the judgment processing system 90 with the analysis data sequentially read out.
The output is input to the system controller system 47.

The system controller system 47 controls the reproduction control system 56 in accordance with the signal from the determination processing system 90, controls the reproduction of the first recording medium 35, performs a predetermined similar scene detection operation, and performs a special reproduction operation. .

(5) Example of Operation Flowchart of the Present Embodiment FIG. 10 is an example of an operation flowchart of the present embodiment. In this flowchart, when the user wants to perform similarity detection during the above-described reproduction, a scene is designated at a desired time, a predetermined section is reproduced at the time of similarity detection, and a portion other than the detected section is skipped to perform special reproduction.

Starting from step S1, step S1
In step 2, N = 0 is input as the initial value of the number of times of similarity designation, and in step S3, the first and second recording media are reproduced.

At step S4, it is determined whether or not the user wants to specify the similarity. If the user wants to specify the similarity, the process proceeds to the next step S5, where the specified number N is incremented by one, and the scene is specified at step S6. The specification may be made at a plurality of locations each time the value is incremented.

Since the reproduced scene is often a moving image, it is determined in step S7 whether or not the designated time is the time desired by the user. If the designated scene is as desired, the second recording at that time is performed in step S8. Temporarily stores the characteristic data reproduced from the medium.

Here, in order to determine whether or not the scene at the time point designated by the user is the desired one, for example, the image at the designated time point is displayed as a small screen as a multi-screen on the playback screen as a still image so that it can be confirmed. Just do it.

If the scene specified in step S7 is not the desired scene, it is determined in step S9 whether or not the scene is to be re-designated. The end is determined in step S10, and stopped in step S21.

If the process is not ended in step S10, the designation is made again in step S11, and the process returns to step S7 to retry the designation operation.

If no similar designation is made in step S4 and if no re-designation is made in step S9, the flow shifts to step S12 to determine whether or not the recording medium is to be terminated and whether or not the user is to stop the operation. If the operation is to be continued, the designated number of similar scenes is checked in step S13.

If it is determined in step S13 that a similar scene has already been designated, similarity can be detected.
In step S14, it is determined whether or not to perform similarity detection.

When the similarity is detected in step S14, the characteristic data temporarily stored in step S8 is read out in step S15, and a predetermined similarity detection calculation is performed on the characteristic data reproduced from the second recording medium in step S16.

In step S17, it is determined whether or not the detected operation value is within a predetermined threshold value. If it is determined that the similarity is detected within the predetermined range, in step S24, a nearby predetermined section including the detection section is determined. Reproduce.

In step S25, it is determined whether or not to stop, and if so, step S21
To stop the operation.

If it is determined in step S17 that the scene is not a similar scene, reproduction control is performed in step S18.
At 19, a skip operation is performed to perform special reproduction. Step S2
It is determined whether or not to stop at 0, and if so, the operation is stopped at step S21. If the playback is not to be stopped, it is determined in step S22 whether or not the playback is the normal playback.

If the special reproduction operation for similarity detection is continued in steps S22 and S25, the process returns to step S16, and the similarity detection operation is repeated.

When similarity detection is not specified in step S13, when it is determined in step S14 that the user does not want to perform the detection operation even when similarity is specified, and in step S22, the special reproduction operation for similarity detection is performed. If not performed, the process proceeds to step S23 to perform normal reproduction.

In step S23, a normal reproduction operation is performed, and the flow returns to step S4 to determine whether or not a similar designation is made, and the operation described above is repeated.

In the present embodiment described above, the identification signal for special reproduction is recorded on the second recording medium different from the first recording medium on which image data and audio data are recorded. It is also possible to reproduce the identification signal at 10 times speed with respect to the data, and it is possible to improve the added value.

Further, in the above-described embodiment, an example has been described in which the reproduction priority is set higher in a sea change or a climax section, but the reproduction priority may be set according to the reproduction time length. .

Further, in the above-described embodiment, an example has been described in which the identification signal for trick play is recorded on the second recording medium different from the first recording medium. An identification signal for trick play may be recorded on a removable second recording medium.

Further, in the above-described embodiment, an example has been described in which the reproduction priority is set such that the sea change is set highest and the climax section is set next high. Accordingly, the reproduction priority may be arbitrarily set.

[0138]

According to the present invention, for example, when there are several soft tapes or disk recording media on which a predetermined image and sound such as a movie are recorded, the original image and sound are analyzed and the special reproduction signal is converted to another signal. When recording on a recording medium, if the soft tape or disk recording medium is copied to another recording medium by another recording method, it is not necessary to copy the special reproduction recording medium by changing the recording method etc. Instead, a special reproduction recording medium on which the same data is recorded can be mounted on the recording medium of the copy destination.

When the soft tape or disk recording medium is distributed for sale or rental, a recording medium on which special reproduction data is recorded is distributed according to the purpose, so that all the images and sounds of the movie can be reproduced. Since it is possible to grasp the outline without performing such operations, the added value of the soft tape or the disk recording medium is increased, and there is a possibility that the range of methods of sale, rental, and the like is expanded.

Also, since the special reproduction data is recorded on another recording medium, it is not necessary to provide a recording area specially on the same recording medium as the recording medium on which the image and audio data is recorded, so that the recording capacity can be used effectively. become.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram of an operation concept of the present embodiment, and FIG.
Is an image scene, FIG. 1B is music detection, FIG. 1C is an audio level, and FIG. 1D is a reproduction priority.

FIG. 2 is a conceptual diagram of a recording medium according to the embodiment;
FIG. 2B shows an example of a method of mounting a second recording medium, and FIG. 2C shows an example of a method of mounting a second recording medium.

FIG. 3 is a block diagram of a signal processing device of a recording signal processing system according to the embodiment.

FIG. 4 is a block diagram of a signal processing device of a reproduction signal processing system according to the present embodiment.

5A and 5B are explanatory diagrams of an operation of a modified example, in which FIG. 5A is an image scene, FIG. 5B is an average luminance signal level of a portion, and FIG.
FIG. 5D shows the average luminance signal level of the portion c.

FIG. 6 is an explanatory diagram of a scene change concept of a modified example,
FIG. 6A shows an image scene, and FIG. 6B shows an analysis data recording section.

FIG. 7 is an example of a conceptual diagram of a data arrangement on a recording medium;
FIG. 7A shows an example of identification data for special reproduction, and FIG. 7B shows an example of a memory arrangement of analysis data for special reproduction.

FIG. 8 is a diagram illustrating an example of a block configuration of a recording signal processing system according to a modification.

FIG. 9 is a diagram illustrating an example of a block configuration of a reproduction signal processing system according to a modification.

FIG. 10 is a diagram showing an example of an operation flowchart.

[Explanation of symbols]

31 video signal A / D conversion system, 32 video signal encoder processing system, 33 multiplexed signal processing system, 34
Recording signal processing system, 35 ... Recording medium, 36 ... Video signal analysis processing system, 37 ... Audio signal A / D conversion system, 38 ...
Audio signal encoder system, 39 ... identification data generation system,
40 ... address generation system, 41 ... recording signal processing system, 4
2 recording medium 43 audio signal level detection system 44
…… analysis signal judgment processing system, 45 …… FFT analysis system, 46
…… Tone detection system, 47 …… System controller system,
50 playback signal processing system, 51 playback data separation processing system, 52 video signal decoding processing system, 53 video signal D / A conversion processing system, 54 audio signal decoding processing system, 55 Audio signal D / A conversion processing system, 56: playback control system, 57: playback processing system, 58: address generation system, 90: determination processing system, 91: data memory system

Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat II (reference) H04N 5/76 H04N 5/76 B 5/91 5/91 N 5/92 5/92 H F term (reference) 5C052 AA01 AA17 AB03 AB05 AC01 CC11 DD04 EE08 5C053 FA14 FA20 FA21 FA23 FA27 GA11 GB01 GB06 GB09 GB37 HA21 JA01 JA24 KA05 KA19 KA24 5D044 AB05 AB07 BC01 BC02 CC03 CC04 DE19 DE22 EF05 FG18 FG24 HL07 HL14 5A03A04 BA04A04 A04A04A04 AA14 AA27 AA29 CA04 CA07 CA32 CA44 CA50 CB08 DA19 DB08 DC05 DC16 FA02 FA09

Claims (20)

[Claims] 1. The method according to claim 1, wherein the first information signal is recorded on the first information signal recording medium or when the first information signal is recorded on the first information signal recording medium. Signal analyzing means for generating a second information signal generated at the time of recording or reproduction of the signal and identifying a predetermined reproduction section of the first information signal recording medium by analyzing the first information signal; A predetermined identification signal generated in response to a signal from the signal analysis means or the second information signal is paired with a reproduction time point of the first information signal recorded on the first information signal recording medium; An information signal processing device comprising: signal recording means for recording on a second information signal recording medium so as to correspond to (1). 2. The information signal processing device according to claim 1, wherein the information signal is an image signal or an audio signal. 3. The first information signal recording medium according to claim 1, wherein
The information signal processing device according to claim 1, wherein the information signal processing device is a recording medium which is pre-mounted on or can be mounted on the information signal recording medium. 4. The method according to claim 1, wherein the reproduction by specifying the predetermined reproduction section reproduces a predetermined climax time point or a predetermined similar signal time point in the first information signal or does not reproduce the predetermined signal section. Item 2. The information signal processing device according to item 1. 5. A first reproducing means for reproducing a first information signal recorded on a first information signal recording medium, and a one-to-one correspondence with the reproduction on the first information signal recording medium. The second information signal recorded on the second information signal recording medium
A second reproducing unit that reproduces the information signal of the above, a signal analyzing unit that analyzes a reproduced signal from the second reproducing unit by a predetermined signal processing, and a first signal processing unit that responds to a signal from the signal analyzing unit. An information signal processing device comprising: a reproduction control unit that controls an operation of the reproduction unit. 6. The information signal processing device according to claim 5, wherein the information signal is an image signal or an audio signal. 7. The first information signal recording medium according to claim 1, wherein
6. The information signal processing apparatus according to claim 5, wherein the information signal recording medium is a recording medium which is previously mounted on or mountable on the information signal recording medium. 8. The second information signal reproduces a predetermined climax time point or a predetermined similar signal time point in the first information signal, or operates the reproduction control means so as not to reproduce a predetermined signal section. The information signal processing apparatus according to claim 5, which is an information signal necessary for the information signal processing. 9. Reproducing a first information signal recorded on a first information signal recording medium, and recording a second information signal so as to correspond one-to-one with reproduction on the first information signal recording medium. The second recorded on the medium
Reproducing the information signal of the above, analyzing the reproduced signal from the second reproduction by predetermined signal processing, and controlling the operation of the first reproduction according to the signal from the signal analysis. Signal processing method. 10. The information signal processing method according to claim 9, wherein the information signal is an image signal or an audio signal. 11. The second information signal recording medium is mounted in advance on the first information signal recording medium,
10. The information signal processing method according to claim 9, wherein the information signal processing method is a recording medium that can be mounted. 12. The second information signal reproduces a predetermined climax time point or a predetermined similar signal time point in the first information signal, or operates the reproduction control so as not to reproduce a predetermined signal section. The information signal processing method according to claim 9, wherein the information signal is an information signal required for: 13. The method according to claim 1, wherein the first information signal is recorded on the first information signal recording medium or when the first information signal is recorded on the first information signal recording medium. A second signal, which is generated at the time of recording or reproduction of a signal and specifies a predetermined reproduction section of the first information signal recording medium.
The first information signal is generated by analyzing the first information signal, and the predetermined identification signal or the second information signal generated in accordance with the signal from the signal analysis is stored in the first information signal recording medium. The reproduction time of the first information signal to be recorded and 1
An information signal processing method characterized by recording on a second information signal recording medium so as to correspond to one to one. 14. The information signal processing method according to claim 13, wherein the information signal is a video signal or an audio signal. 15. The second information signal recording medium is mounted in advance on the first information signal recording medium,
14. The information signal processing method according to claim 13, wherein the information signal processing method is a recording medium that can be mounted. 16. The method according to claim 1, wherein the reproduction by specifying the predetermined reproduction section reproduces a predetermined climax time point or a predetermined similar signal time point in the first information signal or does not reproduce the predetermined signal section. Item 14. The information signal processing method according to Item 13. 17. The method according to claim 1, wherein the first information signal is recorded on the first information signal recording medium or when the first information signal is recorded on the first information signal recording medium. A second signal for specifying a predetermined reproduction section of the signal recording medium.
The first information signal is generated by analyzing the first information signal, and the predetermined identification signal or the second information signal generated in accordance with the signal from the signal analysis is stored in the first information signal recording medium. The reproduction time of the first information signal to be recorded and 1
An information signal recording medium recorded on a second information signal recording medium in a one-to-one correspondence. 18. The information signal recording medium according to claim 17, wherein said information signal is an image signal or an audio signal. 19. The second information signal recording medium is mounted in advance on the first information signal recording medium,
18. The information signal recording medium according to claim 17, which is a recording medium that can be mounted. 20. The reproduction by specifying the predetermined reproduction section reproduces a predetermined climax time point or a predetermined similar signal time point in the first information signal according to the recording time of the first information signal or the predetermined reproduction time. 2. The method as claimed in claim 1, wherein a predetermined signal section is not reproduced.
8. The information signal recording medium according to 7.