JP2001346153A - Device and method for recording, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a recorder that records coded data and can also record the feature points of the data. SOLUTION: Digital data received via a digital interface 13 are given to a multiplexer section 12 and a demultiplexer section 19. The demultiplexer section 19 applies demultiplexing processing to the received digital data and outputs prescribed data to an MPEG AV decoder 20. The MPEG AV decoder 20 outputs video data, audio data and coded data to a feature point extract section 23, which uses the received data to extract feature points and outputs its information to the multiplexer section 12. The multiplexer section 12 multiplexes the received information with the received digital data and allows an HDD 15 to record the multiplexed signal via a buffer 14.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a recording apparatus, a recording method, and a recording medium. The present invention relates to a recording apparatus and method for generating and recording, and a recording medium.

[0002]

2. Description of the Related Art Some recording / reproducing apparatuses for recording and reproducing video data and audio data include information on feature points of a video such as a CM (commercial) start point, end point, scene change, and change of an audio mode at the time of recording. A device that detects and records feature point information of voice such as points, and controls playback operation (for example, skips CM and plays back) using the recorded feature point information during playback. There is.

[0003]

The recording / reproducing apparatus described above directly records digital data encoded using an MPEG (Moving Picture Experts Group) system output from an IEEE1394 terminal or a tuner for digital broadcasting, or the like. Therefore, there is a problem that the feature point information cannot be extracted, and reproduction using the feature point information, for example, reproduction in which a commercial is skipped, cannot be performed.

[0004] The present invention has been made in view of such circumstances, and while recording input digital data, performs decoding processing, generates feature point information using the resulting data, An object of the present invention is to enable the reproduction using the feature point information by recording the information in association with the input digital data.

[0005]

According to the present invention, there is provided a recording apparatus comprising: input means for inputting digital data encoded by a predetermined method; decoding means for decoding digital data input by the input means; Generating means for generating feature point information using the digital data decoded by the decoding means; digital data input by the input means; and recording means for recording the feature point information generated by the generating means. Features.

[0006] The recording means may multiplex and record feature point information corresponding to digital data.

[0007] The recording means may associate the feature point information generated by the generation means with digital data, and record a table describing the association as feature point information.

According to a fourth aspect of the present invention, in the recording method, an input control step of controlling input of digital data encoded by a predetermined method, and a decoding step of decoding digital data whose input is controlled in the processing of the input control step A generation step of generating feature point information using digital data decoded in the processing of the decoding step, digital data whose input is controlled in the processing of the input control step, and a feature point generated in the processing of the generation step And a recording control step of controlling recording of information.

According to a fifth aspect of the present invention, a program for a recording medium controls an input of digital data encoded by a predetermined method, and decodes the digital data whose input is controlled in the processing of the input control step. A decoding step, a generating step of generating feature point information using the digital data decoded in the processing of the decoding step, digital data whose input is controlled in the processing of the input control step, and a digital data generated in the processing of the generating step. And a recording control step of controlling recording of the feature point information.

In the recording apparatus according to the first aspect, the recording method according to the fourth aspect, and the recording medium according to the fifth aspect, the input digital data is decoded, and the decoded digital data is used. Then, the feature point information is generated, and the input digital data and the generated feature point information are recorded.

[0011]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing a configuration of an embodiment of a system including a recording / reproducing device 1 to which the present invention is applied. An IRD (Integrated Receiver Decoder) 2 is connected to the recording / reproducing apparatus 1 via the IEEE1394 bus 100.
00 is connected, and digital data is transmitted and received. The recording / reproducing apparatus 1 is also connected to a television receiver 300 as a display device. Furthermore, a video tape recorder 400 is also connected to the recording / reproducing apparatus 1 so that data can be exchanged.

FIG. 2 is a diagram showing an example of the internal configuration of the recording / reproducing apparatus 1. A signal received by an antenna (not shown) for receiving a terrestrial wave is input to a tuner 2 of the recording / reproducing apparatus 1. The tuner 2 extracts a video signal and an audio signal of a channel desired by the user from the input signal,
Output to the switching unit 3. The output from the video tape recorder 400 connected externally is also input to the switching unit 3.

The switching section 3 outputs a video signal (composite video signal) designated by the user among the input signals.
Internal switches are switched so that the C separator 4 outputs an audio signal corresponding to the composite video signal to an A / D (Analog / Digital) converter 5. Y
The C separation unit 4 converts the input composite video signal into YC
Separate and output to terminal b of switch 6. To the switch 6, among the outputs from the externally connected video tape recorder 400 and the like, the S video signal is supplied to the a terminal, and the video signal from the YC separation unit 4 is supplied to the b terminal.
Connected to either terminal according to user's instruction.

The video signal output from the switch 6 is NT
It is input to an SC (National Television System Committee) decoder 7. The NTSC decoder 7 performs A / D conversion on the input video signal, performs a chroma encoding process, changes the digital video signal into a digital component video signal (hereinafter referred to as image data), and outputs the digital component video signal to the pre-video processing unit 9. Then, a clock generated on the basis of a vertical synchronization signal of the input video signal and a horizontal synchronization signal, a vertical synchronization signal, and a field determination signal obtained by performing synchronization separation are supplied to the synchronization control unit 8.

The synchronization control unit 8 generates a clock and a synchronization signal, which are converted into timings necessary for controlling each unit in the recording / reproducing apparatus 1 based on various input signals, and supplies them to each unit. The pre-video processing unit 9 performs various video signal processing such as a pre-filter on the input image data and outputs the processed data to the MPEG video encoder 10. The MPEG video encoder 10 performs encoding processing based on the MPEG method such as block DCT (Discrete Cosine Transform) on the input image data, generates an elementary stream of the image, and outputs the elementary stream to the multiplexing unit 12.

In the present embodiment, the description will be made assuming that compression based on the MPEG system is performed. However, compression based on another compression system may be performed or non-compression may be performed.

On the other hand, the audio signal input from the switching unit 3 to the A / D converter 5 is converted into a digital audio signal,
Output to the EG audio encoder 11. The MPEG audio encoder 11 performs a compression process based on the MPEG method on the input digital audio signal, generates an audio elementary stream, and outputs the audio elementary stream to the multiplexing unit 12.

[0027] The multiplexing unit 12 includes the MPEG video encoder 1
0 and the elementary stream of the image output from
The audio elementary stream output from the EG audio encoder 11 is multiplexed with various signals,
A transport stream is generated and output to the buffer. The multiplexing unit 12 may receive digital data output from the digital interface 13 as necessary.

The buffer 14 converts the transport stream output from the multiplexing unit 12 into an HDD (Hard Disc Drive).
e) Provided for intermittent output to 15 and storage. For example, when the HDD 15 is performing a seek operation, the transport stream cannot be written. Therefore, the buffer 14 temporarily stores the transport stream. Are sequentially output and stored. Since the writing is performed at a higher rate than the input rate, it is possible to record the continuously input transport stream in the HDD 15 without interruption.

In this embodiment, the HDD 15 is used as a recording medium for recording the transport stream.
However, another recording medium such as an optical disk, a magneto-optical disk, or a solid-state memory may be used.

The system controller 16 controls each block in the recording / reproducing apparatus 1. The control is ROM
(Read Only Memory) 17 is performed according to a program stored in the memory. RAM (Random Access Memory) 1
Reference numeral 8 stores data necessary for the system controller 16 to control each block.

The system controller 16 sends, for example, an instruction to the switching section 3 to switch back which signal among the input signals,
It controls writing of the transport stream to the DD 15.

The transport stream stored in the HDD 15 is read out according to an instruction from the system controller 16 and output to the buffer 14. Buffer 14
Outputs the transport stream intermittently read from the HDD 15 to the separation unit 19 while controlling the transport stream to be continuously output. The separation unit 19 converts the input transport stream into PES (Packetiz
ed Elementary Stream) and MPEG AV (Audio Vid
eo) Output to the decoder 20.

The MPEG AV decoder 20 receives the input PE
S is separated into an image elementary stream and an audio elementary stream, and each elementary stream is subjected to decoding processing. The image data generated by decoding the elementary stream of the image is output to the post-video processing unit 21, and the audio data generated by decoding the elementary stream of the audio is output to the terminal a of the switch 22. Is output to

The MPEG AV decoder 20 outputs image data, audio data, and coding information to the feature point extracting unit 23 as needed. Details will be described later.

The post-video processing unit 21 stores the image data output from the MPEG AV decoder 20 and the pre-video processing unit 9
Is output, and either one of the image data is converted according to the instruction of the system controller 16.
Output to OSD (On Screen Display) processing unit 24. Further, the post-video processing unit 21 performs a process such as a filtering process or a combining process on the output image data.

When the post-video processing unit 21 outputs the image data supplied from the pre-video processing unit 9, the user records the program supplied from the tuner 2 or the like on the HDD 15, and the television receiver 300 For example, when the user instructs to watch, or when instructing to watch on the television receiver 300 via the recording / reproducing apparatus 1 without recording on the HDD 15. Further, when the post video processing unit 21 outputs the image data from the MPEGAV decoder 20, it is when the user instructs the television receiver 300 to view the program recorded in the HDD 15.

The OSD processing section 24 generates graphics for image display, performs processing such as overlapping or partially displaying the input image data, and executes the processed image data ( Component digital signal)
Output to the NTSC encoder 25. NTSC encoder 25
Converts the input component digital signal into a YC signal, further converts it into an analog signal, and outputs it to the television receiver 300 as an analog composite signal.

The switch 22 is connected to the MP input to the terminal a.
One of the audio signals from the EG AV decoder 20 or the audio signal from the A / D converter 5 input to the terminal b is selected (connected to one terminal), and D / D Output to the A converter 26. The switching of the switch 22 corresponds to the image data output from the post video processing unit 21. That is, when the image data output from the post-video processing unit 21 is output from the pre-video processing unit 9, the switch 22 is connected to the terminal b and the A / D
The audio data output from the conversion unit 5 is output, and the image data output from the post-video processing unit 21
If the data is output from the decoder 20, the switch 22 is connected to the terminal “a”, and the audio data output from the MPEG AV decoder 20 is output.

The D / A converter 26 converts the input digital audio data into an analog audio signal and outputs the analog audio signal to the television receiver 300.

Next, recording and reproduction of digital data input to the digital interface 13 will be described.
First, recording of digital data in the recording / reproducing apparatus 1 will be described with reference to the flowchart in FIG. The process of the flowchart shown in FIG. 3 is started when digital data is input to the recording / reproducing apparatus 1.

An IRD 200 is connected to the recording / reproducing apparatus 1, and digital data is input from the IRD 200 to the digital interface 13 via the IEEE 1394 bus 100. The input digital data is transmitted to the multiplexing unit 1
2 and the separation unit 19. The digital data supplied to the multiplexing unit 12 is subjected to analysis and generation of a control signal and the like in step S1, and
Recorded in D15.

On the other hand, the digital data input to the separation unit 19 is subjected to a separation process in step S2.
As described above, in the separation unit 19, PES is extracted by performing separation processing on the input digital data (transport stream). Extracted PES
Is supplied to the MPEG AV decoder 20, and as described above, decoded image data and audio data are generated. The MPEG AV decoder 20 further extracts encoded information included in the image elementary stream and the audio elementary stream, and supplies the encoded information, image data, and audio data to the feature point extracting unit 23.

In step S3, the feature point extraction unit 23 uses the supplied coding information, image data, and audio data to start and end commercial (CM), scene change, audio mode information, Then, a characteristic point such as a change point is detected. Information on the detected feature points is output to the system controller 16 in step S4. The system controller 16
In step S5, a table is created.

FIG. 4 is a diagram for explaining the table created in step S5. As shown in FIG. 4, the table includes information including a scene, a situation, a time stamp, and an address on the HDD 15. The scene is described so that a portion detected as a scene and a portion detected as a commercial can be distinguished from each other, and the situation is a description corresponding to a situation corresponding to each scene, in this case, a start or end of the scene (commercial). Is done.

The time stamp describes the time corresponding to each scene (situation), and the address of the HDD 15 indicates the transport stream corresponding to each scene (situation).
Address information indicating which position on the address 15 is recorded is described. Such a table is created based on the information on the feature points output from the feature point extraction unit 23 and the information on the recording position (address) of the transport stream on the HDD 15 supplied from the buffer 14.

In step S6, it is determined whether the input of digital data has been stopped. If it is determined that the input of the digital data has not stopped and that the input of the digital data is still being performed, the processing from step S1 is repeated for the input digital data.

On the other hand, if it is determined in step S6 that the input of the digital data has stopped, the process proceeds to step S7, where the table created by the system controller 16 is supplied to the buffer 14 and recorded on the HDD 15.

The table created in this way is stored in the HDD 15 separately (not including) from the transport stream.
To record on top, for example, read only the table,
Processing such as detecting a scene can be performed based on the table.

When the user causes the program stored in the HDD 15 to be reproduced, a table can be used as information for selecting the program to be reproduced. As described above, the creation of the table starts when digital data is input, and ends when the input is stopped. This indicates that one table corresponds to one program (or more in some cases).

Therefore, when the reproduction of the program recorded in the HDD 15 is instructed, the head information of each table is read out from each table, and the screen based on the information is displayed on the television receiver 300 as an index. To be done. Then, when the user selects a desired program from the displayed index of each table (program), each information in the table corresponding to the program is read, and the screens (commercials) of all scenes are read. , Except for the scene). The user can further reproduce a desired program from a desired scene by designating a desired scene from the displayed index.

Further, using the read table,
During the reproduction operation, it is also possible to execute processing such as skipping and reproducing a commercial. When such playback is performed, the system controller 16
From D15, a table corresponding to the program to be reproduced is read, and based on the read table, image data and audio data output from the MPEG AV decoder 20 are controlled.

In the above-described embodiment, the table is created by the system controller 16 and recorded on the HDD 15 separately from the input digital data (transport stream). It is also possible to include the information output from the feature point extracting unit 23 in the digital data thus obtained and record the digital data on the HDD 15. FIG. 5 is a diagram showing a configuration of the recording / reproducing apparatus 1 corresponding to such a case.

A comparison between the configuration of the recording / reproducing apparatus 1 shown in FIG. 5 and the configuration of the recording / reproducing apparatus 1 shown in FIG.
In the recording / reproducing apparatus 1 shown in FIG.
The feature point information output from the feature point extraction unit 23 is input to the multiplexing unit 12 in order to multiplex the feature point information with the input digital data. FIG.
Since the table is not created in the recording / reproducing apparatus 1 shown in (1), the system controller 16 does not need to supply the address on the HDD 15 where the transport stream is recorded from the buffer 14.

In the recording / reproducing apparatus 1 shown in FIG.
Since the feature point information is multiplexed and recorded in the transport stream, the feature point information is extracted by being separated by the separation unit 19, and the extracted information is supplied to the system controller 16. ing.
The system controller 16 controls the MPEG AV decoder 20 based on the supplied feature point information.

Next, referring to the flowchart of FIG.
The recording operation of the recording / reproducing apparatus 1 shown in FIG. 5 will be described. Multiplexer 12 via digital interface 13
When the digital data is input to the separation unit 19, the processing of the flowchart shown in FIG. 6 is started. Multiplexer 1
The digital data input to 2 will be
Since it is multiplexed with the information on the feature points, it is temporarily stored. The digital data input to the separation unit 19 is subjected to a separation process.

The processing in steps S11 to S13 is the same as that in FIG.
Since the processing is the same as the processing of steps S2 to S4 in the flowchart shown in FIG. However, in step S13, the information on the feature points output from the feature point extraction unit 23 is output to the multiplexing unit 12.

In step S14, the multiplexing unit 12
Multiplexes the digital data (transport stream) input via the digital interface 13 and the information on the feature points output from the feature point extraction unit 23. At this time, feature point information temporally relative to the transport stream is added and output to the buffer 14. In step S15, the transport stream output to the buffer 14 is recorded on the HDD 15.

As described above, when the feature point information is multiplexed with the transport stream and recorded, the recorded transport stream is reproduced basically in the same manner as when the table is created. However, HDD
The transport stream read from 15 is supplied to the separation unit 19 via the buffer 14,
Information on feature points in the data separated by
Supplied to the system controller 16, and the system controller 16 uses the supplied information to
The decoder 20 is controlled.

As described above, when recording the supplied digital data, a decoding process is performed to obtain information on the characteristic points, and the obtained information is recorded together with the input digital data (as a table or By multiplexing and recording), at the time of reproduction, the reproduction operation can be controlled using the information.

In the above-described embodiment, the case where the table is created and the case where the table is not created have been described. However, the two cases coexist, the table is created, and the table is recorded separately from the digital data. Along with
The digital data may be data in which feature point information is multiplexed.

In the above-described embodiment, the recording / reproducing apparatus 1 uses the IEEE1394 bus 100 as a digital bus.
And the IRD 200 is connected as a digital device, but another digital bus may be used, or another digital device such as a personal computer may be connected. AV devices other than the television receiver 300 and the video tape recorder 400
It is also possible to connect devices.

The above-described series of processes can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, it is possible to execute various functions by installing a computer in which the programs constituting the software are embedded in dedicated hardware, or by installing various programs For example, it is installed from a recording medium to a general-purpose personal computer or the like.

As shown in FIG. 7, this recording medium is a magnetic disk 51 (including a floppy disk) on which the program is recorded and an optical disk 52 distributed separately from the computer to provide the program to the user.
(CD-ROM (Compact Disk-Read Only Memory), DVD (Dig
Ital Versatile Disk), magneto-optical disk 53
(Including MD (Mini-Disk)) or semiconductor memory 5
ROM 32 that stores programs and is provided to the user in a state in which it is not only configured by a package medium such as
And a hard disk including the storage unit 38.

In this specification, the steps of describing a program provided by a medium are not necessarily performed in chronological order but may be performed in chronological order according to the described order. Alternatively, it also includes individually executed processing.

In this specification, the system is
It represents the entire device composed of a plurality of devices.

[0057]

As described above, the recording apparatus according to claim 1,
According to the recording method of the fourth aspect and the recording medium of the fifth aspect, the input digital data is decoded, and the feature point information is generated using the decoded digital data. Since the digital data and the generated feature point information are recorded, the input digital data can be recorded as it is, and the reproduction can be controlled using the feature point information at the time of reproduction.

[Brief description of the drawings]

FIG. 1 is a diagram showing a configuration of an embodiment of a system including a recording / reproducing device to which the present invention is applied.

FIG. 2 is a diagram showing an internal configuration of the recording / reproducing apparatus 1.

FIG. 3 is a flowchart illustrating a recording operation of the recording / reproducing apparatus 1 shown in FIG.

FIG. 4 is a diagram illustrating a table created in step S5.

FIG. 5 is a diagram showing another internal configuration of the recording / reproducing device 1.

6 is a flowchart illustrating a recording operation of the recording / reproducing apparatus 1 shown in FIG.

FIG. 7 is a diagram illustrating a medium.

[Explanation of symbols]

Reference Signs List 1 recording / reproducing device, 2 tuner, 3 switching unit, 4 YC separation unit, 5 A / D conversion unit, 6 switch, 7 NTSC decoder, 8 synchronization control unit, 9 pre-video processing unit, 10 MPEG video encoder, 11
MPEG audio encoder, 12 Multiplexer, 13
Digital interface, 14 buffers, 15
HDD, 16 system controller, 17 RO
M, 18 RAM, 19 separation unit, 20 MPEG AV
Decoder, 21 post-video processing unit, 22 switch, 23 feature point extraction unit, 24 OSD processing unit, 25
NTSC encoder, 26 D / A converter

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/781 H04N 5/781 510L 5/92 5/92 H 5/93 5/93 Z 7/08 7 / 08 Z 7/081 G11B 27/02 K (72) Inventor Taro Mizuto 6-7-35 Kita Shinagawa, Shinagawa-ku, Tokyo Inside Sony Corporation (72) Inventor Katsunari Miyata 6 Kita-Shinagawa, Shinagawa-ku, Tokyo 7-35 within Sonny Co., Ltd. (72) Inventor Koichi Nagatoku 6- 7-35, Kita Shinagawa, Shinagawa-ku, Tokyo F-term (reference) 5C053 FA14 FA23 FA27 GA11 GA20 GB05 GB09 GB37 HA40 JA01 JA30 KA04 KA05 KA08 LA06 LA07 LA14 5C063 AC10 DA07 DA11 DA13 5D077 AA22 AA30 CA02 DC03 DC22 DC25 EA33 EA34 5D110 AA13 AA27 AA29 CB04 CB06 CD02 CD03 CD09 CD14 CJ14

Claims (5)

[Claims] An input unit that inputs digital data encoded by a predetermined method; a decoding unit that decodes the digital data input by the input unit; and a digital data that is decoded by the decoding unit. Generating means for generating feature point information by using the digital data input by the input means;
Recording means for recording the feature point information generated by the generation means. 2. The recording apparatus according to claim 1, wherein the recording unit multiplexes and records the feature point information corresponding to the digital data. 3. The method according to claim 1, wherein the recording unit associates the feature point information generated by the generation unit with the digital data, and records a table describing the association as the feature point information. The recording device according to claim 1, wherein 4. An input control step of controlling input of digital data encoded by a predetermined method; a decoding step of decoding the digital data whose input is controlled in the processing of the input control step; A generation step of generating feature point information using the digital data decoded in the processing, the digital data whose input is controlled in the processing of the input control step, and the feature point generated in the processing of the generation step A recording control step of controlling recording of information. 5. An input control step of controlling input of digital data encoded by a predetermined method; a decoding step of decoding the digital data whose input is controlled in the processing of the input control step; A generation step of generating feature point information using the digital data decoded in the processing, the digital data whose input is controlled in the processing of the input control step, and the feature point generated in the processing of the generation step A recording control step of controlling recording of information, the recording medium being recorded with a computer-readable program.