JPH06276479A - Video and audio information edit method - Google Patents

Abstract

PURPOSE:To provide the video and audio information edit method able to add new audio information to video data and audio data stored in a storage device capable of random accessing such as a magnetic disk in real time. CONSTITUTION:Compressed picture data are divided for each of odd number fields and even number fields, audio data are added to the odd number fields and they are stored continuously to a random accessible storage means 7, field data with audio data added to them are read from the storage means 7, the field data are expanded and reproduced and outputted on a display means, and audio data inputted externally are added to the field data as revision by an audio data entry means to generate new field data, which are stored in the storage means 7 while the field data are read from the storage means.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video and audio information editing method for storing video and audio information compressed in field or frame units in a randomly accessible storage device, such as a magnetic disk storage device. Regarding
In particular, it relates to a video and audio information editing method for adding new audio data after being stored in the storage device.

[0002]

2. Description of the Related Art Generally, an image system for expressing motion adopts a method of transmitting a plurality of still images within a unit time. The number of images in this unit time is called a frame, and is used for a video such as a television. The video consists of 30 frames per second. Then, in order to smoothly express a fast-moving image, an interlaced scanning method in which a scanning line of one frame is divided into two fields of even number and odd number is adopted. Therefore,
In the interlaced scanning method, one field of image data is transmitted every 1/60 second, and in the non-interlaced scanning method, one frame of image data is transmitted every 1/30 second.

Such video data is stored in a random access type large-capacity storage device, for example, a storage device such as a magnetic disk for the convenience of reproduction, but in order to efficiently store a large amount of video data. In this case, it is necessary to compress the video data in advance. Conventionally, for example, a so-called JPEG method is generally used as the above-described compression processing method, and a series of video data is sequentially compressed in field or frame units. Then, the compressed data is stored in the above-described storage device in time series in the order in which the original video data is constructed, and the audio data corresponding to each frame is added and stored after each frame data.

[0004]

However, in the above-mentioned conventional method for storing video and audio information, new audio information is added while reproducing the video information stored in the storage device, and re-recorded at the same time. There was a problem that the so-called real-time dubbing could not be edited. That is, in order to add the audio data in real time, the video data and the audio data are continuously read from the storage device, the compressed video data is decompressed and reproduced and output to the display unit, and at the same time, the operator reproduces the video. It is necessary to input new voice while visually observing and to store the input voice data in the original voice data area on the storage device. It is difficult to read data on one side and write data on the other side using one recording head. Therefore, at the time of so-called after-recording, the read time is halved by adding only the odd field of the frame composed of the odd and even fields to the video data read from the storage device at the expense of some image quality, thereby reducing the audio data to be added. It may be possible to secure the operating time of the head for writing, but if the area for reading and writing data from and to the storage medium such as a magnetic disk is discontinuous, the head moves frequently toward the relevant location. Since the seek time is long, it is impossible to add voice data in real time after all.

An object of the present invention is to solve the above-mentioned drawbacks and to add new audio information in real time to video data and audio data stored in a randomly accessible storage device such as a magnetic disk. The point is to provide a method for editing voice information.

[0006]

To achieve this object, the first characteristic configuration of the video and audio information editing method according to the present invention is to time-sequentially sample the image data compressed by the image data compression means. Divided into a plurality of frame data or field data obtained by
The audio data of the frames forming the frames are added to the frames or fields, and the frames are sequentially stored in a randomly accessible storage unit, and the frame data or the field data to which the audio data is added is read from the storage unit. Then, the frame data or field data is expanded by the image data expansion means and reproduced and output to the display means. At the time of reproduction output, the audio data externally input by the audio data input means is updated to the frame data or field data. A new frame data or field data is added to generate the new frame data or field data, and the new frame data or field data is stored in the storage means during an operation of reading the frame data or field data from the storage means. . The second characteristic configuration is that the image data compressed by the image data compressing unit on a field-by-field basis is divided into odd-numbered fields and even-numbered fields, and the odd-numbered or even-numbered fields form those fields. After the audio data is added and sequentially stored in each randomly accessible storage means, the field data to which the audio data is added is read from the storage means, and the field data is expanded by the image data expansion means. The data is reproduced and output to the display means, and at the time of the reproduction and output, the sound data input from the outside by the sound data input means is updated and added to the field data to generate new field data, and the new field data is stored in the field. The storage means during an operation of reading data from the storage means There is a point to be stored.

[0007]

According to the first characteristic configuration, first, a plurality of groups obtained by time-sequentially sampling frame data or field data as image data having a capacity such that the reproduced image can be visually observed when the audio data is updated. Audio data of the frames constituting them is added to the frames or fields, and the frames are successively stored in a randomly accessible storage means for each group. Frame data or field data, to which voice data is added and stored in continuous storage areas, is continuously read from the storage means without spending unnecessary seek time. The frame data or field data is decompressed by the image data decompression means and then reproduced and output to the display means. At the time of reproduction and output, external audio data such as narration is input through the audio data input means. Newly input audio data is updated and added to the frame data or field data to generate new frame data or field data, and the new frame data or field data is stored in the frame data or field data. Stored in the storage means during a read operation from the means. That is,
Since the data read out from the storage means at the time of reproduction is only a part of the image data obtained by dividing the entire image data into groups, it is possible to secure a writing time for new frame data or field data.

The second characteristic configuration is a case where a plurality of groups obtained by sampling the frame data or the field data in the first characteristic configuration in time series are constituted by either an odd field or an even field. The maximum allowable sampling capacity is shown in order to avoid extreme deterioration of image quality when inserting audio data.

[0009]

According to the present invention, there is provided a video and audio information editing method capable of adding new audio information in real time to video data and audio data stored in a randomly accessible storage device such as a magnetic disk. It is now possible to provide.

[0010]

EXAMPLES Examples will be described below. As shown in FIG. 1, the image processing apparatus includes a control means 1 for controlling the entire system, an image data compression means for performing compression / expansion processing of video information, and image data processing means 2, 3 as image data expansion means. A voice data processing means 4 for processing voice information and an analog signal processing means 5 for performing mutual conversion between an analog signal and a digital signal are connected by a VME bus 6.

The analog signal processing means 5 includes a VTR and an LD.
Mutual conversion between analog signals such as video signals and audio signals and corresponding digital signals between the video image output device (not shown) such as the above and the image data processing means 2 and 3 and the audio data processing means 4. It is configured by an A / D conversion circuit, a D / A conversion circuit, and the like that perform processing.

The audio data processing means 4 comprises two systems of data buffers 4a and 4b, while an image processing circuit 4d.
Etc. are provided and configured.

The control means 1 mainly stores a bus control circuit 1d, a serial communication circuit 1e, a SCSI control circuit 1f for controlling data transmission / reception of the system, a microcomputer 1a for controlling them, a control program and data. It is configured to include memories 1b and 1c. SC
A magnetic disk storage device 7 as a randomly accessible storage means is connected to the SI control circuit 1f.

The image data processing means 2 and 3 are VTR, L
The video information output from the video video output device such as D is compressed and the magnetic disk storage device 6 via the VME bus.
CRT as a display unit which is a constituent element of a video image output device by outputting compressed video data to the computer or decompressing compressed data input from the magnetic disk storage device 7 via the VME bus 6.
The compression / expansion processing is performed for each of the odd field and the even field. The one image data processing means 2 will be described in detail. A pair of field memories 2a for accumulating data to be compressed or expanded data, and a compression / expansion processing circuit 2b for compressing or expanding the image data by the so-called JPEG method. The control circuit 2c, which is composed of a control circuit 2c and its control circuit 2c, a data buffer 2d for temporarily storing compressed data, etc.
To control.

The compression processing of video information and audio information will be described. As shown in FIGS. 2 and 3, the permissible time of one frame is 1 for each video information of the odd field and the even field which are alternately input at 1/60 second intervals.
Subsequent processing is performed at a time interval of / 30 seconds, first, each video information is converted into a digital image signal by the analog signal processing means 5, and odd field data (O1, O
2, O3, ...) Is input to one of the image data processing means 2 and even field data (E1, E2, E3, ...) Is input to the other image data processing means 3 and is stored in the field memories 2a and 3a, respectively. To be done. The data of the first frame is input to the compression / expansion processing circuits 2b and 3b in synchronization with the storage timing of the data of the second frame, and the data subjected to the compression processing is stored in the data buffers 2d and 3d. When 16 frames of data are accumulated in the data buffers 2d and 3d, the compressed data is output to the VME bus 6 and transferred to the magnetic disk storage device 7 via the control means 1 and stored therein. After that, these operations are repeated, but in outputting compressed data to the VME bus 6, 16 fields of odd field data are transferred first, and 16 fields of even field data are transferred thereafter. Here, when the preceding odd field data is transferred, the audio data corresponding to each frame is output from the data buffer 4a of the audio data processing means 4, and is added immediately after each odd field data and stored in the magnetic disk storage device 7. To be done. Therefore, in the magnetic disk storage device 7, odd field data and audio data are continuously stored in a fixed area, and even field data are stored in an area different from the odd field data and audio data.

As an example of the editing process of the video information and the audio information, the case where the so-called post-recording process for updating the audio data already stored in the storage device 7 by the above-mentioned method is performed in real time will be described. As shown in FIGS. 4 and 5, the odd number field data and the audio data added thereto are controlled in units of 16 fields by the control means 1, VME.
The data is read from the magnetic disk storage device 7 via the bus 6 and the field data is stored in the data buffer 2d of the one image data processing means 2 while the audio data is stored in the data buffer 4a of the audio data processing means 4. The 16-field odd-field data stored in the data buffer 2d is compressed / expanded for each field 2
Decompression processing is performed using b, odd-numbered field data is stored in one field memory of the pair of field memories 2a, and even-numbered field data is stored in the other field memory. The data stored in the pair of field memories 2a is switched twice by the switch circuit 2e in correspondence with the odd and even fields for each frame, and is output twice to the CRT through the analog signal processing means 5. When an audio to be updated such as narration is input while visually observing the video data displayed on the CRT, the analog signal processing means 5 converts the audio into digital audio data and accumulates it in the data buffer 4b of the audio data processing means 4. . Here, the previous audio data is stored in the data buffer 4a, but the output of this data is blocked by the switch circuit 4e. On the other hand, during the reproduction process of these 16 frames, the next 16 frames of field data are loaded into the data buffer 2d.
The previous 16 frames of data and the new audio data accumulated in the data buffer 4b are output to the VME bus 6, transferred to the magnetic disk storage device 7 via the control means 1, and continuously stored in the same storage area. Then, this operation is repeated thereafter.

Another embodiment will be described below. In the previous embodiment, the case where the reproduced image data and the audio data to be newly added are both written again in the storage device has been described. However, regarding the operation of the write head of the storage device, data is written or prohibited for consecutive addresses. If a control signal is added, dummy data is used for the range of the image data, and writing between them is prohibited by the control signal.
Only voice data can be written.

In the above embodiment, the magnetic disk was used as the storage device, but the storage device is not limited to this, and any random access is possible.

In the above embodiment, an example in which the odd number field and the even number field are stored in the storage means has been described. However, the present invention is not limited to this, and a video and audio information editing method generally uses an image data compression means. The compressed image data is divided into a plurality of frame data or field data obtained by time-sequential sampling, and the audio data of the frames constituting them is added to these frames or fields to randomly The frame data or the field data to which the audio data is added is sequentially stored in the accessible storage means, and the frame data or the field data is expanded by the image data expansion means and then displayed on the display means. Playback output, at the time of playback output, by the audio data input means The audio data input from the unit is updated and added to the frame data or field data to generate new frame data or field data, and the new frame data or field data is stored in the frame data or field data storage means. The same effect can be obtained as long as it is stored in the storage means during the read operation from.

In the above embodiment, the image data is processed in units of 16 frames, but the number of processing frames can take any value.

The configuration of the image processing apparatus for carrying out the method of the present invention is not limited to the one described in the above embodiment, and may have any configuration.

It should be noted that reference numerals are added to the claims for convenience of comparison with the drawings, but the present invention is not limited to the configurations of the accompanying drawings by the entry.

[Brief description of drawings]

FIG. 1 is a block configuration diagram of an image processing apparatus.

FIG. 2 is a timing chart of a video and audio information compression processing method.

FIG. 3 is a timing chart of a video and audio information compression processing method.

FIG. 4 is a timing chart of a video and audio information editing method.

FIG. 5 is a timing chart of a video and audio information editing method.

[Explanation of symbols]

 2 image data compression / decompression means 3 image data compression / decompression means 7 storage means

Claims (2)

[Claims] 1. The image data compressed by the image data compression means (2), (3) is divided into a plurality of frame data or field data obtained by time-series sampling, and the frames are also divided. Or add the audio data of the frames that make up them to the field,
Each of them is successively stored in a randomly accessible storage means (7), frame data or field data with audio data is read from the storage means (7), and the frame data or field data is expanded as image data. After decompressed by the means (2) and (3), the data is reproduced and output to the display means, and at the time of reproduction and output, the audio data input from the outside by the audio data input means is updated and added to the frame data or the field data and new data is added. Generate frame data or field data, and add the new frame data or field data to
A video and audio information editing method for storing in the storage means (7) during an operation of reading the frame data or field data from the storage means (7). 2. The image data compressed by the image data compression means (2) and (3) in field units is divided into odd fields and even fields, and the fields are divided into odd fields and even fields. The audio data of the frames that make up the frame is added and sequentially stored in the randomly accessible storage means (7) separately, and the field data to which the audio data is added is read from the storage means, and the field data is read. After decompressing by the image data decompressing means (2) and (3), the image data is reproduced and output to the display means. At the time of reproducing and outputting, the audio data input from the outside by the audio data inputting means is updated and added to the field data, and new data is added. Field data is generated, and the new field data is stored in the storage means (7) for storing the field data. Video and audio information editing method of storing the in the storage means (7) during a read operation.