JP2010278481A - Data processing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve high-speed photography without having a high-performance processing means. <P>SOLUTION: A data processing device for performing recording/reproducing with the output signal of a high-speed camera as an input includes: (n+1) data storage means for dividing the output signal of the high-speed camera in each n (n is an integer ≥1) frames as a frame unit and temporarily storing respectively divided frames; (n+1) encoding means for individually encoding, into stream data, the frames that have been read from respective (n+1) data storage means; and (n+1) data recording means for recording the stream data compressed by the (n+1) encoding means. Since the output signal from the camera is divided in each frame unit and processed, a high-performance processing means is not needed and a system can be configured by using a plurality of processing means with low processing performance. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a data processing apparatus that performs high-speed shooting recording and slow motion reproduction.

  In general, home video cameras shoot at 30 frames per second, which is not suitable for shooting a phenomenon that moves at high speed. Therefore, in order to capture a phenomenon that moves at high speed, a data processing apparatus is known that captures a captured image at high speed, records it in an IC memory or a special VTR, and reproduces it at a standard speed during reproduction.

  However, the conventional data processing apparatus needs to capture images at a high speed. Therefore, as a conventional data processing apparatus that captures data at a low speed, recording data input at a high speed is separated and transmitted at a low speed. Data separation means for creating separated data, a plurality of data storage means for recording the separation data as recording data, and outputting the recording data as separation data for reproduction, and outputting from the plurality of data storage means at a low speed The reproduction separated data is temporarily held and synchronized to output and the reproduction separation data output from the synchronization means is multiplexed to create reproduction data output at high speed, There are some which have data multiplexing means for outputting (see, for example, Patent Document 1).

  FIG. 7 shows a conventional data processing apparatus described in Patent Document 1. In FIG.

In FIG. 7, the data separating means 1 separates recording data inputted at high speed and creates a plurality of low-speed separated data. Under the control of the control means 2, the data storage means 3a to 3n record the separation data output from the data separation means 1 as recording data. The data storage means 3a to 3n receive the control of the control means 2 and output the recorded data as reproduction separated data. The synchronization means 4 temporarily holds the reproduction separated data output at a low speed from the data storage means 3a to 3n, and outputs it in synchronization. The data multiplexing means 5 multiplexes the reproduction separation data output from the synchronization means 4 to create high-speed reproduction data and outputs it.
JP-A-10-149625 (FIG. 1)

  However, when performing high-speed shooting using the conventional configuration, the data storage means stores RAW data, so a large-scale storage capacity is required. Furthermore, although the high-speed input data from the outside can be separated into the low-speed separation data in the data separation means, it is a general data separation means, especially in high-speed shooting using an image codec. There was also a problem that it was not effective.

  The present invention solves the above-described conventional problems. When performing high-speed shooting, high-speed input data is combined with an image codec to perform signal processing as low-speed separated data having no dependency, and to perform individual processing. It is an object of the present invention to provide a data processing apparatus which can reproduce a created stream individually and can perform slow motion reproduction by providing a dependency during reproduction after high-speed shooting.

  In order to solve the above-described conventional problems, a data processing device according to a first aspect of the present invention is a data processing device that performs recording and reproduction using an output signal of a high-speed camera as an input, and outputs the output signal of the high-speed camera in units of frames. n + 1 (n is an integer greater than or equal to 1) frames, each of which is divided into n + 1 data storage means for temporarily storing the divided frames, and frames read from the n + 1 data storage means are individually streamed. It has n + 1 encoding means for encoding data and n + 1 data recording means for recording stream data compressed by the n + 1 encoding means, and performs high-speed shooting.

  According to a second aspect of the present invention, there is provided a data processing apparatus comprising: a decoding unit that decodes individual stream data read from a data storage unit; and the frame data generated by the decoding unit is output from the high-speed camera. Display control for alternately displaying signals in the same frame order as the signal.

  Furthermore, a data processing apparatus according to a third aspect of the present invention comprises control means for enabling the data storage means to control the frame interval to be captured in accordance with the performance of the encoding means or the performance of the display device.

  Further, the data processing device according to a fourth aspect of the present invention is the data storage means for thinning out the output signal of the high-speed camera so that it becomes a normal speed frame matched with a display device, and temporarily storing the frame; An encoding means for individually encoding the frame read from the data storage means into stream data and a data recording means for recording the stream data compressed by the encoding means are mounted separately from those for high-speed shooting.

  Furthermore, a data processing apparatus according to a fifth aspect of the present invention provides a decoding unit that decodes individual stream data read from the data storage unit, and outputs frame data generated by the decoding unit to the output of the high-speed camera. Display control for selecting and displaying either the case of alternately displaying in the same frame order as the signal or the case of displaying the frame at the normal speed is provided.

  With this configuration, the camera output signal is processed by dividing it into independent frames, so there is no need for high-performance processing means compared to the case where a series of processing is performed by directly receiving the camera output signal. The system can be configured by using a plurality of low processing means. Further, since encoding is performed without interdependence between frames and recording is performed as separate streams, each recording data can be reproduced in other systems.

  According to the data processing apparatus of the present invention, high-performance processing means is not required at the time of high-speed shooting, and the memory capacity can be reduced by further compressing data, and individual streams can be recorded individually. Therefore, data that can be decoded in other systems can be created.

  Embodiments of the present invention will be described below with reference to the drawings.

(Embodiment 1)
FIG. 1 is a diagram of a data processing apparatus according to Embodiment 1 of the present invention. In FIG. 1, 101a and 101b receive the camera output signal, and data storage means for storing image data in units of frames, and 102a and 102b encode the image data stored in the data storage means 101a and 101b, respectively. Signal processing means for performing processing, etc. 103a and 103b are recording means for recording the image stream data encoded by the signal processing means 102a and 102b, respectively, and 104 is a stream recorded in the recording means 103a and 103b, respectively. Display control means 105 for displaying the respective data output as images by performing decoding processing on the data in the signal processing means 102a and 103b, respectively, is constituted by control means for performing overall system control.

  FIG. 2 is a timing chart for storing camera output signals in 101a and 101b in units of frames. In FIG. 2, 201 is a vertical synchronizing signal for matching the start of a frame, 202 is a count signal indicating the number of frames, and 203 and 204 are signals indicating that the count signal of 202 is odd and even, respectively. FIG. 3 is a diagram showing input / output image data of the data processing apparatus. In FIG. 3, 301 is a camera output signal, 302 is a decode signal of the signal processing means 102a, 303 is a decode signal of the signal processing means 102b, and 304 is an output signal of the display control means.

  The camera output signal in FIG. 1 is output at 300 frames per second as shown by the camera output signal 301 in FIG. 3, and the display is 1 second as shown by the output signal 304 of the display control means in FIG. It is assumed that a device that displays 30 frames is connected. Also, the two frames drawn with white and diagonal lines in the camera output signal 301 in FIG. 3 indicate the odd and even frames, respectively.

  First, capturing of camera output signals into the data storage means 101a and 101b in FIG. 1 will be described with reference to FIG.

  In FIG. 2, the count signal 202 counts the rising edge of the vertical synchronizing signal 201 to the high level, counts 300 frames, and then returns the counting signal 202 to 1 at the rising edge of the next vertical synchronizing signal 201 that becomes the high level. This operation is repeated until the end of shooting. The odd signal 203 indicates a high level when the count signal 202 is odd, and the even signal 204 indicates a high level when the count signal 202 is even.

  The data storage means 101a in FIG. 1 stores data for one frame when the odd signal 203 in FIG. 2 is at a high level. Further, the data storage means 101b stores data for one frame when the even signal 204 in FIG. 2 is at a high level. That is, the data storage means 101a and 101b store the camera output signal alternately divided into odd frames and even frames and output them to the subsequent signal processing means 102a and 102b. The signal processing means 102a and 102b perform processing such as noise removal and flaw correction on the data of each frame, further perform encoding processing using a moving image compression technique such as MPEG, and compress 150 frames of data per second. The stream data is recorded in the recording means 103a and 103b, and the photographing process is terminated.

  Further, when reproducing the encoded image data after the photographing, the encoded odd frame data is read from the storage means 103a, and the signal processing means 102a performs decoding processing, post processing, and the like, as indicated by 302 in FIG. As described above, only odd frames are decoded in 15 frames per second and output to the display control means 104. On the other hand, the encoded even frame data is read from the storage means 103b, and the signal processing means 102b performs decoding processing and post processing, and as shown by 303 in FIG. And output to the display control means 104. The display control means 104 performs control so that the decoded odd frames and even frames are alternated in the order of encoding as indicated by 304 in FIG. 3, and the video signal is sent to the display device at 30 frames per second. Output.

  According to such a configuration, since the camera output signal is processed by dividing it into odd and even frames, a series of processing is performed with 1/2 processing performance compared to a case where a series of processing is performed by directly receiving the camera output signal. Therefore, a high-performance processing unit is not necessary, and a system can be configured by using a plurality of processing units with low processing performance. In addition, encoding is performed without interdependence between odd and even frames, and each stream is recorded as a separate stream, so each recorded data can be played back even in other systems where even and odd numbers cannot be rearranged by the display control means. It becomes.

  The series of controls can be controlled by a control signal from the control means 105. The control means 105 controls the number of data stored in the data storage means 101a and 101b and the number of signal processing means 102a and 102b according to the display device. In addition, the display control means can set the number of displayed images.

  Although each means is described as an individual component, it may be configured on one LSI, and the storage means 102a and 103b can be accessed from the signal processing means 102a and 103a as the same storage means. .

  Further, this time, a series of processing is described by dividing into even frames and odd frames. However, depending on the performance of the signal processing means 102a and 102b, means subsequent to the signal processing means may be added so that the number of divisions is 1 frame, 4 Frames, 7 frames, 2 frames, 5 frames, 8 frames, 3 frames, 6 frames, 9 frames, and so on. It is also possible.

(Embodiment 2)
FIG. 4 is a diagram of the data processing apparatus according to the second embodiment of the present invention. The same components as those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted. 5 and FIG. 6 showing the input / output image data of the data processing apparatus also use the same reference numerals for the same components as those in FIG. 2 and FIG.

  4 differs from FIG. 1 in that the data storage means 401c, the signal processing means 402c, and the recording means 403c have additional configurations, and the display control means 404 and the control means 405 have additional functions.

  Further, in FIG. 5, as a difference from FIG. 2, a signal indicating that the last digit of the count signal 202 is 1 such as the 1st frame, the 11th frame, and the 21st frame is added. 6 differs from FIG. 3 in that the output signal of the display control means when the camera output signal 605 is encoded every 10 frames and decoded in 30 frames is added.

  The camera output signal in FIG. 4 is output at 300 frames per second as indicated by the camera output signal 301 in FIG. 6, and the display is indicated by the output signal 304 or 605 of the display control means in FIG. It shall be connected to a device that displays 30 frames per second. In addition, two frames drawn with white and diagonal lines in the camera output signal 301 in FIG. 6 indicate odd and even frames, respectively.

  Acquisition of camera output signals into the data storage means 101a and 101b in FIG. 4 is the same as that in the first embodiment, and thus description thereof will be omitted. Acquisition of camera output signals into the data storage means 401c will be described.

  The count signal 202 counts the rise of the vertical synchronization signal 201 to the high level, counts 300 frames, and then returns the count signal 202 to 1 at the rise of the next vertical synchronization signal 201 to the high level. Repeat until shooting is complete. A signal 505 in which the last digit is 1 indicates a high level when the count signal 202 is 1, 11 and 21, and the last digit is 1.

  The data storage unit 401c in FIG. 4 stores data for one frame when the signal 505 in which the last digit of FIG. 5 indicates 1 is at a high level. In other words, the data storage unit 401c stores the camera output signal with 10 frames skipped and outputs it to the subsequent signal processing unit 402c. The signal processing unit 402c performs processing such as noise removal and flaw correction on the frame data, further performs encoding processing using a moving image compression technique such as MPEG, compresses 30 frames of data per second, and records it as stream data. Recording is performed in the means 403c, and the photographing process is terminated.

  When the encoded image data is reproduced after the photographing is finished, the encoded frame data is read from the storage unit 403c, and the signal processing unit 402c performs decoding processing, post processing, and the like, as indicated by reference numeral 605 in FIG. 30 frames per second are decoded and output to the display control means 404.

  On the other hand, the same components as in the first embodiment perform the same operation as in the first embodiment, read the odd frame data encoded from the storage means 103a, and perform the decoding process and the post process in the signal processing means 102a. 6, 15 frames are decoded per second for only odd frames, and output to the display control means 104. Further, the even frame data encoded from the storage means 103b is read out, and the signal processing means 102b performs decoding processing and post processing, and as shown by 303 in FIG. 6, each even frame is decoded at 15 frames per second. And output to the display control means 104. The display control means 404 selects either 304 or 605 in FIG. 6 and outputs a video signal to the display device for 30 frames per second.

  According to such a configuration, since the camera output signal is processed by dividing it into odd and even frames, the high-speed shooting has half the processing performance compared to the case where a series of processing is performed by directly receiving the camera output signal. At the same time, a series of processing can be performed at 1/10 of normal shooting, and high-performance processing means is not required, and a system can be configured by using a plurality of processing means with low processing performance. In addition, encoding is performed without interdependence between the odd and even frames, and encoding is performed at the normal speed with the same number of frames as the display, and each is recorded as a separate stream. Each recorded data can be reproduced even in other systems that cannot perform rearrangement and systems that can decode only the same number of frames as the display.

  The series of controls can be controlled by a control signal from the control unit 405. The control unit 405 can control the signal processing units 102a, 102b, and 402c in accordance with the number of data stored in the data storage units 101a, 101b, and 401c and the display device. It is possible to control the number of decodes and further set the number of displays in the display control means.

  Although each means is described as an individual component, it may be configured on one LSI, and the storage means 103a, 103b, 403c are accessed from the signal processing means 102a, 102b, 402c as the same storage means. Is also possible.

  The data processing apparatus according to the present invention can be used in an experimental apparatus that performs high-speed shooting, an electronic apparatus equipped with a camera and an image codec such as a surveillance camera, a movie, and a digital still camera, and its application field.

Configuration diagram of data processing apparatus according to Embodiment 1 of the present invention Timing chart for storing in frame units in Embodiment 1 of the present invention The figure which shows the input-output image data of the data processor in Embodiment 1 of this invention Configuration diagram of data processing apparatus according to Embodiment 2 of the present invention Timing chart for storing in units of frames in Embodiment 2 of the present invention The figure which shows the image data of the input / output of the data processor in Embodiment 2 of this invention Figure of conventional data processing device

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Data separation means 4 Synchronization means 5 Data multiplexing means 3a, 3b, 3n, 101a, 101b, 401c Data storage means 102a, 102b, 402c Signal processing means 103a, 103b, 403c Recording means 104, 404 Display control means 2, 105 , 405 Control means 201 Vertical synchronization signal for aligning the start of a frame 202 Count signal indicating the number of frames 203 Signal indicating that the count signal is odd 204 Signal indicating that the count signal is even 505 When the last digit of the count signal is 1 Signal 301 shown Camera output signal 302, 303 Decoding signal of signal processing means 304, 605 Output signal of display control means

Claims (5)

A data processing apparatus for recording and reproducing with an output signal of a high-speed camera as an input,
N + 1 first data storage means for dividing the output signal of the high-speed camera into n (n is an integer of 1 or more) frames in units of frames and temporarily storing the divided frames;
N + 1 first encoding means for individually encoding the frames read from the n + 1 data storage means into stream data;
A data processing apparatus comprising: n + 1 first data recording means for recording the stream data compressed by the n + 1 encoding means. First decoding means for decoding each individual stream data read from the first data storage means;
The data processing apparatus according to claim 1, further comprising display control means for alternately displaying the frame data generated by the first decoding means in the same frame order as the output signal of the high-speed camera. 3. The data processing apparatus according to claim 1, further comprising a control unit that controls a frame interval to be taken into the data storage unit in accordance with the performance of the encoding unit or the performance of the display device. A second data storage means for thinning out the output signal of the high-speed camera so as to obtain a normal speed frame adapted to a display device, and temporarily storing the frame;
Second encoding means for individually encoding frames read from the second data storage means into stream data;
2. The data processing apparatus according to claim 1, further comprising second data recording means for recording the stream data compressed by the second encoding means. First decoding means for decoding each individual stream data read from the first data storage means;
Second decoding means for decoding stream data read from the second data storage means;
When displaying the frame data generated by the first decoding means alternately in the same frame order as the output signal of the high-speed camera;
5. The data processing apparatus according to claim 4, further comprising display control means for selecting and displaying one of a case where frame data generated by the second decoding means is displayed at a normal speed. .

Images