JP6127705B2 - Data processing device - Google Patents

Description

  The present invention relates to a data processing apparatus that processes input data and outputs the processed data.

  A data processing apparatus that acquires image data from an input device, processes the acquired image data, and outputs the processed image data to an image processing apparatus is known (see, for example, Patent Document 1).

  For example, consider a case where a moving image captured by a video camera (input device) is taken into a personal computer (image processing apparatus) via a data processing apparatus. In this case, the conventional data processing apparatus sequentially receives a plurality of image data constituting the moving image data from the video camera, and sequentially outputs the received image data to the personal computer. Such a conventional data processing apparatus has the following problems.

  The timing at which the conventional data processing apparatus outputs the image data to the personal computer depends on the timing at which the data processing apparatus acquires the image data from the video camera. That is, each time a conventional data processing apparatus acquires image data from a video camera, the acquired image data is transferred to a personal computer.

  By the way, there is a case where moving image data input to the data processing apparatus by the video camera is delayed. This is because when the frame rate is reduced due to long exposure during moving image capture, when image data input to the data processing device by the video camera contains defects, or due to noise during data transfer, etc. For example, if

  In addition, the time interval at which the video camera inputs image data to the data processing apparatus may be shorter than the time interval assumed (or designated) by the personal computer.

  As described above, even if the time interval at which the video camera inputs image data to the data processing device is different from the time interval assumed by the personal computer, the data processing device Image data is output to a personal computer at the timing when the data is input. Therefore, in such a case, the personal computer cannot acquire image data at an assumed time interval. That is, there arises a problem that the personal computer cannot acquire image data stably.

  The present invention has been made in view of such problems, and an object of the present invention is to provide a data processing apparatus that can stably output image data to a subsequent apparatus.

The data processing apparatus according to the present invention
An acquisition unit that sequentially acquires each piece of image data for one frame that is transmitted by being divided into a plurality of fragments from an input device that acquires image data;
A restoration management unit that restores the image data for one frame from each piece of the acquired image data;
A storage unit including a received data storage unit for storing each piece of the acquired image data, and a restored data storage unit for storing the restored image data;
An image output unit for outputting the image data stored in the restored data storage unit;
A time management unit for instructing the image output unit to output the image data stored in the restored data storage unit;
With
The restoration management unit
It is determined whether or not the obtained pieces of image data are normal, and when the obtained pieces of image data are normal, each piece of image data previously stored in the received data storage unit The acquired image data fragment is stored in the received data storage unit so as to be additionally recorded, and when the acquired image data fragment is not normal, the acquired image data fragment is stored in the received data storage unit. Without erasing each piece of image data previously stored in the received data storage unit,
When each piece of image data for one frame is stored in the received data storage unit, it is determined whether or not the stored image data for one frame is normal. When the image data is normal, the image data for one frame is stored in the restored data storage unit as restored image data. When the stored image data for one frame is not normal, the image data for one frame is stored. Are deleted from the received data storage unit .

  According to the data processing device of the present invention, it is possible to stably output image data to a subsequent device even if the input of the image data is unstable.

The block diagram which shows the functional structure of one Embodiment of this invention. The block diagram which shows an example of a structure of the memory | storage part of this invention. The block diagram for demonstrating the example of application of the moving image input device of this embodiment.

  Embodiments of the present invention will be described below with reference to the drawings as appropriate.

<1. Configuration of video input device>
Hereinafter, with reference to FIG. 1, the structure of the moving image input apparatus which is the data processing apparatus of this embodiment is demonstrated.

  As shown in FIG. 1, the moving image input apparatus 200 includes a data acquisition unit 210, a storage unit 220, a restoration management unit 230, an image output unit 240, and a time management unit 250.

  The storage unit 220 includes a received data storage unit 221 and a restored data storage unit 222.

  The data acquisition unit 210 acquires moving image data output from the input device 100 (for example, a video camera).

  In the present embodiment, the moving image data includes a plurality of image data having temporal continuity. Each image data is data indicating an image for one frame. Each piece of image data is divided into a plurality of pieces (for example, payload) and is sequentially transmitted from the input device 100 to the moving image input apparatus 200 (that is, the data acquisition unit 210). That is, the data acquisition unit 210 sequentially acquires pieces of image data output from the input device 100.

  The storage unit 220 restores image data for one frame by storing a plurality of pieces of image data acquired by the data acquisition unit 210 in the order received. That is, “restoring image data” indicates storing all image data for one frame from a plurality of pieces constituting the image data.

  The restoration management unit 230 controls the storage of the input image data in the storage unit 220. More specific operations of the restoration management unit 230 and the storage unit 220 will be described later.

  The image output unit 240 transmits the image data restored and stored by the storage unit 220 to the image processing apparatus 300.

  The time management unit 250 manages the timing at which the image output unit 240 outputs the image data restored and stored by the storage unit 220 to the image processing apparatus 300.

  The time management unit 250 acquires an instruction for determining the timing at which the image output unit 240 outputs image data from the image processing apparatus 300 at a predetermined timing. The timing instruction is, for example, information related to processing of moving image data in the image processing apparatus 300 (for example, information indicating the frame rate of the moving image processed by the image processing apparatus 300). The predetermined timing is, for example, when the moving image input apparatus 200 is turned on or when the moving image input apparatus 200, the input device 100, and the image processing apparatus 300 are connected.

  The time management unit 250 instructs the image output unit 240 to output image data based on the timing instruction acquired from the image processing apparatus 300. The output timing is, for example, the frame rate of image data to be output.

  The image output unit 240 reads data from the storage unit 220 based on the output timing instruction from the time management unit 250 and outputs the read data to the image processing apparatus 300.

  The image output unit 240 includes a data processing unit 241. The data processing unit 241 performs predetermined image processing on the image data restored and stored by the storage unit 220. The data processing unit 241 can receive an instruction from the image processing apparatus 300 via the image output unit 240 and process image data based on the instruction.

  The data processing unit 241 performs predetermined image processing so that the processing is completed within a certain period (for example, a frame period) determined at a timing specified by the time management unit 250.

  Hereinafter, a time interval at which the input device 100 inputs image data to the data acquisition unit 210 (that is, the moving image input device 200) is also referred to as an “input interval”. The time interval at which the image output unit 240 (that is, the moving image input device 200) outputs the image data to the image processing device 300 is also referred to as an “output interval”. The output interval is the same as the time interval at which the time management unit 250 instructs the image output unit 240 to output data.

<2. Operation of video input device>
Hereinafter, the operation of the moving image input apparatus 200 will be described.

  The data acquisition unit 210 sequentially acquires image data fragments from the input device 100.

  The restoration management unit 230 determines whether the fragment of the image data acquired by the data acquisition unit 210 is normal. This determination can be performed, for example, by referring to information included in the image data fragment (for example, information indicating that the image data fragment is invalid). Alternatively, the determination can be performed by comparing the size of the obtained fragment of the image data with the determined size when the size of the fragment of the image data is predetermined.

  When the restoration management unit 230 determines that the acquired pieces of image data are normal, the restoration management unit 230 stores the pieces of image data in the received data storage unit 221 of the storage unit 220.

  The data acquisition unit 210 sequentially acquires image data fragments from the input device 100, and the restoration management unit 230 sequentially determines whether the image data fragments are normal. When the restoration management unit 230 determines that the fragment of the image data is normal, the restoration management unit 230 stores (appends) the acquired fragment of the image data in addition to the previously stored fragment of the image data. The data acquisition unit 210 and the restoration management unit 230 repeat such a series of operations until image data for one frame is restored.

  On the other hand, if the restoration management unit 230 determines that the obtained pieces of image data are not normal, the restoration management unit 230 does not store the obtained pieces of image data in the storage unit 220 and does not store the pieces of image data that have been stored in the storage unit 220 until then. Erase the fragment. Thereafter, the restoration management unit 230 does not store in the received data storage unit 221 image data fragments to which image data fragments determined to be abnormal belong.

  When the reception data storage unit 221 stores the restored image data for one frame (that is, when restoring the image data for one frame), the restoration management unit 230 determines whether the restored image data is normal. judge. This determination can be performed, for example, by verifying whether an error is included in the image data. Alternatively, the determination can be performed by comparing the size of the image data with the determined size when the size of the image data is determined in advance.

  When it is determined that the restored image data is normal, the restored data storage unit 222 stores the restored image data.

  On the other hand, when the restoration management unit 230 determines that the restored image data is not normal, the restoration management unit 230 deletes the data in the received data storage unit 221.

  The restoration management unit 230 stores the received data storage unit 221 in the restoration data storage unit 222 every time the reception data storage unit 221 completes restoration of the image data and the restoration management unit 230 determines that the restored image data is normal. The existing image data is replaced with the latest image data. That is, the image data in the restoration management unit 230 is updated to the latest restored image data every time normal image data is restored in the reception data storage unit 221.

  Note that when the image data stored in the restoration data storage unit 222 is being output to the image processing apparatus 300 and the restoration of the image data is completed in the reception data storage unit 221, the newly input image Data fragments are stored in a spare storage unit. After that, when the image data in the restored data storage unit 222 is output to the image processing device 300, the image data in the image processing device 300 is updated with the image data in the restored data storage unit 222, and a spare storage is stored in the restored data storage unit 222. Part of data is stored.

  In this way, while the storage unit 220 is updating the image data, the time management unit 250 instructs the image output unit 240 to output data at a timing determined based on the timing information.

  The image output unit 240 reads the image data stored in the restored data storage unit 222 in accordance with the data output instruction from the time management unit 250 and outputs the read image data to the image processing apparatus 300. At that time, the image output unit 240 processes the read image data in the data processing unit 241 as necessary.

  As described above, the moving image input apparatus 200 restores moving image data (image data) input from the input device 100 and outputs the restored data to the image processing apparatus 300.

  At this time, the restoration management unit 230 controls the received data storage unit 221 and the restoration management unit 230 as follows.

  When the image data fragments are successively input from the input device 100, the restoration management unit 230 uses the restored image data to restore the restored data storage unit 221 every time the received data storage unit 221 completes restoration of normal image data. The image data stored in 222 is updated to the latest one.

  Thereby, when the input interval of the image data is shorter than the output interval, the image data can be input to the image processing apparatus 300 at the time interval indicated by the time management unit 250.

  On the other hand, the restoration management unit 230 keeps the image data currently stored in the restoration data storage unit 222 unless the reception data storage unit 221 completes restoration of the image data. The image data output from the restoration data storage unit 222 to the image processing apparatus 300 while the restoration data storage unit 222 continues to hold the image data is the same as the previously output image data.

  Thereby, when the input interval of the image data is longer than the output interval (for example, when the input of the image data from the input device 100 is interrupted), the time management unit 250 instructs the image processing apparatus 300 for the same image data. It becomes possible to input at time intervals.

  Therefore, even if the input of the image data from the input device 100 is unstable in the moving image input apparatus 200, the image data can be stably sent out to the image processing apparatus 300.

<2-1. Operation of machining part>
Hereinafter, the image processing by the data processing unit 241 will be specifically described.

  The data processing unit 241 decodes the input image data and performs predetermined image processing on the decoded image data.

  For example, the data processing unit 241 performs image analysis, geometric conversion (for example, enlargement, reduction, rotation), replacement, synthesis, and the like on the image indicated by the image data based on an instruction from the image processing apparatus 300. Or the data format of the image data is converted.

  For example, the data processing unit 241 can extract color information related to color from image data and perform the following analysis based on the color information.

(1) An analysis of a trend related to the color of an area of the image by calculating an average value.
(2) Analysis of color distribution by histogram.
(3) Analysis of pixel distribution in color space.
(4) Edge detection.
(5) Grouping by approximate values.
(6) Waveform analysis by wavelet transform and measurement of dispersion in each frequency band.

  Further, the data processing unit 241 may be configured to perform analysis other than these. Any necessary analysis may be performed as appropriate.

  Based on the analysis results as described above, the data processing unit 241 can perform, for example, the following image processing on the image data.

(1) Automatic adjustment of hue and / or white balance.
(2) Automatic adjustment of contrast and / or saturation by performing color smoothing based on a color histogram.
(3) Automatic adjustment of brightness, gain, and / or gamma value based on luminance histogram.
(4) Automatic focus adjustment based on edge detection amount.
(5) Removal of noise included in the image.

  Further, the data processing unit 241 may be configured to perform image processing other than these.

  Further, the data processing unit 241 can, for example, paint a part of an image indicated by the image data with one color based on an instruction from the image processing apparatus 300.

<3. Example of storage unit>
An example of the configuration of the storage unit 220 will be described with reference to FIG. In order to simplify the description, description of the determination operation regarding whether or not the fragment of the image data and the image data are normal will be omitted.

  As shown in FIG. 2, the storage unit 220 of the present embodiment includes a first switch 271, a second switch 272, a first buffer 223A, a second buffer 223B, and a third buffer 223C.

  The first switch 271 and the second switch 272 are controlled by the restoration management unit 230.

  The restoration management unit 230 manages the states of the buffers 223A, 223B, and 223C, and sequentially switches buffers used for restoring, storing, or transmitting image data according to the states of the buffers 223A, 223B, and 223C.

  Specifically, the restoration management unit 230 manages the following various states as buffer states.

(1) A state in which image data fragments are being recorded.
(2) A state in which the restored image data is stored.
(3) The stored image data has been transmitted / not transmitted to the image processing apparatus 300.

  Here, a buffer that stores untransmitted image data in the image processing apparatus 300 is referred to as an “untransmitted buffer”, and a buffer that stores image data that has been transmitted to the image processing apparatus 300 is referred to as a “transmitted buffer”.

  The first switch 271 switches a buffer for storing the pieces of image data acquired by the data acquisition unit 210 and restoring the image data. Specifically, the first switch 271 receives, as a buffer for receiving a fragment of image data from the data acquisition unit 210, the first buffer 223A → the second buffer 223B → the third buffer 223C → the first buffer 223A →. Switch sequentially. That is, when the restoration of the image data is completed in one of the three buffers 223A, 223B, and 223C, the first switch 271 is switched so that the fragment of the image data is stored in the next buffer.

  Further, when the restoration of the image data is completed in a certain buffer, the restoration management unit 230 recognizes the image data as the latest image data. When the restored image data is stored in a plurality of buffers, the image data restored last is recognized as the latest image data.

  The restoration management unit 230 controls the second switch 272 so that a buffer for storing the latest image data can be connected to the image output unit 240.

  At this time, the restoration management unit 230 controls the second switch 272 to connect the image output unit 240 and each buffer as follows. First, the restoration management unit 230 searches for an untransmitted buffer, and when an untransmitted buffer is found, connects the found untransmitted buffer to the image output unit 240. However, when a plurality of untransmitted buffers are found, the restoration management unit 230 connects the untransmitted buffer that stores the latest image data to the image output unit 240. When no untransmitted buffer is found, the restoration management unit 230 searches for a transmitted buffer. Then, when the transmitted management buffer is found, the restoration management unit 230 connects the found transmitted buffer to the image output unit 240. However, when a plurality of transmitted buffers are found, the restoration management unit 230 connects the transmitted buffer that stores the latest image data to the image output unit 240.

  When the data output timing is instructed by the time management unit 250, the image output unit 240 reads the image data from the connected buffer, performs image processing by the data processing unit 241 as necessary, and then outputs the image data. The image is output to the image processing apparatus 300.

  Hereinafter, the operation of the storage unit 220 of the present embodiment will be described more specifically.

  For example, when the data acquisition unit 210 newly acquires a fragment of image data while the restored image data is stored in the first buffer 223A, the acquired image data fragment is stored in the second buffer 223B. Is done. At this time, the restoration management unit 230 recognizes the image data in the first buffer 223A as the latest image data. When the restoration of the image data is completed in the second buffer 223B, the image data in the second buffer 223B is recognized as the latest image data. Therefore, the image data stored in the second buffer 223B is input to the image output unit 240 at the next data output timing.

  When the second buffer 223B completes the restoration of the image data while the first buffer 223A is transmitting image data to the image output unit 240, the image data acquired by the data acquisition unit 210 is the next. Are stored in the third buffer 223C. As described above, the storage unit 220 of this example includes three buffers, so that even when one buffer is transmitting image data and another one buffer stores restored image data, the input is also possible. A piece of image data input from the device 100 can be stored.

  As described above, the storage unit 220 always holds the latest image data by switching the buffer used for restoring and storing the image data.

  That is, for example, when the first buffer 223 </ b> A is sequentially storing image data fragments, the first buffer 223 </ b> A functions as the received data storage unit 221. Further, when the first buffer 223A completes the restoration of the image data and holds the restored image data, the first buffer 223A functions as the restored data storage unit 222. Further, when the image data is being output from the first buffer 223A to the image processing apparatus 300 and the restoration of the image data in the second buffer 223B is completed, the third buffer 223C stores a spare storage. It functions as a part. As described above, the buffers 223A, 223B, and 223C are switched according to the situation so as to function as the received data storage unit 221 or the restored data storage unit 222.

  Here, when image data is successively input from the input device 100, the buffer in which the input image data is restored and stored is changed one after another among the three buffers 223A, 223B, and 223C.

  On the other hand, when the input of the image data from the input device 100 is delayed or stopped, one of the three buffers 223A, 223B, and 223C keeps the restored image data.

  You may implement | achieve the memory | storage part 220 with the above structures. However, since the above configuration is an example of the configuration of the storage unit 220, the storage unit 220 may be realized by a configuration different from the above configuration.

<4. Application example of moving image input apparatus of this embodiment>
With reference to FIG. 3, an application example of the moving image input apparatus of the present embodiment will be described.

  FIG. 3A shows an example in which the moving image input apparatus 200 is realized by a personal computer 300 that is an example of the image processing apparatus 300. In this example, a video camera 100, which is an example of the input device 100, is connected to the personal computer 300. In this case, the function of the video input device 200 can be realized as a function of a video driver of the personal computer 300, for example. Here, the video driver is a program for inputting image data from the video camera 100 to the personal computer 300. Further, the function of the image processing apparatus 300 can be realized as a function of an application installed in the personal computer 300.

  As shown in FIG. 3B, the moving image input apparatus 200 is connected between a video camera 100 that is an example of the input device 100 and a personal computer 300 that is an example of the image processing apparatus 300. It may be configured as an independent interface device.

  In this case, the restoration management unit 230, the time management unit 250, and the data processing unit 241 can be realized by a CPU, for example. The storage unit 220 can be realized by a storage medium (for example, DRAM or HDD).

  Alternatively, some of the functions of the restoration management unit 230, the time management unit 250, and the data processing unit 241 may be realized by software. In that case, the moving image input apparatus 200 may be provided with an arithmetic processing unit that executes software.

<5. Examples of effects according to this embodiment>
As described above, the moving image input apparatus 200 according to the present embodiment can cause the image processing apparatus 300 to stably acquire the image data even when the input timing of the image data from the input device 100 is unstable. Is possible. For this reason, the moving image input apparatus 200 can solve the following problems, for example.

  As described above, each time a conventional data processing apparatus acquires image data from an input device, the acquired image data is transferred to the image processing apparatus. As described above, when the conventional data processing apparatus operates, the following problems occur.

  (1) Consider a case where the image processing apparatus receives moving image distribution data. In this case, image data cannot be received if the image processing apparatus starts receiving during a period in which there is a delay in image input. Therefore, the image processing apparatus cannot display an image on a display device, for example.

  (2) Consider a case where an image processing apparatus records a video stream and other streams such as audio and text in synchronization and generates a synchronization signal based on an image input of a moving image. In this case, when a delay occurs in image input, the image processing apparatus cannot record a video stream and cannot record other streams.

  (3) Consider a case where the image processing apparatus is required to follow up in real time and is configured to process all input image data. When the image data input interval is shorter than the time interval specified (assumed) by the image processing device, the processing of the image processing device is real time. I cannot follow. For example, the time interval of image input designated by the image processing apparatus is 30 [fps], and the time required for the image processing apparatus to process one piece of image data is 33 [msec] (≈ 1/30 [Sec]) Consider the case. Here, “fps” (fps = frame / second) is a unit representing the number of images processed per second. When 60 [fps] moving image data is input to such an image processing apparatus for 10 seconds, the image processing apparatus takes 20 seconds to process all the data. Therefore, the processing of the image processing apparatus cannot follow the input moving image data.

  The above problems can be solved by the above-described configuration and operation of the moving image input apparatus 200 of the present embodiment.

<6. Summary of this embodiment>
As described above, the moving image input apparatus 200 according to the present embodiment includes the data acquisition unit 210 that acquires a plurality of pieces of image data, and the reception data storage unit 221 that restores image data from the acquired pieces of image data. Is provided. The moving image input apparatus 200 also includes a restored data storage unit 222 that stores the restored image data, an image output unit 240 that outputs the stored image data, and a time for instructing the image output unit 240 to output image data. And a management unit 250.

  According to the moving image input apparatus 200 having the above configuration, even when the time interval of the image data input by the input device 100 is unstable, the image data can be stably output to the image processing apparatus 300. It becomes.

  Also, the restored data storage unit 222 of the present embodiment holds the currently stored image data until the received data storage unit 221 restores new image data, and the image output unit stores the restored image data in the restored data storage unit 222. The processed image data is output in accordance with an instruction from the management unit.

  Thus, when the input interval of the image data from the input device 100 is longer than the time interval specified by the image processing device 300, the image data is output to the image processing device 300 at the time interval specified by the image processing device 300. Is possible.

  In addition, the restored data storage unit 222 of the present embodiment stores the stored image when the received data storage unit 221 restores new image data before the time management unit 250 instructs the output of the image data. Replace data with new image data.

  Thus, when the input interval of the image data from the input device 100 is shorter than the time interval specified by the image processing device 300, the image data is output to the image processing device 300 at the time interval specified by the image processing device 300. Is possible. At the same time, the image data output to the image processing apparatus 300 can be updated to the latest image data.

  In the moving image input apparatus 200 of the present embodiment, the time management unit 250 instructs the image output unit 240 to specify the frame rate of the image data to be output.

  Thereby, the moving image input apparatus 200 can output the image data to the image processing apparatus 300 at the frame rate specified by the image processing apparatus 300 even if the input interval of the image data from the input device 100 is unstable.

  In the moving image input apparatus 200 of the present embodiment, the received data storage unit 221 restores image data for one frame constituting the moving image data from a plurality of pieces of image data acquired by the data acquisition unit 210. That is, the moving image input apparatus 200 restores and holds image data for one frame, and outputs image data for one frame to the image processing apparatus 300 at a time interval specified by the image processing apparatus 300.

  Thereby, the image processing apparatus 300 can acquire image data for each frame at a specified time interval. Therefore, the image processing apparatus 300 can acquire image data stably.

  In addition, the restoration management unit 230 of this embodiment determines whether the image data restored by the received data storage unit 221 is normal. The restoration data storage unit 222 stores the restored image data when the restoration management unit 230 determines that the restored image data is normal.

  Thereby, it is possible to prevent image data that is not normal (for example, image data in which a part of the image is broken) from being input to the image processing apparatus 300.

  In addition, the restoration management unit 230 of the present embodiment determines whether each of a plurality of pieces of image data acquired by the data acquisition unit 210 is normal. The reception data storage unit 221 restores image data from a plurality of pieces of image data when the restoration management unit 230 determines that all of the obtained pieces of image data are normal. That is, the reception data storage unit 221 does not restore the image data when at least one of the acquired pieces of the image data is not normal.

  Thereby, it is possible to efficiently restore the image data.

  In addition, the data processing unit 241 according to the present embodiment includes a data processing unit 241 that performs predetermined image processing on output image data.

  As a result, even when the subsequent apparatus does not have an image processing function, it is possible to perform image processing on the image data.

  The moving image input apparatus 200 of this embodiment has been described above. The data acquisition unit 210 can be realized by, for example, an interface device (for example, a USB interface). The storage unit 220 can be realized by a recording medium (for example, DRAM or HDD), for example. The functions of the restoration management unit 230, the time management unit 250, and the image output unit 240 may be realized by, for example, a combination of a CPU and software, or may be realized only by hardware (electronic circuit).

  The moving image input apparatus 200 according to the present embodiment is an example of a data processing apparatus. The data acquisition unit 210 is an example of an acquisition unit. The reception data storage unit 221 is an example of a restoration unit. The restored data storage unit 222 is an example of a storage unit. The image output unit 240 is an example of an image output unit. The time management unit 250 is an example of a management unit. The restoration management unit 230 is an example of a determination unit. The data processing unit 241 is an example of a processing unit.

<7. Other embodiments>
The embodiment of the present invention has been described above. However, the idea of the present invention is not limited to the above embodiment. Hereinafter, other embodiments to which the idea of the present invention can be applied will be described.

  In the above embodiment, the data processed by the moving image input apparatus 200 is image data, but the idea of the present invention is not limited to this. The moving image input apparatus 200 may process data of a type other than image data. That is, the moving image input apparatus 200 may process arbitrary data input from the input device 100 as a plurality of fragments. In this case, the idea of the present invention can be applied.

  In the above embodiment, the data processing unit 241 decodes the image data. However, the idea of the present invention is not limited to the above embodiment. Components other than the data processing unit 241 may decode the image data. For example, the restoration management unit 230 may decode the image data. In this case, the restored data storage unit 222 stores the decoded image data.

  In the above embodiment, the moving image input apparatus 200 decodes the image data. However, the moving image input apparatus 200 does not have to decode the image data.

  In the above embodiment, the moving image input apparatus 200 includes the data processing unit 241 that processes image data. However, the moving image input apparatus 200 may not include the data processing unit 241. That is, the moving image input apparatus 200 may not perform data processing.

  Further, the restoration management unit 230 of the above embodiment determines whether or not the fragment of the image data acquired by the data acquisition unit 210 is normal, and the image data restored by the received data storage unit 221 is normal. It was determined whether or not. However, the idea of the present invention is not limited to the above embodiment. It may not be determined whether or not the fragment of the image data is normal and / or whether or not the image data is normal. The idea of the present invention can also be applied when no determination is made.

In addition, the moving image input apparatus 200 of the above embodiment transmits image data to the image processing apparatus 300. However, the moving image input apparatus 200 may transmit data other than image data to the image processing apparatus 300. For example, the moving image input apparatus 200 may transmit the analysis result of the image data by the data processing unit 241 to the image processing apparatus 300. By transmitting the analysis result to the image processing apparatus 300, the following processing becomes possible.
(1) Automatic adjustment of illumination based on luminance obtained from image data.
(2) Automatic determination of recording start and stop of the surveillance camera based on the change amount of the image data.
(3) Detection of the number of people in the image and / or the position of each individual based on face detection by grouping.
(4) Biometric authentication by detecting human faces and / or vein patterns by grouping.
(5) Augmented Reality (AR) processing by recognizing an arbitrary shape by grouping.
(6) Device operation by detecting the motion of the subject's hand or body based on the structural analysis of the grouped shapes.

  Further, in the application example of the moving image input apparatus 200 illustrated in FIG. 3A, it has been described that the function of the moving image input apparatus 200 can be realized as the function of the video driver of the personal computer 300. Such a video driver can be realized by a program including the following configuration, for example. The program is a program for inputting image data, and a computer control means (for example, CPU) acquires a plurality of pieces of image data from a plurality of pieces of image data and a function for obtaining pieces of pieces of image data. Execute the function to restore. In addition, the program causes the computer control means to store the restored image data in a storage unit (eg, DRAM, HDD), and outputs the image data stored in the storage unit to a subsequent processing unit in the image output unit. To execute the function. The program also causes the control means of the computer to execute a function that instructs the image output unit to output image data. The idea of the present invention can be applied to the program configured as described above.

DESCRIPTION OF SYMBOLS 100: Input device 200: Video input device 210: Data acquisition part 220: Storage part 221: Received data storage part 222: Restoration data storage part 230: Restoration management part 240: Image output part 241: Data processing part 250: Time management part 300: Image processing apparatus

JP2012-60594A

Claims (7)

An acquisition unit that sequentially acquires each piece of image data for one frame that is transmitted by being divided into a plurality of fragments from an input device that acquires image data ;
And recovery management unit for restoring the image data of one frame from each piece of image data to which the acquired,
A storage unit including a received data storage unit for storing each piece of the acquired image data, and a restored data storage unit for storing the restored image data;
An image output unit for outputting the image data stored in the restored data storage unit ;
Bei example the time to instruct the management unit to the image output section the timing for outputting the image data stored before Symbol restoration data storage unit,
The restoration management unit
It is determined whether or not the obtained pieces of image data are normal, and when the obtained pieces of image data are normal, each piece of image data previously stored in the received data storage unit The acquired image data fragment is stored in the received data storage unit so as to be additionally recorded, and when the acquired image data fragment is not normal, the acquired image data fragment is stored in the received data storage unit. Without erasing each piece of image data previously stored in the received data storage unit,
When each piece of image data for one frame is stored in the received data storage unit, it is determined whether or not the stored image data for one frame is normal. When the image data is normal, the image data for one frame is stored in the restored data storage unit as restored image data. When the stored image data for one frame is not normal, the image data for one frame is stored. Delete the image data of the received data storage unit ,
Data processing device. The restoration data storage unit holds the currently stored image data until the restoration management unit restores image data of a new frame ,
The image output unit, the image data stored in the restored data storage unit, and outputs in accordance with an instruction from the time management section,
The data processing apparatus according to claim 1. The recovered data storage unit, when said recovery management unit is restored image data of a new frame before being instructed to output image data from the time management unit, a new piece of the image data that the storage Replace with frame image data,
The data processing apparatus according to claim 1. The time management unit, to the image output unit, and instructs the frame rate of the image data to be output,
The data processing apparatus according to any one of claims 1 to 3. The recovery management unit,
When determining whether or not the obtained fragment of image data is normal, determine whether the information included in the image data fragment or the size of the fragment is normal,
When determining whether or not the stored image data for one frame is normal, whether or not the image data includes an error, or the size of the image data matches a predetermined size To determine whether or not
The data processing apparatus according to any one of claims 1 to 3. The image output unit includes a processing unit that performs predetermined image processing on output image data.
The data processing apparatus according to any one of claims 1 to 3. A program for a computer for inputting image data acquired from an input device to a subsequent processing unit ,
In the control means of the computer,
A function for sequentially acquiring each piece of image data for one frame transmitted by dividing into a plurality of pieces from the input device for obtaining image data ;
A function of storing each piece of the acquired image data in a received data storage unit;
A function for restoring the image data of one frame from each piece of image data to which the acquired,
A function that stores the reconstructed image data in the restoration data storage unit,
And ability to output the image data stored before Symbol restoration data storage unit to the subsequent processing unit,
A image data stored before Symbol restoration data storage unit a program for executing the function of instructing the timing for outputting to the subsequent processing unit,
The function to restore is
It is determined whether or not the obtained pieces of image data are normal, and when the obtained pieces of image data are normal, each piece of image data previously stored in the received data storage unit The acquired image data fragment is stored in the received data storage unit so as to be additionally recorded, and when the acquired image data fragment is not normal, the acquired image data fragment is stored in the received data storage unit. A function of erasing each piece of image data previously stored in the received data storage unit without storing;
When each piece of image data for one frame is stored in the received data storage unit, it is determined whether or not the stored image data for one frame is normal. When the image data is normal, the image data for one frame is stored in the restored data storage unit as restored image data. When the stored image data for one frame is not normal, the image data for one frame is stored. A function of erasing the received image data from the received data storage unit ,
program.

Images