JP2009033670A - Camera system, and camera used therefor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera system capable of transferring an image in a high-speed transfer mode regardless of a resolution of the image. <P>SOLUTION: The camera system 1 comprises: a camera 2 capable of pixel-shift photographing; an image recognition information imparting means 12 for imparting recognition information recognizing each pixel-shifted image captured by the camera; frame memories 13, 14 for storing pixel-shifted images to each of which the recognition information is imparted; an image memory 21 for storing a plurality of pixel-shifted images transferred from the frame memories, respectively; an image synthesizing means 22 for capturing the pixel-shifted images from the image memory based on the image recognition information to synthesize a high-resolution image; and a control section 6 which controls to continuously transfer one of images stored in the frame memories to the image synthesizing means until a new pixel-shifted image captured by the camera is transferred to the frame memory. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a camera system including an image composition device for pixel-shifted images, and a camera used therefor.

  Conventionally, when an image acquired from a camera is a normal low-resolution image obtained without adopting pixel shifting, the image transfer has no data guarantee but uses an isochronous transfer mode that can ensure a constant transfer rate, When shooting using pixel shifting, there is a data guarantee for transferring multiple images acquired by shooting, and there is a camera system using the bulk transfer mode that can transfer at a higher speed but does not guarantee the transfer rate. It is disclosed (for example, see Patent Document 1).

An image acquired by pixel shifting has a large amount of image data, and when it is transferred by bulk transfer, the transfer time becomes long. Therefore, it has been proposed to adopt isochronous transfer with a high transfer rate.
Japanese Patent No. 3004618

  However, when an image is acquired by shifting pixels, the image cannot be transferred continuously in order to operate the mechanical mechanism, and there are cases where the transfer is delayed. In this way, if there is a delay in the transfer and the isochronous transfer is performed, a time zone during which the transfer is not performed is detected, the isochronous transfer mode is turned off, and the transfer must be resumed. Also, when transferring images acquired by pixel shifting in bulk or when acquiring images continuously with a slight shift in the image acquisition area in the specimen, transfer when acquiring multiple images and transferring them. There is a similar problem when there is a time period when no time is taken.

  In order to solve the above-mentioned problems, the present invention is provided with a camera capable of shooting by shifting pixels, image recognition information adding means for adding recognition information for recognizing each pixel-shifted image acquired by the camera, and the recognition information. A frame memory for storing each pixel-shifted image, an image memory for storing the plurality of pixel-shifted images respectively transferred from the frame memory, and obtaining the pixel-shifted image from the image memory based on the image recognition information The image synthesizing means for synthesizing the high resolution image and any of the images stored in the frame memory until the new pixel shifted image acquired by the camera is transferred to the frame memory. A camera system is provided that includes a control unit that performs control to transfer to the image composition unit.

  In addition, the present invention is a camera capable of pixel-shifted photographing, and includes image recognition information adding means for adding recognition information for recognizing an image to each pixel-shifted image acquired by the camera, and the recognition information added to the camera A plurality of frame memories for storing each pixel-shifted image; a first switching means for switching inputs to the plurality of frame memories; a second switching means for switching outputs from the plurality of frame memories; And an output control unit for outputting the image from the frame memory selected by the switching means to the outside.

  ADVANTAGE OF THE INVENTION According to this invention, the camera system which enables the transfer of an image by one transfer mode in which high-speed transfer is possible irrespective of the resolution of an image, and the camera used for this can be provided.

  Hereinafter, a camera system according to an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a schematic configuration diagram of a camera system having a camera capable of shooting by shifting pixels according to an embodiment. FIG. 2 is a configuration example of an image format used in the camera system according to the embodiment.

  In FIG. 1, a camera 2 capable of pixel-shifting photography is connected to a camera control unit 3 by a camera cable 4, the camera control unit 3 is connected to a PC 6 by a USB cable 5, and an image taken by the camera 2 is controlled by the camera. The image is transferred to the PC 6 via the unit 3 and is synthesized by the PC 6 so that a high-resolution image is displayed on the monitor 7. When the camera 2 and the camera control unit 3 are configured integrally, the camera cable 4 uses internal wiring.

  The camera 2 that captures an image is connected to the camera control unit 3 via a camera interface (not shown). The camera 2 incorporates a CCD element, and usually subjects are imaged one after another at regular intervals, and the captured subjects are converted into digital data frame by frame and output.

  Further, the camera 2 has a function of shifting pixels. In this method, two parallel flat glass plates are placed in front of the CCD, and the optical path is displaced by a specified amount by refraction to perform an imaging operation. When these images are combined, it is possible to obtain a high-resolution image that is substantially equivalent to increasing the number of pixels of the image sensor.

  The camera control unit 3 includes an image processing unit 11 that processes an image acquired from the camera 2, a counter unit 12 that assigns an image number that is image recognition information to the acquired image, a first frame memory 13, and a second frame memory 14. , A USB control unit 15 and a control unit (not shown).

  A switch 16 that outputs an image output from the image processing unit 11 to either the first frame memory 13 or the second frame memory 14, and an image number output from the counter unit 12 in conjunction with the switch 16 is a first frame memory. 13 or the second frame memory 14 and a switch 18 for outputting an image from the frame memory of either the first frame memory 13 or the second frame memory 14 to the USB control unit 15. ing.

  The switch 16 and the switch 17 select the same frame memory, and the switch 18 is configured to select a frame memory different from the switches 16 and 17. That is, as shown in FIG. 1, when the switches 16 and 17 select the first frame memory 13, the switch 18 selects the second frame memory 14. When the switches 16 and 17 select the second frame memory 14, the switch 18 selects the first frame memory 13. As described above, the switches 16 and 17 and the switch 18 are controlled by a control unit (not shown) so as to select different frame memories.

  The image acquired by the camera 2 is stored in the first frame memory 13 via the switch 16. The image number is written from the counter unit 12 to the first frame memory 13 via the switch 17. An example of the image format at this time is shown in FIG. The acquired images are output to the PC via the USB control unit 15 as a set of image numbers and image data as shown in FIG. In this way, the image captured by the camera 2 is stored in the first frame memory 13 or the second frame memory 14 by switching the first frame memory 13 and the second frame memory 14 with the switches 16, 17 and 18. And the second frame memory 14 or the first frame memory 13, and the image transfer to the USB control unit 15 can be performed in parallel.

  The PC 6 includes a memory 21 that stores an image acquired via the USB control unit 15, an image composition unit 22 that synthesizes a high-resolution image using an image stored in the memory 21, a camera 2, and camera control. A control unit (not shown) for controlling the unit 3 is incorporated.

  In this way, a camera system 1 having a camera 2 capable of shooting with shifted pixels is configured.

  Hereinafter, in the camera system 1, the process from when the camera 2 obtains a captured image with pixel shift to image synthesis will be described in detail.

  First, for example, dummy image data of the same color is written in advance in the frame memory 14. At this time, “0” is written as the image number. The switch 17 is connected to the first frame memory 13 side, and only the image number of the counter unit 12 is set to “1” and is written in the first frame memory 13. Further, the switch 16 is connected to the first frame memory 13 side in order to write an image from the camera 2. Further, the switch 18 is connected to the second frame memory 14 side in order to read the image in the second frame memory 14.

  The camera control unit 3 permits the camera 2 to permit / inhibit imaging and waits for the camera 2 to start imaging.

  In response to a one-frame image request from the PC 6, the dummy image data in the second frame memory 14 is continued to the PC 6 via the USB control unit 15 until the first image from the camera 2 is stored in the first frame memory 13. And transfer. The PC 6 detects the image number of the received image data, and discards it without storing it in the memory 21 if the image number is “0”.

  Next, the camera 2 confirms the imaging permission / inhibition signal from the camera control unit 3, and if this signal is permitted, the imaging position is moved, the imaging signal is turned on, and imaging is started. Is input to the first frame memory 13. When imaging is completed, the imaging signal is turned off.

  The camera control unit 3 detects a signal during imaging from the camera 2, detects that imaging is completed, and switches the switches 16 and 17 from the first frame memory 13 side to the second frame memory 14 side. As a result, the next image to be captured is written into the second frame memory 14. The switch 18 is switched from the second frame memory 14 side to the first frame memory 13 side. Thus, the next image to be read becomes image data stored in the first frame memory 13. In addition, the counter unit 12 adds 1 to the previous image number to obtain a new image number and writes the new image number in the second frame memory 14.

  When the imaging signal is turned ON and the camera 2 starts to capture again, the imaging permission / inhibition signal is set to a prohibited state in order to wait for the next imaging.

  When the one frame image request signal is received from the PC 6, the switch 18 transfers the image data from the first frame memory 13 to the PC 6 via the USB control unit 15.

  When the transfer is completed, the imaging permission / prohibition signal is set to the permitted state in order to cause the camera 2 to capture the next frame.

  The camera 2 completes the imaging of one frame, stores the image data captured in the first frame memory 13, and then turns off the imaging signal and stops the imaging until the imaging permission / prohibition signal is permitted. stand by.

  When this signal is permitted, the imaging position is moved, the imaging signal is turned ON to start imaging, and image data is written to the second frame memory 14 to which the switch 16 is connected. When the imaging is completed, the camera 3 turns off the imaging signal.

  The PC 6 detects the image number in the received image data. When the image number is “0” or the same as the previously received image number value, it is invalid image data and is discarded without being stored in the memory 21. If the detected image number is other than the above (numbers other than 1 to 9), it is determined that a frame loss has occurred and the processing is interrupted.

  When the PC 9 has acquired all the image data of image numbers 1 to 9 one by one, the image synthesizing unit 22 shifts the pixels and synthesizes the image data to generate a high-resolution image.

  As described above, in the camera system 1, when the image transfer speed between the camera control unit 3 and the PC 6 is lower than the image transfer speed between the camera 2 and the camera control unit 3, the imaging permission / prohibition signal is set to a prohibited state. Thus, it is possible to control the camera 2 to wait for the movement to the imaging position and the imaging. On the other hand, when the image transfer rate between the camera control unit 3 and the PC 6 is higher than the image transfer rate between the camera 2 and the camera control unit 3, the same image data is sent from the first frame memory 13 or the second frame memory 14 to the PC 6. It is possible to control to wait for the imaging of the camera 2 to be completed.

  Further, by switching the first frame memory 13 and the second frame memory 14 in order and storing the image captured by the camera 2, the PC 6 side from the frame memory that is not writing the image even when the camera 2 is capturing. It is possible to output an image.

  This makes it possible to transfer image data from the camera control unit to the PC without causing a transfer error in the isochronous transfer method. In addition, it absorbs the difference between the image transfer speed from the camera control unit to the PC and the image transfer speed from the camera head to the camera control unit, and performs parallel operation to speed up image transfer. The transfer can be performed in a high-speed mode similar to the image transfer. Further, by transferring the image to the PC at a constant cycle, it becomes easy for the PC to distinguish from the situation in which the image transfer becomes impossible due to another factor such as disconnection of the line. The PC can also determine that an image omission has occurred based on the image number.

  Note that the camera system according to the present embodiment can be applied to bulk transfer other than isochronous transfer. Further, the present invention can be applied not only to pixel-shift imaging but also to generating a composite image by capturing an image while moving the subject itself.

  Further, the image composition may be performed by providing an image composition unit inside the camera.

  The above-described embodiment is merely an example, and is not limited to the above-described configuration and shape, and can be appropriately modified and changed within the scope of the present invention.

It is a schematic block diagram of the camera system which has a camera which can carry out pixel shift photography concerning an embodiment. It is an example of a structure of the image format used with the camera system concerning embodiment.

Explanation of symbols

1 Camera System 2 Camera 3 Camera Control Unit 4 Camera Cable 5 USB Cable 6 PC
7 Monitor 11 Image processing unit 12 Counter unit 13 First frame memory 14 Second frame memory 15 USB control unit 16, 17, 18 Switch 21 Memory 22 Image composition unit

Claims (6)

A camera capable of shifting pixels,
Image recognition information giving means for giving recognition information for recognizing each pixel-shifted image acquired by the camera;
A frame memory for storing each pixel-shifted image provided with the recognition information;
An image memory for storing a plurality of pixel-shifted images respectively transferred from the frame memory;
Image synthesizing means for acquiring the pixel-shifted image based on the image recognition information from the image memory and synthesizing a high-resolution image;
A control unit that performs control to continuously transfer any image stored in the frame memory to the image composition unit until a new pixel-shifted image acquired by the camera is transferred to the frame memory; A camera system comprising: First switching means for switching inputs to the plurality of frame memories;
Second switching means for switching output from the plurality of frame memories;
The first switching means and the second switching means operate in conjunction with each other,
2. The camera system according to claim 1, wherein the frame memories selected by the first switching unit and the second switching unit among the plurality of frame memories are different from each other.   The frame memory selected by the second switching means repeats transfer of the image in the frame memory to the image memory until the switching of the first and second switching means is performed. The camera system according to claim 2.   The camera system according to claim 1, wherein the image transfer includes isochronous transfer. A camera that can shoot with shifted pixels,
Image recognition information adding means for adding recognition information for recognizing an image to each pixel-shifted image acquired by the camera;
A plurality of frame memories for storing the pixel-shifted images to which the recognition information is attached;
First switching means for switching inputs to the plurality of frame memories;
Second switching means for switching output from the plurality of frame memories;
An output control unit for outputting the image from the frame memory selected by the second switching means to the outside.   The camera according to claim 5, wherein the output control unit is a USB control unit or an IEEE 1394 control unit.

Images