JP2007097043A - Apparatus for outputting photographed image, and method and program for controlling photographing of same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To output image data after image processing as speedily as possible and to reflect on a projecting operation with the image data while applying various kinds of image processing to a photographed image. <P>SOLUTION: An apparatus for outputting a photographed image comprises: a photographing unit including a lens optical system 12 for continuously performing photographing on prescribed photographing conditions and a CCD (Charge-Coupled Device) 13; and a control unit 66 which applies prescribed image processing to an image obtained by the photographing unit, outputs the image data to which the image processing is applied, by an USBI/F 23, detects a change in the motion of the image obtained in the photographing unit on the other hand, and switches at least either the photographing conditions of the photographing unit or a detection reference for the change of motion in accordance with a detection result. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention is a photographed image output device suitable for a document camera connected to a projector device or the like, photographing a document placed on a document table, outputting the image data, and projecting and displaying the image data on the projector device. The present invention relates to a photographing control method and a program.

  2. Description of the Related Art Conventionally, there is a camera in which a document table camera called a document camera is connected to a personal computer and a projector device, and an image of a document placed on the document table is taken and projected as it is.

  This type of document camera does not simply output the image of the document placed on the document table as it is, but performs various types of image processing, specifically contour extraction, clipping, brightness unevenness correction, color There are many models that can obtain and project a more easily viewable image by performing correction, luminance correction, trapezoidal distortion correction, and the like.

For example, in order to perform an accurate correction corresponding to various corrections necessary for optimization of a captured image prior to projection, an arbitrary document is photographed with a document camera, and the captured image obtained thereby is sent to a personal computer, In a personal computer, various distortion corrections including trapezoidal distortion based on image information acquired from captured images, and various image processing such as rotation processing and clipping are performed on the captured images, and then the processed images are sent to the projector. Thus, there has been proposed a technique in which various corrections are performed on a captured image in addition to trapezoidal distortion correction. (For example, Patent Document 1)
Japanese Patent Laid-Open No. 2004-363636

  However, including the techniques described in the above-mentioned patent documents, when performing projection after performing various image processing including trapezoidal distortion correction on the captured image, particularly when starting the projection operation, the document is placed on the document table. It takes a long time until the image is actually projected and displayed after the image is placed, which may give the user anxiety and discomfort.

  The present invention has been made in view of the above circumstances, and its object is to output and project image data after image processing as quickly as possible while performing various image processing on the captured image. Another object of the present invention is to provide a photographic image output device that can be reflected in operations such as the above, a photographic control method and program for the device.

  According to the first aspect of the present invention, there is provided a photographing means for continuously photographing under a predetermined photographing condition, an image processing means for performing a predetermined image processing on an image obtained by the photographing means, and an image processing by the image processing means. Output means for outputting the captured image data, detection means for detecting a change in the movement of the image obtained by the photographing means, and detection conditions of the photographing means or detection criteria of the detection means based on the detection result of the detection means And a control means for switching at least one of them.

  According to a second aspect of the present invention, in the first aspect of the present invention, the control means may be configured such that, when the power is turned on, the detection means detects the photographing condition of the photographing means or It is characterized in that at least one of the detection standards of the detection means is switched.

  According to a third aspect of the present invention, in the first aspect of the present invention, the control means switches the number of image frames to be photographed per unit time as a photographing condition.

  According to a fourth aspect of the present invention, in the first aspect of the present invention, the control means switches the number of temporally continuous image frames in which no motion has occurred as a detection reference.

  According to a fifth aspect of the invention, in the first aspect of the invention, the control means switches a threshold value for judging whether or not there is a change between temporally continuous images as a detection reference.

A sixth aspect of the present invention is a shooting control method for a shot image output apparatus that continuously shoots under a predetermined shooting condition and performs a predetermined pixel process on an image obtained by shooting and outputs the image. It has a detection step for detecting a change in the movement of a photographed image, and a control step for switching at least one of the shooting conditions or the detection criterion in the detection step based on the detection result in the detection step. .

  The invention described in claim 7 is a program executed by a computer built in a captured image output apparatus that continuously captures images under predetermined capturing conditions, performs predetermined pixel processing on an image obtained by capturing, and outputs the result. The computer includes a detection step for detecting a change in motion of the continuously shot images and a control step for switching at least one of the shooting conditions or the detection reference in the detection step based on the detection result in the detection step. It is made to perform.

  According to the first aspect of the present invention, the sensitivity of the motion detection of the captured image is appropriately switched according to the operation status of the apparatus until the image is actually projected and displayed after the document is placed on the document table. Therefore, it is not necessary to take a long time, and it is possible to suppress wasteful power consumption without giving anxiety and discomfort to the user.

  According to the second aspect of the invention, in addition to the effect of the first aspect of the invention, in order to detect a change in image movement with higher sensitivity, particularly at the beginning of power-on, the image processing can be performed as soon as possible. The image data can be output and reflected in operations such as projection.

  According to the third to fifth aspects of the present invention, in addition to the effect of the first aspect of the invention, the sensitivity to the change in motion can be switched by simple control.

  According to the sixth aspect of the present invention, the sensitivity of motion detection of the photographed image is appropriately switched according to the operation state of the apparatus until the image is actually projected and displayed after the document is placed on the document table. Therefore, it is not necessary to take a long time, and it is possible to suppress wasteful power consumption without giving anxiety and discomfort to the user.

  According to the seventh aspect of the present invention, the sensitivity of motion detection of the photographed image is appropriately switched according to the operation state of the apparatus until the image is actually projected and displayed after the document is placed on the document table. Therefore, it is not necessary to take a long time, and it is possible to suppress wasteful power consumption without giving anxiety and discomfort to the user.

  Hereinafter, a case where the present invention is applied to an imaging projection system including a document camera apparatus, a personal computer (PC), and a data projector apparatus will be described with reference to the drawings.

  FIG. 1 shows the appearance and connection configuration. The document camera device 1 and the PC 2 are connected by a USB (Universal Serial Bus) cable 4. In the document camera apparatus 1, images of documents placed on the document table 1 a are always taken continuously in time, and sequentially sent to the PC 2 in real time as isochronous transfer via the USB cable 4 as digital value image signals. It is done.

  The PC 2 is preinstalled with a drive program for the document camera apparatus 1 by a recording medium attached to the document camera apparatus 1, for example, a CD-ROM 6, and is executed from the document camera apparatus 1 by executing the program. An analog image signal corresponding to the transmitted image signal is generated and sent to the data projector device 3 via the RGB cable 5.

  The data projector device 3 forms a light image corresponding to the transmitted image signal by using a light source, a display element such as a micromirror element, and other projection system optical element groups, on a screen to be projected. The formed optical image is projected and displayed.

FIG. 2 shows a circuit configuration of the document camera apparatus 1.
The document camera apparatus 1 has two display operation modes, a still display mode and a through display mode, and outputs image data obtained by photographing in any one of the display modes to the PC 2 according to an arbitrary selection by the user.

  In the still display mode, a motion detection operation is performed, and the same image data is output to the PC 2 for displaying a still image as long as there is no movement in the document placed on the document table 1a. Is output after performing various image correction processes, specifically, contour extraction, clipping, luminance unevenness correction, color correction, luminance correction, rotation correction, and keystone correction. In these image correction processes, arbitrary contents can be selected and set by the user.

  In the through display mode, an image placed on the document table 1a is photographed at a constant frame rate, for example, 30 [fps] (30 frames per second), and the obtained image data is not subjected to the above-described image correction processing or the like. Without being performed, the data is output to the PC 2 in real time.

  In the drawing system, in the imaging system, a CCD 13 as an imaging element is disposed behind the imaging optical axis of the lens optical system 12 in which a zoom angle of view, a diaphragm position, and the like are moved by driving a motor (M) 11.

  This CCD 13 is scanned and driven by a timing generator (TG) 14 and a vertical driver 15, and outputs a photoelectric conversion output corresponding to a light image formed at intervals of a frame rate, which will be described later, for one screen.

  The photoelectric conversion output is appropriately gain-adjusted for each primary color component of RGB in the state of an analog value signal, sampled and held by a sample hold circuit (S / H) 16, and digital data by an A / D converter 17. The color process circuit 18 is subjected to color process processing including pixel interpolation processing and γ correction processing to generate a luminance signal Y and color difference signals Cb and Cr (YUV signals), and DMA (Direct Memory). Access) is output to the controller 19.

  The DMA controller 19 once uses the luminance signal Y and the color difference signals Cb and Cr output from the color process circuit 18 by using the composite synchronization signal, the memory write enable signal, and the clock signal from the color process circuit 18 once. And the DMA transfer to the DRAM 21 used as a buffer memory through the DRAM interface (I / F) 20.

  The control unit 22 includes a CPU, a non-volatile memory in which an operation program executed by the CPU is fixedly stored, a work memory, and the like, and controls the overall operation of the document camera apparatus 1.

  In the through display mode, the control unit 22 reads the luminance and color difference signals (YUV signals) from the DRAM 21 via the DRAM interface 20 after the DMA transfer of the luminance and color difference signals to the DRAM 21 and completes the USB interface (I / I). F) Send to 23.

  The USB interface 23 sends the luminance and color difference signals to the PC 2 in real time via the USB cable 4 by isochronous transfer according to the USB standard.

  Further, the control unit 22 detects a change in the movement of the document placed on the document table 1a in the still display mode, and captures it from the CCD 13 when it is determined that the movement has stopped after detecting the movement. The DMA transfer of the image data for one screen to the DRAM 21 is stopped, and the CCD 13 is scanned and driven again with the aperture value, shutter speed, and resolution according to the appropriate exposure conditions, and the image data for one screen is obtained and transferred to the DRAM 21. .

  The control unit 22 transfers the image data held in the DRAM 21 to the storage unit 25, performs image correction processing set at that time, and reads out the image data after the image processing from the storage unit 25. The USB interface 23 outputs the image to the PC 2 and returns to the operation of detecting the motion of the image in preparation for the next shooting.

  A key input unit 24 is connected to the control unit 22, and key operation signals such as a power key constituting the key input unit 24 are directly input to the control unit 22.

  Next, the configuration of the PC 2 will be described with reference to FIG. FIG. 3 shows the hardware configuration of the PC 2, and the north bridge 32 is connected to the CPU 31 that controls various processes and the front side bus FSB.

  The north bridge 32 is further connected to the main memory 33 via the memory bus MB and to the graphic controller 34 and the graphic memory 35 via the graphics interface AGP, and also to the south bridge 36, mainly between them. Execute I / O control.

  The south bridge 36 is connected to a PCI bus 37, a keyboard / mouse 38, a video encoder 39, a USB interface (I / F) 40, a multi-disk drive 41, and a hard disk device (HDD) 42, and mainly these peripheral circuits and the north bridge 32. Input / output control between

  In addition, since each element which comprises these PC2 is a very general technique, the basic description shall be abbreviate | omitted.

  The video encoder 39 generates and outputs an RGB video signal which is an analog value image signal from a given digital value image signal.

  The HDD 42 stores in advance a drive program for the document camera device 1 installed by installing the CD-ROM 6 in the multi-disk drive 41 together with an OS (operating system), various application programs, and data files.

Next, the circuit configuration of the data projector device 3 will be described with reference to FIG.
In the figure, image signals of various standards including RGB video signals input from the input / output connector unit 51 are projected by the image conversion unit 53 via the input / output interface (I / F) 52 and the system bus SB. After being unified into a format image signal, it is sent to the projection encoder 54.

  The projection encoder 54 develops and stores the transmitted image signal in the video RAM 55, generates a video signal from the stored contents of the video RAM 55, and outputs the video signal to the projection drive unit 56.

  The projection driving unit 56 appropriately speeds up time division by multiplying an appropriate frame rate, for example, 60 [frames / second], the number of color component divisions, and the number of display gradations in accordance with the transmitted image signal. For example, a micromirror element 57 which is a spatial light modulation element (SOM) is driven to display.

  High-luminance white light emitted from the light source lamp 59 disposed in the reflector 58 is appropriately colored to the primary color via the color wheel 60 and irradiated through the integrator 61 and the mirror 62 to the micromirror element 57. Thus, an optical image is formed by the reflected light, and is projected and displayed on a screen (not shown) through the projection lens 63.

  However, both the lighting drive of the light source lamp 59 and the motor (M) 64 that rotationally drives the color wheel 60 operate based on the supply voltage value from the projection light processing unit 65.

  The control unit 66 controls all the operations of the above circuits. The control unit 66 includes a CPU, a non-volatile memory that stores an operation program executed by the CPU including processing of a projection operation and a photographing operation described later, a work memory, and the like.

An audio processing unit 67 is also connected to the control unit 66 via the system bus SB.
The sound processing unit 67 includes a sound source circuit such as a PCM sound source, converts the sound data given during the projection operation into an analog signal, drives the speaker 68 to emit a loud sound, or generates a beep sound if necessary.

  Each key operation signal in the key switch unit 69 provided in the data projector device 3 is directly input to the control unit 66, and a signal from the Ir receiving unit 70 is also directly input.

  The Ir receiving unit 70 is provided on each of the front and back surfaces of the data projector device 3, and the infrared light reception signal is converted into a code signal and transmitted to the control unit 66.

Next, the operation of the above embodiment will be described.
FIG. 5 shows the processing contents in the static display mode from the beginning when the power is turned on, and all the operation control is executed by the control unit 22 according to the operation program stored in the internal nonvolatile memory.

  At the beginning of power-on, first, for example, the sensitivity of motion detection for a document placed on the document table 1a is set in advance to the “high” side of two levels of sensitivity “high” and “low” (step S01).

  Here, when the sensitivity of motion detection is “high”, for example, the frame rate when shooting a document on the document table 1a is set to 30 [fps] (30 frames per second), and an image having no motion is 2 in comparison with the immediately preceding frame. It is determined that there is no motion when the frames are continuous, and conversely, it is determined that there is motion when two consecutive frames of motion are compared with the immediately preceding frame.

  Then, the motion detection process is executed with the set contents (step S02), and whether or not the motion of the image obtained by photographing the document described on the document table 1a is stationary is specifically described above. As described above, it is determined whether or not two frames of non-moving images have continued in comparison with the immediately preceding frame (step S03), and when there is a movement, the process returns to step S02 to repeatedly execute. Then, it waits for the image to stand still when the document table 1a is photographed at a predetermined frame rate.

  If it is determined that the image being photographed is stationary with no motion, the CCD 13 is again scanned and photographed with an aperture value, shutter speed, and resolution in accordance with an appropriate exposure condition. Data is obtained and held in the DRAM 21 (step S04).

  After the image data held in the DRAM 21 is transferred to the storage unit 25, image correction processing, specifically contour extraction, clipping, luminance unevenness correction, color correction, luminance correction, Rotation correction, trapezoid correction, and the like are performed (step S05).

  Next, after confirming that there is no movement in the image on the document table 1a during the time required for the image correction process (step S07), the image data after the image correction process stored in the storage unit 25 is stopped. It is assumed that the image data is read out, output to the PC 2 side from the USB interface 23, and projected by the data projector device 3 via the PC 2 (step S08).

  As described above, since the detection sensitivity is set to “high” at the beginning of the power supply (specifically, the shooting frame rate is high and the number of continuous frames for determining that there is movement), the document is printed. Since the image of the document placed on the table 1a can be projected and displayed in the shortest possible time, it is possible to avoid the situation where the user feels anxiety and discomfort without being projected. it can.

  With the image of the document placed on the document table 1a being projected and displayed as a still image in this way, the motion detection sensitivity is set to the “low” side of the sensitivity “high” and “low”, for example, in two stages in advance. (Step S09).

  Here, when the sensitivity of motion detection is “low”, for example, the frame rate when shooting a document on the document table 1a is set to 15 [fps] (15 frames per second), and 4 images with no motion are compared with the immediately preceding frame. It is determined that there is no motion when the frames are continuous, and conversely, it is determined that there is motion when there are four consecutive frames of motion compared to the immediately preceding frame.

  Then, the motion detection process is executed with the set contents (step S10), and whether or not there is a motion of the image obtained by photographing the document described on the document table 1a, specifically as described above, respectively. It is determined whether or not four frames have been moved in comparison with the immediately preceding frame (step S11), and if there is no movement, the process returns to step S10 to repeat the above steps. While continuing the projection of the still image based on the image data after the image correction processing in S08, it waits for the image on the document table 1a to move.

In the state of waiting for the movement of this image, the detection sensitivity is set to “low” (specifically, the shooting frame rate is low and the number of continuous frames for determining that there is movement) is set. Even if there is some movement in the document placed on the document table 1a, the degree of determination that the image is moving is low. Then, if it is determined that the image of the document placed on the document table 1a has moved. In step S11, this is determined, and the process proceeds to step S01 again. The motion detection sensitivity is temporarily set to “high” while there is motion in the image. The accompanying image shooting and image correction processing are executed, and the image data after the image correction processing is projected in a shorter time.

  If it is detected in step S07 that there is a motion, for example, if the document of the image has been moved on the document table 1a before shifting to the projection of the image data subjected to the image correction processing. Since it is not possible to proceed to the projection process as it is, the image data held in the storage unit 25 is deleted as the image data is canceled (step S12), and the process proceeds to the process from step S02 again. To do.

  As described above, since the sensitivity of motion detection of the captured image is appropriately switched according to the operating state of the apparatus, it is possible to suppress wasteful power consumption without giving the user anxiety and discomfort.

  In this regard, particularly when the power is turned on, it is set to detect a change in the motion of the photographed image with higher sensitivity. Therefore, it is possible to output the image data after the image processing as soon as possible at the beginning of the operation such as the presentation and reflect it in the operation such as the projection.

  In the above embodiment, the motion detection sensitivity of the captured image is set to “high” and “low” in two stages. However, the present invention is not limited to this, and individual elements relating to motion detection are individually set. It is also possible to increase the number of stages by an operation such as variably setting.

  In the above embodiment, as specific elements for setting the sensitivity of motion detection, the frame rate indicating the frequency of shooting and the number of continuous frames for determining the presence / absence of image motion are variably set. However, the present invention is not limited to this.

  For example, when motion detection is performed by comparing temporally continuous two-frame images, pixels at the same position constituting each image are compared, and it is set in advance what percentage of the pixels are different. Although it seems that the presence / absence of movement is determined above and below the threshold value, the threshold value itself may be arbitrarily variably set.

  Furthermore, in this case, when comparing pixels at the same position constituting each image, how much the difference is judged to be different, the threshold value for the comparison result in pixel units Can be variably set.

  In this way, with regard to motion detection, it is possible to determine whether or not there is motion between frames by combining a large number of elements, so the sensitivity to motion changes can be easily switched by simple control. it can.

  In the above embodiment, the document camera connected to the projector via the personal computer has been described as switching the sensitivity of motion detection. However, the present invention is not limited to a single document camera, and the document camera and the projector device. The projector can be similarly applied to a projector device having a document camera function.

  In addition, the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the invention.

  Further, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent elements are deleted from all the constituent elements shown in the embodiment, at least one of the problems described in the column of the problem to be solved by the invention can be solved, and described in the column of the effect of the invention. In a case where at least one of the obtained effects can be obtained, a configuration in which this configuration requirement is deleted can be extracted as an invention.

The figure which shows the connection structure of the whole system which concerns on one Embodiment of this invention. The block diagram which shows the functional circuit structure of the document camera apparatus which concerns on the same embodiment. The block diagram which shows the circuit structure of the personal computer which concerns on the embodiment. The block diagram which shows the functional circuit structure of the data projector apparatus which concerns on the same embodiment. The flowchart which shows the processing content regarding imaging | photography with the document camera which concerns on the embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Document camera apparatus, 1a ... Document stand, 2 ... Personal computer (PC), 3 ... Data projector apparatus, 4 ... USB cable, 5 ... RGB cable, 6 ... CD-ROM, 11 ... Motor (M), 12 ... Lens optical system, 13 ... CCD, 14 ... Timing generator (TG), 15 ... Vertical driver, 16 ... Sample hold circuit (S / H), 17 ... A / D converter, 18 ... Color process circuit, 19 ... DMA Controller 20... DRAM interface 21. DRAM 22 Control unit 23 USB interface (I / F) 24 Key input unit

Claims (7)

Photographing means for continuously photographing under predetermined photographing conditions;
Image processing means for performing predetermined image processing on the image obtained by the photographing means;
Output means for outputting image data subjected to image processing by the image processing means;
Detecting means for detecting a change in motion of the image obtained by the photographing means;
A photographed image output apparatus comprising: a control means for switching at least one of a photographing condition of the photographing means or a detection criterion of the detecting means based on a detection result of the detecting means.   The control means switches at least one of an imaging condition of the imaging means or a detection reference of the detection means so that the detection means detects a change in movement with higher sensitivity when the power is turned on. Item 1. A captured image output device according to Item 1.   The photographed image output apparatus according to claim 1, wherein the control means switches the number of image frames photographed per unit time as a photographing condition.   The photographed image output apparatus according to claim 1, wherein the control means switches the number of temporally continuous image frames in which no motion occurs in the image as a detection reference.   The photographed image output apparatus according to claim 1, wherein the control means switches a threshold value for determining whether or not there is a change between temporally continuous images as a detection reference. A shooting control method for a shooting image output device that continuously shots under predetermined shooting conditions, performs predetermined pixel processing on an image obtained by shooting, and outputs the image.
A detection step of detecting a change in the movement of the continuously shot images;
A photographing control method for a photographed image output apparatus, comprising: a control step of switching at least one of the photographing condition or the detection criterion in the detection step according to a detection result in the detection step. A program executed by a computer built in a photographic image output device that continuously shoots under predetermined shooting conditions, performs predetermined pixel processing on an image obtained by shooting, and outputs the result.
A detection step of detecting a change in the movement of the continuously shot images;
A program for causing a computer to execute a control step of switching at least one of the photographing condition or the detection criterion in the detection step based on a detection result in the detection step.

Images