JP2010130181A - Image acquiring apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image acquiring apparatus acquiring an image that reflects the original shape of an object by simple image processing. <P>SOLUTION: When a second imaging mode is set, and a part of a laptop personal computer PC is imaged together with a document DCM by a solid imaging element 102, a parameter for correcting an image of the document DCM is decided according to the outline of the image of the part of the laptop personal computer PC which is formed based on a signal outputted from the solid imaging element 102. By performing the image processing to image data of a primary acquired image G1, based on the parameter for correcting the document DCM, therefore, images G2 and G3 that reflect the original rectangular shape of the document DCM are acquired. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image acquisition apparatus using a solid-state imaging device such as a CCD (Charge Coupled Devices) type image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) type image sensor.

  In recent years, video cameras and digital cameras equipped with an imaging device using a solid-state imaging device such as a CCD type image sensor or a CMOS type image sensor have become widespread, and a solid having a high number of pixels so that a higher quality image can be obtained. A device equipped with an image pickup device using an image pickup element has been supplied to the market. In addition, with the spread of the Internet, so-called web cameras or the like that are attached to a personal computer to acquire a sender's image and transmit it to the other party are already on the market.

  By the way, there is an increasing need for digitizing documents for information security or remote communication using handwritten documents. There is a scanner as an apparatus conventionally used for digitizing a document. However, the scanner captures an image plane that faces the imaging optical system, and a large-sized scanner device equipped with a line sensor is often used particularly when a document containing characters is digitized on a desktop. However, there is a problem that the device itself is relatively bulky. On the other hand, a digital camera may be used instead of a scanner, but in this case, it is necessary to shoot with the image plane and the digital camera facing each other at a certain distance. There is a problem that it has to be placed on the floor or the like to take an image and is not easy to use.

  On the other hand, if a paper document can be digitized using a web camera built in or externally attached to a notebook personal computer or the like, there is an advantage that it can be effectively used on a desktop at low cost. However, when such a web camera is used, the document placed on the table is photographed obliquely from above, so the side of the document near the web camera is long and the side of the far side document is short. In other words, there is a problem that a document that should originally be a rectangle is distorted into a trapezoidal shape.

On the other hand, Patent Document 1 obtains a geometric distortion correction coefficient from a camera head mounted on a support member based on the shape of a region of an original photographed obliquely from above, and performs image reading to correct it. An apparatus is disclosed. On the other hand, Patent Document 2 discloses a technique for capturing an image by capturing a subject with a digital camera that can be attached to and detached from a personal computer, extracting a rectangular area in the image, and correcting the image so that the area becomes rectangular. It is disclosed.
JP 2003-141520 A Japanese Patent Laying-Open No. 2005-143052

  However, the image reading apparatus disclosed in Patent Document 1 requires document area shape detection, and there is a problem that correct image correction cannot be performed if the document area cannot be accurately detected. On the other hand, according to the image correction technique of Patent Document 2, there is a problem that contour extraction processing is necessary and image processing becomes complicated, and correct image correction cannot be performed unless contour extraction is performed with high accuracy. Further, when the subject has a shape other than a quadrangle, there is a problem that correction is difficult because there is no reference.

  The present invention has been made in view of such problems, and an object of the present invention is to provide an image acquisition apparatus that can acquire an image reflecting the original shape of a subject by simple image processing.

The image acquisition device according to claim 1 is an image acquisition device having an imaging element and an imaging optical system that forms an optical image on a light receiving surface of the imaging element.
When a part of the image acquisition device is imaged by the imaging device together with the subject, an image of the subject is formed according to a partial image of the image acquisition device formed based on a signal output from the imaging device. Determining means for determining parameters for correcting
Storage means for storing the parameter in association with the image data of the subject.

  According to the present invention, when a part of the image acquisition device is imaged by the imaging element together with a subject, the image acquisition device is configured to respond to a partial image of the image acquisition device formed based on a signal output from the imaging element. And determining means for determining a parameter for correcting the image of the subject, and storage means for storing the parameter in association with the image data of the subject. Therefore, based on the parameter for correcting the subject By applying image processing to the image data of the subject, an image reflecting the original shape of the subject can be acquired regardless of the shape of the subject.

  The image acquisition device according to claim 2 is characterized in that, in the invention according to claim 1, the image data of the subject is corrected based on the parameter, and the corrected image data is stored. For example, an image reflecting the original shape of the subject can be displayed or printed without the software for correcting the image data of the subject based on the parameter at the transfer destination of the image data.

  According to a third aspect of the present invention, in the invention according to the second aspect, the correction is a trapezoidal correction.

  According to a fourth aspect of the present invention, in the invention according to the second or third aspect, the image data of the subject is subjected to shading correction. However, after performing keystone correction, shading correction, or the like, characters or the like may be converted into character data or the like by OCR.

  According to a fifth aspect of the present invention, in the invention according to any of the first to fourth aspects, the image data of the subject before correction and the parameters are stored in the same file. Therefore, it is convenient for correcting image data.

  According to a sixth aspect of the present invention, in the invention according to any one of the first to fifth aspects, the determining unit stores a feature of the shape of the image acquiring device, and uses the stored feature. , Determining a part of the image acquisition device from an image formed based on a signal output from the image sensor, and determining a parameter for correcting the subject based on the determined part of the image acquisition device Therefore, it is not necessary to separately provide a reference such as a marker.

  The image acquisition device according to a seventh aspect is the invention according to any one of the first to sixth aspects, wherein a marker is provided in a part of the image acquisition device, and the determination means is an image of the marker. Since the parameter for correcting the subject is determined based on the above, it is easy to recognize the marker by placing the marker at a known position, it is possible to suppress erroneous correction and the like, and to perform high-speed image processing. It can be carried out. The marker preferably has a color, shape, contrast, etc. that can be easily distinguished from the subject or the background.

  An image acquisition device according to an eighth aspect of the present invention is the invention according to any one of the first to seventh aspects, further comprising a direction sensor that detects a direction of a normal line of the imaging element with respect to a horizontal direction, Based on the signal from the direction sensor, it is detected that the normal direction of the image sensor is directed downward from the horizontal, and it is determined that a part of the image acquisition device is included in the shooting angle of view. In this case, since the parameter for correcting the subject is determined according to a part of the image of the image acquisition device, the image data of the subject can be automatically corrected.

  The image acquisition device according to claim 9 is the invention according to any one of claims 1 to 8, wherein the image acquisition device is rotatable with respect to the main body, the main body, and the imaging element and the A support unit that supports the imaging optical system; and an angle sensor that detects a rotation angle between the main body and the support unit; and the determination unit is configured to output the main body and the base unit based on a signal from the angle sensor. When it is detected that the rotation angle with the support portion is equal to or less than a predetermined value and it is determined that a part of the image acquisition device is included in the shooting angle of view, a part of the image acquisition device Since the parameter for correcting the subject is determined according to the image, the image data of the subject can be automatically corrected.

An image acquisition device according to a tenth aspect of the present invention is the image acquisition device according to any one of the first to ninth aspects, wherein a first imaging mode for imaging a first subject positioned vertically above the imaging device; A second imaging mode for capturing an image of a second subject located vertically below the imaging device can be selectively set;
When it is determined that the second imaging mode is set and a part of the image acquisition device is included in the shooting angle of view, the determination unit determines whether a part of the image acquisition device is included. Since the parameter for correcting the subject is determined, the image data of the subject can be automatically corrected.

  According to an eleventh aspect of the present invention, in the invention according to the tenth aspect, the first subject is a user who is operating the image obtaining device, and the second subject is level with the second subject. It is a document that has been placed.

  The image acquisition device according to claim 12 is the invention according to claim 10 or 11, wherein when the second imaging mode is set, the in-focus position is farther from the optical axis center position. Since the imaging optical system is controlled, a high-resolution image can be obtained over the entire document.

  According to a thirteenth aspect of the present invention, in the invention according to any one of the tenth to twelfth aspects, the imaging optical system is more suitable in the second imaging mode than in the first imaging mode. Since the focal position is close, it is suitable for imaging a document placed in the vicinity of the image acquisition device.

  The image acquisition device according to a fourteenth aspect is the invention according to any one of the tenth to thirteenth aspects, in which the amount of the image acquired in the second imaging mode is larger than the data amount of the image acquired in the first imaging mode. Since the amount of data is larger, the image data acquired in the first imaging mode is suitable for transferring, and the image data acquired in the second imaging mode is high resolution. It is suitable for forming an image.

  An image acquisition apparatus according to a fifteenth aspect of the invention according to any one of the first to fifteenth aspects displays an image of the subject based on a signal of the imaging element that forms an optical image on the light receiving surface. Since the monitor is provided on the front side of the imaging apparatus, a user operating the image acquisition apparatus can visually recognize the subject.

  ADVANTAGE OF THE INVENTION According to this invention, the image acquisition apparatus which can acquire the image which reflected the to-be-photographed object's original shape by simple image processing can be provided.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a perspective view of a notebook personal computer (image processing apparatus) PC equipped with an imaging apparatus CA according to the present embodiment. FIG. 2 is a block diagram of a notebook personal computer PC equipped with the imaging apparatus CA according to the present embodiment.

  As shown in FIG. 1, the notebook PC PC has a main body PCB and a display unit PCD connected to each other by a hinge PCH so that the notebook PC can be folded, and the imaging apparatus CA is arranged at the center of the monitor 112 in the display unit PCD as a support unit. In other words, the monitor 112 is provided on the front side of the imaging apparatus CA. The image pickup apparatus CA is built in the notebook personal computer PC, so that the image captured by the monitor 112 can be confirmed, and the image processing circuit on the personal computer side can be used to perform image processing at high speed. This is preferable because it can be pasted on materials, and characters and pictures can be extracted and reused. Further, since the display unit PCD can be used as a support unit of the imaging apparatus CA, there is an advantage that a certain angle of view can be secured when the document DCM is captured.

  In FIG. 2, the imaging apparatus CA includes an imaging optical system 101, a solid-state imaging device 102, and an A / D conversion unit 103. On the other hand, the notebook personal computer PC includes a control unit 104, an optical system driving unit 105, a timing generation unit 106, an image sensor driving unit 107, an image memory 108, an image processing unit 109, an image compression unit 110, The image recording unit 111, the monitor 112, and the keyboard 113 are included. In addition, a device used for a normal personal computer is provided, but the description is omitted here. Imaging device CA is preferably tiltable with respect to notebook personal computer PC.

  The imaging optical system 101 has a function of forming a subject image on the imaging surface (light receiving surface) of the solid-state imaging device 102. The solid-state image sensor 102 is an image sensor such as a CCD or CMOS, and photoelectrically converts incident light for each of R, G, and B and outputs an analog signal thereof. The A / D conversion unit 103 converts an analog signal into digital image data.

  The control unit 104 has a function of controlling the imaging device CA. The control unit 104 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), and a ROM (Read Only Memory), and various programs read out from the ROM and expanded in the RAM, and various in cooperation with the CPU. Execute the process.

  The optical system drive unit 105 controls the drive of the imaging optical system 101 during focusing, exposure, and the like under the control of the control unit 104. The optical system driving unit 105 and the control unit 104 constitute a focusing position control unit. The timing generator 106 outputs a timing signal for analog signal output. The image sensor drive unit 107 performs scanning drive control of the solid-state image sensor 102.

  The image memory 108 stores image data so as to be readable and writable. The image processing unit 109 performs various image processes on the image data. The image compression unit 110 compresses captured image data by a compression method such as JPEG (Joint Photographic Experts Group). The image recording unit 111 records image data on a recording medium such as a memory card set in a hard disk or a slot (not shown).

  The monitor 112 is a color liquid crystal panel or the like, and can display image data after shooting, a through image before shooting, and the like. The keyboard 113 includes a mode setting command and various operation keys for inputting information, and outputs information input by the user to the control unit 104.

  Here, operations in the imaging apparatus CA and the notebook personal computer PC will be described. The user uses the keyboard 113 to photograph the first imaging mode in which the user (a first subject extending approximately in the vertical direction) can be photographed and the document DCM (the second subject extending approximately in the horizontal direction). Any of the possible second imaging modes can be selected. It is preferable to set the focal length shorter in the second imaging mode than in the first imaging mode.

  However, the selection of either the first imaging mode or the second imaging mode is not limited to a user operation, and may be performed automatically. Here, when the user himself / herself is imaged in a TV conference or the like, as shown in FIG. 3A, the position of the face of the user US as the first subject is the state in which the notebook personal computer PC is placed on the desk. Therefore, it is located above the horizontal line HL (that is, in the vertical direction) of the imaging device CA. On the other hand, as shown in FIG. 3B, the position of the document DCM as the second subject is placed on a desk in the vicinity of the main body PCB of the notebook personal computer PC from the horizontal line HL of the imaging device CA. It is located below (that is, vertically).

  Therefore, for example, when the imaging apparatus CA is tiltable with respect to the display unit PCD, the imaging apparatus CA is provided with an acceleration sensor (direction sensor) SAC that detects the tilt of the optical axis of the imaging sensor CA. As shown in FIG. 3 (a), when the optical axis of the image sensor CA is directed upward from the horizontal line HL (tilt angle θ is positive), the first image capture mode is automatically set, and FIG. As shown in b), the second imaging mode may be automatically set when the optical axis of the imaging sensor CA is directed downward from the horizontal line HL (tilt angle θ is negative).

  Alternatively, when the imaging device CA is fixed to the display unit PCD, an angle sensor SAG for detecting an inclination angle α of the display unit PCD with respect to the main body PCB is provided on the hinge PCH of the notebook personal computer PC, and FIG. As shown in FIG. 4A, when the inclination angle α is greater than or equal to a predetermined value (for example, 90 degrees), the first imaging mode is automatically set, and as shown in FIG. If it is less than the predetermined value, the second imaging mode may be automatically set. However, in the above example, the control unit 104 determines that a part of the notebook personal computer PC (for example, the keyboard unit PCB) is present within the angle of view based on the signal from the solid-state imaging device 102. A condition for automatically setting the imaging mode may be used.

  Next, a case where the first imaging mode is set will be described. In the first imaging mode, subject monitoring (through image display) and image shooting execution are performed as necessary. In monitoring, an image of a subject obtained through the imaging optical system 101 is formed on the light receiving surface of the solid-state imaging device 102. As a photoelectric conversion output corresponding to an optical image formed at fixed intervals, the solid-state imaging device 102 disposed behind the imaging optical axis of the imaging optical system 101 is scanned and driven by the timing generation unit 106 and the imaging device driving unit 107. The analog signal is output for one screen.

  The analog signal is appropriately gain-adjusted for each primary color component of RGB, and then converted into digital data by the A / D conversion unit 103. The digital data is subjected to color process processing including pixel interpolation processing and γ correction processing by the image processing unit 109 to generate a luminance signal Y and color difference signals Cb, Cr (image data) as digital values, and the image memory. 108, the signal is periodically read out, the video signal is generated, output to the monitor 112, and transmitted to the other party connected via the Internet.

  The monitor 112 functions as an electronic viewfinder in monitoring, and displays captured images in real time. In this state, focusing, exposure, and the like of the imaging optical system 101 are set by the drive of the optical system driving unit 105 as needed by the image plane AF.

  In such a monitoring state, the user can acquire still image data by operating a predetermined key on the keyboard 113 at a timing when still image shooting is desired. In response to such a key operation, one frame of image data stored in the image memory 108 is read out and compressed by the image compression unit 110. The compressed image data is recorded on a recording medium by the image recording unit 111.

  Next, a case where the second imaging mode is set will be described. Also in the second imaging mode, subject monitoring (through image display) and image capturing execution are performed as described above. Here, in order to easily capture the document DCM, the user may tilt the imaging device CA itself while visually checking the image displayed on the monitor 112, or the display unit PCD and the imaging device CA may be integrated. You can tilt it. In this state, the center of the optical axis of the imaging optical system 101 is located on the document DCM placed on the table. Here, in the document DCM, the optical system driving unit 105 is set such that the upper position on the screen (the position farther away in the document DCM) than the optical axis center position (that is, the center of the screen) of the imaging optical system 101 in the document DCM. Drive. Focusing is preferably performed automatically by the image plane AF as described above, but a distance measuring device may be provided separately.

  In this state, the user can acquire still image data by operating a predetermined key on the keyboard 113. Here, based on the signal from the solid-state image sensor 102, the control unit 104, which is a determination unit, determines that both the outline of the main body PCB that is a part of the notebook personal computer PC and the document DCM placed on the table are included. An included image (referred to as a primary acquired image) G1 is acquired (see FIG. 5A, but inverted so that the top and bottom are reversed). The side of the image of the document DCM near the solid-state image sensor 102 is longer than the side of the image of the document DCM far from the solid-state image sensor 102. Therefore, both side pieces of the image of the document DCM in the primary acquisition image G1 are tapered. It is deformed. Therefore, the control unit 104 obtains the contours of both sides of the main body PCB in the primary acquisition image G1, and the inclination angle β1 between the reference lines L1 and L2 obtained by extending both sides and the side edge (vertical axis) of the screen. , Β2 (correction parameters) are stored in a common file together with the image data of the primary acquired image G1, and stored in the image memory 108 serving as storage means. The image data may be subjected to predetermined compression. Such a file is recorded on a recording medium by the image recording unit 111.

  When image correction is performed on the notebook personal computer PC, the horizontal width of the primary acquired image G1 is increased toward the lower side of the screen so that the inclination angles β1 and β2 become zero, and the inclination angles β1 and β2 are increased. The image G2 is formed by performing the keystone correction (image processing) by enlarging the vertical direction with a set magnification corresponding to (see FIG. 5B). With this correction, the document DCM has a rectangular shape with an original aspect ratio. Thereafter, as shown in FIG. 5C, image processing may be performed so as to cut out along the outline of the document DCM, and an image G3 of only the document DCM may be formed. The corrected image is displayed on the monitor 112 and can be confirmed by the user.

  Alternatively, a file in which the image data of the primary acquired image G1 and the inclination angles β1 and β2 are stored is transmitted from the notebook personal computer PC via the LAN or the Internet, and the same keystone correction is performed in the image forming apparatus of the transmission destination. Also good. The correction parameters are not limited to the inclination angles β1 and β2, and for example, the side of the image of the document DCM near the solid-state image sensor 102 and the side of the image of the document DCM far from the solid-state image sensor 102 in the primary acquired image G1. It may be a ratio or the like.

  According to the present embodiment, when the second imaging mode is set and a part of the notebook personal computer PC is imaged by the solid-state imaging device 102 together with the document DCM, the signal output from the solid-state imaging device 102 is used. Since the parameter for correcting the image of the document DCM is determined according to the outline of a part of the image of the notebook personal computer PC to be formed, the image of the primary acquired image G1 is determined based on the parameter for correcting the document DCM. By performing image processing on the data, images G2 and G3 reflecting the original rectangular shape of the document DCM can be acquired. Accordingly, since the shape of the document DCM is irrelevant to the determination of the correction parameter, even a paper document such as a circle or a triangle can be corrected to reflect the original shape.

  FIG. 6 is a diagram illustrating a primary acquired image according to a modified example. In this modification, as shown in FIG. 6, the outlines of both sides of the keyboard 113 of the main body PCB are obtained, and the inclination angles between the reference lines L1 and L2 extending from both sides and the side edges of the screen are corrected parameters. It can be. The document DCM may include a photograph having a shape similar to that of the keyboard 113. Even in such a case, if the control device 104 stores the shape of the keyboard 113 of the main body PCB, the pattern matching process is performed. Thus, the photograph of the document DCM and the keyboard 113 can be accurately distinguished.

  FIG. 7 is a diagram illustrating a primary acquired image according to another modified example. In this modification, as shown in FIG. 7, a red line RL as a marker is formed in parallel near both sides of the upper surface on the user side of the main body PCB. Therefore, the inclination angle between the reference lines L1 and L2 obtained by extending the red line RL and the side edge of the screen can be used as a correction parameter. The marker is not limited to the red line, and various color lines can be used.

  FIG. 8 is a diagram illustrating a primary acquired image according to another modified example. In this modification, as shown in FIG. 8, a plurality of red spots RD as markers are formed in two rows in parallel near both sides of the upper surface on the user side of the main body PCB. Therefore, the inclination angle between the reference lines L1 and L2 obtained by extending the lines connecting the red lines RD arranged in two rows and the side edges of the screen can be used as a correction parameter. The marker is not limited to the red dot, and various color points can be used.

  FIG. 9A is a diagram showing a primary acquired image according to another modified example, and FIG. 9B is a diagram of a notebook personal computer PC and a document DCM according to another modified example viewed from the side. It is. In this modification, as shown in FIG. 9A, the reference line L3 is formed so as to overlap the edge on the user side in the image of the main body PCB. The imaging range of the subject varies depending on the tilt angle of the imaging device CA and the hinge angle of the display unit PCD. Therefore, in this modification, the relative position of the reference line L3 on the screen of the primary acquired image G1 is stored as a correction parameter in association with the tilt angle of the imaging device CA and the hinge angle of the display unit PCD. Image processing can be performed on the image data of the primary acquired image G1 as a keystone correction coefficient. If the A4 document DCM is located approximately on the user side edge of the main body PCB, the range of the document DCM can be obtained from the reference line L3.

  Furthermore, as shown in FIG. 10, the focus position FP is the position above the optical axis center position O (that is, the center of the screen) of the imaging optical system 101 in the document DCM on the screen (position far from the imaging device CA). As described above, when the control unit 104 controls the optical system driving unit 105, characters on the far side from the imaging device CA (side far from the imaging device CA) on the document DCM are close to the in-focus position of the imaging optical system 101. Therefore, it is possible to take an image with high resolution. On the other hand, characters on the side of the document DCM that are close to the imaging device CA are far from the in-focus position, so there is a risk of being out of focus, but many images are captured at high resolution with the help of the depth of field. Even if some characters are out of focus, they are easy to read because the angle of view is large. Therefore, good imaging can be performed for the entire subject.

  The correction performed on the image data of the primary acquired image is not limited to trapezoid correction. Referring to FIG. 10, since the reflected light from the document DCM is attenuated as the distance to the image capturing apparatus CA is longer, the image of the document DCM on the side close to the image capturing apparatus CA is bright and the image on the side far from the image capturing apparatus CA. Becomes darker. Therefore, by performing shading correction on the image data of the primary acquired image together with the age meter correction according to the distance to the imaging device CA, an image with uniform brightness on the upper surface of the imaging device CA can be obtained. . Note that it is optional to perform processing such as OCR based on the corrected document DCM image.

  FIG. 11 is a diagram showing the results of studies conducted by the present inventors. In FIG. 11A, it is assumed that the display unit PCD of the notebook personal computer placed on the desk is opened 90 degrees (hinge angle α = 90 degrees). It is assumed that a solid-state imaging device CCD is attached at a position having a height of 230 mm. Here, it is assumed that the display unit PCD extends in the vertical direction with respect to the horizontal desk, and the A4 document DCM placed vertically on the desk in front of the keyboard PCB is positioned at the hinge position (B ) To 220 mm and the nearest end P, and the farthest end Q to 520 mm. In addition, the normal line of the solid-state imaging device CCD is tilted 38 degrees downward from the horizontal. At this time, as in the photographed image shown in FIG. 11B, the horizontal angle of view of the document DCM at the position P is 36 degrees, and the horizontal angle of view of the document DCM at the position Q is 20 degrees. The vertical angle of view is 21 degrees. In such a case, the correction parameters β1, β2 = about 20 degrees.

  The present invention has been described above with reference to the embodiments. However, the present invention should not be construed as being limited to the above-described embodiments, and can be modified or improved as appropriate. For example, as shown in FIG. 1, a sub monitor 112b for displaying an image of a subject may be provided in the vicinity of the keyboard 113 of the notebook personal computer PC, or the sub monitor 112a indicated by a dotted line may be provided on the display of the notebook personal computer PC. You may provide in the back side of the part PCD. Thereby, even if the display unit PCD is tilted toward the document DCM, the displayed image can be visually recognized.

It is a perspective view of notebook type personal computer PC carrying imaging device CA concerning this embodiment. It is a block diagram of notebook type personal computer PC which mounts imaging device CA concerning this embodiment. It is the figure seen from the side in the state which has arrange | positioned document DCM in the vicinity of notebook type personal computer PC. It is the figure seen from the side in the state which has arrange | positioned document DCM in the vicinity of notebook type personal computer PC. 5 (a) is a diagram showing a primary acquired image before correction, and FIG. 5 (b) is a diagram showing an image obtained by performing trapezoidal correction on the primary acquired image, and FIG. 5 (c). FIG. 4 is a diagram illustrating an image obtained by cutting out only a document. It is a figure which shows the primary acquisition image concerning a modification. It is a figure which shows the primary acquisition image concerning a modification. It is a figure which shows the primary acquisition image concerning a modification. FIG. 9A is a diagram showing a primary acquired image according to another modified example, and FIG. 9B is a diagram of the notebook personal computer PC and the document DCM according to the modified example viewed from the side. . It is the figure which looked at notebook type personal computer PC and document DCM from the side. It is a figure which shows the examination result which the present inventors performed.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Imaging optical system 102 Solid-state image sensor 103 Conversion part 104 Control part 105 Optical system drive part 106 Timing generation part 107 Image sensor drive part 108 Image memory 109 Image processing part 110 Image compression part 111 Image recording part 112 Monitor 112b Sub monitor 113 Keyboard CA Imaging device DCM Document PC Notebook PC SAC Acceleration sensor SAG Angle sensor

Claims (15)

An image acquisition device having an imaging element and an imaging optical system that forms an optical image on a light receiving surface of the imaging element,
When a part of the image acquisition device is imaged by the imaging device together with the subject, an image of the subject is formed according to a partial image of the image acquisition device formed based on a signal output from the imaging device. Determining means for determining parameters for correcting
An image acquisition apparatus comprising: storage means for storing the parameter in association with image data of the subject.   The image acquisition apparatus according to claim 1, wherein the image data of the subject is corrected based on the parameter, and the corrected image data is stored.   The image acquisition apparatus according to claim 2, wherein the correction is a keystone correction.   The image acquisition apparatus according to claim 2, wherein shading correction is performed on the image data of the subject.   The image acquisition apparatus according to claim 1, wherein the image data of the subject before correction and the parameters are stored in the same file.   The determining means stores a feature of the shape of the image acquisition device, and uses the stored feature to generate a part of the image acquisition device from an image formed based on a signal output from the image sensor. The image acquisition apparatus according to claim 1, wherein a parameter for correcting the subject is determined with reference to a part of the determined image acquisition apparatus.   7. The marker according to claim 1, wherein a marker is provided in a part of the image acquisition device, and the determination unit determines a parameter for correcting the subject based on an image of the marker. The image acquisition device according to claim 1.   A direction sensor that detects a direction of a normal line of the imaging element with respect to a horizontal direction, and the determination unit has a direction of the normal line of the imaging element facing downward from the horizontal based on a signal from the direction sensor; And when determining that a part of the image acquisition device is included in the shooting angle of view, determine a parameter for correcting the subject according to the partial image of the image acquisition device. The image acquisition apparatus according to claim 1, wherein the image acquisition apparatus is an image acquisition apparatus.   The image acquisition device detects a rotation angle between the main body, a support portion that is rotatable relative to the main body and supports the imaging element and the imaging optical system, and a rotation angle between the main body and the support portion. An angle sensor, and the determining means detects that a rotation angle between the main body and the support portion is a predetermined value or less based on a signal from the angle sensor, and the angle of view is within the photographing field angle. The parameter for correcting the subject is determined according to a partial image of the image acquisition device when it is determined that a part of the image acquisition device is included. The image acquisition device according to any one of the above. A first imaging mode for imaging a first subject located vertically above the imaging device; and a second imaging mode for imaging a second subject located vertically below the imaging device. Can be set selectively,
When it is determined that the second imaging mode is set and a part of the image acquisition device is included in the shooting angle of view, the determination unit determines whether a part of the image acquisition device is included. The image acquisition apparatus according to claim 1, wherein a parameter for correcting the subject is determined.   The image acquisition device according to claim 10, wherein the first subject is a user operating the image acquisition device, and the second subject is a horizontally placed document. .   12. The image acquisition according to claim 10, wherein when the second imaging mode is set, the imaging optical system is controlled so that a focus position is farther from the optical axis center position. apparatus.   The image acquisition apparatus according to claim 10, wherein the focusing position of the imaging optical system is closer in the second imaging mode than in the first imaging mode.   The image acquisition according to any one of claims 10 to 13, wherein the data amount of the image acquired in the second imaging mode is larger than the data amount of the image acquired in the first imaging mode. apparatus.   The monitor according to any one of claims 1 to 14, further comprising a monitor on the front side of the imaging device that displays an image of the subject based on a signal of the imaging element that forms an optical image on the light receiving surface. The image acquisition device described.

Images